2024-09-14T10:30:57.174 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:30:57.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:30:57.278 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116 branch: main description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904116' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHB8xFbEs7HHjkEdO2g+KAZ/pvBuVlMk7O9N+ZY0xTCkJnCkyvup6yxaI1jMDPRGWNUVNi+GFjk+8X0Re317zgs= smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJZtH8kyxfGd93OoXMVhkYOhMJY/kUGP3CBD/wRroZCBJkBW1oJFFfslBBTvIFMSrgdld9r962xMsz6NAWFTy0A= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:30:57.278 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:30:57.279 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:30:57.279 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:30:57.280 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:30:57.301 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:30:57.301 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:30:57.301 INFO:teuthology.packaging:ref: None 2024-09-14T10:30:57.302 INFO:teuthology.packaging:tag: None 2024-09-14T10:30:57.302 INFO:teuthology.packaging:branch: main 2024-09-14T10:30:57.302 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:30:57.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-14T10:30:57.503 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:30:57.505 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:30:57.513 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:30:57.513 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:30:57.529 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:30:57.546 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:30:57.554 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:30:57.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:25:18.403683', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH5GWxZkRR5E3OlKYNuuUiqKloERTzW8KMW9J3J1Oz5i'} 2024-09-14T10:30:57.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:25:18.402000', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICEUGtPv2YO+Yd3oghJRVXBo4Z5c63h48wXDOiHsBYkA'} 2024-09-14T10:30:57.605 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:30:57.613 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-14T10:30:57.613 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-14T10:30:57.613 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:30:57.678 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd97ca39a0>, signals=[15]) 2024-09-14T10:30:57.679 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:30:57.685 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:30:57.685 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-14T10:30:57.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:30:57.767 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:30:57.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:30:57.847 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:30:57.854 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-14T10:30:57.859 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-14T10:30:57.860 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-14T10:30:57.906 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:30:57.907 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:30:57.908 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-14T10:30:57.928 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-09-14T10:30:57.933 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-09-14T10:30:57.933 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="22.04" 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=jammy 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:30:57.979 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:30:57.980 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:30:57.980 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:30:57.980 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-09-14T10:30:58.003 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:30:58.012 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:30:58.020 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:30:58.020 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:30:58.023 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:30:58.028 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:30:58.035 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:30:58.036 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:30:58.068 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:30:58.084 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:30:58.140 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:30:58.155 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:30:58.155 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:30:58.155 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:30:58.156 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:30:58.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:30:58.161 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-14T10:30:58.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:30:58.162 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-14T10:30:58.207 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-56-generic 2024-09-14T10:30:58.207 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.15.0-56-generic 2024-09-14T10:30:58.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-14T10:30:58.208 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-56-generic 2024-09-14T10:30:58.209 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.15.0-56-generic 2024-09-14T10:30:58.209 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-09-14T10:30:58.334 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-14T10:30:58.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-14T10:30:58.466 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:30:58.475 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:30:58.514 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:30:58.539 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:30:58.575 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:30:58.621 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:30:58.698 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:30:58.703 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:30:58.728 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:30:58.795 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:30:58.796 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:30:58.799 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:30:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:30:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:30:58.821 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:30:58.822 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:30:58.824 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:30:58.825 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:30:58.832 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:30:58.834 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:30:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:30:58.838 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:30:58.838 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:30:58.839 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:30:58.839 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:30:58.839 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:30:58.855 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:30:58.856 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:30:58.859 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:30:58.859 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:30:58.863 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:30:58.869 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:30:58.870 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:30:58.872 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:30:58.872 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:30:58.876 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:30:58.876 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:30:58.877 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:30:58.877 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:30:58.878 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:30:58.878 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:30:58.878 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:30:58.879 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:30:58.879 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:30:58.879 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:30:58.920 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:30:58.920 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:30:59.021 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:30:59.196 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:30:59.306 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:30:59.389 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:30:59.480 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:30:59.492 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:30:59.493 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:30:59.495 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:30:59.549 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:30:59.562 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:30:59.563 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:30:59.564 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:30:59.579 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:30:59.596 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:30:59.596 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:30:59.633 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:30:59.633 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:30:59.648 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:30:59.648 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:30:59.650 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:30:59.654 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:30:59.655 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:30:59.655 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:30:59.656 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:30:59.682 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:30:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:30:59.706 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:30:59.713 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:30:59.713 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:30:59.714 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:30:59.725 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:30:59.789 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:30:59.789 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:30:59.790 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:30:59.792 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:30:59.792 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:30:59.794 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:30:59.795 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:30:59.876 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:30:59.876 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:31:05.140 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 16.0 MB in 2s (7,583 kB/s) 2024-09-14T10:31:05.148 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 16.0 MB in 2s (7,487 kB/s) 2024-09-14T10:31:06.608 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-14T10:31:06.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:31:06.692 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-14T10:31:06.793 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-14T10:31:06.811 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:31:06.877 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-14T10:31:06.902 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-14T10:31:06.903 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-14T10:31:07.091 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:31:07.091 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:31:07.091 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:31:07.092 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:31:07.092 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:31:07.092 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2024-09-14T10:31:07.092 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:31:07.093 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-14T10:31:07.094 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:31:07.094 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:31:07.094 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:31:07.095 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-14T10:31:07.095 INFO:teuthology.orchestra.run.smithi070.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:31:07.095 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-14T10:31:07.095 INFO:teuthology.orchestra.run.smithi070.stdout: thermald 2024-09-14T10:31:07.096 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-14T10:31:07.096 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-14T10:31:07.147 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-14T10:31:07.147 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:31:07.147 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:31:07.147 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:31:07.149 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-09-14T10:31:07.149 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:31:07.283 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:31:07.283 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:31:07.283 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:31:07.284 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:31:07.284 INFO:teuthology.orchestra.run.smithi096.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:31:07.284 INFO:teuthology.orchestra.run.smithi096.stdout: python2.7-minimal 2024-09-14T10:31:07.284 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:31:07.285 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-14T10:31:07.285 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:31:07.285 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:31:07.285 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:31:07.287 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-14T10:31:07.287 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:31:07.287 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-09-14T10:31:07.287 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-09-14T10:31:07.329 INFO:teuthology.orchestra.run.smithi070.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:31:07.329 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 113 MB of archives. 2024-09-14T10:31:07.329 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:31:07.329 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:31:07.343 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-14T10:31:07.343 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:31:07.343 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:31:07.344 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:31:07.344 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-09-14T10:31:07.345 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:31:07.525 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:31:07.525 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 113 MB of archives. 2024-09-14T10:31:07.525 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:31:07.525 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:31:08.796 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:31:08.909 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:31:09.145 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:31:09.255 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:31:11.323 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:31:11.323 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:31:11.324 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:31:11.555 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:31:11.603 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:31:11.606 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:31:11.770 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:31:11.874 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:31:12.246 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:31:12.277 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 113 MB in 5s (24.0 MB/s) 2024-09-14T10:31:12.388 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:31:12.457 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:31:12.801 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 113 MB in 5s (22.5 MB/s) 2024-09-14T10:31:13.003 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:31:14.459 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:31:14.463 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:31:14.580 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:15.052 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:31:15.057 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:31:15.184 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:16.832 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:31:16.853 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:31:16.966 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:17.485 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:31:17.506 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:31:17.560 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:17.729 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:31:17.750 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:31:18.048 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:18.566 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:31:18.586 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:31:18.624 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:24.604 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:31:24.756 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:31:25.131 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:31:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:31:25.580 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:31:25.590 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:31:25.621 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:31:25.694 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:31:25.837 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:31:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:31:26.324 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:31:26.661 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:31:26.683 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:31:26.727 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:31:31.652 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:31:31.688 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:31:31.726 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:32.754 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:31:32.792 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:31:32.837 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:35.372 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:31:35.516 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:31:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:31:36.019 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:36.121 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:31:36.248 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:36.912 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:31:37.055 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:31:37.413 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:31:37.543 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:37.590 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:31:37.590 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:31:37.590 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:31:37.590 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:31:37.653 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:31:37.752 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:37.789 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:39.116 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:31:39.116 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:31:39.116 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:31:39.116 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:31:39.286 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:39.300 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:41.084 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:41.205 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:31:41.356 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:31:41.482 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:41.579 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:31:41.579 INFO:teuthology.orchestra.run.smithi070.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:31:42.494 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:31:42.594 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:31:42.738 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:31:42.795 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:31:42.795 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:31:55.941 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:31:55.941 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:31:55.972 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:31:56.001 INFO:teuthology.orchestra.run.smithi070.stdout:Generating grub configuration file ... 2024-09-14T10:31:56.311 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:31:56.331 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:31:56.636 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:31:56.641 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:31:56.706 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:31:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:31:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:31:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:31:56.867 INFO:teuthology.orchestra.run.smithi070.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:31:56.920 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-09-14T10:31:57.436 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-14T10:31:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.121.121 2024-09-14T10:31:57.460 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:31:57.460 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:31:57.460 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-14T10:31:57.460 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-14T10:31:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:31:57.460 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-14T10:31:57.460 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:31:57.460 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:31:57.460 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:31:57.461 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:31:57.461 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:31:57.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-14T10:31:57.654 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:31:57.654 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:31:57.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-14T10:31:57.681 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:31:57.709 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-09-14T10:31:57.780 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:31:57.780 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:31:57.789 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:31:57.807 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:31:58.134 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:31:58.158 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:31:58.562 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:31:58.568 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:31:58.637 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:31:58.642 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:31:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:31:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:31:58.838 INFO:teuthology.orchestra.run.smithi096.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:31:58.883 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-09-14T10:31:59.177 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-14T10:31:59.196 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:31:59.250 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-14T10:31:59.393 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-09-14T10:31:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-09-14T10:31:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-09-14T10:31:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-09-14T10:31:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-09-14T10:31:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-09-14T10:31:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:31:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-09-14T10:31:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-09-14T10:31:59.419 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.121.121 2024-09-14T10:31:59.419 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:31:59.419 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:31:59.419 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-09-14T10:31:59.419 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-09-14T10:31:59.419 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:31:59.419 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-09-14T10:31:59.419 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:31:59.419 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:31:59.419 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:31:59.420 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-14T10:31:59.420 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:31:59.420 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-09-14T10:31:59.435 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-14T10:31:59.435 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-14T10:31:59.597 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-14T10:31:59.601 INFO:teuthology.orchestra.run.smithi070.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:31:59.601 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:31:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:31:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:31:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:31:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:31:59.602 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:31:59.602 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:31:59.642 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:31:59.644 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-14T10:31:59.700 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.121.121 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-14T10:31:59.701 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-14T10:31:59.702 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:31:59.702 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-14T10:31:59.702 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-14T10:31:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:31:59.717 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:31:59.725 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:31:59.743 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:31:59.745 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.jZF0DouJyU 2024-09-14T10:31:59.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jZF0DouJyU 2024-09-14T10:31:59.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.jZF0DouJyU 2024-09-14T10:31:59.938 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.jZF0DouJyU is 10KB 2024-09-14T10:31:59.952 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.jZF0DouJyU 2024-09-14T10:31:59.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:32:00.009 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:32:00.009 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:32:00.009 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:32:00.093 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:32:00.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-grub 2024-09-14T10:32:01.197 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-14T10:32:01.215 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:32:01.277 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-14T10:32:01.481 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:32:01.482 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:32:01.490 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-14T10:32:01.510 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-14T10:32:01.511 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-14T10:32:01.691 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:32:01.691 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:32:01.691 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:32:01.691 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:32:01.691 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:32:01.692 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:32:01.692 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:32:01.692 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:32:01.693 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:32:01.699 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:32:01.732 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:32:01.734 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-09-14T10:32:01.750 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-09-14T10:32:01.751 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-09-14T10:32:01.751 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-09-14T10:32:01.751 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-09-14T10:32:01.751 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-09-14T10:32:01.751 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:32:01.752 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-09-14T10:32:01.752 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-09-14T10:32:01.752 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.121.121 2024-09-14T10:32:01.752 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:32:01.752 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:32:01.753 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-09-14T10:32:01.753 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-09-14T10:32:01.753 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:32:01.753 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-09-14T10:32:01.754 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-14T10:32:01.799 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.Ih0lFEObBV 2024-09-14T10:32:01.799 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ih0lFEObBV 2024-09-14T10:32:01.854 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.Ih0lFEObBV 2024-09-14T10:32:01.935 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:32:01.941 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:32:01.973 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.Ih0lFEObBV is 10KB 2024-09-14T10:32:01.981 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:32:01.986 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:32:01.987 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.Ih0lFEObBV 2024-09-14T10:32:01.992 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:32:02.046 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:32:02.046 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:32:02.046 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:32:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:32:02.126 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:32:02.126 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:32:02.144 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:32:02.144 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-09-14T10:32:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-14T10:32:02.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-14T10:32:03.698 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:32:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:32:03.703 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-09-14T10:32:03.927 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:32:03.933 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:32:04.226 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:32:04.231 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:32:04.273 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:32:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:32:04.404 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:32:04.405 INFO:teuthology.orchestra.run.smithi096.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:32:04.405 INFO:teuthology.orchestra.run.smithi096.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:32:04.416 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-09-14T10:32:04.419 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-09-14T10:32:32.180 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:32:32.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-14T10:32:32.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:32:34.471 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-14T10:32:34.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-14T10:32:34.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:32:50.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-14T10:32:52.797 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-14T10:32:59.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-14T10:32:59.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:33:01.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-14T10:33:01.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:33:02.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-14T10:33:04.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-14T10:33:14.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-14T10:33:14.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:33:16.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-14T10:33:16.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:33:33.245 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-14T10:33:35.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-14T10:33:48.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-14T10:33:48.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:33:48.478 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-14T10:33:49.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-14T10:33:49.040 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-14T10:33:49.040 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-14T10:33:49.086 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-121-generic 2024-09-14T10:33:49.086 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T10:33:49.086 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:33:49.086 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T10:33:50.087 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:33:50.087 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:33:50.180 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-14T10:33:50.199 DEBUG:teuthology.parallel:result is None 2024-09-14T10:33:50.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-14T10:33:50.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:33:50.644 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-14T10:33:51.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-14T10:33:51.491 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-121-generic"... 2024-09-14T10:33:51.491 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-14T10:33:51.537 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-121-generic 2024-09-14T10:33:51.538 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T10:33:51.538 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:33:51.538 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T10:33:52.539 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-14T10:33:52.539 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:33:52.934 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-09-14T10:33:52.954 DEBUG:teuthology.parallel:result is None 2024-09-14T10:33:52.954 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:33:52.962 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:33:52.962 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:33:52.964 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:33:52.970 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:33:52.982 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:33:52.992 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:33:52.992 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:33:53.011 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:33:53.095 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:33:53.102 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:33:53.102 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:33:53.105 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:33:53.126 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:33:53.133 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:33:53.173 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:33:53.177 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:33:53.180 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:33:53.188 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:33:53.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:33:53.191 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:33:53.205 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:33:53.214 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:33:53.214 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:33:53.247 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:33:53.252 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:33:53.298 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:33:53.346 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:33:53.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:33:53.413 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:33:53.419 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:33:53.464 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:33:53.465 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:33:53.530 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-14T10:33:53.533 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-09-14T10:33:53.674 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:33:53.681 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:33:53.682 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:33:53.692 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:33:53.701 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2024-09-14T10:33:53.701 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-09-14T10:33:53.701 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:33:53.701 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-14T10:33:53.701 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:33:53.701 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:33:53.709 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-14T10:33:53.711 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-14T10:33:53.822 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:33:53.834 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:33:53.836 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi096.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T10:41:21.477 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi096.front.sepia.ceph.com')] 2024-09-14T10:41:21.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-14T10:41:21.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:41:21.565 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-14T10:41:21.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-14T10:41:21.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-14T10:41:21.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:41:21.729 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-14T10:41:21.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-14T10:41:21.805 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T10:41:21.815 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T10:41:21.815 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:41:21.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:41:21.818 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:41:21.818 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:41:21.847 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T10:41:21.847 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Command line: ntpd -gq 2024-09-14T10:41:21.847 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: ---------------------------------------------------- 2024-09-14T10:41:21.847 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: corporation. Support and training for ntp-4 are 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: available at https://www.nwtime.org/support 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: ---------------------------------------------------- 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: proto: precision = 0.043 usec (-24) 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: basedate set to 2022-02-04 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: gps base set to 2022-02-06 (week 2196) 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T10:41:21.848 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T10:41:21.849 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T10:41:21.850 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T10:41:21.850 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T10:41:21.850 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T10:41:21.850 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T10:41:21.850 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2024-09-14T10:41:21.850 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Listen normally on 4 lo [::1]:123 2024-09-14T10:41:21.850 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2024-09-14T10:41:21.850 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:21 ntpd[18456]: Listening on routing socket on fd #22 for interface updates 2024-09-14T10:41:21.876 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T10:41:21.876 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Command line: ntpd -gq 2024-09-14T10:41:21.877 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: ---------------------------------------------------- 2024-09-14T10:41:21.877 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T10:41:21.877 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T10:41:21.877 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: corporation. Support and training for ntp-4 are 2024-09-14T10:41:21.877 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: available at https://www.nwtime.org/support 2024-09-14T10:41:21.877 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: ---------------------------------------------------- 2024-09-14T10:41:21.877 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: proto: precision = 0.047 usec (-24) 2024-09-14T10:41:21.882 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: basedate set to 2022-02-04 2024-09-14T10:41:21.882 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: gps base set to 2022-02-06 (week 2196) 2024-09-14T10:41:21.882 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T10:41:21.882 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T10:41:21.882 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T10:41:21.883 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T10:41:21.884 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T10:41:21.884 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T10:41:21.884 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T10:41:21.884 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-09-14T10:41:21.884 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Listen normally on 4 lo [::1]:123 2024-09-14T10:41:21.884 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-09-14T10:41:21.884 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:21 ntpd[18460]: Listening on routing socket on fd #22 for interface updates 2024-09-14T10:41:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:22 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:22.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:22.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:22.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:22.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:22.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:22 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:23.846 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:23.847 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:23 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:23 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:23 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:23 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:23 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:23 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:23 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:24 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:24.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:24 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:25.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:25 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:25.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:25 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:25.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:25 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:25.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:25 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:25.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:25 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:25.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:25 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:25.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:25 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:25.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:25 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:26.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:26 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:26.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:26.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:26 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:27.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:27.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:27 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:27.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:27.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:27 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:27.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:27 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:27.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:27 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:28.848 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:28.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:28.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:28.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:28.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:28.849 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout:14 Sep 10:41:28 ntpd[18456]: ntpd: time slew -0.006614 s 2024-09-14T10:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew -0.006614s 2024-09-14T10:41:28.850 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T10:41:28.850 INFO:teuthology.orchestra.run.smithi070.stderr:14 Sep 10:41:28 ntpd[18456]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T10:41:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:41:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:41:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:41:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:41:28.878 INFO:teuthology.orchestra.run.smithi096.stdout:14 Sep 10:41:28 ntpd[18460]: ntpd: time slew -0.005121 s 2024-09-14T10:41:28.878 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew -0.005121s 2024-09-14T10:41:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T10:41:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:14 Sep 10:41:28 ntpd[18460]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T10:41:28.936 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T10:41:28.936 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-09-14T10:41:28.936 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:41:28.937 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:41:28.937 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:41:28.937 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:41:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T10:41:28.978 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-14T10:41:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:41:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:41:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:41:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:41:28.979 INFO:teuthology.run_tasks:Running task install... 2024-09-14T10:41:28.987 DEBUG:teuthology.task.install:project ceph 2024-09-14T10:41:28.987 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T10:41:28.988 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T10:41:28.988 INFO:teuthology.task.install:Using flavor: default 2024-09-14T10:41:28.994 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T10:41:28.994 INFO:teuthology.task.install:extra packages: [] 2024-09-14T10:41:28.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2024-09-14T10:41:28.995 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-09-14T10:41:29.050 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T10:41:29.078 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T10:41:29.078 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T10:41:29.078 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T10:41:29.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:41:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T10:41:29.113 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T10:41:29.114 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T10:41:29.114 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T10:41:29.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:41:29.230 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T10:41:29.231 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:41:29.250 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T10:41:29.250 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:41:29.343 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:41:29.343 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T10:41:29.357 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-14T10:41:29.360 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:41:29.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T10:41:29.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-14T10:41:29.529 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:41:29.543 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:41:29.582 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T10:41:29.593 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T10:41:29.607 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T10:41:29.614 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T10:41:29.629 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T10:41:29.636 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T10:41:29.651 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T10:41:29.651 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:41:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:41:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T10:41:29.678 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T10:41:29.694 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T10:41:29.733 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:41:29.745 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:41:29.814 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:41:29.825 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:41:29.953 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 29.3 kB in 0s (70.7 kB/s) 2024-09-14T10:41:29.964 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 29.3 kB in 0s (71.3 kB/s) 2024-09-14T10:41:30.959 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-14T10:41:30.975 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T10:41:31.003 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-14T10:41:31.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T10:41:31.041 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-14T10:41:31.075 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-14T10:41:31.252 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-14T10:41:31.252 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-14T10:41:31.261 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-14T10:41:31.262 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-14T10:41:31.445 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:41:31.445 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:41:31.445 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:41:31.445 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:41:31.445 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:41:31.446 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:41:31.446 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:41:31.446 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-14T10:41:31.446 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T10:41:31.446 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T10:41:31.447 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T10:41:31.447 INFO:teuthology.orchestra.run.smithi070.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T10:41:31.447 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T10:41:31.448 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T10:41:31.449 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet zip 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-14T10:41:31.450 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2024-09-14T10:41:31.460 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:41:31.460 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:41:31.460 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:41:31.460 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:41:31.461 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:41:31.461 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:41:31.461 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:41:31.462 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-14T10:41:31.462 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T10:41:31.462 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T10:41:31.462 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T10:41:31.462 INFO:teuthology.orchestra.run.smithi096.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T10:41:31.462 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T10:41:31.463 INFO:teuthology.orchestra.run.smithi096.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T10:41:31.463 INFO:teuthology.orchestra.run.smithi096.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T10:41:31.463 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T10:41:31.463 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T10:41:31.463 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T10:41:31.463 INFO:teuthology.orchestra.run.smithi096.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T10:41:31.464 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet zip 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-09-14T10:41:31.465 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-09-14T10:41:31.553 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-14T10:41:31.553 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T10:41:31.553 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T10:41:31.553 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T10:41:31.553 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T10:41:31.553 INFO:teuthology.orchestra.run.smithi070.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T10:41:31.553 INFO:teuthology.orchestra.run.smithi070.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T10:41:31.554 INFO:teuthology.orchestra.run.smithi070.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T10:41:31.554 INFO:teuthology.orchestra.run.smithi070.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T10:41:31.555 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T10:41:31.556 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T10:41:31.556 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T10:41:31.556 INFO:teuthology.orchestra.run.smithi070.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T10:41:31.571 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-14T10:41:31.571 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T10:41:31.572 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T10:41:31.572 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T10:41:31.572 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T10:41:31.572 INFO:teuthology.orchestra.run.smithi096.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T10:41:31.572 INFO:teuthology.orchestra.run.smithi096.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T10:41:31.573 INFO:teuthology.orchestra.run.smithi096.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T10:41:31.573 INFO:teuthology.orchestra.run.smithi096.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T10:41:31.573 INFO:teuthology.orchestra.run.smithi096.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T10:41:31.573 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T10:41:31.573 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T10:41:31.573 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T10:41:31.573 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T10:41:31.574 INFO:teuthology.orchestra.run.smithi096.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T10:41:31.614 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T10:41:31.615 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 251 MB of archives. 2024-09-14T10:41:31.615 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T10:41:31.615 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T10:41:31.697 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T10:41:31.704 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T10:41:31.706 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T10:41:31.714 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T10:41:31.715 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 251 MB of archives. 2024-09-14T10:41:31.715 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T10:41:31.715 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T10:41:31.724 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T10:41:31.760 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T10:41:31.784 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T10:41:31.788 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T10:41:31.801 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T10:41:31.805 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T10:41:31.806 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T10:41:31.807 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T10:41:31.808 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T10:41:31.816 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T10:41:31.818 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T10:41:31.821 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T10:41:31.822 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T10:41:31.822 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T10:41:31.839 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T10:41:31.841 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T10:41:31.843 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T10:41:31.843 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T10:41:31.844 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T10:41:31.845 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T10:41:31.856 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T10:41:31.857 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T10:41:31.857 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T10:41:31.857 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T10:41:31.874 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T10:41:31.874 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T10:41:31.877 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T10:41:31.877 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T10:41:31.877 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T10:41:31.878 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T10:41:31.891 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T10:41:31.891 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T10:41:31.892 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T10:41:31.892 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T10:41:31.908 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T10:41:31.909 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T10:41:31.914 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T10:41:31.914 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T10:41:31.914 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T10:41:31.915 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T10:41:31.917 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T10:41:31.925 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T10:41:31.925 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T10:41:31.927 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T10:41:31.928 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T10:41:31.929 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T10:41:31.943 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T10:41:31.945 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T10:41:31.945 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T10:41:31.946 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T10:41:31.949 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T10:41:31.999 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T10:41:32.000 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T10:41:32.001 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T10:41:32.002 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T10:41:32.003 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T10:41:32.003 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T10:41:32.019 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T10:41:32.021 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T10:41:32.021 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T10:41:32.023 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T10:41:32.032 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T10:41:32.036 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T10:41:32.036 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T10:41:32.036 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T10:41:32.037 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T10:41:32.037 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T10:41:32.037 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T10:41:32.038 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T10:41:32.039 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T10:41:32.043 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T10:41:32.045 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T10:41:32.053 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T10:41:32.053 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T10:41:32.054 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T10:41:32.057 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T10:41:32.061 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T10:41:32.062 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T10:41:32.066 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T10:41:32.067 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T10:41:32.068 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T10:41:32.070 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T10:41:32.071 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T10:41:32.072 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T10:41:32.075 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T10:41:32.077 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T10:41:32.078 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T10:41:32.078 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T10:41:32.088 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T10:41:32.088 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T10:41:32.090 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T10:41:32.091 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T10:41:32.105 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T10:41:32.106 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T10:41:32.106 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T10:41:32.108 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T10:41:32.108 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T10:41:32.114 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T10:41:32.115 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T10:41:32.122 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T10:41:32.124 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T10:41:32.125 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T10:41:32.185 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T10:41:32.197 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T10:41:32.278 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T10:41:32.324 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T10:41:32.326 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T10:41:32.335 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T10:41:32.352 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T10:41:32.355 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T10:41:32.364 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T10:41:32.508 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T10:41:32.518 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T10:41:32.552 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T10:41:32.560 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T10:41:32.562 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T10:41:32.563 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T10:41:32.565 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T10:41:32.581 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T10:41:32.585 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T10:41:32.590 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T10:41:32.672 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T10:41:32.672 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T10:41:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T10:41:32.681 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T10:41:32.684 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T10:41:32.685 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T10:41:32.685 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T10:41:32.687 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T10:41:32.753 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T10:41:32.754 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T10:41:32.835 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T10:41:32.836 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T10:41:32.837 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T10:41:32.837 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T10:41:32.843 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T10:41:32.844 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T10:41:32.845 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T10:41:32.845 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T10:41:32.916 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T10:41:32.917 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T10:41:32.998 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T10:41:33.001 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T10:41:33.002 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T10:41:33.003 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T10:41:33.014 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T10:41:33.014 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T10:41:33.016 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T10:41:33.017 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T10:41:33.080 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T10:41:33.083 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T10:41:33.166 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T10:41:33.343 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T10:41:33.383 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T10:41:33.422 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T10:41:33.425 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T10:41:33.427 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T10:41:33.454 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T10:41:33.455 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T10:41:33.456 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T10:41:33.458 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T10:41:33.458 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T10:41:33.461 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T10:41:33.507 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T10:41:33.511 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T10:41:33.511 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T10:41:33.539 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T10:41:33.550 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T10:41:33.551 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T10:41:33.561 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T10:41:33.561 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T10:41:33.562 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T10:41:33.605 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T10:41:33.623 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T10:41:33.623 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T10:41:33.625 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T10:41:33.625 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T10:41:33.627 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T10:41:33.633 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T10:41:33.665 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T10:41:33.704 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T10:41:33.708 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T10:41:33.710 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T10:41:33.718 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T10:41:33.786 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T10:41:33.788 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T10:41:33.790 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T10:41:33.801 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T10:41:33.802 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T10:41:33.810 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T10:41:33.850 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T10:41:33.867 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T10:41:33.869 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T10:41:33.870 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T10:41:33.874 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T10:41:33.949 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T10:41:33.968 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T10:41:33.969 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T10:41:33.970 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T10:41:33.976 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T10:41:33.977 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T10:41:34.643 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T10:41:34.644 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T10:41:34.661 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T10:41:34.702 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T10:41:34.721 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T10:41:34.724 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T10:41:35.001 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T10:41:35.051 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T10:41:35.070 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T10:41:35.114 INFO:teuthology.orchestra.run.smithi096.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T10:41:35.126 INFO:teuthology.orchestra.run.smithi096.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T10:41:35.128 INFO:teuthology.orchestra.run.smithi096.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T10:41:38.224 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T10:41:38.440 INFO:teuthology.orchestra.run.smithi096.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T10:41:38.465 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T10:41:38.466 INFO:teuthology.orchestra.run.smithi070.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T10:41:38.674 INFO:teuthology.orchestra.run.smithi096.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T10:41:38.674 INFO:teuthology.orchestra.run.smithi096.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T10:41:41.597 INFO:teuthology.orchestra.run.smithi070.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T10:41:41.600 INFO:teuthology.orchestra.run.smithi070.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T10:41:41.601 INFO:teuthology.orchestra.run.smithi070.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T10:41:41.762 INFO:teuthology.orchestra.run.smithi096.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T10:41:41.765 INFO:teuthology.orchestra.run.smithi096.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T10:41:41.766 INFO:teuthology.orchestra.run.smithi096.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T10:41:42.253 INFO:teuthology.orchestra.run.smithi070.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T10:41:42.456 INFO:teuthology.orchestra.run.smithi096.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T10:41:42.827 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 251 MB in 11s (23.5 MB/s) 2024-09-14T10:41:42.968 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T10:41:43.025 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 251 MB in 11s (23.1 MB/s) 2024-09-14T10:41:43.050 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T10:41:43.055 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T10:41:43.141 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T10:41:43.186 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T10:41:43.285 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T10:41:43.290 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T10:41:43.376 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T10:41:43.461 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T10:41:43.487 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T10:41:43.528 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T10:41:43.671 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T10:41:43.697 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T10:41:43.729 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T10:41:43.881 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T10:41:43.907 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T10:41:43.947 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T10:41:44.032 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T10:41:44.058 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T10:41:44.099 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T10:41:44.317 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T10:41:44.344 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:41:44.384 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:41:44.536 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T10:41:44.562 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:41:44.635 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:41:44.754 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T10:41:44.780 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:41:44.812 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:41:45.148 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T10:41:45.175 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:41:45.197 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T10:41:45.215 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:41:45.223 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:41:45.255 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:41:45.568 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T10:41:45.592 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T10:41:45.594 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T10:41:45.618 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:41:45.634 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T10:41:45.658 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:41:45.912 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2024-09-14T10:41:45.939 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:45.970 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:46.003 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T10:41:46.029 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T10:41:46.069 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T10:41:46.355 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librados2. 2024-09-14T10:41:46.381 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:46.407 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libnbd0. 2024-09-14T10:41:46.422 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:46.433 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T10:41:46.473 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T10:41:46.785 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2024-09-14T10:41:46.811 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:46.850 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libnbd0. 2024-09-14T10:41:46.851 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:46.876 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T10:41:46.916 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T10:41:47.219 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librbd1. 2024-09-14T10:41:47.245 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:47.286 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:47.304 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T10:41:47.330 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:47.370 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:47.639 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2024-09-14T10:41:47.654 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:47.697 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:47.730 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T10:41:47.756 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:47.796 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:48.001 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T10:41:48.027 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:41:48.040 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-09-14T10:41:48.056 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:48.084 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:48.090 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:48.336 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T10:41:48.362 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:48.393 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T10:41:48.403 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:48.420 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:41:48.460 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:48.688 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T10:41:48.704 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:41:48.739 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:48.745 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T10:41:48.772 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:48.812 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:49.017 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T10:41:49.043 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T10:41:49.083 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T10:41:49.132 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T10:41:49.158 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:41:49.198 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:49.394 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T10:41:49.421 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T10:41:49.461 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T10:41:49.501 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T10:41:49.527 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T10:41:49.568 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T10:41:49.862 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T10:41:49.888 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T10:41:49.922 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T10:41:49.928 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T10:41:49.948 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:49.988 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:50.189 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T10:41:50.205 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:50.256 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:50.300 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T10:41:50.326 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T10:41:50.358 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T10:41:50.585 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T10:41:50.600 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T10:41:50.609 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T10:41:50.636 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T10:41:50.643 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T10:41:50.676 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T10:41:50.938 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T10:41:50.945 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T10:41:50.960 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T10:41:50.964 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T10:41:50.997 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T10:41:51.004 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T10:41:51.239 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T10:41:51.254 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T10:41:51.297 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T10:41:51.333 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua5.1. 2024-09-14T10:41:51.359 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T10:41:51.399 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T10:41:51.617 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua5.1. 2024-09-14T10:41:51.644 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T10:41:51.677 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-any. 2024-09-14T10:41:51.684 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T10:41:51.692 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T10:41:51.736 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T10:41:51.980 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package zip. 2024-09-14T10:41:51.987 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-any. 2024-09-14T10:41:51.995 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T10:41:52.013 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T10:41:52.038 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T10:41:52.053 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T10:41:52.289 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package zip. 2024-09-14T10:41:52.315 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T10:41:52.326 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package unzip. 2024-09-14T10:41:52.347 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T10:41:52.352 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T10:41:52.418 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T10:41:52.634 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package unzip. 2024-09-14T10:41:52.660 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T10:41:52.700 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T10:41:52.797 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package luarocks. 2024-09-14T10:41:52.823 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T10:41:52.863 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T10:41:53.104 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package luarocks. 2024-09-14T10:41:53.130 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T10:41:53.171 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T10:41:53.254 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2024-09-14T10:41:53.281 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:53.321 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:53.547 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-09-14T10:41:53.573 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:53.613 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:53.931 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T10:41:53.955 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:53.990 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:54.216 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T10:41:54.231 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:54.268 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T10:41:54.274 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:54.294 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T10:41:54.334 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T10:41:54.552 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T10:41:54.578 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T10:41:54.610 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T10:41:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T10:41:54.655 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:54.695 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:54.888 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T10:41:54.915 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:54.946 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:55.307 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2024-09-14T10:41:55.333 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:55.373 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:55.474 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-09-14T10:41:55.501 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:55.541 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:56.803 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2024-09-14T10:41:56.830 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:56.871 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:57.063 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-09-14T10:41:57.089 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:41:57.138 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:41:57.407 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T10:41:57.434 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T10:41:57.465 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T10:41:57.692 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T10:41:57.718 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T10:41:57.758 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T10:41:57.760 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T10:41:57.786 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T10:41:57.827 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T10:41:58.044 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T10:41:58.071 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T10:41:58.111 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T10:41:58.138 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T10:41:58.165 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T10:41:58.204 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T10:41:58.422 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T10:41:58.448 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T10:41:58.488 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T10:41:58.524 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T10:41:58.550 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T10:41:58.590 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T10:41:58.758 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T10:41:58.773 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T10:41:58.808 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T10:41:58.860 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T10:41:58.875 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T10:41:58.910 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T10:41:59.103 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T10:41:59.129 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T10:41:59.169 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T10:41:59.196 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T10:41:59.223 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T10:41:59.263 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T10:41:59.472 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T10:41:59.498 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T10:41:59.538 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T10:41:59.565 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2024-09-14T10:41:59.592 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T10:41:59.632 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T10:41:59.850 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-portend. 2024-09-14T10:41:59.876 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T10:41:59.916 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T10:41:59.935 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T10:41:59.962 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T10:42:00.002 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T10:42:00.194 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T10:42:00.221 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T10:42:00.261 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T10:42:00.288 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T10:42:00.314 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T10:42:00.354 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T10:42:00.580 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T10:42:00.606 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T10:42:00.646 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T10:42:00.691 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T10:42:00.718 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T10:42:00.757 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T10:42:01.016 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T10:42:01.043 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T10:42:01.052 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T10:42:01.079 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T10:42:01.083 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T10:42:01.136 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T10:42:01.363 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T10:42:01.386 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T10:42:01.390 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T10:42:01.413 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T10:42:01.421 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T10:42:01.453 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T10:42:01.724 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2024-09-14T10:42:01.739 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T10:42:01.751 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T10:42:01.766 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T10:42:01.791 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T10:42:01.797 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T10:42:02.083 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-09-14T10:42:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T10:42:02.128 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T10:42:02.150 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T10:42:02.154 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T10:42:02.194 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T10:42:02.486 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T10:42:02.497 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T10:42:02.513 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T10:42:02.523 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T10:42:02.553 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T10:42:02.563 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T10:42:02.816 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2024-09-14T10:42:02.832 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T10:42:02.856 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T10:42:02.866 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T10:42:02.882 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T10:42:02.922 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T10:42:03.186 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T10:42:03.212 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T10:42:03.242 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-09-14T10:42:03.255 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T10:42:03.268 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T10:42:03.300 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T10:42:03.564 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T10:42:03.590 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T10:42:03.628 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T10:42:03.630 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T10:42:03.654 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T10:42:03.698 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T10:42:03.933 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2024-09-14T10:42:03.959 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T10:42:03.999 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T10:42:04.014 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T10:42:04.040 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T10:42:04.081 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T10:42:04.327 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T10:42:04.343 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T10:42:04.386 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T10:42:04.400 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-09-14T10:42:04.426 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T10:42:04.466 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T10:42:04.688 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T10:42:04.715 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T10:42:04.755 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T10:42:04.886 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T10:42:04.914 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T10:42:05.286 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T10:42:05.975 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T10:42:06.003 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T10:42:06.033 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T10:42:06.231 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T10:42:06.258 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T10:42:06.278 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T10:42:06.297 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T10:42:06.305 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T10:42:06.344 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T10:42:06.584 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T10:42:06.611 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T10:42:06.650 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T10:42:06.699 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T10:42:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T10:42:06.765 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T10:42:06.928 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T10:42:06.955 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T10:42:06.986 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T10:42:07.085 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2024-09-14T10:42:07.112 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T10:42:07.152 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T10:42:07.308 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T10:42:07.335 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T10:42:07.366 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T10:42:07.463 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T10:42:07.478 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T10:42:07.521 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T10:42:07.686 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-idna. 2024-09-14T10:42:07.713 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T10:42:07.752 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T10:42:07.849 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2024-09-14T10:42:07.876 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T10:42:07.916 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T10:42:08.063 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T10:42:08.090 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T10:42:08.130 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T10:42:08.177 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T10:42:08.193 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T10:42:08.227 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T10:42:08.450 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests. 2024-09-14T10:42:08.476 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T10:42:08.516 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T10:42:08.522 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T10:42:08.549 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:08.588 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:08.844 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T10:42:08.871 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T10:42:08.910 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T10:42:08.960 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T10:42:08.987 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:09.026 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:09.214 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T10:42:09.230 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:09.272 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:09.312 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T10:42:09.339 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T10:42:09.379 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T10:42:09.618 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T10:42:09.646 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:09.656 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T10:42:09.676 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:09.683 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T10:42:09.723 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T10:42:09.979 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T10:42:10.005 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T10:42:10.046 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T10:42:10.059 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T10:42:10.087 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:10.126 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:10.332 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T10:42:10.359 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T10:42:10.398 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T10:42:10.521 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T10:42:10.548 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:10.587 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:10.726 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T10:42:10.753 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:10.793 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:11.138 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T10:42:11.164 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:11.204 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:11.207 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T10:42:11.234 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:11.824 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T10:42:11.851 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:11.890 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:12.285 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2024-09-14T10:42:12.301 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:12.343 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:12.662 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T10:42:12.689 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:12.729 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:12.960 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-09-14T10:42:12.976 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:13.018 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:13.099 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T10:42:13.126 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:13.165 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:13.321 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T10:42:13.347 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:13.379 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:13.518 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2024-09-14T10:42:13.545 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:13.576 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:13.741 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T10:42:13.767 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:13.806 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:13.871 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T10:42:13.898 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T10:42:13.937 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T10:42:14.218 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-09-14T10:42:14.244 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:14.265 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T10:42:14.281 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T10:42:14.284 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:14.323 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T10:42:14.596 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T10:42:14.622 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T10:42:14.662 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T10:42:14.982 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T10:42:15.008 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T10:42:15.048 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T10:42:15.295 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2024-09-14T10:42:15.322 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T10:42:15.361 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T10:42:15.706 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T10:42:15.732 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T10:42:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T10:42:16.045 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-babel. 2024-09-14T10:42:16.072 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T10:42:16.111 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T10:42:16.133 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T10:42:16.160 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:16.200 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:16.537 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T10:42:16.564 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T10:42:16.572 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T10:42:16.599 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T10:42:16.603 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T10:42:16.639 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T10:42:16.890 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2024-09-14T10:42:16.917 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T10:42:16.947 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T10:42:16.967 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T10:42:16.993 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:17.033 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:17.259 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T10:42:17.286 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:17.317 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:17.378 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T10:42:17.405 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T10:42:17.445 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T10:42:17.747 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-09-14T10:42:17.774 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T10:42:17.814 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T10:42:18.142 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T10:42:18.169 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:18.208 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:19.764 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T10:42:19.794 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T10:42:19.838 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T10:42:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T10:42:20.336 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T10:42:20.384 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T10:42:20.737 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T10:42:20.764 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T10:42:20.803 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T10:42:20.871 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T10:42:20.901 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T10:42:20.938 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T10:42:21.181 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T10:42:21.209 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T10:42:21.416 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T10:42:21.458 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T10:42:21.485 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T10:42:21.524 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T10:42:21.894 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T10:42:21.922 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T10:42:21.961 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T10:42:22.151 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T10:42:22.179 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:22.209 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:22.263 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T10:42:22.291 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T10:42:22.407 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T10:42:23.099 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T10:42:23.115 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:23.157 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:23.195 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T10:42:23.223 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T10:42:23.262 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T10:42:23.548 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T10:42:23.575 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T10:42:23.614 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T10:42:23.959 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T10:42:23.987 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T10:42:24.026 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T10:42:24.202 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T10:42:24.230 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T10:42:24.269 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T10:42:24.312 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T10:42:24.328 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T10:42:24.362 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T10:42:24.580 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T10:42:24.608 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T10:42:24.646 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T10:42:24.666 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T10:42:24.694 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T10:42:24.732 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T10:42:24.950 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T10:42:24.977 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T10:42:25.008 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T10:42:25.052 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T10:42:25.080 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T10:42:25.119 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T10:42:25.286 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T10:42:25.313 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T10:42:25.344 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T10:42:25.380 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T10:42:25.408 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T10:42:25.446 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T10:42:25.681 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T10:42:25.709 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T10:42:25.748 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T10:42:25.766 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T10:42:25.794 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T10:42:25.833 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T10:42:26.067 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T10:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T10:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T10:42:26.579 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T10:42:26.606 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T10:42:26.637 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T10:42:26.863 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T10:42:26.880 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:26.921 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:27.115 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T10:42:27.143 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T10:42:27.181 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T10:42:27.257 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T10:42:27.286 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T10:42:27.324 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T10:42:27.602 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T10:42:27.618 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T10:42:27.652 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T10:42:27.812 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T10:42:27.840 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:27.878 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:27.904 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2024-09-14T10:42:27.933 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T10:42:27.971 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T10:42:28.206 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T10:42:28.223 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2024-09-14T10:42:28.233 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T10:42:28.240 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T10:42:28.272 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T10:42:28.281 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T10:42:28.602 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T10:42:28.609 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T10:42:28.618 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T10:42:28.636 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T10:42:28.659 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T10:42:28.675 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T10:42:28.903 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-09-14T10:42:28.931 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T10:42:28.969 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T10:42:28.989 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2024-09-14T10:42:29.005 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:29.039 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:29.222 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-09-14T10:42:29.250 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T10:42:29.289 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T10:42:29.591 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T10:42:29.608 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T10:42:29.675 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T10:42:30.029 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-09-14T10:42:30.046 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:30.087 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:31.510 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T10:42:31.538 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:31.601 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:31.913 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T10:42:31.930 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:31.971 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:32.266 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T10:42:32.293 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T10:42:32.332 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T10:42:32.558 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T10:42:32.586 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:42:32.624 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:32.662 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T10:42:32.690 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T10:42:32.728 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T10:42:32.928 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T10:42:32.944 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:32.986 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:33.090 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T10:42:33.118 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T10:42:33.157 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T10:42:33.306 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T10:42:33.334 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T10:42:33.372 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T10:42:33.547 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pkg-config. 2024-09-14T10:42:33.576 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T10:42:33.614 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T10:42:33.654 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T10:42:33.670 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T10:42:33.703 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T10:42:33.875 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T10:42:33.903 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T10:42:33.950 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T10:42:34.083 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T10:42:34.111 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T10:42:34.149 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T10:42:34.436 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T10:42:34.453 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T10:42:34.494 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T10:42:34.555 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package pkg-config. 2024-09-14T10:42:34.582 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T10:42:34.621 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T10:42:34.797 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T10:42:34.825 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T10:42:34.863 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T10:42:34.882 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T10:42:34.898 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T10:42:34.941 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T10:42:35.183 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T10:42:35.212 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T10:42:35.249 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T10:42:35.335 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T10:42:35.363 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T10:42:35.410 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T10:42:35.561 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T10:42:35.589 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T10:42:35.619 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T10:42:35.713 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T10:42:35.742 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T10:42:35.780 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T10:42:35.997 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2024-09-14T10:42:36.025 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T10:42:36.063 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T10:42:36.108 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T10:42:36.137 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T10:42:36.175 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T10:42:36.375 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T10:42:36.403 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T10:42:36.441 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T10:42:36.461 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T10:42:36.478 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T10:42:36.511 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T10:42:36.831 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-09-14T10:42:36.854 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T10:42:36.859 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T10:42:36.882 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T10:42:36.889 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T10:42:36.920 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T10:42:37.176 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T10:42:37.204 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T10:42:37.223 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2024-09-14T10:42:37.234 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T10:42:37.250 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T10:42:37.289 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T10:42:37.575 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T10:42:37.602 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T10:42:37.638 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T10:42:37.641 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T10:42:37.654 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T10:42:37.688 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T10:42:37.987 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T10:42:38.008 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-toml. 2024-09-14T10:42:38.015 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T10:42:38.036 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T10:42:38.053 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T10:42:38.074 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T10:42:38.324 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T10:42:38.356 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T10:42:38.378 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T10:42:38.390 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T10:42:38.406 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T10:42:38.448 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T10:42:38.772 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T10:42:38.801 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T10:42:38.839 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T10:42:39.100 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T10:42:39.109 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2024-09-14T10:42:39.116 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T10:42:39.138 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:39.149 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T10:42:39.175 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:39.829 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-09-14T10:42:39.857 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:39.895 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:40.071 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T10:42:40.087 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:40.128 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:40.408 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T10:42:40.658 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T10:42:40.732 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T10:42:40.748 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:42:40.781 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:40.784 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T10:42:41.050 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T10:42:41.069 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T10:42:41.320 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T10:42:41.366 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T10:42:41.463 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T10:42:41.717 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T10:42:41.775 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T10:42:41.844 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:42.043 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T10:42:42.443 INFO:teuthology.orchestra.run.smithi096.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T10:42:42.515 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:42.619 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2024-09-14T10:42:42.758 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T10:42:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-09-14T10:42:43.035 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T10:42:43.171 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T10:42:43.294 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T10:42:43.395 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T10:42:43.439 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T10:42:43.638 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T10:42:43.682 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T10:42:43.808 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T10:42:43.889 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T10:42:44.023 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T10:42:44.076 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T10:42:44.325 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T10:42:44.353 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T10:42:44.470 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T10:42:44.685 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T10:42:44.772 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T10:42:44.953 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T10:42:45.116 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T10:42:45.204 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T10:42:45.367 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T10:42:45.447 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T10:42:45.651 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T10:42:45.698 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T10:42:45.911 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T10:42:45.957 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T10:42:46.154 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T10:42:46.267 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:46.414 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T10:42:46.526 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T10:42:46.652 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T10:42:46.664 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:46.778 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T10:42:46.904 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T10:42:46.924 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T10:42:47.030 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T10:42:47.050 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T10:42:47.176 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T10:42:47.281 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T10:42:47.311 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T10:42:47.428 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T10:42:47.671 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T10:42:47.703 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T10:42:47.754 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T10:42:47.818 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T10:42:47.944 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T10:42:48.042 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T10:42:48.070 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T10:42:48.133 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T10:42:48.259 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T10:42:48.303 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T10:42:48.404 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T10:42:48.610 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T10:42:48.663 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T10:42:48.736 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T10:42:48.923 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T10:42:49.004 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T10:42:49.249 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T10:42:49.255 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T10:42:49.374 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T10:42:49.548 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T10:42:49.674 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T10:42:50.060 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T10:42:50.318 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T10:42:50.319 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T10:42:50.420 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T10:42:50.530 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T10:42:50.586 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T10:42:50.703 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T10:42:50.813 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T10:42:50.822 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T10:42:51.089 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T10:42:51.190 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T10:42:51.433 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T10:42:51.473 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T10:42:51.724 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T10:42:51.809 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T10:42:52.094 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T10:42:52.117 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T10:42:52.411 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T10:42:52.437 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T10:42:52.671 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T10:42:52.746 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T10:42:52.797 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:52.980 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T10:42:53.098 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T10:42:53.106 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:42:53.416 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T10:42:53.424 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T10:42:53.742 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T10:42:54.514 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T10:42:54.765 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:42:54.899 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T10:42:54.906 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T10:42:55.158 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:42:55.158 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T10:42:55.284 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T10:42:55.292 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T10:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T10:42:55.577 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T10:42:55.711 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T10:42:55.737 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T10:42:55.821 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T10:42:55.996 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T10:42:56.097 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T10:42:56.264 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:42:56.348 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T10:42:56.373 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T10:42:56.591 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:42:56.674 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T10:42:56.717 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T10:42:56.934 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T10:42:57.027 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T10:42:57.185 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T10:42:57.286 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T10:42:57.436 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T10:42:57.546 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T10:42:57.703 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T10:42:57.814 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T10:42:57.962 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T10:42:58.048 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T10:42:58.088 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T10:42:58.332 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T10:42:58.364 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T10:42:58.458 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T10:42:58.465 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T10:42:58.743 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T10:42:58.750 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T10:42:58.861 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T10:42:59.059 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T10:42:59.154 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T10:42:59.302 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T10:42:59.403 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T10:42:59.430 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T10:42:59.521 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T10:42:59.610 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T10:42:59.672 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T10:42:59.799 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T10:42:59.855 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T10:42:59.925 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T10:42:59.956 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T10:43:00.014 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T10:43:00.260 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T10:43:00.324 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T10:43:00.377 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T10:43:00.592 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T10:43:00.718 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T10:43:00.762 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T10:43:00.969 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:43:01.013 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T10:43:01.087 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T10:43:01.139 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T10:43:01.399 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:43:01.413 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T10:43:01.525 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T10:43:01.705 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T10:43:01.851 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T10:43:01.973 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T10:43:02.099 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T10:43:02.152 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T10:43:02.384 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T10:43:02.437 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T10:43:02.546 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T10:43:02.720 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T10:43:02.814 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T10:43:02.979 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T10:43:03.184 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T10:43:03.364 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T10:43:03.469 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T10:43:03.632 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T10:43:03.846 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T10:43:03.968 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T10:43:04.094 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:04.122 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T10:43:04.220 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:04.346 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T10:43:04.458 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T10:43:04.593 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:04.624 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:04.727 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:04.759 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:04.837 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T10:43:04.884 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T10:43:05.148 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:05.161 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:05.274 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:05.400 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T10:43:05.413 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:05.627 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T10:43:05.627 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T10:43:05.677 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:05.795 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:05.896 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:06.081 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:06.102 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T10:43:06.102 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T10:43:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:06.341 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:06.475 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T10:43:06.580 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:06.706 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:06.832 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T10:43:07.662 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:07.780 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:07.889 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:08.015 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:08.141 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:08.171 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:08.288 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:08.414 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:08.557 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:08.625 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2024-09-14T10:43:08.683 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:08.959 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2024-09-14T10:43:09.128 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2024-09-14T10:43:09.142 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T10:43:09.218 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-09-14T10:43:09.280 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T10:43:09.595 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-09-14T10:43:09.627 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T10:43:09.754 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-09-14T10:43:09.769 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T10:43:09.905 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T10:43:10.100 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:10.201 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:10.217 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T10:43:10.631 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:43:10.632 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:43:10.676 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:10.802 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:11.077 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:11.241 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:43:11.241 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:43:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T10:43:11.687 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:11.862 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:12.042 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T10:43:12.076 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T10:43:12.076 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T10:43:12.522 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:12.539 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:12.746 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T10:43:12.747 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T10:43:12.757 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T10:43:12.757 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T10:43:13.224 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:13.349 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:13.443 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T10:43:13.443 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T10:43:13.597 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T10:43:13.597 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T10:43:13.926 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:14.067 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:14.178 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T10:43:14.178 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T10:43:14.218 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:14.378 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:14.583 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T10:43:14.583 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T10:43:14.696 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:14.820 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:14.971 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:15.146 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:15.186 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T10:43:15.186 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T10:43:15.281 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:15.415 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:15.647 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:15.790 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:15.891 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:16.011 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T10:43:16.050 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:43:16.111 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T10:43:16.264 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T10:43:16.395 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T10:43:16.504 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T10:43:16.657 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T10:43:17.372 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T10:43:17.700 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T10:43:18.001 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T10:43:18.007 DEBUG:teuthology.parallel:result is None 2024-09-14T10:43:18.360 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T10:43:18.365 DEBUG:teuthology.parallel:result is None 2024-09-14T10:43:18.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:43:18.510 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2024-09-14T10:43:18.529 INFO:teuthology.orchestra.run.smithi070.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T10:43:18.529 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:43:18.529 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T10:43:18.531 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:43:18.683 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-09-14T10:43:18.702 INFO:teuthology.orchestra.run.smithi096.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T10:43:18.702 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:43:18.702 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T10:43:18.704 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T10:43:18.704 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:18.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:43:18.718 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:18.718 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:43:18.757 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T10:43:18.757 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:18.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:43:18.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:43:18.826 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:18.826 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:43:18.839 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:43:18.892 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T10:43:18.892 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:18.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:43:18.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:43:18.960 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:18.960 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:43:18.973 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:43:19.028 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T10:43:19.029 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:19.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:43:19.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:43:19.095 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:19.096 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:43:19.109 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:43:19.164 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T10:43:19.247 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T10:43:19.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-09-14T10:43:19.250 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-09-14T10:43:19.262 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T10:43:19.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:43:19.306 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:43:19.318 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T10:43:19.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:43:19.362 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:43:19.383 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T10:43:19.383 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T10:43:19.383 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116', 'branch': 'main', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904116', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHB8xFbEs7HHjkEdO2g+KAZ/pvBuVlMk7O9N+ZY0xTCkJnCkyvup6yxaI1jMDPRGWNUVNi+GFjk+8X0Re317zgs=', 'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJZtH8kyxfGd93OoXMVhkYOhMJY/kUGP3CBD/wRroZCBJkBW1oJFFfslBBTvIFMSrgdld9r962xMsz6NAWFTy0A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T10:43:19.384 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:43:19.418 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:43:19.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:43:19.470 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:43:19.483 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:19.483 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:43:19.530 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:43:19.531 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-14T10:43:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:43:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:43:19.589 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-14T10:43:19.589 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:43:19.589 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-14 10:37:50.835458871 +0000 2024-09-14T10:43:19.589 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-14 10:37:50.595461015 +0000 2024-09-14T10:43:19.589 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-14 10:37:50.595461015 +0000 2024-09-14T10:43:19.589 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-14T10:43:19.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:43:19.659 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-14T10:43:19.659 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-14T10:43:19.659 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000292442 s, 1.8 MB/s 2024-09-14T10:43:19.661 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:43:19.738 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-14T10:43:19.788 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:43:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:43:19.789 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-14T10:43:19.789 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:43:19.789 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-14 10:37:51.315454584 +0000 2024-09-14T10:43:19.789 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-14 10:37:51.055456906 +0000 2024-09-14T10:43:19.789 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-14 10:37:51.055456906 +0000 2024-09-14T10:43:19.789 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-14T10:43:19.789 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:43:19.843 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-14T10:43:19.844 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-14T10:43:19.844 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000267565 s, 1.9 MB/s 2024-09-14T10:43:19.845 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:43:19.894 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-14T10:43:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:43:19.941 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:43:19.941 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-14T10:43:19.941 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:43:19.941 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-14 10:37:51.775450474 +0000 2024-09-14T10:43:19.941 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-14 10:37:51.523452726 +0000 2024-09-14T10:43:19.942 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-14 10:37:51.523452726 +0000 2024-09-14T10:43:19.942 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-14T10:43:19.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:43:19.995 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-14T10:43:19.995 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-14T10:43:19.996 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000272527 s, 1.9 MB/s 2024-09-14T10:43:19.996 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:43:20.047 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-14T10:43:20.093 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:43:20.093 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:43:20.093 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-14T10:43:20.094 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:43:20.094 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-14 10:37:52.283445937 +0000 2024-09-14T10:43:20.094 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-14 10:37:52.015448331 +0000 2024-09-14T10:43:20.094 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-14 10:37:52.015448331 +0000 2024-09-14T10:43:20.094 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-14T10:43:20.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:43:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-14T10:43:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-14T10:43:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000313427 s, 1.6 MB/s 2024-09-14T10:43:20.149 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:43:20.202 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-14T10:43:20.203 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:20.203 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:43:20.209 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:43:20.209 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-09-14T10:43:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:43:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:43:20.258 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-14T10:43:20.258 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:43:20.258 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-14 10:37:49.752454785 +0000 2024-09-14T10:43:20.259 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-14 10:37:49.496457071 +0000 2024-09-14T10:43:20.259 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-14 10:37:49.496457071 +0000 2024-09-14T10:43:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-14T10:43:20.259 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:43:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-14T10:43:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-14T10:43:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00038731 s, 1.3 MB/s 2024-09-14T10:43:20.314 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:43:20.362 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-09-14T10:43:20.413 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:43:20.413 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:43:20.413 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-14T10:43:20.413 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:43:20.413 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-14 10:37:50.244450391 +0000 2024-09-14T10:43:20.414 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-14 10:37:49.996452606 +0000 2024-09-14T10:43:20.414 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-14 10:37:49.996452606 +0000 2024-09-14T10:43:20.414 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-14T10:43:20.414 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:43:20.468 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-14T10:43:20.468 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-14T10:43:20.468 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000417876 s, 1.2 MB/s 2024-09-14T10:43:20.469 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:43:20.519 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-09-14T10:43:20.565 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:43:20.566 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:43:20.566 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-14T10:43:20.566 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:43:20.566 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-14 10:37:50.748445889 +0000 2024-09-14T10:43:20.566 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-14 10:37:50.488448211 +0000 2024-09-14T10:43:20.566 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-14 10:37:50.488448211 +0000 2024-09-14T10:43:20.566 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-14T10:43:20.566 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:43:20.619 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-14T10:43:20.619 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-14T10:43:20.619 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000447113 s, 1.1 MB/s 2024-09-14T10:43:20.620 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:43:20.670 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-09-14T10:43:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:43:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:43:20.717 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-14T10:43:20.717 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:43:20.717 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-14 10:37:51.228441601 +0000 2024-09-14T10:43:20.717 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-14 10:37:50.988443745 +0000 2024-09-14T10:43:20.717 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-14 10:37:50.988443745 +0000 2024-09-14T10:43:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-14T10:43:20.718 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:43:20.771 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-14T10:43:20.771 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-14T10:43:20.771 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000278386 s, 1.8 MB/s 2024-09-14T10:43:20.773 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:43:20.823 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-14T10:43:20.823 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-14T10:43:20.823 INFO:tasks.ceph:Generating config... 2024-09-14T10:43:20.824 INFO:tasks.ceph:[client] debug ms = 1 2024-09-14T10:43:20.824 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-14T10:43:20.825 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T10:43:20.825 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T10:43:20.825 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T10:43:20.825 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T10:43:20.826 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T10:43:20.826 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T10:43:20.826 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T10:43:20.826 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T10:43:20.826 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T10:43:20.826 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T10:43:20.826 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T10:43:20.826 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T10:43:20.826 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T10:43:20.826 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T10:43:20.827 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T10:43:20.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T10:43:20.861 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T10:43:20.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T10:43:20.951 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:43:21.003 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70')] 2024-09-14T10:43:21.004 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-14T10:43:21.005 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:21.005 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:43:21.049 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:21.128 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:43:21.128 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid 2e314bd0-9070-44fa-a8ec-a9266c5de294 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 2e314bd0-9070-44fa-a8ec-a9266c5de294 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2024-09-14T10:43:21.133529+0000 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-14T10:43:21.133529+0000 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 17 (quincy) 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-14T10:43:21.129 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-14T10:43:21.131 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:43:21.177 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2e314bd0-9070-44fa-a8ec-a9266c5de294... 2024-09-14T10:43:21.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:43:21.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:43:21.250 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-09-14T10:43:21.251 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-09-14T10:43:21.252 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.253 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = 172.21.15.70 2024-09-14T10:43:21.254 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 2e314bd0-9070-44fa-a8ec-a9266c5de294 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-09-14T10:43:21.255 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.256 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: debug objclass = 20 2024-09-14T10:43:21.257 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-09-14T10:43:21.258 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-09-14T10:43:21.259 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:43:21.260 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-09-14T10:43:21.261 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:43:21.262 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:43:21.262 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-14T10:43:21.262 INFO:teuthology.orchestra.run.smithi070.stdout: rgw gc obj min wait = 15 2024-09-14T10:43:21.262 INFO:teuthology.orchestra.run.smithi070.stdout: debug rgw = 20 2024-09-14T10:43:21.262 INFO:teuthology.orchestra.run.smithi070.stdout: setgroup = ceph 2024-09-14T10:43:21.262 INFO:teuthology.orchestra.run.smithi070.stdout: setuser = ceph 2024-09-14T10:43:21.262 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-09-14T10:43:21.264 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-09-14T10:43:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-09-14T10:43:21.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = 172.21.15.70 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 2e314bd0-9070-44fa-a8ec-a9266c5de294 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-09-14T10:43:21.267 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug trim objects = true 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.268 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: debug objclass = 20 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: bdev async discard = True 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: bdev enable discard = True 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore allocator = bitmap 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-09-14T10:43:21.269 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 1/20 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 1/20 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 4/10 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-09-14T10:43:21.270 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-09-14T10:43:21.271 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:43:21.272 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: rgw gc obj min wait = 15 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: debug rgw = 20 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: setgroup = ceph 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout: setuser = ceph 2024-09-14T10:43:21.273 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-09-14T10:43:21.273 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T10:43:21.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T10:43:21.352 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T10:43:21.352 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:21.352 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T10:43:21.357 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:21.358 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T10:43:21.404 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-09-14T10:43:21.405 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:21.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:43:21.405 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:43:21.470 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:21.470 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:21.517 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:43:21.517 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:21.517 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:43:21.517 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:43:21.540 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:21.540 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:21.589 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T10:43:21.589 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T10:43:21.590 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:43:21.675 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:43:21.686 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T10:43:21.686 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T10:43:21.686 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T10:43:21.761 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T10:43:21.772 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T10:43:21.772 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-14T10:43:21.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T10:43:21.786 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-14T10:43:21.786 INFO:tasks.ceph:role: osd.0 2024-09-14T10:43:21.786 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-14T10:43:21.786 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:43:21.840 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:43:21.840 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:43:21.840 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:43:21.841 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:43:21.841 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:43:21.841 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:43:21.841 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:43:21.841 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:43:21.841 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:43:21.841 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:43:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-14T10:43:21.866 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-14T10:43:21.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T10:43:21.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T10:43:21.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:43:21.974 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:43:21.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:22.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:22.085+0000 7f57dad1c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T10:43:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:22.089+0000 7f57dad1c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T10:43:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:22.089+0000 7f57dad1c7c0 -1 bdev(0x557f526cb800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T10:43:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:22.089+0000 7f57dad1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T10:43:25.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T10:43:25.232 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T10:43:25.246 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-14T10:43:25.247 INFO:tasks.ceph:role: osd.1 2024-09-14T10:43:25.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:43:25.247 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:43:25.308 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:43:25.308 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:43:25.308 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:43:25.309 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:43:25.309 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:43:25.309 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:43:25.309 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:43:25.309 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:43:25.309 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:43:25.309 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:43:25.760 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-14T10:43:25.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-14T10:43:25.762 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-14T10:43:25.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T10:43:25.867 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:43:25.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:43:25.869 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T10:43:25.923 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-14T10:43:25.924 INFO:tasks.ceph:role: osd.2 2024-09-14T10:43:25.924 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:43:25.924 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:43:25.986 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:43:25.986 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:43:25.986 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:43:25.986 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:43:25.986 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:43:25.986 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:43:25.986 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:43:25.986 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:43:25.987 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:43:25.987 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:43:26.465 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-14T10:43:26.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-14T10:43:26.468 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-14T10:43:26.630 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T10:43:26.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:43:26.641 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:43:26.641 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T10:43:26.695 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-14T10:43:26.696 INFO:tasks.ceph:role: osd.3 2024-09-14T10:43:26.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:43:26.696 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:43:26.756 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:43:26.757 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:43:27.231 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-14T10:43:27.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-14T10:43:27.235 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-14T10:43:27.372 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T10:43:27.383 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:43:27.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:43:27.384 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:27.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:27.492+0000 7fb9605417c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T10:43:27.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:27.492+0000 7fb9605417c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T10:43:27.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:27.492+0000 7fb9605417c0 -1 bdev(0x55d18fa1d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T10:43:27.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:27.496+0000 7fb9605417c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T10:43:30.633 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T10:43:30.646 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:30.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:30.728+0000 7f2feb4597c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T10:43:30.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:30.728+0000 7f2feb4597c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T10:43:30.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:30.728+0000 7f2feb4597c0 -1 bdev(0x562515589800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T10:43:30.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:30.732+0000 7f2feb4597c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T10:43:33.885 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T10:43:33.942 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:34.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:34.024+0000 7f49027127c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T10:43:34.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:34.028+0000 7f49027127c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T10:43:34.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:34.028+0000 7f49027127c0 -1 bdev(0x559b77985800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T10:43:34.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:34.028+0000 7f49027127c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T10:43:37.133 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T10:43:37.189 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T10:43:37.190 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:37.190 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T10:43:37.204 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:37.205 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T10:43:37.243 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:37.244 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T10:43:37.296 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:37.297 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T10:43:37.353 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:37.353 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T10:43:37.407 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:37.408 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T10:43:37.453 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T10:43:37.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:43:37.464 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDKaOVmIXGLBRAAKDcha9MaXoFVGLhrFlUPzQ== 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDJaOVmAqKDKBAAYalo5D/KsUkfD99g7ECp4w== 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDPaOVma6GLHRAAt6bdznISbo8uHGec/fKUwA== 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDSaOVmpHCjKxAA3lNwNxbVw1cLlX9H0RChag== 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDWaOVmOeG3ARAAifmWnOwaRAsqY5ZtAhy0zA== 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-14T10:43:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDJaOVmsvulLRAAAembe1qsJt+z1lISZ1gNJA== 2024-09-14T10:43:37.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:43:37.553 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:43:37.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:43:37.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:43:37.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:43:37.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:43:37.925 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T10:43:37.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T10:43:37.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:43:38.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T10:43:38.080 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:43:38.127 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T10:43:38.128 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T10:43:38.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T10:43:38.173 INFO:tasks.ceph.mon.a:Started 2024-09-14T10:43:38.174 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T10:43:38.174 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T10:43:38.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T10:43:38.176 INFO:tasks.ceph.mgr.x:Started 2024-09-14T10:43:38.177 DEBUG:tasks.ceph:set 0 configs 2024-09-14T10:43:38.177 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T10:43:38.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T10:43:38.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6f840640 1 Processor -- start 2024-09-14T10:43:38.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6f840640 1 -- start start 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6f840640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 0x7eff6806e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6f840640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff68070820 con 0x7eff6806e5e0 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6f840640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7eff68070510 con 0x7eff68098c00 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6d5dc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 0x7eff6806e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6cddb640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7eff6806e5e0 0x7eff68133be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:59168/0 (socket says 172.21.15.70:59168) 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6cddb640 1 -- 172.21.15.70:0/1206499247 learned_addr learned my addr 172.21.15.70:0/1206499247 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6d5dc640 1 -- 172.21.15.70:0/1206499247 >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 msgr2=0x7eff6806e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6d5dc640 1 -- 172.21.15.70:0/1206499247 >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 msgr2=0x7eff6806e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-14T10:43:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6d5dc640 1 --2- 172.21.15.70:0/1206499247 >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 0x7eff6806e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-14T10:43:38.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.297+0000 7eff6d5dc640 1 --2- 172.21.15.70:0/1206499247 >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 0x7eff6806e0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-14T10:43:38.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.317+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284639791 0 0) 0x7eff68070820 con 0x7eff6806e5e0 2024-09-14T10:43:38.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.317+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff54003530 con 0x7eff6806e5e0 2024-09-14T10:43:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.317+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781137231 0 0) 0x7eff54003530 con 0x7eff6806e5e0 2024-09-14T10:43:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.317+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 msgr2=0x7eff6806e0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-14T10:43:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.317+0000 7eff5ffff640 1 --2- 172.21.15.70:0/1206499247 >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 0x7eff6806e0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.317+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6806fc70 con 0x7eff6806e5e0 2024-09-14T10:43:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.321+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2889246557 0 0) 0x7eff58001630 con 0x7eff6806e5e0 2024-09-14T10:43:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.321+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 >> v1:172.21.15.70:6789/0 conn(0x7eff6806e5e0 legacy=0x7eff68133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.321+0000 7eff5ffff640 1 --2- 172.21.15.70:0/1206499247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff54003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.321+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff68070510 con 0x7eff54003ab0 2024-09-14T10:43:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.321+0000 7eff6d5dc640 1 --2- 172.21.15.70:0/1206499247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff54003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.321+0000 7eff6d5dc640 1 -- 172.21.15.70:0/1206499247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff54003530 con 0x7eff54003ab0 2024-09-14T10:43:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6d5dc640 1 --2- 172.21.15.70:0/1206499247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff54003eb0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c7a0 tx=0x7eff6401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22951502c8d900fe server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6400f040 con 0x7eff54003ab0 2024-09-14T10:43:38.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff640a9560 con 0x7eff54003ab0 2024-09-14T10:43:38.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff5ffff640 1 -- 172.21.15.70:0/1206499247 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff640a9880 con 0x7eff54003ab0 2024-09-14T10:43:38.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 -- 172.21.15.70:0/1206499247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 msgr2=0x7eff54003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:38.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 --2- 172.21.15.70:0/1206499247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff54003eb0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c7a0 tx=0x7eff6401c5d0 comp rx=0 tx=0).stop 2024-09-14T10:43:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 -- 172.21.15.70:0/1206499247 shutdown_connections 2024-09-14T10:43:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 --2- 172.21.15.70:0/1206499247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff54003eb0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 --2- 172.21.15.70:0/1206499247 >> v2:172.21.15.70:3300/0 conn(0x7eff68098c00 0x7eff6806e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 -- 172.21.15.70:0/1206499247 >> 172.21.15.70:0/1206499247 conn(0x7eff6809ec10 msgr2=0x7eff6809f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 -- 172.21.15.70:0/1206499247 shutdown_connections 2024-09-14T10:43:38.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 -- 172.21.15.70:0/1206499247 wait complete. 2024-09-14T10:43:38.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 Processor -- start 2024-09-14T10:43:38.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 -- start start 2024-09-14T10:43:38.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff68131380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:38.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.337+0000 7eff6f840640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff68137eb0 con 0x7eff54003ab0 2024-09-14T10:43:38.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff6d5dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff68131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:38.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff6d5dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff68131380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47854/0 (socket says 172.21.15.70:47854) 2024-09-14T10:43:38.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff6d5dc640 1 -- 172.21.15.70:0/937118957 learned_addr learned my addr 172.21.15.70:0/937118957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:38.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff6d5dc640 1 -- 172.21.15.70:0/937118957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff680979f0 con 0x7eff54003ab0 2024-09-14T10:43:38.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff6d5dc640 1 --2- 172.21.15.70:0/937118957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff68131380 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7eff640191e0 tx=0x7eff54005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff5dffb640 1 -- 172.21.15.70:0/937118957 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff640c0070 con 0x7eff54003ab0 2024-09-14T10:43:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff5dffb640 1 -- 172.21.15.70:0/937118957 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff640b1730 con 0x7eff54003ab0 2024-09-14T10:43:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff681241a0 con 0x7eff54003ab0 2024-09-14T10:43:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff5dffb640 1 -- 172.21.15.70:0/937118957 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff640b1a10 con 0x7eff54003ab0 2024-09-14T10:43:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff68131a90 con 0x7eff54003ab0 2024-09-14T10:43:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff5dffb640 1 -- 172.21.15.70:0/937118957 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff640c3070 con 0x7eff54003ab0 2024-09-14T10:43:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff5dffb640 1 -- 172.21.15.70:0/937118957 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7eff640b8070 con 0x7eff54003ab0 2024-09-14T10:43:38.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.341+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6806e0a0 con 0x7eff54003ab0 2024-09-14T10:43:38.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.345+0000 7eff5dffb640 1 -- 172.21.15.70:0/937118957 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7eff640ad020 con 0x7eff54003ab0 2024-09-14T10:43:38.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.405+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7eff68050ef0 con 0x7eff54003ab0 2024-09-14T10:43:38.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.409+0000 7eff5dffb640 1 -- 172.21.15.70:0/937118957 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7eff640161c0 con 0x7eff54003ab0 2024-09-14T10:43:38.409 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-14T10:43:38.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.409+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 msgr2=0x7eff68131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:38.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.409+0000 7eff6f840640 1 --2- 172.21.15.70:0/937118957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff68131380 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7eff640191e0 tx=0x7eff54005840 comp rx=0 tx=0).stop 2024-09-14T10:43:38.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.409+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 shutdown_connections 2024-09-14T10:43:38.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.409+0000 7eff6f840640 1 --2- 172.21.15.70:0/937118957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff54003ab0 0x7eff68131380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:38.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.409+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 >> 172.21.15.70:0/937118957 conn(0x7eff6809ec10 msgr2=0x7eff68072110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:38.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.409+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 shutdown_connections 2024-09-14T10:43:38.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:38.409+0000 7eff6f840640 1 -- 172.21.15.70:0/937118957 wait complete. 2024-09-14T10:43:38.427 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T10:43:38.427 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T10:43:38.427 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-14T10:43:38.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T10:43:38.438 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:38.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T10:43:38.452 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:38.452 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T10:43:38.510 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-14T10:43:38.511 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T10:43:38.565 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 94e00249-58b2-4247-a635-db467796e81e 0 2024-09-14T10:43:38.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b5aeea640 1 Processor -- start 2024-09-14T10:43:38.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b5aeea640 1 -- start start 2024-09-14T10:43:38.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b5aeea640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1b54110070 0x7f1b54110450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:38.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b5aeea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b54110b40 con 0x7f1b54115600 2024-09-14T10:43:38.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b5aeea640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f1b541161c0 con 0x7f1b54110070 2024-09-14T10:43:38.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b58c86640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1b54110070 0x7f1b54110450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:38.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b58c86640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1b54110070 0x7f1b54110450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36656/0 (socket says 172.21.15.96:36656) 2024-09-14T10:43:38.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b53fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1b54115600 0x7f1b54115ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:54410/0 (socket says 172.21.15.96:54410) 2024-09-14T10:43:38.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.732+0000 7f1b58c86640 1 -- 172.21.15.96:0/3598947950 learned_addr learned my addr 172.21.15.96:0/3598947950 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:43:38.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b58c86640 1 -- 172.21.15.96:0/3598947950 >> v1:172.21.15.70:6789/0 conn(0x7f1b54115600 legacy=0x7f1b54115ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:38.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b58c86640 1 -- 172.21.15.96:0/3598947950 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b54116370 con 0x7f1b54110070 2024-09-14T10:43:38.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b58c86640 1 --2- 172.21.15.96:0/3598947950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b54110450 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b480097f0 tx=0x7f1b4801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cfd98042656ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:38.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b537fe640 1 -- 172.21.15.96:0/3598947950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b480ab580 con 0x7f1b54110070 2024-09-14T10:43:38.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b537fe640 1 -- 172.21.15.96:0/3598947950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b480b0070 con 0x7f1b54110070 2024-09-14T10:43:38.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b537fe640 1 -- 172.21.15.96:0/3598947950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b480ab870 con 0x7f1b54110070 2024-09-14T10:43:38.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b5aeea640 1 -- 172.21.15.96:0/3598947950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 msgr2=0x7f1b54110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:38.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b5aeea640 1 --2- 172.21.15.96:0/3598947950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b54110450 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b480097f0 tx=0x7f1b4801c430 comp rx=0 tx=0).stop 2024-09-14T10:43:38.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b5aeea640 1 -- 172.21.15.96:0/3598947950 shutdown_connections 2024-09-14T10:43:38.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b5aeea640 1 --2- 172.21.15.96:0/3598947950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b54110450 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:38.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b5aeea640 1 -- 172.21.15.96:0/3598947950 >> 172.21.15.96:0/3598947950 conn(0x7f1b54070ec0 msgr2=0x7f1b540732e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:38.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b5aeea640 1 -- 172.21.15.96:0/3598947950 shutdown_connections 2024-09-14T10:43:38.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.736+0000 7f1b5aeea640 1 -- 172.21.15.96:0/3598947950 wait complete. 2024-09-14T10:43:38.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b5aeea640 1 Processor -- start 2024-09-14T10:43:38.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b5aeea640 1 -- start start 2024-09-14T10:43:38.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b5aeea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b541a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:38.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b5aeea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5411e3b0 con 0x7f1b54110070 2024-09-14T10:43:38.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b58c86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b541a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:38.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b58c86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b541a7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36662/0 (socket says 172.21.15.96:36662) 2024-09-14T10:43:38.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b58c86640 1 -- 172.21.15.96:0/548983729 learned_addr learned my addr 172.21.15.96:0/548983729 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b58c86640 1 -- 172.21.15.96:0/548983729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b541a8350 con 0x7f1b54110070 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b58c86640 1 --2- 172.21.15.96:0/548983729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b541a7d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1b480ad040 tx=0x7f1b4801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b517fa640 1 -- 172.21.15.96:0/548983729 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b480abe30 con 0x7f1b54110070 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b517fa640 1 -- 172.21.15.96:0/548983729 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b480aa940 con 0x7f1b54110070 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b541a85e0 con 0x7f1b54110070 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b517fa640 1 -- 172.21.15.96:0/548983729 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b480aac20 con 0x7f1b54110070 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b541ad640 con 0x7f1b54110070 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b517fa640 1 -- 172.21.15.96:0/548983729 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b480c77d0 con 0x7f1b54110070 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b517fa640 1 -- 172.21.15.96:0/548983729 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1b480be990 con 0x7f1b54110070 2024-09-14T10:43:38.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.740+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b54110450 con 0x7f1b54110070 2024-09-14T10:43:38.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.748+0000 7f1b517fa640 1 -- 172.21.15.96:0/548983729 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1b480160b0 con 0x7f1b54110070 2024-09-14T10:43:38.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.816+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94e00249-58b2-4247-a635-db467796e81e", "id": 0} v 0) -- 0x7f1b54115600 con 0x7f1b54110070 2024-09-14T10:43:38.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.820+0000 7f1b517fa640 1 -- 172.21.15.96:0/548983729 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94e00249-58b2-4247-a635-db467796e81e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1b480cc030 con 0x7f1b54110070 2024-09-14T10:43:38.818 INFO:teuthology.orchestra.run.smithi096.stdout:0 2024-09-14T10:43:38.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.820+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 msgr2=0x7f1b541a7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:38.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.820+0000 7f1b5aeea640 1 --2- 172.21.15.96:0/548983729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b541a7d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1b480ad040 tx=0x7f1b4801ac70 comp rx=0 tx=0).stop 2024-09-14T10:43:38.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.820+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 shutdown_connections 2024-09-14T10:43:38.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.820+0000 7f1b5aeea640 1 --2- 172.21.15.96:0/548983729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b54110070 0x7f1b541a7d80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:38.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.820+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 >> 172.21.15.96:0/548983729 conn(0x7f1b54070ec0 msgr2=0x7f1b5406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:38.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.820+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 shutdown_connections 2024-09-14T10:43:38.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.820+0000 7f1b5aeea640 1 -- 172.21.15.96:0/548983729 wait complete. 2024-09-14T10:43:38.835 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 26e1a964-ad73-4f8f-9ab6-0c4c442429a4 1 2024-09-14T10:43:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c07716640 1 Processor -- start 2024-09-14T10:43:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c07716640 1 -- start start 2024-09-14T10:43:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c07716640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c001104c0 0x7f1c0011c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c07716640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c00110970 con 0x7f1c00074e70 2024-09-14T10:43:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c07716640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f1c00110b40 con 0x7f1c001104c0 2024-09-14T10:43:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c04cb1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c001104c0 0x7f1c0011c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c04cb1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1c001104c0 0x7f1c0011c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36676/0 (socket says 172.21.15.96:36676) 2024-09-14T10:43:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c04cb1640 1 -- 172.21.15.96:0/2896844676 learned_addr learned my addr 172.21.15.96:0/2896844676 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:43:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c04cb1640 1 -- 172.21.15.96:0/2896844676 >> v1:172.21.15.70:6789/0 conn(0x7f1c00074e70 legacy=0x7f1c0010fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.952+0000 7f1c04cb1640 1 -- 172.21.15.96:0/2896844676 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0011d690 con 0x7f1c001104c0 2024-09-14T10:43:38.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c04cb1640 1 --2- 172.21.15.96:0/2896844676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c001104c0 0x7f1c0011c140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0097f0 tx=0x7f1bfc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a423cd17444ec334 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:38.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1bf7fff640 1 -- 172.21.15.96:0/2896844676 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc0ab580 con 0x7f1c001104c0 2024-09-14T10:43:38.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1bf7fff640 1 -- 172.21.15.96:0/2896844676 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0b0070 con 0x7f1c001104c0 2024-09-14T10:43:38.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1bf7fff640 1 -- 172.21.15.96:0/2896844676 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bfc0ab870 con 0x7f1c001104c0 2024-09-14T10:43:38.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 -- 172.21.15.96:0/2896844676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c001104c0 msgr2=0x7f1c0011c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:38.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 --2- 172.21.15.96:0/2896844676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c001104c0 0x7f1c0011c140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0097f0 tx=0x7f1bfc01c430 comp rx=0 tx=0).stop 2024-09-14T10:43:38.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 -- 172.21.15.96:0/2896844676 shutdown_connections 2024-09-14T10:43:38.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 --2- 172.21.15.96:0/2896844676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c001104c0 0x7f1c0011c140 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 -- 172.21.15.96:0/2896844676 >> 172.21.15.96:0/2896844676 conn(0x7f1c000705e0 msgr2=0x7f1c00072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 -- 172.21.15.96:0/2896844676 shutdown_connections 2024-09-14T10:43:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 -- 172.21.15.96:0/2896844676 wait complete. 2024-09-14T10:43:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 Processor -- start 2024-09-14T10:43:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 -- start start 2024-09-14T10:43:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.956+0000 7f1c07716640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c00074e70 0x7f1c00110fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c07716640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0011d370 con 0x7f1c00074e70 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c054b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c00074e70 0x7f1c00110fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c054b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c00074e70 0x7f1c00110fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36692/0 (socket says 172.21.15.96:36692) 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c054b2640 1 -- 172.21.15.96:0/1006545741 learned_addr learned my addr 172.21.15.96:0/1006545741 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c054b2640 1 -- 172.21.15.96:0/1006545741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c00112ed0 con 0x7f1c00074e70 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c054b2640 1 --2- 172.21.15.96:0/1006545741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c00074e70 0x7f1c00110fe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000c430 tx=0x7f1bf000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1bf5ffb640 1 -- 172.21.15.96:0/1006545741 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf0017070 con 0x7f1c00074e70 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1bf5ffb640 1 -- 172.21.15.96:0/1006545741 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf0005200 con 0x7f1c00074e70 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c00111580 con 0x7f1c00074e70 2024-09-14T10:43:38.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1bf5ffb640 1 -- 172.21.15.96:0/1006545741 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf0003600 con 0x7f1c00074e70 2024-09-14T10:43:38.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c00111a90 con 0x7f1c00074e70 2024-09-14T10:43:38.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1bf5ffb640 1 -- 172.21.15.96:0/1006545741 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1bf001a070 con 0x7f1c00074e70 2024-09-14T10:43:38.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1bf5ffb640 1 -- 172.21.15.96:0/1006545741 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1bf0011b60 con 0x7f1c00074e70 2024-09-14T10:43:38.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.960+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0010fdb0 con 0x7f1c00074e70 2024-09-14T10:43:38.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:38.968+0000 7f1bf5ffb640 1 -- 172.21.15.96:0/1006545741 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1bf0021020 con 0x7f1c00074e70 2024-09-14T10:43:39.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.036+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26e1a964-ad73-4f8f-9ab6-0c4c442429a4", "id": 1} v 0) -- 0x7f1c00111dd0 con 0x7f1c00074e70 2024-09-14T10:43:39.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.040+0000 7f1bf5ffb640 1 -- 172.21.15.96:0/1006545741 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26e1a964-ad73-4f8f-9ab6-0c4c442429a4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1bf0011590 con 0x7f1c00074e70 2024-09-14T10:43:39.038 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-09-14T10:43:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.040+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c00074e70 msgr2=0x7f1c00110fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.040+0000 7f1c07716640 1 --2- 172.21.15.96:0/1006545741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c00074e70 0x7f1c00110fe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000c430 tx=0x7f1bf000c8f0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.040+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 shutdown_connections 2024-09-14T10:43:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.040+0000 7f1c07716640 1 --2- 172.21.15.96:0/1006545741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c00074e70 0x7f1c00110fe0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.040+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 >> 172.21.15.96:0/1006545741 conn(0x7f1c000705e0 msgr2=0x7f1c00114260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.040+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 shutdown_connections 2024-09-14T10:43:39.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.040+0000 7f1c07716640 1 -- 172.21.15.96:0/1006545741 wait complete. 2024-09-14T10:43:39.056 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 47f610b0-6d57-4262-a3a3-dc8f095700b7 2 2024-09-14T10:43:39.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.172+0000 7fe90d2bb640 1 Processor -- start 2024-09-14T10:43:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.172+0000 7fe90d2bb640 1 -- start start 2024-09-14T10:43:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe90d2bb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe908117ef0 0x7fe90811a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe90d2bb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90811a8b0 con 0x7fe908110070 2024-09-14T10:43:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe90d2bb640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe90811ba90 con 0x7fe908117ef0 2024-09-14T10:43:39.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe9067fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe908117ef0 0x7fe90811a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe9067fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe908117ef0 0x7fe90811a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36694/0 (socket says 172.21.15.96:36694) 2024-09-14T10:43:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe9067fc640 1 -- 172.21.15.96:0/3880991600 learned_addr learned my addr 172.21.15.96:0/3880991600 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:43:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe906ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe908110070 0x7fe908110450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:54430/0 (socket says 172.21.15.96:54430) 2024-09-14T10:43:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe9067fc640 1 -- 172.21.15.96:0/3880991600 >> v1:172.21.15.70:6789/0 conn(0x7fe908110070 legacy=0x7fe908110450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe9067fc640 1 -- 172.21.15.96:0/3880991600 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90811bc10 con 0x7fe908117ef0 2024-09-14T10:43:39.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe9067fc640 1 --2- 172.21.15.96:0/3880991600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908117ef0 0x7fe90811a2e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00a990 tx=0x7fe8fc01d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a762b3b9e489024 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:39.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe905ffb640 1 -- 172.21.15.96:0/3880991600 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8fc0b3070 con 0x7fe908117ef0 2024-09-14T10:43:39.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe905ffb640 1 -- 172.21.15.96:0/3880991600 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8fc0a67a0 con 0x7fe908117ef0 2024-09-14T10:43:39.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.176+0000 7fe905ffb640 1 -- 172.21.15.96:0/3880991600 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8fc00b040 con 0x7fe908117ef0 2024-09-14T10:43:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- 172.21.15.96:0/3880991600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908117ef0 msgr2=0x7fe90811a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 --2- 172.21.15.96:0/3880991600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908117ef0 0x7fe90811a2e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00a990 tx=0x7fe8fc01d800 comp rx=0 tx=0).stop 2024-09-14T10:43:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- 172.21.15.96:0/3880991600 shutdown_connections 2024-09-14T10:43:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 --2- 172.21.15.96:0/3880991600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908117ef0 0x7fe90811a2e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- 172.21.15.96:0/3880991600 >> 172.21.15.96:0/3880991600 conn(0x7fe9080707f0 msgr2=0x7fe908072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:39.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- 172.21.15.96:0/3880991600 shutdown_connections 2024-09-14T10:43:39.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- 172.21.15.96:0/3880991600 wait complete. 2024-09-14T10:43:39.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 Processor -- start 2024-09-14T10:43:39.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- start start 2024-09-14T10:43:39.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908110070 0x7fe9081a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:39.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe90811b740 con 0x7fe908110070 2024-09-14T10:43:39.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe906ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908110070 0x7fe9081a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:39.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe906ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908110070 0x7fe9081a86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36710/0 (socket says 172.21.15.96:36710) 2024-09-14T10:43:39.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe906ffd640 1 -- 172.21.15.96:0/139544049 learned_addr learned my addr 172.21.15.96:0/139544049 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe906ffd640 1 -- 172.21.15.96:0/139544049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9081a8c90 con 0x7fe908110070 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe906ffd640 1 --2- 172.21.15.96:0/139544049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908110070 0x7fe9081a86c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c480 tx=0x7fe8f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe8ef7fe640 1 -- 172.21.15.96:0/139544049 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f8007410 con 0x7fe908110070 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9081a8f20 con 0x7fe908110070 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9081adf80 con 0x7fe908110070 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe8ef7fe640 1 -- 172.21.15.96:0/139544049 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f80075b0 con 0x7fe908110070 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe8ef7fe640 1 -- 172.21.15.96:0/139544049 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f8004920 con 0x7fe908110070 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe8ef7fe640 1 -- 172.21.15.96:0/139544049 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe8f801a020 con 0x7fe908110070 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.180+0000 7fe8ef7fe640 1 -- 172.21.15.96:0/139544049 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fe8f8013820 con 0x7fe908110070 2024-09-14T10:43:39.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.184+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9081104d0 con 0x7fe908110070 2024-09-14T10:43:39.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.188+0000 7fe8ef7fe640 1 -- 172.21.15.96:0/139544049 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe8f8021070 con 0x7fe908110070 2024-09-14T10:43:39.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.256+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47f610b0-6d57-4262-a3a3-dc8f095700b7", "id": 2} v 0) -- 0x7fe908117ef0 con 0x7fe908110070 2024-09-14T10:43:39.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.256+0000 7fe8ef7fe640 1 -- 172.21.15.96:0/139544049 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47f610b0-6d57-4262-a3a3-dc8f095700b7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fe8f8013af0 con 0x7fe908110070 2024-09-14T10:43:39.256 INFO:teuthology.orchestra.run.smithi096.stdout:2 2024-09-14T10:43:39.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.260+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908110070 msgr2=0x7fe9081a86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.260+0000 7fe90d2bb640 1 --2- 172.21.15.96:0/139544049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908110070 0x7fe9081a86c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c480 tx=0x7fe8f800c940 comp rx=0 tx=0).stop 2024-09-14T10:43:39.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.260+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 shutdown_connections 2024-09-14T10:43:39.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.260+0000 7fe90d2bb640 1 --2- 172.21.15.96:0/139544049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe908110070 0x7fe9081a86c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.260+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 >> 172.21.15.96:0/139544049 conn(0x7fe9080707f0 msgr2=0x7fe908073410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:39.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.260+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 shutdown_connections 2024-09-14T10:43:39.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.260+0000 7fe90d2bb640 1 -- 172.21.15.96:0/139544049 wait complete. 2024-09-14T10:43:39.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 0f744f58-2cfb-4f8b-81a8-0891b56da9bf 3 2024-09-14T10:43:39.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedaff47640 1 Processor -- start 2024-09-14T10:43:39.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedaff47640 1 -- start start 2024-09-14T10:43:39.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedaff47640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feda8118780 0x7feda811ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:39.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedaff47640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda811b140 con 0x7feda81137f0 2024-09-14T10:43:39.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedaff47640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7feda811c320 con 0x7feda8118780 2024-09-14T10:43:39.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedad4e2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feda8118780 0x7feda811ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:39.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedadce3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7feda81137f0 0x7feda8113bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:54442/0 (socket says 172.21.15.96:54442) 2024-09-14T10:43:39.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedadce3640 1 -- 172.21.15.96:0/4089969586 learned_addr learned my addr 172.21.15.96:0/4089969586 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:43:39.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedad4e2640 1 -- 172.21.15.96:0/4089969586 >> v1:172.21.15.70:6789/0 conn(0x7feda81137f0 legacy=0x7feda8113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.384+0000 7fedad4e2640 1 -- 172.21.15.96:0/4089969586 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda811c4a0 con 0x7feda8118780 2024-09-14T10:43:39.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedad4e2640 1 --2- 172.21.15.96:0/4089969586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda8118780 0x7feda811ab70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fed98009740 tx=0x7fed9801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d84362f4ff3b0d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:39.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedacce1640 1 -- 172.21.15.96:0/4089969586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed980b1070 con 0x7feda8118780 2024-09-14T10:43:39.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedacce1640 1 -- 172.21.15.96:0/4089969586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed980ac520 con 0x7feda8118780 2024-09-14T10:43:39.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedacce1640 1 -- 172.21.15.96:0/4089969586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed980ac820 con 0x7feda8118780 2024-09-14T10:43:39.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedaff47640 1 -- 172.21.15.96:0/4089969586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda8118780 msgr2=0x7feda811ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedaff47640 1 --2- 172.21.15.96:0/4089969586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda8118780 0x7feda811ab70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fed98009740 tx=0x7fed9801c370 comp rx=0 tx=0).stop 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedaff47640 1 -- 172.21.15.96:0/4089969586 shutdown_connections 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedaff47640 1 --2- 172.21.15.96:0/4089969586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda8118780 0x7feda811ab70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedaff47640 1 -- 172.21.15.96:0/4089969586 >> 172.21.15.96:0/4089969586 conn(0x7feda8070e30 msgr2=0x7feda8073250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedaff47640 1 -- 172.21.15.96:0/4089969586 shutdown_connections 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.388+0000 7fedaff47640 1 -- 172.21.15.96:0/4089969586 wait complete. 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedaff47640 1 Processor -- start 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedaff47640 1 -- start start 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedaff47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda81137f0 0x7feda81a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedaff47640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feda811bfd0 con 0x7feda81137f0 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedadce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda81137f0 0x7feda81a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedadce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda81137f0 0x7feda81a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36732/0 (socket says 172.21.15.96:36732) 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedadce3640 1 -- 172.21.15.96:0/3667325490 learned_addr learned my addr 172.21.15.96:0/3667325490 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:43:39.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedadce3640 1 -- 172.21.15.96:0/3667325490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda81a62c0 con 0x7feda81137f0 2024-09-14T10:43:39.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedadce3640 1 --2- 172.21.15.96:0/3667325490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda81137f0 0x7feda81a5cf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feda400c480 tx=0x7feda400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fed9e7fc640 1 -- 172.21.15.96:0/3667325490 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda4017070 con 0x7feda81137f0 2024-09-14T10:43:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda81a65b0 con 0x7feda81137f0 2024-09-14T10:43:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda81ab700 con 0x7feda81137f0 2024-09-14T10:43:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fed9e7fc640 1 -- 172.21.15.96:0/3667325490 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda4005c20 con 0x7feda81137f0 2024-09-14T10:43:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fed9e7fc640 1 -- 172.21.15.96:0/3667325490 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda40070d0 con 0x7feda81137f0 2024-09-14T10:43:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fed9e7fc640 1 -- 172.21.15.96:0/3667325490 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feda401a070 con 0x7feda81137f0 2024-09-14T10:43:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fed9e7fc640 1 -- 172.21.15.96:0/3667325490 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7feda401cc00 con 0x7feda81137f0 2024-09-14T10:43:39.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.392+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed90005090 con 0x7feda81137f0 2024-09-14T10:43:39.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.400+0000 7fed9e7fc640 1 -- 172.21.15.96:0/3667325490 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7feda401c440 con 0x7feda81137f0 2024-09-14T10:43:39.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.464+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0f744f58-2cfb-4f8b-81a8-0891b56da9bf", "id": 3} v 0) -- 0x7fed90005380 con 0x7feda81137f0 2024-09-14T10:43:39.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.468+0000 7fed9e7fc640 1 -- 172.21.15.96:0/3667325490 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f744f58-2cfb-4f8b-81a8-0891b56da9bf", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7feda401c660 con 0x7feda81137f0 2024-09-14T10:43:39.465 INFO:teuthology.orchestra.run.smithi096.stdout:3 2024-09-14T10:43:39.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.468+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda81137f0 msgr2=0x7feda81a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.468+0000 7fedaff47640 1 --2- 172.21.15.96:0/3667325490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda81137f0 0x7feda81a5cf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feda400c480 tx=0x7feda400c940 comp rx=0 tx=0).stop 2024-09-14T10:43:39.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.468+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 shutdown_connections 2024-09-14T10:43:39.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.468+0000 7fedaff47640 1 --2- 172.21.15.96:0/3667325490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feda81137f0 0x7feda81a5cf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.468+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 >> 172.21.15.96:0/3667325490 conn(0x7feda8070e30 msgr2=0x7feda81150a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:39.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.468+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 shutdown_connections 2024-09-14T10:43:39.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:43:39.468+0000 7fedaff47640 1 -- 172.21.15.96:0/3667325490 wait complete. 2024-09-14T10:43:39.482 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T10:43:39.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T10:43:39.484 INFO:tasks.ceph.osd.0:Started 2024-09-14T10:43:39.484 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T10:43:39.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T10:43:39.486 INFO:tasks.ceph.osd.1:Started 2024-09-14T10:43:39.486 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T10:43:39.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T10:43:39.488 INFO:tasks.ceph.osd.2:Started 2024-09-14T10:43:39.488 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T10:43:39.488 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T10:43:39.491 INFO:tasks.ceph.osd.3:Started 2024-09-14T10:43:39.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2dad7b8640 1 Processor -- start 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2dad7b8640 1 -- start start 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2dad7b8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2da806e630 0x7f2da806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2dad7b8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2da806f580 con 0x7f2da806ef50 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2dad7b8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2da806fb40 con 0x7f2da806e630 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2da6ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2da806e630 0x7f2da806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:39.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2da67fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2da806ef50 0x7f2da812f4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:59182/0 (socket says 172.21.15.70:59182) 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2da6ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2da806e630 0x7f2da806ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47872/0 (socket says 172.21.15.70:47872) 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2da67fc640 1 -- 172.21.15.70:0/2559937541 learned_addr learned my addr 172.21.15.70:0/2559937541 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2da6ffd640 1 -- 172.21.15.70:0/2559937541 >> v1:172.21.15.70:6789/0 conn(0x7f2da806ef50 legacy=0x7f2da812f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2da6ffd640 1 -- 172.21.15.70:0/2559937541 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da8070190 con 0x7f2da806e630 2024-09-14T10:43:39.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.609+0000 7f2da5ffb640 1 -- 172.21.15.70:0/2559937541 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105255198 0 0) 0x7f2da806f580 con 0x7f2da806ef50 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da6ffd640 1 --2- 172.21.15.70:0/2559937541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da806ea10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009740 tx=0x7f2d9801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd984dd2dddcdb5f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da5ffb640 1 -- 172.21.15.70:0/2559937541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d980b0070 con 0x7f2da806e630 2024-09-14T10:43:39.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da5ffb640 1 -- 172.21.15.70:0/2559937541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d980ab530 con 0x7f2da806e630 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da5ffb640 1 -- 172.21.15.70:0/2559937541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d980ab830 con 0x7f2da806e630 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2559937541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 msgr2=0x7f2da806ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 --2- 172.21.15.70:0/2559937541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da806ea10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009740 tx=0x7f2d9801c370 comp rx=0 tx=0).stop 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2559937541 shutdown_connections 2024-09-14T10:43:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 --2- 172.21.15.70:0/2559937541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da806ea10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2559937541 >> 172.21.15.70:0/2559937541 conn(0x7f2da809c9a0 msgr2=0x7f2da809cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2559937541 shutdown_connections 2024-09-14T10:43:39.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2559937541 wait complete. 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 Processor -- start 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- start start 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da8130590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8138380 con 0x7f2da806e630 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da8130590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da8130590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47880/0 (socket says 172.21.15.70:47880) 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da6ffd640 1 -- 172.21.15.70:0/2479930314 learned_addr learned my addr 172.21.15.70:0/2479930314 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da6ffd640 1 -- 172.21.15.70:0/2479930314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da8073530 con 0x7f2da806e630 2024-09-14T10:43:39.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2da6ffd640 1 --2- 172.21.15.70:0/2479930314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da8130590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2d98019fa0 tx=0x7f2d9801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2d8f7fe640 1 -- 172.21.15.70:0/2479930314 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d980bb070 con 0x7f2da806e630 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2d8f7fe640 1 -- 172.21.15.70:0/2479930314 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d98004020 con 0x7f2da806e630 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da81317e0 con 0x7f2da806e630 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2d8f7fe640 1 -- 172.21.15.70:0/2479930314 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d980b0040 con 0x7f2da806e630 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da8132910 con 0x7f2da806e630 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2d8f7fe640 1 -- 172.21.15.70:0/2479930314 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d980aa6d0 con 0x7f2da806e630 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.613+0000 7f2d8f7fe640 1 -- 172.21.15.70:0/2479930314 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2d980b6470 con 0x7f2da806e630 2024-09-14T10:43:39.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.617+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da8132c00 con 0x7f2da806e630 2024-09-14T10:43:39.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.617+0000 7f2d8f7fe640 1 -- 172.21.15.70:0/2479930314 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2da8132c00 con 0x7f2da806e630 2024-09-14T10:43:39.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.677+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2da806ea10 con 0x7f2da806e630 2024-09-14T10:43:39.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.677+0000 7f2d8f7fe640 1 -- 172.21.15.70:0/2479930314 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f2d98015ff0 con 0x7f2da806e630 2024-09-14T10:43:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:39.680 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"fsid":"2e314bd0-9070-44fa-a8ec-a9266c5de294","created":"2024-09-14T10:43:38.317946+0000","modified":"2024-09-14T10:43:39.469314+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:43:39.469314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"94e00249-58b2-4247-a635-db467796e81e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26e1a964-ad73-4f8f-9ab6-0c4c442429a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"47f610b0-6d57-4262-a3a3-dc8f095700b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0f744f58-2cfb-4f8b-81a8-0891b56da9bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:43:39.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.681+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 msgr2=0x7f2da8130590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:39.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.681+0000 7f2dad7b8640 1 --2- 172.21.15.70:0/2479930314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da8130590 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2d98019fa0 tx=0x7f2d9801abb0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.681+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 shutdown_connections 2024-09-14T10:43:39.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.681+0000 7f2dad7b8640 1 --2- 172.21.15.70:0/2479930314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da806e630 0x7f2da8130590 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:39.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.681+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 >> 172.21.15.70:0/2479930314 conn(0x7f2da809c9a0 msgr2=0x7f2da80a10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:39.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.681+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 shutdown_connections 2024-09-14T10:43:39.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:39.681+0000 7f2dad7b8640 1 -- 172.21.15.70:0/2479930314 wait complete. 2024-09-14T10:43:39.697 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T10:43:39.697 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T10:43:40.100 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:43:40.225 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8fb8b1640 1 Processor -- start 2024-09-14T10:43:40.226 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8fb8b1640 1 -- start start 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8fb8b1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc8f412c7e0 0x7fc8f412cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8fb8b1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f4071f30 con 0x7fc8f4128d90 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8fb8b1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f412c5c0 con 0x7fc8f412c7e0 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8f8e4c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc8f4128d90 0x7fc8f4129240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:59192/0 (socket says 172.21.15.70:59192) 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8f8e4c640 1 -- 172.21.15.70:0/119265869 learned_addr learned my addr 172.21.15.70:0/119265869 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8f964d640 1 --2- 172.21.15.70:0/119265869 >> v2:172.21.15.70:3300/0 conn(0x7fc8f412c7e0 0x7fc8f412cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8ebfff640 1 -- 172.21.15.70:0/119265869 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724171776 0 0) 0x7fc8f4071f30 con 0x7fc8f4128d90 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8ebfff640 1 -- 172.21.15.70:0/119265869 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8e0005740 con 0x7fc8f4128d90 2024-09-14T10:43:40.227 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8f964d640 1 -- 172.21.15.70:0/119265869 >> v1:172.21.15.70:6789/0 conn(0x7fc8f4128d90 legacy=0x7fc8f4129240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:40.228 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.225+0000 7fc8f964d640 1 -- 172.21.15.70:0/119265869 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f412c2b0 con 0x7fc8f412c7e0 2024-09-14T10:43:40.229 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8f964d640 1 --2- 172.21.15.70:0/119265869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f412c7e0 0x7fc8f412cbc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009d90 tx=0x7fc8f001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f4919c3d37431e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:40.229 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8ebfff640 1 -- 172.21.15.70:0/119265869 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f00a6540 con 0x7fc8f412c7e0 2024-09-14T10:43:40.229 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8ebfff640 1 -- 172.21.15.70:0/119265869 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f00a66e0 con 0x7fc8f412c7e0 2024-09-14T10:43:40.229 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8ebfff640 1 -- 172.21.15.70:0/119265869 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f00a69e0 con 0x7fc8f412c7e0 2024-09-14T10:43:40.230 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/119265869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f412c7e0 msgr2=0x7fc8f412cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:40.230 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 --2- 172.21.15.70:0/119265869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f412c7e0 0x7fc8f412cbc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009d90 tx=0x7fc8f001c8c0 comp rx=0 tx=0).stop 2024-09-14T10:43:40.230 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/119265869 shutdown_connections 2024-09-14T10:43:40.230 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 --2- 172.21.15.70:0/119265869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f412c7e0 0x7fc8f412cbc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:40.230 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/119265869 >> 172.21.15.70:0/119265869 conn(0x7fc8f409b8f0 msgr2=0x7fc8f409bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:40.230 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/119265869 shutdown_connections 2024-09-14T10:43:40.231 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/119265869 wait complete. 2024-09-14T10:43:40.231 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 Processor -- start 2024-09-14T10:43:40.232 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 -- start start 2024-09-14T10:43:40.232 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f4128d90 0x7fc8f412d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:40.232 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8fb8b1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f406f4b0 con 0x7fc8f4128d90 2024-09-14T10:43:40.232 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8f964d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f4128d90 0x7fc8f412d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:40.232 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8f964d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f4128d90 0x7fc8f412d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47906/0 (socket says 172.21.15.70:47906) 2024-09-14T10:43:40.232 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8f964d640 1 -- 172.21.15.70:0/1705405063 learned_addr learned my addr 172.21.15.70:0/1705405063 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:40.232 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.229+0000 7fc8f964d640 1 -- 172.21.15.70:0/1705405063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f412e8d0 con 0x7fc8f4128d90 2024-09-14T10:43:40.233 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8f964d640 1 --2- 172.21.15.70:0/1705405063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f4128d90 0x7fc8f412d570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00194d0 tx=0x7fc8f0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:40.233 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8e9ffb640 1 -- 172.21.15.70:0/1705405063 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f00b0400 con 0x7fc8f4128d90 2024-09-14T10:43:40.233 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8e9ffb640 1 -- 172.21.15.70:0/1705405063 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f00b05a0 con 0x7fc8f4128d90 2024-09-14T10:43:40.234 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f4126ad0 con 0x7fc8f4128d90 2024-09-14T10:43:40.234 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8e9ffb640 1 -- 172.21.15.70:0/1705405063 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f00b08e0 con 0x7fc8f4128d90 2024-09-14T10:43:40.234 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f412fc20 con 0x7fc8f4128d90 2024-09-14T10:43:40.234 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8e9ffb640 1 -- 172.21.15.70:0/1705405063 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc8f00c1030 con 0x7fc8f4128d90 2024-09-14T10:43:40.234 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8e9ffb640 1 -- 172.21.15.70:0/1705405063 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc8f00bf070 con 0x7fc8f4128d90 2024-09-14T10:43:40.234 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f406f9f0 con 0x7fc8f4128d90 2024-09-14T10:43:40.235 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.233+0000 7fc8e9ffb640 1 -- 172.21.15.70:0/1705405063 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc8f00c8060 con 0x7fc8f4128d90 2024-09-14T10:43:40.295 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.293+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8f412f4b0 con 0x7fc8f4128d90 2024-09-14T10:43:40.295 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.293+0000 7fc8e9ffb640 1 -- 172.21.15.70:0/1705405063 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fc8f00b7070 con 0x7fc8f4128d90 2024-09-14T10:43:40.296 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-14T10:43:40.296 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":6,"fsid":"2e314bd0-9070-44fa-a8ec-a9266c5de294","created":"2024-09-14T10:43:38.317946+0000","modified":"2024-09-14T10:43:39.469314+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:43:39.469314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"94e00249-58b2-4247-a635-db467796e81e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26e1a964-ad73-4f8f-9ab6-0c4c442429a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"47f610b0-6d57-4262-a3a3-dc8f095700b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0f744f58-2cfb-4f8b-81a8-0891b56da9bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:43:40.296 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.297+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f4128d90 msgr2=0x7fc8f412d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:40.297 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.297+0000 7fc8fb8b1640 1 --2- 172.21.15.70:0/1705405063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f4128d90 0x7fc8f412d570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00194d0 tx=0x7fc8f0019660 comp rx=0 tx=0).stop 2024-09-14T10:43:40.297 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.297+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 shutdown_connections 2024-09-14T10:43:40.297 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.297+0000 7fc8fb8b1640 1 --2- 172.21.15.70:0/1705405063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8f4128d90 0x7fc8f412d570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:40.297 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.297+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 >> 172.21.15.70:0/1705405063 conn(0x7fc8f409b8f0 msgr2=0x7fc8f4098c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:40.297 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.297+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 shutdown_connections 2024-09-14T10:43:40.297 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:40.297+0000 7fc8fb8b1640 1 -- 172.21.15.70:0/1705405063 wait complete. 2024-09-14T10:43:40.312 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-14T10:43:40.570 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-14T10:43:40.569+0000 7f6c0dc547c0 -1 Falling back to public interface 2024-09-14T10:43:40.862 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-09-14T10:43:40.864+0000 7fe3376a67c0 -1 Falling back to public interface 2024-09-14T10:43:41.126 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-09-14T10:43:41.128+0000 7f00c25197c0 -1 Falling back to public interface 2024-09-14T10:43:41.356 INFO:tasks.ceph.mgr.x.smithi096.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T10:43:41.356 INFO:tasks.ceph.mgr.x.smithi096.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T10:43:41.356 INFO:tasks.ceph.mgr.x.smithi096.stderr: from numpy import show_config as show_numpy_config 2024-09-14T10:43:41.362 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-09-14T10:43:41.364+0000 7f78c10087c0 -1 Falling back to public interface 2024-09-14T10:43:44.339 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-14T10:43:44.340+0000 7fd4035a8640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-14T10:43:44.466 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-14T10:43:44.465+0000 7f6c0dc547c0 -1 osd.0 0 log_to_monitors true 2024-09-14T10:43:44.879 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-09-14T10:43:44.880+0000 7fe3376a67c0 -1 osd.3 0 log_to_monitors true 2024-09-14T10:43:45.083 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-09-14T10:43:45.084+0000 7f00c25197c0 -1 osd.1 0 log_to_monitors true 2024-09-14T10:43:45.666 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-09-14T10:43:45.668+0000 7f78c10087c0 -1 osd.2 0 log_to_monitors true 2024-09-14T10:43:46.716 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:43:46.846 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77f26f0640 1 Processor -- start 2024-09-14T10:43:46.846 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77f26f0640 1 -- start start 2024-09-14T10:43:46.847 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77f26f0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f77ec12fa70 0x7f77ec12fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:46.847 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77f26f0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ec12f590 con 0x7f77ec06e550 2024-09-14T10:43:46.848 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77f26f0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f77ec070ef0 con 0x7f77ec12fa70 2024-09-14T10:43:46.848 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77ebfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f77ec12fa70 0x7f77ec12fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:46.848 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77eb7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f77ec06e550 0x7f77ec06e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49216/0 (socket says 172.21.15.70:49216) 2024-09-14T10:43:46.848 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77ebfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f77ec12fa70 0x7f77ec12fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58378/0 (socket says 172.21.15.70:58378) 2024-09-14T10:43:46.848 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77eb7fe640 1 -- 172.21.15.70:0/2655358000 learned_addr learned my addr 172.21.15.70:0/2655358000 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:46.848 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77ebfff640 1 -- 172.21.15.70:0/2655358000 >> v1:172.21.15.70:6789/0 conn(0x7f77ec06e550 legacy=0x7f77ec06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:46.848 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.845+0000 7f77ebfff640 1 -- 172.21.15.70:0/2655358000 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec070b20 con 0x7f77ec12fa70 2024-09-14T10:43:46.851 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77ebfff640 1 --2- 172.21.15.70:0/2655358000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec12fa70 0x7f77ec12fe50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009740 tx=0x7f77dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75bf2846db05f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:46.851 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77eaffd640 1 -- 172.21.15.70:0/2655358000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77dc0b0070 con 0x7f77ec12fa70 2024-09-14T10:43:46.851 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77eaffd640 1 -- 172.21.15.70:0/2655358000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc0ab530 con 0x7f77ec12fa70 2024-09-14T10:43:46.851 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77eaffd640 1 -- 172.21.15.70:0/2655358000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77dc0ab830 con 0x7f77ec12fa70 2024-09-14T10:43:46.852 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77f26f0640 1 -- 172.21.15.70:0/2655358000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec12fa70 msgr2=0x7f77ec12fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:46.852 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77f26f0640 1 --2- 172.21.15.70:0/2655358000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec12fa70 0x7f77ec12fe50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009740 tx=0x7f77dc01c370 comp rx=0 tx=0).stop 2024-09-14T10:43:46.852 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77f26f0640 1 -- 172.21.15.70:0/2655358000 shutdown_connections 2024-09-14T10:43:46.853 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77f26f0640 1 --2- 172.21.15.70:0/2655358000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec12fa70 0x7f77ec12fe50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:46.853 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77f26f0640 1 -- 172.21.15.70:0/2655358000 >> 172.21.15.70:0/2655358000 conn(0x7f77ec0a1fd0 msgr2=0x7f77ec0a23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:46.853 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77f26f0640 1 -- 172.21.15.70:0/2655358000 shutdown_connections 2024-09-14T10:43:46.853 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.849+0000 7f77f26f0640 1 -- 172.21.15.70:0/2655358000 wait complete. 2024-09-14T10:43:46.853 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77f26f0640 1 Processor -- start 2024-09-14T10:43:46.853 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77f26f0640 1 -- start start 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77f26f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec06e550 0x7f77ec12b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77f26f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec06f8f0 con 0x7f77ec06e550 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec06e550 0x7f77ec12b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec06e550 0x7f77ec12b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58382/0 (socket says 172.21.15.70:58382) 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77ebfff640 1 -- 172.21.15.70:0/1716009541 learned_addr learned my addr 172.21.15.70:0/1716009541 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77ebfff640 1 -- 172.21.15.70:0/1716009541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec12a420 con 0x7f77ec06e550 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77ebfff640 1 --2- 172.21.15.70:0/1716009541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec06e550 0x7f77ec12b9c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0ae040 tx=0x7f77dc019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77e8ff9640 1 -- 172.21.15.70:0/1716009541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77dc0b8020 con 0x7f77ec06e550 2024-09-14T10:43:46.855 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77e8ff9640 1 -- 172.21.15.70:0/1716009541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77dc0b4600 con 0x7f77ec06e550 2024-09-14T10:43:46.856 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec12bf00 con 0x7f77ec06e550 2024-09-14T10:43:46.856 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77e8ff9640 1 -- 172.21.15.70:0/1716009541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77dc0b0040 con 0x7f77ec06e550 2024-09-14T10:43:46.856 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec12c360 con 0x7f77ec06e550 2024-09-14T10:43:46.856 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec1291f0 con 0x7f77ec06e550 2024-09-14T10:43:46.856 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77e8ff9640 1 -- 172.21.15.70:0/1716009541 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 48811+0+0 (secure 0 0 0) 0x7f77dc0bb020 con 0x7f77ec06e550 2024-09-14T10:43:46.857 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77e8ff9640 1 --2- 172.21.15.70:0/1716009541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f77d803b820 0x7f77d803dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:46.857 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.853+0000 7f77e8ff9640 1 -- 172.21.15.70:0/1716009541 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1607+0+0 (secure 0 0 0) 0x7f77dc0a4e00 con 0x7f77ec06e550 2024-09-14T10:43:46.857 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.857+0000 7f77eb7fe640 1 --2- 172.21.15.70:0/1716009541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f77d803b820 0x7f77d803dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:46.857 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.857+0000 7f77eb7fe640 1 --2- 172.21.15.70:0/1716009541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f77d803b820 0x7f77d803dce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77e0005890 tx=0x7f77e0007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:46.860 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:46.861+0000 7f77e8ff9640 1 -- 172.21.15.70:0/1716009541 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f77dc0c2030 con 0x7f77ec06e550 2024-09-14T10:43:47.069 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.069+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77ec12b530 con 0x7f77ec06e550 2024-09-14T10:43:47.069 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.069+0000 7f77e8ff9640 1 -- 172.21.15.70:0/1716009541 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f77dc015ff0 con 0x7f77ec06e550 2024-09-14T10:43:47.069 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-14T10:43:47.069 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":8,"fsid":"2e314bd0-9070-44fa-a8ec-a9266c5de294","created":"2024-09-14T10:43:38.317946+0000","modified":"2024-09-14T10:43:46.393433+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:43:39.469314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"94e00249-58b2-4247-a635-db467796e81e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26e1a964-ad73-4f8f-9ab6-0c4c442429a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"47f610b0-6d57-4262-a3a3-dc8f095700b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0f744f58-2cfb-4f8b-81a8-0891b56da9bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:43:47.073 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f77d803b820 msgr2=0x7f77d803dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:47.073 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 --2- 172.21.15.70:0/1716009541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f77d803b820 0x7f77d803dce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77e0005890 tx=0x7f77e0007ab0 comp rx=0 tx=0).stop 2024-09-14T10:43:47.073 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec06e550 msgr2=0x7f77ec12b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:47.073 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 --2- 172.21.15.70:0/1716009541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec06e550 0x7f77ec12b9c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0ae040 tx=0x7f77dc019110 comp rx=0 tx=0).stop 2024-09-14T10:43:47.074 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 shutdown_connections 2024-09-14T10:43:47.074 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 --2- 172.21.15.70:0/1716009541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f77d803b820 0x7f77d803dce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:47.074 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 --2- 172.21.15.70:0/1716009541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77ec06e550 0x7f77ec12b9c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:47.074 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 >> 172.21.15.70:0/1716009541 conn(0x7f77ec0a1fd0 msgr2=0x7f77ec09e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:47.074 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 shutdown_connections 2024-09-14T10:43:47.074 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:47.073+0000 7f77f26f0640 1 -- 172.21.15.70:0/1716009541 wait complete. 2024-09-14T10:43:47.089 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-14T10:43:47.286 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-14T10:43:47.285+0000 7f6c0a40f640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T10:43:47.308 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-14T10:43:47.309+0000 7f6c01a2f640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:43:47.733 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-09-14T10:43:47.736+0000 7fe33364f640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T10:43:47.761 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-09-14T10:43:47.764+0000 7fe32b481640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:43:47.818 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-09-14T10:43:47.820+0000 7f00becd4640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T10:43:47.850 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-09-14T10:43:47.852+0000 7f00b62f4640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:43:48.408 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-09-14T10:43:48.408+0000 7f78bd7c3640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T10:43:48.445 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-09-14T10:43:48.448+0000 7f78b4de3640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:43:53.493 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:43:53.615 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.613+0000 7f9e1d9d7640 1 Processor -- start 2024-09-14T10:43:53.616 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.613+0000 7f9e1d9d7640 1 -- start start 2024-09-14T10:43:53.616 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e1d9d7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e1812d470 0x7f9e1812d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:53.617 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e1d9d7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e18073430 con 0x7f9e1812ded0 2024-09-14T10:43:53.617 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e1d9d7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f9e1812e360 con 0x7f9e1812d470 2024-09-14T10:43:53.617 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e16ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e1812d470 0x7f9e1812d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:53.617 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e16ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e1812d470 0x7f9e1812d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58392/0 (socket says 172.21.15.70:58392) 2024-09-14T10:43:53.617 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e16ffd640 1 -- 172.21.15.70:0/736649519 learned_addr learned my addr 172.21.15.70:0/736649519 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:53.617 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e16ffd640 1 -- 172.21.15.70:0/736649519 >> v1:172.21.15.70:6789/0 conn(0x7f9e1812ded0 legacy=0x7f9e18129ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:53.617 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e16ffd640 1 -- 172.21.15.70:0/736649519 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1809d7f0 con 0x7f9e1812d470 2024-09-14T10:43:53.619 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/736649519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e1812d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009e50 tx=0x7f9e1001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c895c3fa1e96f281 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:53.619 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e15ffb640 1 -- 172.21.15.70:0/736649519 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e10009200 con 0x7f9e1812d470 2024-09-14T10:43:53.619 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e15ffb640 1 -- 172.21.15.70:0/736649519 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e100a5700 con 0x7f9e1812d470 2024-09-14T10:43:53.619 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e15ffb640 1 -- 172.21.15.70:0/736649519 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e100a5a00 con 0x7f9e1812d470 2024-09-14T10:43:53.620 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/736649519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 msgr2=0x7f9e1812d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:53.620 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e1d9d7640 1 --2- 172.21.15.70:0/736649519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e1812d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009e50 tx=0x7f9e1001c980 comp rx=0 tx=0).stop 2024-09-14T10:43:53.620 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/736649519 shutdown_connections 2024-09-14T10:43:53.620 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e1d9d7640 1 --2- 172.21.15.70:0/736649519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e1812d990 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:53.620 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.617+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/736649519 >> 172.21.15.70:0/736649519 conn(0x7f9e1809b8f0 msgr2=0x7f9e1809bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:53.620 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/736649519 shutdown_connections 2024-09-14T10:43:53.620 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/736649519 wait complete. 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 Processor -- start 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 -- start start 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e181c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e18135ba0 con 0x7f9e1812d470 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e181c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e181c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58408/0 (socket says 172.21.15.70:58408) 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e16ffd640 1 -- 172.21.15.70:0/796253957 learned_addr learned my addr 172.21.15.70:0/796253957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e16ffd640 1 -- 172.21.15.70:0/796253957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e18125d70 con 0x7f9e1812d470 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/796253957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e181c4e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e1001a5b0 tx=0x7f9e10019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e0ffff640 1 -- 172.21.15.70:0/796253957 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e100bc020 con 0x7f9e1812d470 2024-09-14T10:43:53.622 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e0ffff640 1 -- 172.21.15.70:0/796253957 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e100b8470 con 0x7f9e1812d470 2024-09-14T10:43:53.623 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e181243c0 con 0x7f9e1812d470 2024-09-14T10:43:53.623 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e0ffff640 1 -- 172.21.15.70:0/796253957 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e100b8750 con 0x7f9e1812d470 2024-09-14T10:43:53.623 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e181260a0 con 0x7f9e1812d470 2024-09-14T10:43:53.623 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e1812d990 con 0x7f9e1812d470 2024-09-14T10:43:53.624 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e0ffff640 1 -- 172.21.15.70:0/796253957 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9e100bf020 con 0x7f9e1812d470 2024-09-14T10:43:53.624 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e0ffff640 1 --2- 172.21.15.70:0/796253957 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9df803b8b0 0x7f9df803dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:53.624 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e0ffff640 1 -- 172.21.15.70:0/796253957 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f9e100ea5e0 con 0x7f9e1812d470 2024-09-14T10:43:53.624 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.621+0000 7f9e167fc640 1 --2- 172.21.15.70:0/796253957 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9df803b8b0 0x7f9df803dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:53.624 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.625+0000 7f9e167fc640 1 --2- 172.21.15.70:0/796253957 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9df803b8b0 0x7f9df803dd70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e00000f70 tx=0x7f9e00007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:53.628 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.629+0000 7f9e0ffff640 1 -- 172.21.15.70:0/796253957 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f9e100c6030 con 0x7f9e1812d470 2024-09-14T10:43:53.799 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.797+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e181273f0 con 0x7f9e1812d470 2024-09-14T10:43:53.800 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e0ffff640 1 -- 172.21.15.70:0/796253957 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7978 (secure 0 0 0) 0x7f9e10016600 con 0x7f9e1812d470 2024-09-14T10:43:53.801 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-14T10:43:53.801 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":13,"fsid":"2e314bd0-9070-44fa-a8ec-a9266c5de294","created":"2024-09-14T10:43:38.317946+0000","modified":"2024-09-14T10:43:51.423186+0000","last_up_change":"2024-09-14T10:43:49.418142+0000","last_in_change":"2024-09-14T10:43:39.469314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:43:49.381445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e00249-58b2-4247-a635-db467796e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6801","nonce":3481052616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6803","nonce":3481052616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6807","nonce":3481052616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6805","nonce":3481052616}]},"public_addr":"172.21.15.70:6801/3481052616","cluster_addr":"172.21.15.70:6803/3481052616","heartbeat_back_addr":"172.21.15.70:6807/3481052616","heartbeat_front_addr":"172.21.15.70:6805/3481052616","state":["exists","up"]},{"osd":1,"uuid":"26e1a964-ad73-4f8f-9ab6-0c4c442429a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6809","nonce":2339799699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6811","nonce":2339799699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6815","nonce":2339799699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6813","nonce":2339799699}]},"public_addr":"172.21.15.96:6809/2339799699","cluster_addr":"172.21.15.96:6811/2339799699","heartbeat_back_addr":"172.21.15.96:6815/2339799699","heartbeat_front_addr":"172.21.15.96:6813/2339799699","state":["exists","up"]},{"osd":2,"uuid":"47f610b0-6d57-4262-a3a3-dc8f095700b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6817","nonce":2312202642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6819","nonce":2312202642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6823","nonce":2312202642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6821","nonce":2312202642}]},"public_addr":"172.21.15.96:6817/2312202642","cluster_addr":"172.21.15.96:6819/2312202642","heartbeat_back_addr":"172.21.15.96:6823/2312202642","heartbeat_front_addr":"172.21.15.96:6821/2312202642","state":["exists","up"]},{"osd":3,"uuid":"0f744f58-2cfb-4f8b-81a8-0891b56da9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6801","nonce":3683402699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6803","nonce":3683402699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6807","nonce":3683402699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6805","nonce":3683402699}]},"public_addr":"172.21.15.96:6801/3683402699","cluster_addr":"172.21.15.96:6803/3683402699","heartbeat_back_addr":"172.21.15.96:6807/3683402699","heartbeat_front_addr":"172.21.15.96:6805/3683402699","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:45.474926+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:46.131113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:46.635517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:45.852608+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9df803b8b0 msgr2=0x7f9df803dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 --2- 172.21.15.70:0/796253957 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9df803b8b0 0x7f9df803dd70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e00000f70 tx=0x7f9e00007a40 comp rx=0 tx=0).stop 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 msgr2=0x7f9e181c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 --2- 172.21.15.70:0/796253957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e181c4e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e1001a5b0 tx=0x7f9e10019720 comp rx=0 tx=0).stop 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 shutdown_connections 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 --2- 172.21.15.70:0/796253957 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9df803b8b0 0x7f9df803dd70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 --2- 172.21.15.70:0/796253957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e1812d470 0x7f9e181c4e70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 >> 172.21.15.70:0/796253957 conn(0x7f9e1809b8f0 msgr2=0x7f9e1812b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 shutdown_connections 2024-09-14T10:43:53.803 INFO:teuthology.misc.health.smithi070.stderr:2024-09-14T10:43:53.801+0000 7f9e1d9d7640 1 -- 172.21.15.70:0/796253957 wait complete. 2024-09-14T10:43:53.818 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-14T10:43:53.819 INFO:tasks.ceph:Creating RBD pool 2024-09-14T10:43:53.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.941+0000 7f0ae0ca5640 1 Processor -- start 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ae0ca5640 1 -- start start 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ae0ca5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0adc06eb50 0x7f0adc138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ae0ca5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0adc09a330 con 0x7f0adc06e060 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ae0ca5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0adc099b10 con 0x7f0adc06eb50 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ad9d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0adc06eb50 0x7f0adc138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ada59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f0adc06e060 0x7f0adc06e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49224/0 (socket says 172.21.15.70:49224) 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ad9d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0adc06eb50 0x7f0adc138ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58420/0 (socket says 172.21.15.70:58420) 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ada59c640 1 -- 172.21.15.70:0/4119155800 learned_addr learned my addr 172.21.15.70:0/4119155800 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ad9d9b640 1 -- 172.21.15.70:0/4119155800 >> v1:172.21.15.70:6789/0 conn(0x7f0adc06e060 legacy=0x7f0adc06e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:53.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ad959a640 1 -- 172.21.15.70:0/4119155800 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293876800 0 0) 0x7f0adc09a330 con 0x7f0adc06e060 2024-09-14T10:43:53.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ad9d9b640 1 -- 172.21.15.70:0/4119155800 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc06f390 con 0x7f0adc06eb50 2024-09-14T10:43:53.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ad9d9b640 1 --2- 172.21.15.70:0/4119155800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06eb50 0x7f0adc138ca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009740 tx=0x7f0ad001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0a4532da64e113 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:53.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.945+0000 7f0ad959a640 1 -- 172.21.15.70:0/4119155800 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad00b0070 con 0x7f0adc06eb50 2024-09-14T10:43:53.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ad959a640 1 -- 172.21.15.70:0/4119155800 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad00ab530 con 0x7f0adc06eb50 2024-09-14T10:43:53.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ad959a640 1 -- 172.21.15.70:0/4119155800 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad00ab830 con 0x7f0adc06eb50 2024-09-14T10:43:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/4119155800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06eb50 msgr2=0x7f0adc138ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 --2- 172.21.15.70:0/4119155800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06eb50 0x7f0adc138ca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009740 tx=0x7f0ad001c370 comp rx=0 tx=0).stop 2024-09-14T10:43:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/4119155800 shutdown_connections 2024-09-14T10:43:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 --2- 172.21.15.70:0/4119155800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06eb50 0x7f0adc138ca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/4119155800 >> 172.21.15.70:0/4119155800 conn(0x7f0adc09a970 msgr2=0x7f0adc09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/4119155800 shutdown_connections 2024-09-14T10:43:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/4119155800 wait complete. 2024-09-14T10:43:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 Processor -- start 2024-09-14T10:43:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- start start 2024-09-14T10:43:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06e060 0x7f0adc12c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0adc13bb80 con 0x7f0adc06e060 2024-09-14T10:43:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ada59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06e060 0x7f0adc12c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ada59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06e060 0x7f0adc12c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58430/0 (socket says 172.21.15.70:58430) 2024-09-14T10:43:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ada59c640 1 -- 172.21.15.70:0/2927612882 learned_addr learned my addr 172.21.15.70:0/2927612882 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:53.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ada59c640 1 -- 172.21.15.70:0/2927612882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0adc12e170 con 0x7f0adc06e060 2024-09-14T10:43:53.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ada59c640 1 --2- 172.21.15.70:0/2927612882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06e060 0x7f0adc12c1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00c3d0 tx=0x7f0acc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:53.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0acaffd640 1 -- 172.21.15.70:0/2927612882 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0acc007410 con 0x7f0adc06e060 2024-09-14T10:43:53.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0acaffd640 1 -- 172.21.15.70:0/2927612882 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc0075d0 con 0x7f0adc06e060 2024-09-14T10:43:53.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0acaffd640 1 -- 172.21.15.70:0/2927612882 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0acc004960 con 0x7f0adc06e060 2024-09-14T10:43:53.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0adc12ee30 con 0x7f0adc06e060 2024-09-14T10:43:53.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.949+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0adc12c720 con 0x7f0adc06e060 2024-09-14T10:43:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.953+0000 7f0acaffd640 1 -- 172.21.15.70:0/2927612882 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0acc011070 con 0x7f0adc06e060 2024-09-14T10:43:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.953+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0adc06e440 con 0x7f0adc06e060 2024-09-14T10:43:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.953+0000 7f0acaffd640 1 --2- 172.21.15.70:0/2927612882 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0abc03b8b0 0x7f0abc03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.953+0000 7f0acaffd640 1 -- 172.21.15.70:0/2927612882 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f0acc04f040 con 0x7f0adc06e060 2024-09-14T10:43:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.953+0000 7f0ad9d9b640 1 --2- 172.21.15.70:0/2927612882 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0abc03b8b0 0x7f0abc03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.953+0000 7f0ad9d9b640 1 --2- 172.21.15.70:0/2927612882 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0abc03b8b0 0x7f0abc03dd70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00ad000 tx=0x7f0ad0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:53.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:53.957+0000 7f0acaffd640 1 -- 172.21.15.70:0/2927612882 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f0acc010d50 con 0x7f0adc06e060 2024-09-14T10:43:54.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.125+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f0adc0750b0 con 0x7f0adc06e060 2024-09-14T10:43:54.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0acaffd640 1 -- 172.21.15.70:0/2927612882 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f0acc012d70 con 0x7f0adc06e060 2024-09-14T10:43:54.437 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'rbd' created 2024-09-14T10:43:54.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0abc03b8b0 msgr2=0x7f0abc03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:54.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 --2- 172.21.15.70:0/2927612882 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0abc03b8b0 0x7f0abc03dd70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00ad000 tx=0x7f0ad0008040 comp rx=0 tx=0).stop 2024-09-14T10:43:54.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06e060 msgr2=0x7f0adc12c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:54.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 --2- 172.21.15.70:0/2927612882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06e060 0x7f0adc12c1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00c3d0 tx=0x7f0acc00c890 comp rx=0 tx=0).stop 2024-09-14T10:43:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 shutdown_connections 2024-09-14T10:43:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 --2- 172.21.15.70:0/2927612882 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0abc03b8b0 0x7f0abc03dd70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 --2- 172.21.15.70:0/2927612882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0adc06e060 0x7f0adc12c1e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 >> 172.21.15.70:0/2927612882 conn(0x7f0adc09a970 msgr2=0x7f0adc1335f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 shutdown_connections 2024-09-14T10:43:54.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.437+0000 7f0ae0ca5640 1 -- 172.21.15.70:0/2927612882 wait complete. 2024-09-14T10:43:54.462 DEBUG:teuthology.orchestra.run.smithi070:> rbd --cluster ceph pool init rbd 2024-09-14T10:43:54.518 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:43:54.518 INFO:teuthology.orchestra.run.smithi070.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:43:54.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.517+0000 7f4e11ad0100 1 Processor -- start 2024-09-14T10:43:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e11ad0100 1 -- start start 2024-09-14T10:43:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e11ad0100 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562c9704be10 0x562c970fd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e11ad0100 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x562c96eb6c80 con 0x562c970f86a0 2024-09-14T10:43:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e11ad0100 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x562c96f38160 con 0x562c9704be10 2024-09-14T10:43:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e0fdd8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562c9704be10 0x562c970fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e105d9640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x562c970f86a0 0x562c970f8a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49236/0 (socket says 172.21.15.70:49236) 2024-09-14T10:43:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e105d9640 1 -- 172.21.15.70:0/3685332213 learned_addr learned my addr 172.21.15.70:0/3685332213 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e0f5d7640 1 -- 172.21.15.70:0/3685332213 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291753527 0 0) 0x562c96eb6c80 con 0x562c970f86a0 2024-09-14T10:43:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e0fdd8640 1 -- 172.21.15.70:0/3685332213 >> v1:172.21.15.70:6789/0 conn(0x562c970f86a0 legacy=0x562c970f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.521+0000 7f4e0fdd8640 1 -- 172.21.15.70:0/3685332213 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c97062770 con 0x562c9704be10 2024-09-14T10:43:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e0fdd8640 1 --2- 172.21.15.70:0/3685332213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970fd8c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400a480 tx=0x7f4e0401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8d07db09cb6308 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e0f5d7640 1 -- 172.21.15.70:0/3685332213 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e040af070 con 0x562c9704be10 2024-09-14T10:43:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e0f5d7640 1 -- 172.21.15.70:0/3685332213 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e040aa530 con 0x562c9704be10 2024-09-14T10:43:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e0f5d7640 1 -- 172.21.15.70:0/3685332213 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e040aa830 con 0x562c9704be10 2024-09-14T10:43:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 -- 172.21.15.70:0/3685332213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 msgr2=0x562c970fd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/3685332213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970fd8c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400a480 tx=0x7f4e0401b310 comp rx=0 tx=0).stop 2024-09-14T10:43:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 -- 172.21.15.70:0/3685332213 shutdown_connections 2024-09-14T10:43:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/3685332213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970fd8c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 -- 172.21.15.70:0/3685332213 >> 172.21.15.70:0/3685332213 conn(0x562c9706abe0 msgr2=0x562c9706aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 -- 172.21.15.70:0/3685332213 shutdown_connections 2024-09-14T10:43:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 -- 172.21.15.70:0/3685332213 wait complete. 2024-09-14T10:43:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 Processor -- start 2024-09-14T10:43:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 -- start start 2024-09-14T10:43:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e11ad0100 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562c96f3bf70 con 0x562c9704be10 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e105d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e105d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970e67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58454/0 (socket says 172.21.15.70:58454) 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e105d9640 1 -- 172.21.15.70:0/4102472372 learned_addr learned my addr 172.21.15.70:0/4102472372 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.525+0000 7f4e105d9640 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c970e7ea0 con 0x562c9704be10 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e105d9640 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970e67f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000bde0 tx=0x7f4e00009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e00012070 con 0x562c9704be10 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0000e5d0 con 0x562c9704be10 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e0000e8f0 con 0x562c9704be10 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c970e9740 con 0x562c9704be10 2024-09-14T10:43:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c970e6d30 con 0x562c9704be10 2024-09-14T10:43:54.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f4e00015070 con 0x562c9704be10 2024-09-14T10:43:54.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e0cdd2640 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4df403a1a0 0x7f4df403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:54.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f4e00005050 con 0x562c9704be10 2024-09-14T10:43:54.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x562c970e7340 con 0x562c9704be10 2024-09-14T10:43:54.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e0fdd8640 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4df403a1a0 0x7f4df403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:54.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:54.529+0000 7f4e0fdd8640 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4df403a1a0 0x7f4df403c660 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e040ac000 tx=0x7f4e040a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:55.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.441+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7f4e0000d710 con 0x562c9704be10 2024-09-14T10:43:55.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.441+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e040aa530 con 0x562c9704be10 2024-09-14T10:43:55.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.445+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4e0000d3e0 con 0x562c9704be10 2024-09-14T10:43:55.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.445+0000 7f4e0edd6640 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f4dec002af0 con 0x562c9704be10 2024-09-14T10:43:55.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.445+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f4e0000ea90 con 0x562c9704be10 2024-09-14T10:43:55.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.445+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562c970f86a0 0x562c9710a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:55.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.445+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x562c9710f170 con 0x562c970f86a0 2024-09-14T10:43:55.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.449+0000 7f4e1183b640 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562c970f86a0 0x562c9710a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:55.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.449+0000 7f4e1183b640 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562c970f86a0 0x562c9710a7b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:55.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.461+0000 7f4e1183b640 1 -- 172.21.15.70:0/4102472372 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f4e0800a4d0 con 0x562c970f86a0 2024-09-14T10:43:55.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.465+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x562c97161850 con 0x562c970f86a0 2024-09-14T10:43:55.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.465+0000 7f4e1183b640 1 -- 172.21.15.70:0/4102472372 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4e0800a4d0 con 0x562c970f86a0 2024-09-14T10:43:55.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.465+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x562c97160960 con 0x562c970f86a0 2024-09-14T10:43:55.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.465+0000 7f4e1183b640 1 -- 172.21.15.70:0/4102472372 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4e0800a4d0 con 0x562c970f86a0 2024-09-14T10:43:55.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:55.469+0000 7f4e0e5d5640 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f4df0001f10 con 0x562c9704be10 2024-09-14T10:43:56.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:56.449+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7f4e0004c120 con 0x562c9704be10 2024-09-14T10:43:56.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:56.449+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f4df403fd50 con 0x562c9704be10 2024-09-14T10:43:56.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:56.449+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f4e000163b0 con 0x562c9704be10 2024-09-14T10:43:56.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:56.449+0000 7f4e0edd6640 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f4dec005790 con 0x562c970f86a0 2024-09-14T10:43:56.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:56.457+0000 7f4e1183b640 1 -- 172.21.15.70:0/4102472372 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4e0800a4d0 con 0x562c970f86a0 2024-09-14T10:43:56.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:56.457+0000 7f4e0e5d5640 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f4df0003360 con 0x562c9704be10 2024-09-14T10:43:57.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.457+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f4e00026020 con 0x562c9704be10 2024-09-14T10:43:57.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.457+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f4df403ffd0 con 0x562c9704be10 2024-09-14T10:43:57.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.457+0000 7f4e0cdd2640 1 -- 172.21.15.70:0/4102472372 <== mon.0 v2:172.21.15.70:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f4e0003b590 con 0x562c9704be10 2024-09-14T10:43:57.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.457+0000 7f4e0edd6640 1 -- 172.21.15.70:0/4102472372 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f4dec005b50 con 0x562c970f86a0 2024-09-14T10:43:57.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e1183b640 1 -- 172.21.15.70:0/4102472372 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e0800a4d0 con 0x562c970f86a0 2024-09-14T10:43:57.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562c970f86a0 msgr2=0x562c9710a7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562c970f86a0 0x562c9710a7b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4df403a1a0 msgr2=0x7f4df403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4df403a1a0 0x7f4df403c660 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e040ac000 tx=0x7f4e040a5000 comp rx=0 tx=0).stop 2024-09-14T10:43:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 msgr2=0x562c970e67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970e67f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000bde0 tx=0x7f4e00009650 comp rx=0 tx=0).stop 2024-09-14T10:43:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 shutdown_connections 2024-09-14T10:43:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562c970f86a0 0x562c9710a7b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4df403a1a0 0x7f4df403c660 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 --2- 172.21.15.70:0/4102472372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c9704be10 0x562c970e67f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 >> 172.21.15.70:0/4102472372 conn(0x562c9706abe0 msgr2=0x562c970661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 shutdown_connections 2024-09-14T10:43:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.469+0000 7f4e11ad0100 1 -- 172.21.15.70:0/4102472372 wait complete. 2024-09-14T10:43:57.472 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T10:43:57.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T10:43:57.473 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T10:43:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92eb607640 1 Processor -- start 2024-09-14T10:43:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92eb607640 1 -- start start 2024-09-14T10:43:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92eb607640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f92e4071d80 0x7f92e4132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92eb607640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e40724f0 con 0x7f92e412d390 2024-09-14T10:43:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92eb607640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f92e4099e20 con 0x7f92e4071d80 2024-09-14T10:43:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92e8ba2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f92e4071d80 0x7f92e4132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92e93a3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f92e412d390 0x7f92e412d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40370/0 (socket says 172.21.15.70:40370) 2024-09-14T10:43:57.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92e93a3640 1 -- 172.21.15.70:0/3438990067 learned_addr learned my addr 172.21.15.70:0/3438990067 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92e8ba2640 1 -- 172.21.15.70:0/3438990067 >> v1:172.21.15.70:6789/0 conn(0x7f92e412d390 legacy=0x7f92e412d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92dbfff640 1 -- 172.21.15.70:0/3438990067 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328642717 0 0) 0x7f92e40724f0 con 0x7f92e412d390 2024-09-14T10:43:57.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.605+0000 7f92e8ba2640 1 -- 172.21.15.70:0/3438990067 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e412de80 con 0x7f92e4071d80 2024-09-14T10:43:57.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92e8ba2640 1 --2- 172.21.15.70:0/3438990067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e4132390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009770 tx=0x7f92d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a11f7fa3b19477e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:57.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92dbfff640 1 -- 172.21.15.70:0/3438990067 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d40b1070 con 0x7f92e4071d80 2024-09-14T10:43:57.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92dbfff640 1 -- 172.21.15.70:0/3438990067 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d40ac520 con 0x7f92e4071d80 2024-09-14T10:43:57.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92dbfff640 1 -- 172.21.15.70:0/3438990067 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d40ac820 con 0x7f92e4071d80 2024-09-14T10:43:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- 172.21.15.70:0/3438990067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 msgr2=0x7f92e4132390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 --2- 172.21.15.70:0/3438990067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e4132390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009770 tx=0x7f92d401c370 comp rx=0 tx=0).stop 2024-09-14T10:43:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- 172.21.15.70:0/3438990067 shutdown_connections 2024-09-14T10:43:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 --2- 172.21.15.70:0/3438990067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e4132390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- 172.21.15.70:0/3438990067 >> 172.21.15.70:0/3438990067 conn(0x7f92e409aba0 msgr2=0x7f92e40984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- 172.21.15.70:0/3438990067 shutdown_connections 2024-09-14T10:43:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- 172.21.15.70:0/3438990067 wait complete. 2024-09-14T10:43:57.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 Processor -- start 2024-09-14T10:43:57.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- start start 2024-09-14T10:43:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e41c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f92e4135480 con 0x7f92e4071d80 2024-09-14T10:43:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92e93a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e41c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:57.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92e93a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e41c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60432/0 (socket says 172.21.15.70:60432) 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92e93a3640 1 -- 172.21.15.70:0/3245639687 learned_addr learned my addr 172.21.15.70:0/3245639687 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92e93a3640 1 -- 172.21.15.70:0/3245639687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e4070830 con 0x7f92e4071d80 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92e93a3640 1 --2- 172.21.15.70:0/3245639687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e41c5a80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c450 tx=0x7f92e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92d9ffb640 1 -- 172.21.15.70:0/3245639687 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e0017070 con 0x7f92e4071d80 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92d9ffb640 1 -- 172.21.15.70:0/3245639687 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e0005c20 con 0x7f92e4071d80 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e4074070 con 0x7f92e4071d80 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92d9ffb640 1 -- 172.21.15.70:0/3245639687 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e00070d0 con 0x7f92e4071d80 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e412a660 con 0x7f92e4071d80 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92d9ffb640 1 -- 172.21.15.70:0/3245639687 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f92e001a070 con 0x7f92e4071d80 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e40008e0 con 0x7f92e4071d80 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92d9ffb640 1 --2- 172.21.15.70:0/3245639687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f92c803b8b0 0x7f92c803dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:57.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92d9ffb640 1 -- 172.21.15.70:0/3245639687 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f92e004e9b0 con 0x7f92e4071d80 2024-09-14T10:43:57.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92e8ba2640 1 --2- 172.21.15.70:0/3245639687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f92c803b8b0 0x7f92c803dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:57.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.609+0000 7f92e8ba2640 1 --2- 172.21.15.70:0/3245639687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f92c803b8b0 0x7f92c803dd70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92d40ae000 tx=0x7f92d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:57.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.617+0000 7f92d9ffb640 1 -- 172.21.15.70:0/3245639687 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f92e4070830 con 0x7f92e4071d80 2024-09-14T10:43:57.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.797+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f92e408c640 con 0x7f92e4071d80 2024-09-14T10:43:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.797+0000 7f92d9ffb640 1 -- 172.21.15.70:0/3245639687 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7f92e001ad80 con 0x7f92e4071d80 2024-09-14T10:43:57.795 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f92c803b8b0 msgr2=0x7f92c803dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 --2- 172.21.15.70:0/3245639687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f92c803b8b0 0x7f92c803dd70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92d40ae000 tx=0x7f92d4008040 comp rx=0 tx=0).stop 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 msgr2=0x7f92e41c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 --2- 172.21.15.70:0/3245639687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e41c5a80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c450 tx=0x7f92e000c910 comp rx=0 tx=0).stop 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 shutdown_connections 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 --2- 172.21.15.70:0/3245639687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f92c803b8b0 0x7f92c803dd70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 --2- 172.21.15.70:0/3245639687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92e4071d80 0x7f92e41c5a80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 >> 172.21.15.70:0/3245639687 conn(0x7f92e409aba0 msgr2=0x7f92e40987c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 shutdown_connections 2024-09-14T10:43:57.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.801+0000 7f92eb607640 1 -- 172.21.15.70:0/3245639687 wait complete. 2024-09-14T10:43:57.814 INFO:teuthology.orchestra.run.smithi070.stdout:[{"version":5,"timestamp":"2024-09-14T10:43:48.417272+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"6932.622414"}]}] 2024-09-14T10:43:57.814 INFO:tasks.ceph_manager:config epoch is 5 2024-09-14T10:43:57.815 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T10:43:57.815 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T10:43:57.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T10:43:57.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.933+0000 7f53e530c640 1 Processor -- start 2024-09-14T10:43:57.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.933+0000 7f53e530c640 1 -- start start 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53e530c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53e0132800 0x7f53e0134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53e530c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e01303a0 con 0x7f53e012f8b0 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53e530c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f53e012f4f0 con 0x7f53e0132800 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53d7fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53e0132800 0x7f53e0134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53deffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f53e012f8b0 0x7f53e012fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40382/0 (socket says 172.21.15.70:40382) 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53deffd640 1 -- 172.21.15.70:0/1402191366 learned_addr learned my addr 172.21.15.70:0/1402191366 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53d7fff640 1 -- 172.21.15.70:0/1402191366 >> v1:172.21.15.70:6789/0 conn(0x7f53e012f8b0 legacy=0x7f53e012fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53de7fc640 1 -- 172.21.15.70:0/1402191366 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538391113 0 0) 0x7f53e01303a0 con 0x7f53e012f8b0 2024-09-14T10:43:57.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53d7fff640 1 -- 172.21.15.70:0/1402191366 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e0070a60 con 0x7f53e0132800 2024-09-14T10:43:57.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53d7fff640 1 --2- 172.21.15.70:0/1402191366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0132800 0x7f53e0134bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009770 tx=0x7f53c801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6871e5927b154f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:57.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53de7fc640 1 -- 172.21.15.70:0/1402191366 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c80b0070 con 0x7f53e0132800 2024-09-14T10:43:57.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53de7fc640 1 -- 172.21.15.70:0/1402191366 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c80ab530 con 0x7f53e0132800 2024-09-14T10:43:57.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53de7fc640 1 -- 172.21.15.70:0/1402191366 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c80ab830 con 0x7f53e0132800 2024-09-14T10:43:57.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53e530c640 1 -- 172.21.15.70:0/1402191366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0132800 msgr2=0x7f53e0134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:57.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53e530c640 1 --2- 172.21.15.70:0/1402191366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0132800 0x7f53e0134bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009770 tx=0x7f53c801c370 comp rx=0 tx=0).stop 2024-09-14T10:43:57.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53e530c640 1 -- 172.21.15.70:0/1402191366 shutdown_connections 2024-09-14T10:43:57.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53e530c640 1 --2- 172.21.15.70:0/1402191366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0132800 0x7f53e0134bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:57.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.937+0000 7f53e530c640 1 -- 172.21.15.70:0/1402191366 >> 172.21.15.70:0/1402191366 conn(0x7f53e00a2520 msgr2=0x7f53e009ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:57.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 -- 172.21.15.70:0/1402191366 shutdown_connections 2024-09-14T10:43:57.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 -- 172.21.15.70:0/1402191366 wait complete. 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 Processor -- start 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 -- start start 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e012f8b0 0x7f53e012b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53e0070690 con 0x7f53e012f8b0 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53deffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e012f8b0 0x7f53e012b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53deffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e012f8b0 0x7f53e012b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60450/0 (socket says 172.21.15.70:60450) 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53deffd640 1 -- 172.21.15.70:0/690376033 learned_addr learned my addr 172.21.15.70:0/690376033 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53deffd640 1 -- 172.21.15.70:0/690376033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e00718d0 con 0x7f53e012f8b0 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53deffd640 1 --2- 172.21.15.70:0/690376033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e012f8b0 0x7f53e012b240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c3d0 tx=0x7f53d000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53d77fe640 1 -- 172.21.15.70:0/690376033 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d0007410 con 0x7f53e012f8b0 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53d77fe640 1 -- 172.21.15.70:0/690376033 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d00075d0 con 0x7f53e012f8b0 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e012c8e0 con 0x7f53e012f8b0 2024-09-14T10:43:57.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53d77fe640 1 -- 172.21.15.70:0/690376033 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d0004960 con 0x7f53e012f8b0 2024-09-14T10:43:57.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e012b780 con 0x7f53e012f8b0 2024-09-14T10:43:57.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53d77fe640 1 -- 172.21.15.70:0/690376033 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f53d0011070 con 0x7f53e012f8b0 2024-09-14T10:43:57.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e012fc90 con 0x7f53e012f8b0 2024-09-14T10:43:57.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53d77fe640 1 --2- 172.21.15.70:0/690376033 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f53c003b8b0 0x7f53c003dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:57.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53d77fe640 1 -- 172.21.15.70:0/690376033 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f53d004f1e0 con 0x7f53e012f8b0 2024-09-14T10:43:57.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.941+0000 7f53d7fff640 1 --2- 172.21.15.70:0/690376033 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f53c003b8b0 0x7f53c003dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:57.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.945+0000 7f53d7fff640 1 --2- 172.21.15.70:0/690376033 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f53c003b8b0 0x7f53c003dd70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ad000 tx=0x7f53c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:57.949+0000 7f53d77fe640 1 -- 172.21.15.70:0/690376033 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f53d0010d50 con 0x7f53e012f8b0 2024-09-14T10:43:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.149+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f53e0050ef0 con 0x7f53e012f8b0 2024-09-14T10:43:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.153+0000 7f53d77fe640 1 -- 172.21.15.70:0/690376033 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+93766 (secure 0 0 0) 0x7f53d0012d70 con 0x7f53e012f8b0 2024-09-14T10:43:58.152 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f53c003b8b0 msgr2=0x7f53c003dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 --2- 172.21.15.70:0/690376033 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f53c003b8b0 0x7f53c003dd70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ad000 tx=0x7f53c8008040 comp rx=0 tx=0).stop 2024-09-14T10:43:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e012f8b0 msgr2=0x7f53e012b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 --2- 172.21.15.70:0/690376033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e012f8b0 0x7f53e012b240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c3d0 tx=0x7f53d000c890 comp rx=0 tx=0).stop 2024-09-14T10:43:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 shutdown_connections 2024-09-14T10:43:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 --2- 172.21.15.70:0/690376033 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f53c003b8b0 0x7f53c003dd70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 --2- 172.21.15.70:0/690376033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e012f8b0 0x7f53e012b240 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 >> 172.21.15.70:0/690376033 conn(0x7f53e00a2520 msgr2=0x7f53e006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 shutdown_connections 2024-09-14T10:43:58.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.157+0000 7f53e530c640 1 -- 172.21.15.70:0/690376033 wait complete. 2024-09-14T10:43:58.169 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":992869166},{"type":"v1","addr":"172.21.15.96:6825","nonce":992869166}]},"active_addr":"172.21.15.96:6825/992869166","active_change":"2024-09-14T10:43:43.331487+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":871831542}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3014754692}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":727627180}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":467237322}]}]} 2024-09-14T10:43:58.171 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T10:43:58.171 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T10:43:58.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:43:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.281+0000 7f71a1d3c640 1 Processor -- start 2024-09-14T10:43:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.281+0000 7f71a1d3c640 1 -- start start 2024-09-14T10:43:58.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f719c12f8b0 0x7f719c12fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719c070a60 con 0x7f719c1301d0 2024-09-14T10:43:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f719c12f4f0 con 0x7f719c12f8b0 2024-09-14T10:43:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719affd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f719c1301d0 0x7f719c06f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40386/0 (socket says 172.21.15.70:40386) 2024-09-14T10:43:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f719c12f8b0 0x7f719c12fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719affd640 1 -- 172.21.15.70:0/1840803167 learned_addr learned my addr 172.21.15.70:0/1840803167 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719b7fe640 1 -- 172.21.15.70:0/1840803167 >> v1:172.21.15.70:6789/0 conn(0x7f719c1301d0 legacy=0x7f719c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719b7fe640 1 -- 172.21.15.70:0/1840803167 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c09f300 con 0x7f719c12f8b0 2024-09-14T10:43:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719b7fe640 1 --2- 172.21.15.70:0/1840803167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c12fc90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7184009740 tx=0x7f718401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4327ada53754ec2d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719a7fc640 1 -- 172.21.15.70:0/1840803167 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71840b0070 con 0x7f719c12f8b0 2024-09-14T10:43:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719a7fc640 1 -- 172.21.15.70:0/1840803167 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71840ab530 con 0x7f719c12f8b0 2024-09-14T10:43:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f719a7fc640 1 -- 172.21.15.70:0/1840803167 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71840ab830 con 0x7f719c12f8b0 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 -- 172.21.15.70:0/1840803167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 msgr2=0x7f719c12fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 --2- 172.21.15.70:0/1840803167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c12fc90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7184009740 tx=0x7f718401c370 comp rx=0 tx=0).stop 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 -- 172.21.15.70:0/1840803167 shutdown_connections 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 --2- 172.21.15.70:0/1840803167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c12fc90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 -- 172.21.15.70:0/1840803167 >> 172.21.15.70:0/1840803167 conn(0x7f719c0a2520 msgr2=0x7f719c09ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 -- 172.21.15.70:0/1840803167 shutdown_connections 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.285+0000 7f71a1d3c640 1 -- 172.21.15.70:0/1840803167 wait complete. 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f71a1d3c640 1 Processor -- start 2024-09-14T10:43:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f71a1d3c640 1 -- start start 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f71a1d3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c1308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f71a1d3c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f719c138250 con 0x7f719c12f8b0 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f719b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c1308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f719b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c1308b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60470/0 (socket says 172.21.15.70:60470) 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f719b7fe640 1 -- 172.21.15.70:0/2884214936 learned_addr learned my addr 172.21.15.70:0/2884214936 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f719b7fe640 1 -- 172.21.15.70:0/2884214936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c12a010 con 0x7f719c12f8b0 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f719b7fe640 1 --2- 172.21.15.70:0/2884214936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c1308b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7184019fa0 tx=0x7f718401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f7193fff640 1 -- 172.21.15.70:0/2884214936 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71840b0050 con 0x7f719c12f8b0 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f7193fff640 1 -- 172.21.15.70:0/2884214936 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71840b1040 con 0x7f719c12f8b0 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719c131f00 con 0x7f719c12f8b0 2024-09-14T10:43:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f7193fff640 1 -- 172.21.15.70:0/2884214936 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71840aab60 con 0x7f719c12f8b0 2024-09-14T10:43:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719c130df0 con 0x7f719c12f8b0 2024-09-14T10:43:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719c1336f0 con 0x7f719c12f8b0 2024-09-14T10:43:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f7193fff640 1 -- 172.21.15.70:0/2884214936 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f71840be030 con 0x7f719c12f8b0 2024-09-14T10:43:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f7193fff640 1 --2- 172.21.15.70:0/2884214936 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f717c03b8b0 0x7f717c03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f7193fff640 1 -- 172.21.15.70:0/2884214936 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f71840bc070 con 0x7f719c12f8b0 2024-09-14T10:43:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.289+0000 7f719affd640 1 --2- 172.21.15.70:0/2884214936 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f717c03b8b0 0x7f717c03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.293+0000 7f719affd640 1 --2- 172.21.15.70:0/2884214936 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f717c03b8b0 0x7f717c03dd70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f718c005890 tx=0x7f718c007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.293+0000 7f7193fff640 1 -- 172.21.15.70:0/2884214936 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f71840c5060 con 0x7f719c12f8b0 2024-09-14T10:43:58.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.453+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f719c12fc90 con 0x7f719c12f8b0 2024-09-14T10:43:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.453+0000 7f7193fff640 1 -- 172.21.15.70:0/2884214936 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9878 (secure 0 0 0) 0x7f719c12a010 con 0x7f719c12f8b0 2024-09-14T10:43:58.451 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:58.451 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"fsid":"2e314bd0-9070-44fa-a8ec-a9266c5de294","created":"2024-09-14T10:43:38.317946+0000","modified":"2024-09-14T10:43:57.453117+0000","last_up_change":"2024-09-14T10:43:49.418142+0000","last_in_change":"2024-09-14T10:43:39.469314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:43:49.381445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:43:54.136075+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e00249-58b2-4247-a635-db467796e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6801","nonce":3481052616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6803","nonce":3481052616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6807","nonce":3481052616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6805","nonce":3481052616}]},"public_addr":"172.21.15.70:6801/3481052616","cluster_addr":"172.21.15.70:6803/3481052616","heartbeat_back_addr":"172.21.15.70:6807/3481052616","heartbeat_front_addr":"172.21.15.70:6805/3481052616","state":["exists","up"]},{"osd":1,"uuid":"26e1a964-ad73-4f8f-9ab6-0c4c442429a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6809","nonce":2339799699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6811","nonce":2339799699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6815","nonce":2339799699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6813","nonce":2339799699}]},"public_addr":"172.21.15.96:6809/2339799699","cluster_addr":"172.21.15.96:6811/2339799699","heartbeat_back_addr":"172.21.15.96:6815/2339799699","heartbeat_front_addr":"172.21.15.96:6813/2339799699","state":["exists","up"]},{"osd":2,"uuid":"47f610b0-6d57-4262-a3a3-dc8f095700b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6817","nonce":2312202642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6819","nonce":2312202642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6823","nonce":2312202642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6821","nonce":2312202642}]},"public_addr":"172.21.15.96:6817/2312202642","cluster_addr":"172.21.15.96:6819/2312202642","heartbeat_back_addr":"172.21.15.96:6823/2312202642","heartbeat_front_addr":"172.21.15.96:6821/2312202642","state":["exists","up"]},{"osd":3,"uuid":"0f744f58-2cfb-4f8b-81a8-0891b56da9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6801","nonce":3683402699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6803","nonce":3683402699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6807","nonce":3683402699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6805","nonce":3683402699}]},"public_addr":"172.21.15.96:6801/3683402699","cluster_addr":"172.21.15.96:6803/3683402699","heartbeat_back_addr":"172.21.15.96:6807/3683402699","heartbeat_front_addr":"172.21.15.96:6805/3683402699","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:45.474926+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:46.131113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:46.635517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:45.852608+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f717c03b8b0 msgr2=0x7f717c03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 --2- 172.21.15.70:0/2884214936 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f717c03b8b0 0x7f717c03dd70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f718c005890 tx=0x7f718c007ab0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 msgr2=0x7f719c1308b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 --2- 172.21.15.70:0/2884214936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c1308b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7184019fa0 tx=0x7f718401abb0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 shutdown_connections 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 --2- 172.21.15.70:0/2884214936 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f717c03b8b0 0x7f717c03dd70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 --2- 172.21.15.70:0/2884214936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f719c12f8b0 0x7f719c1308b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 >> 172.21.15.70:0/2884214936 conn(0x7f719c0a2520 msgr2=0x7f719c128ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 shutdown_connections 2024-09-14T10:43:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.457+0000 7f71a1d3c640 1 -- 172.21.15.70:0/2884214936 wait complete. 2024-09-14T10:43:58.468 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T10:43:58.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:43:58.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f8070f10640 1 Processor -- start 2024-09-14T10:43:58.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f8070f10640 1 -- start start 2024-09-14T10:43:58.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f8070f10640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f806c099bc0 0x7f806c06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f8070f10640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f806c070400 con 0x7f806c06e5a0 2024-09-14T10:43:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f8070f10640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f806c0707a0 con 0x7f806c099bc0 2024-09-14T10:43:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f806a59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f806c099bc0 0x7f806c06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f8069d9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f806c06e5a0 0x7f806c06e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40392/0 (socket says 172.21.15.70:40392) 2024-09-14T10:43:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f8069d9b640 1 -- 172.21.15.70:0/1908328338 learned_addr learned my addr 172.21.15.70:0/1908328338 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f806a59c640 1 -- 172.21.15.70:0/1908328338 >> v1:172.21.15.70:6789/0 conn(0x7f806c06e5a0 legacy=0x7f806c06e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f806a59c640 1 -- 172.21.15.70:0/1908328338 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c06f0c0 con 0x7f806c099bc0 2024-09-14T10:43:58.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.581+0000 7f806959a640 1 -- 172.21.15.70:0/1908328338 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011607172 0 0) 0x7f806c070400 con 0x7f806c06e5a0 2024-09-14T10:43:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806a59c640 1 --2- 172.21.15.70:0/1908328338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c099bc0 0x7f806c06e060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f805c009740 tx=0x7f805c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fed34539c91ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806959a640 1 -- 172.21.15.70:0/1908328338 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c0b0070 con 0x7f806c099bc0 2024-09-14T10:43:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806959a640 1 -- 172.21.15.70:0/1908328338 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c0ab530 con 0x7f806c099bc0 2024-09-14T10:43:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806959a640 1 -- 172.21.15.70:0/1908328338 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c0ab830 con 0x7f806c099bc0 2024-09-14T10:43:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- 172.21.15.70:0/1908328338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c099bc0 msgr2=0x7f806c06e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 --2- 172.21.15.70:0/1908328338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c099bc0 0x7f806c06e060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f805c009740 tx=0x7f805c01c400 comp rx=0 tx=0).stop 2024-09-14T10:43:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- 172.21.15.70:0/1908328338 shutdown_connections 2024-09-14T10:43:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 --2- 172.21.15.70:0/1908328338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c099bc0 0x7f806c06e060 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- 172.21.15.70:0/1908328338 >> 172.21.15.70:0/1908328338 conn(0x7f806c09aba0 msgr2=0x7f806c0984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- 172.21.15.70:0/1908328338 shutdown_connections 2024-09-14T10:43:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- 172.21.15.70:0/1908328338 wait complete. 2024-09-14T10:43:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 Processor -- start 2024-09-14T10:43:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- start start 2024-09-14T10:43:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c06e5a0 0x7f806c133640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f806c137810 con 0x7f806c06e5a0 2024-09-14T10:43:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c06e5a0 0x7f806c133640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c06e5a0 0x7f806c133640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60494/0 (socket says 172.21.15.70:60494) 2024-09-14T10:43:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806a59c640 1 -- 172.21.15.70:0/332366781 learned_addr learned my addr 172.21.15.70:0/332366781 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806a59c640 1 -- 172.21.15.70:0/332366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c125dc0 con 0x7f806c06e5a0 2024-09-14T10:43:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f806a59c640 1 --2- 172.21.15.70:0/332366781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c06e5a0 0x7f806c133640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f805c01a030 tx=0x7f805c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f805affd640 1 -- 172.21.15.70:0/332366781 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c0bb070 con 0x7f806c06e5a0 2024-09-14T10:43:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f805affd640 1 -- 172.21.15.70:0/332366781 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c004020 con 0x7f806c06e5a0 2024-09-14T10:43:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806c126260 con 0x7f806c06e5a0 2024-09-14T10:43:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f805affd640 1 -- 172.21.15.70:0/332366781 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c0b0040 con 0x7f806c06e5a0 2024-09-14T10:43:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.585+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806c133d50 con 0x7f806c06e5a0 2024-09-14T10:43:58.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.589+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806c06e060 con 0x7f806c06e5a0 2024-09-14T10:43:58.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.589+0000 7f805affd640 1 -- 172.21.15.70:0/332366781 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f805c004300 con 0x7f806c06e5a0 2024-09-14T10:43:58.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.589+0000 7f805affd640 1 --2- 172.21.15.70:0/332366781 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f804c03b8e0 0x7f804c03dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.589+0000 7f805affd640 1 -- 172.21.15.70:0/332366781 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f805c0ea070 con 0x7f806c06e5a0 2024-09-14T10:43:58.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.589+0000 7f8069d9b640 1 --2- 172.21.15.70:0/332366781 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f804c03b8e0 0x7f804c03dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.589+0000 7f8069d9b640 1 --2- 172.21.15.70:0/332366781 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f804c03b8e0 0x7f804c03dda0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8060007fd0 tx=0x7f80600078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.593+0000 7f805affd640 1 -- 172.21.15.70:0/332366781 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f805c015ff0 con 0x7f806c06e5a0 2024-09-14T10:43:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.753+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f806c050ef0 con 0x7f806c06e5a0 2024-09-14T10:43:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.753+0000 7f805affd640 1 -- 172.21.15.70:0/332366781 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9878 (secure 0 0 0) 0x7f805c0b5cd0 con 0x7f806c06e5a0 2024-09-14T10:43:58.749 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:43:58.750 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"fsid":"2e314bd0-9070-44fa-a8ec-a9266c5de294","created":"2024-09-14T10:43:38.317946+0000","modified":"2024-09-14T10:43:57.453117+0000","last_up_change":"2024-09-14T10:43:49.418142+0000","last_in_change":"2024-09-14T10:43:39.469314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:43:49.381445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:43:54.136075+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e00249-58b2-4247-a635-db467796e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6801","nonce":3481052616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6803","nonce":3481052616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6807","nonce":3481052616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6805","nonce":3481052616}]},"public_addr":"172.21.15.70:6801/3481052616","cluster_addr":"172.21.15.70:6803/3481052616","heartbeat_back_addr":"172.21.15.70:6807/3481052616","heartbeat_front_addr":"172.21.15.70:6805/3481052616","state":["exists","up"]},{"osd":1,"uuid":"26e1a964-ad73-4f8f-9ab6-0c4c442429a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6809","nonce":2339799699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6811","nonce":2339799699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6815","nonce":2339799699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6813","nonce":2339799699}]},"public_addr":"172.21.15.96:6809/2339799699","cluster_addr":"172.21.15.96:6811/2339799699","heartbeat_back_addr":"172.21.15.96:6815/2339799699","heartbeat_front_addr":"172.21.15.96:6813/2339799699","state":["exists","up"]},{"osd":2,"uuid":"47f610b0-6d57-4262-a3a3-dc8f095700b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6817","nonce":2312202642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6819","nonce":2312202642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6823","nonce":2312202642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6821","nonce":2312202642}]},"public_addr":"172.21.15.96:6817/2312202642","cluster_addr":"172.21.15.96:6819/2312202642","heartbeat_back_addr":"172.21.15.96:6823/2312202642","heartbeat_front_addr":"172.21.15.96:6821/2312202642","state":["exists","up"]},{"osd":3,"uuid":"0f744f58-2cfb-4f8b-81a8-0891b56da9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6801","nonce":3683402699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6803","nonce":3683402699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6807","nonce":3683402699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6805","nonce":3683402699}]},"public_addr":"172.21.15.96:6801/3683402699","cluster_addr":"172.21.15.96:6803/3683402699","heartbeat_back_addr":"172.21.15.96:6807/3683402699","heartbeat_front_addr":"172.21.15.96:6805/3683402699","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:45.474926+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:46.131113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:46.635517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:45.852608+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f804c03b8e0 msgr2=0x7f804c03dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 --2- 172.21.15.70:0/332366781 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f804c03b8e0 0x7f804c03dda0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8060007fd0 tx=0x7f80600078e0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c06e5a0 msgr2=0x7f806c133640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 --2- 172.21.15.70:0/332366781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c06e5a0 0x7f806c133640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f805c01a030 tx=0x7f805c01ac40 comp rx=0 tx=0).stop 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 shutdown_connections 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 --2- 172.21.15.70:0/332366781 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f804c03b8e0 0x7f804c03dda0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 --2- 172.21.15.70:0/332366781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f806c06e5a0 0x7f806c133640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 >> 172.21.15.70:0/332366781 conn(0x7f806c09aba0 msgr2=0x7f806c09b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 shutdown_connections 2024-09-14T10:43:58.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.757+0000 7f8070f10640 1 -- 172.21.15.70:0/332366781 wait complete. 2024-09-14T10:43:58.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T10:43:58.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T10:43:58.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T10:43:58.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T10:43:58.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.877+0000 7f6f1f923640 1 Processor -- start 2024-09-14T10:43:58.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.877+0000 7f6f1f923640 1 -- start start 2024-09-14T10:43:58.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.877+0000 7f6f1f923640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6f18071a00 0x7f6f18071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.877+0000 7f6f1f923640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1809c280 con 0x7f6f1812d1d0 2024-09-14T10:43:58.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.877+0000 7f6f1f923640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1809c050 con 0x7f6f18071a00 2024-09-14T10:43:58.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.877+0000 7f6f1cebe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6f1812d1d0 0x7f6f1812d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40396/0 (socket says 172.21.15.70:40396) 2024-09-14T10:43:58.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.877+0000 7f6f1cebe640 1 -- 172.21.15.70:0/3138819292 learned_addr learned my addr 172.21.15.70:0/3138819292 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:58.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.877+0000 7f6f1d6bf640 1 --2- 172.21.15.70:0/3138819292 >> v2:172.21.15.70:3300/0 conn(0x7f6f18071a00 0x7f6f18071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6f0ffff640 1 -- 172.21.15.70:0/3138819292 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244500054 0 0) 0x7f6f1809c280 con 0x7f6f1812d1d0 2024-09-14T10:43:58.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6f0ffff640 1 -- 172.21.15.70:0/3138819292 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f04003530 con 0x7f6f1812d1d0 2024-09-14T10:43:58.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6f1d6bf640 1 -- 172.21.15.70:0/3138819292 >> v1:172.21.15.70:6789/0 conn(0x7f6f1812d1d0 legacy=0x7f6f1812d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6f1d6bf640 1 -- 172.21.15.70:0/3138819292 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1809b910 con 0x7f6f18071a00 2024-09-14T10:43:58.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6ef4c1a640 1 Processor -- start 2024-09-14T10:43:58.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6ef4c1a640 1 -- start start 2024-09-14T10:43:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4453986640 1 Processor -- start 2024-09-14T10:43:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4453986640 1 -- start start 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6ef4c1a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6ef0130870 0x7f6ef0132c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6ef4c1a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef0071580 con 0x7f6ef00719b0 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6ef4c1a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef0072ca0 con 0x7f6ef0130870 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6eedd9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6ef0130870 0x7f6ef0132c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6eedd9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6ef0130870 0x7f6ef0132c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60512/0 (socket says 172.21.15.70:60512) 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6eee59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6ef00719b0 0x7f6ef0071d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40402/0 (socket says 172.21.15.70:40402) 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6eedd9b640 1 -- 172.21.15.70:0/1673143746 learned_addr learned my addr 172.21.15.70:0/1673143746 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4453986640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f444c130480 0x7f444c132870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4453986640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444c072980 con 0x7f444c12a0a0 2024-09-14T10:43:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4453986640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f444c129c70 con 0x7f444c130480 2024-09-14T10:43:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6eedd9b640 1 -- 172.21.15.70:0/1673143746 >> v1:172.21.15.70:6789/0 conn(0x7f6ef00719b0 legacy=0x7f6ef0071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6eedd9b640 1 -- 172.21.15.70:0/1673143746 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef01341b0 con 0x7f6ef0130870 2024-09-14T10:43:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb455b640 1 Processor -- start 2024-09-14T10:43:58.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb455b640 1 -- start start 2024-09-14T10:43:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4450f21640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f444c130480 0x7f444c132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4450f21640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f444c130480 0x7f444c132870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60524/0 (socket says 172.21.15.70:60524) 2024-09-14T10:43:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4450f21640 1 -- 172.21.15.70:0/2519647427 learned_addr learned my addr 172.21.15.70:0/2519647427 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4450f21640 1 -- 172.21.15.70:0/2519647427 >> v1:172.21.15.70:6789/0 conn(0x7f444c12a0a0 legacy=0x7f444c12a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f4450f21640 1 -- 172.21.15.70:0/2519647427 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c09ba20 con 0x7f444c130480 2024-09-14T10:43:58.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb455b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0cac094c80 0x7f0cac132770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb455b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cac096a60 con 0x7f0cac069540 2024-09-14T10:43:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb455b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0cac09bd10 con 0x7f0cac094c80 2024-09-14T10:43:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb1af6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0cac094c80 0x7f0cac132770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb22f7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f0cac069540 0x7f0cac094570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40426/0 (socket says 172.21.15.70:40426) 2024-09-14T10:43:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb22f7640 1 -- 172.21.15.70:0/795245397 learned_addr learned my addr 172.21.15.70:0/795245397 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb1af6640 1 -- 172.21.15.70:0/795245397 >> v1:172.21.15.70:6789/0 conn(0x7f0cac069540 legacy=0x7f0cac094570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f0cb1af6640 1 -- 172.21.15.70:0/795245397 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac0950b0 con 0x7f0cac094c80 2024-09-14T10:43:58.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6f1d6bf640 1 --2- 172.21.15.70:0/3138819292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f18071de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009740 tx=0x7f6f1401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a4c057ce0db0e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6f0ffff640 1 -- 172.21.15.70:0/3138819292 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f140b1070 con 0x7f6f18071a00 2024-09-14T10:43:58.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6f0ffff640 1 -- 172.21.15.70:0/3138819292 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f140ac520 con 0x7f6f18071a00 2024-09-14T10:43:58.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.881+0000 7f6f0ffff640 1 -- 172.21.15.70:0/3138819292 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f140ac820 con 0x7f6f18071a00 2024-09-14T10:43:58.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6eedd9b640 1 --2- 172.21.15.70:0/1673143746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef0130870 0x7f6ef0132c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40097f0 tx=0x7f6ee401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3546daa2a85f635 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- 172.21.15.70:0/3138819292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 msgr2=0x7f6f18071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 --2- 172.21.15.70:0/3138819292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f18071de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009740 tx=0x7f6f1401c370 comp rx=0 tx=0).stop 2024-09-14T10:43:58.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- 172.21.15.70:0/3138819292 shutdown_connections 2024-09-14T10:43:58.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 --2- 172.21.15.70:0/3138819292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f18071de0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- 172.21.15.70:0/3138819292 >> 172.21.15.70:0/3138819292 conn(0x7f6f1809c7a0 msgr2=0x7f6f1809cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6eed59a640 1 -- 172.21.15.70:0/1673143746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee40ab580 con 0x7f6ef0130870 2024-09-14T10:43:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- 172.21.15.70:0/3138819292 shutdown_connections 2024-09-14T10:43:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- 172.21.15.70:0/3138819292 wait complete. 2024-09-14T10:43:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6eed59a640 1 -- 172.21.15.70:0/1673143746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee40b0070 con 0x7f6ef0130870 2024-09-14T10:43:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6eed59a640 1 -- 172.21.15.70:0/1673143746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee40ab870 con 0x7f6ef0130870 2024-09-14T10:43:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4450f21640 1 --2- 172.21.15.70:0/2519647427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c130480 0x7f444c132870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f443c0097f0 tx=0x7f443c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5296d6711117f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4443fff640 1 -- 172.21.15.70:0/2519647427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443c0ab580 con 0x7f444c130480 2024-09-14T10:43:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4443fff640 1 -- 172.21.15.70:0/2519647427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443c0b0070 con 0x7f444c130480 2024-09-14T10:43:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4443fff640 1 -- 172.21.15.70:0/2519647427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443c0ab870 con 0x7f444c130480 2024-09-14T10:43:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/1673143746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef0130870 msgr2=0x7f6ef0132c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 --2- 172.21.15.70:0/1673143746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef0130870 0x7f6ef0132c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40097f0 tx=0x7f6ee401c430 comp rx=0 tx=0).stop 2024-09-14T10:43:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/1673143746 shutdown_connections 2024-09-14T10:43:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 -- 172.21.15.70:0/2519647427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c130480 msgr2=0x7f444c132870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 --2- 172.21.15.70:0/2519647427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c130480 0x7f444c132870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f443c0097f0 tx=0x7f443c01c430 comp rx=0 tx=0).stop 2024-09-14T10:43:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 --2- 172.21.15.70:0/1673143746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef0130870 0x7f6ef0132c60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/1673143746 >> 172.21.15.70:0/1673143746 conn(0x7f6ef009cc30 msgr2=0x7f6ef009a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 Processor -- start 2024-09-14T10:43:58.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/1673143746 shutdown_connections 2024-09-14T10:43:58.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb1af6640 1 --2- 172.21.15.70:0/795245397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac094c80 0x7f0cac132770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009740 tx=0x7f0c9c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dcb01be1e99118 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 -- 172.21.15.70:0/2519647427 shutdown_connections 2024-09-14T10:43:58.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 --2- 172.21.15.70:0/2519647427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c130480 0x7f444c132870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 -- 172.21.15.70:0/2519647427 >> 172.21.15.70:0/2519647427 conn(0x7f444c09c950 msgr2=0x7f444c09cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/1673143746 wait complete. 2024-09-14T10:43:58.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 -- 172.21.15.70:0/2519647427 shutdown_connections 2024-09-14T10:43:58.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 -- 172.21.15.70:0/2519647427 wait complete. 2024-09-14T10:43:58.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb12f5640 1 -- 172.21.15.70:0/795245397 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9c0b2070 con 0x7f0cac094c80 2024-09-14T10:43:58.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb12f5640 1 -- 172.21.15.70:0/795245397 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0a9070 con 0x7f0cac094c80 2024-09-14T10:43:58.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb12f5640 1 -- 172.21.15.70:0/795245397 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9c0ad5b0 con 0x7f0cac094c80 2024-09-14T10:43:58.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- start start 2024-09-14T10:43:58.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f181c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f18135d20 con 0x7f6f18071a00 2024-09-14T10:43:58.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1d6bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f181c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1d6bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f181c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60530/0 (socket says 172.21.15.70:60530) 2024-09-14T10:43:58.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1d6bf640 1 -- 172.21.15.70:0/331590427 learned_addr learned my addr 172.21.15.70:0/331590427 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:58.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 Processor -- start 2024-09-14T10:43:58.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1d6bf640 1 -- 172.21.15.70:0/331590427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f18126ca0 con 0x7f6f18071a00 2024-09-14T10:43:58.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 Processor -- start 2024-09-14T10:43:58.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb455b640 1 -- 172.21.15.70:0/795245397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac094c80 msgr2=0x7f0cac132770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb455b640 1 --2- 172.21.15.70:0/795245397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac094c80 0x7f0cac132770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009740 tx=0x7f0c9c01c340 comp rx=0 tx=0).stop 2024-09-14T10:43:58.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 -- start start 2024-09-14T10:43:58.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb455b640 1 -- 172.21.15.70:0/795245397 shutdown_connections 2024-09-14T10:43:58.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb455b640 1 --2- 172.21.15.70:0/795245397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac094c80 0x7f0cac132770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb455b640 1 -- 172.21.15.70:0/795245397 >> 172.21.15.70:0/795245397 conn(0x7f0cac09e9d0 msgr2=0x7f0cac09aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb455b640 1 -- 172.21.15.70:0/795245397 shutdown_connections 2024-09-14T10:43:58.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f4453986640 1 -- start start 2024-09-14T10:43:58.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f0cb455b640 1 -- 172.21.15.70:0/795245397 wait complete. 2024-09-14T10:43:58.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1d6bf640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f181c5030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6f140af040 tx=0x7f6f1401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f140b1050 con 0x7f6f18071a00 2024-09-14T10:43:58.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f140b2040 con 0x7f6f18071a00 2024-09-14T10:43:58.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f18127f00 con 0x7f6f18071a00 2024-09-14T10:43:58.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f140b6780 con 0x7f6f18071a00 2024-09-14T10:43:58.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f18128230 con 0x7f6f18071a00 2024-09-14T10:43:58.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef00719b0 0x7f6ef0099490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.885+0000 7f6ef4c1a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0133bc0 con 0x7f6ef00719b0 2024-09-14T10:43:58.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6eee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef00719b0 0x7f6ef0099490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6eee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef00719b0 0x7f6ef0099490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60532/0 (socket says 172.21.15.70:60532) 2024-09-14T10:43:58.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6eee59c640 1 -- 172.21.15.70:0/3643120809 learned_addr learned my addr 172.21.15.70:0/3643120809 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:58.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4453986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c12a0a0 0x7f444c126d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4453986640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f444c135960 con 0x7f444c12a0a0 2024-09-14T10:43:58.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6eee59c640 1 -- 172.21.15.70:0/3643120809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef012d7a0 con 0x7f6ef00719b0 2024-09-14T10:43:58.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6eee59c640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef00719b0 0x7f6ef0099490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c480 tx=0x7f6ee000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb455b640 1 Processor -- start 2024-09-14T10:43:58.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb455b640 1 -- start start 2024-09-14T10:43:58.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f18074100 con 0x7f6f18071a00 2024-09-14T10:43:58.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4451722640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c12a0a0 0x7f444c126d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4451722640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c12a0a0 0x7f444c126d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60548/0 (socket says 172.21.15.70:60548) 2024-09-14T10:43:58.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4451722640 1 -- 172.21.15.70:0/3354673611 learned_addr learned my addr 172.21.15.70:0/3354673611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:58.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb455b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac069540 0x7f0cac08e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6f140bf030 con 0x7f6f18071a00 2024-09-14T10:43:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4451722640 1 -- 172.21.15.70:0/3354673611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c08c4e0 con 0x7f444c12a0a0 2024-09-14T10:43:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb455b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac1356e0 con 0x7f0cac069540 2024-09-14T10:43:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb22f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac069540 0x7f0cac08e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb22f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac069540 0x7f0cac08e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60560/0 (socket says 172.21.15.70:60560) 2024-09-14T10:43:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb22f7640 1 -- 172.21.15.70:0/1387866068 learned_addr learned my addr 172.21.15.70:0/1387866068 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee0018070 con 0x7f6ef00719b0 2024-09-14T10:43:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee00073b0 con 0x7f6ef00719b0 2024-09-14T10:43:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ee0007690 con 0x7f6ef00719b0 2024-09-14T10:43:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef012da30 con 0x7f6ef00719b0 2024-09-14T10:43:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef00999d0 con 0x7f6ef00719b0 2024-09-14T10:43:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f0dffb640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6efc03b8b0 0x7f6efc03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f6f140bd070 con 0x7f6f18071a00 2024-09-14T10:43:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f0dffb640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6efc041030 0x7f6efc0434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f140ade50 con 0x7f6efc041030 2024-09-14T10:43:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4451722640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c12a0a0 0x7f444c126d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f444800c3a0 tx=0x7f444800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ef0071d90 con 0x7f6ef00719b0 2024-09-14T10:43:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6f140f0050 con 0x7f6f18071a00 2024-09-14T10:43:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f1cebe640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6efc03b8b0 0x7f6efc03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f1dec0640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6efc041030 0x7f6efc0434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4448017070 con 0x7f444c12a0a0 2024-09-14T10:43:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4448005200 con 0x7f444c12a0a0 2024-09-14T10:43:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4448003600 con 0x7f444c12a0a0 2024-09-14T10:43:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c129500 con 0x7f444c12a0a0 2024-09-14T10:43:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c127420 con 0x7f444c12a0a0 2024-09-14T10:43:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6ee001b070 con 0x7f6ef00719b0 2024-09-14T10:43:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb22f7640 1 -- 172.21.15.70:0/1387866068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac08fb60 con 0x7f0cac069540 2024-09-14T10:43:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ed003b8b0 0x7f6ed003dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb22f7640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac069540 0x7f0cac08e4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800c450 tx=0x7f0ca800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f1dec0640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6efc041030 0x7f6efc0434b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f6ee004f3c0 con 0x7f6ef00719b0 2024-09-14T10:43:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6f1cebe640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6efc03b8b0 0x7f6efc03dd70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f08007fd0 tx=0x7f6f08007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6ed0041030 0x7f6ed00434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ee000ee50 con 0x7f6ed0041030 2024-09-14T10:43:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6ee00047f0 con 0x7f6ef00719b0 2024-09-14T10:43:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f444c1290b0 con 0x7f444c12a0a0 2024-09-14T10:43:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f444801a070 con 0x7f444c12a0a0 2024-09-14T10:43:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6eeed9d640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6ed0041030 0x7f6ed00434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f6eedd9b640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ed003b8b0 0x7f6ed003dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca8017070 con 0x7f0cac069540 2024-09-14T10:43:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8005c20 con 0x7f0cac069540 2024-09-14T10:43:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac091cd0 con 0x7f0cac069540 2024-09-14T10:43:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca80070d0 con 0x7f0cac069540 2024-09-14T10:43:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f6eeed9d640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6ed0041030 0x7f6ed00434b0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac08ebd0 con 0x7f0cac069540 2024-09-14T10:43:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f6eedd9b640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ed003b8b0 0x7f6ed003dd70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40af000 tx=0x7f6ee40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f443003b8e0 0x7f443003dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f444804e980 con 0x7f444c12a0a0 2024-09-14T10:43:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7f4430041060 0x7f44300434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4430043bb0 con 0x7f4430041060 2024-09-14T10:43:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.889+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f44480532a0 con 0x7f444c12a0a0 2024-09-14T10:43:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f4451f23640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7f4430041060 0x7f44300434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f4450f21640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f443003b8e0 0x7f443003dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cac090bb0 con 0x7f0cac069540 2024-09-14T10:43:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ee000ee50 con 0x7f6ed0041030 2024-09-14T10:43:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f4451f23640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7f4430041060 0x7f44300434e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0ca801a070 con 0x7f0cac069540 2024-09-14T10:43:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f140ade50 con 0x7f6efc041030 2024-09-14T10:43:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0ca2ffd640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0c9003b900 0x7f0c9003ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0ca804efd0 con 0x7f0cac069540 2024-09-14T10:43:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0ca2ffd640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7f0c90041080 0x7f0c90043500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ca8013e50 con 0x7f0c90041080 2024-09-14T10:43:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f0ca804f390 con 0x7f0cac069540 2024-09-14T10:43:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0cb1af6640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0c9003b900 0x7f0c9003ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f4450f21640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f443003b8e0 0x7f443003dda0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f443c0af000 tx=0x7f443c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0cb2af8640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7f0c90041080 0x7f0c90043500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0cb1af6640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0c9003b900 0x7f0c9003ddc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0af000 tx=0x7f0c9c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f0cb2af8640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7f0c90041080 0x7f0c90043500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.893+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4430043bb0 con 0x7f4430041060 2024-09-14T10:43:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.897+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ca8013e50 con 0x7f0c90041080 2024-09-14T10:43:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.905+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f181275e0 con 0x7f6efc041030 2024-09-14T10:43:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f0dffb640 1 -- 172.21.15.70:0/331590427 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6f1000adb0 con 0x7f6efc041030 2024-09-14T10:43:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6efc041030 msgr2=0x7f6efc0434b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6efc041030 0x7f6efc0434b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f444c12a480 con 0x7f4430041060 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6efc03b8b0 msgr2=0x7f6efc03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6efc03b8b0 0x7f6efc03dd70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f08007fd0 tx=0x7f6f08007980 comp rx=0 tx=0).stop 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 msgr2=0x7f6f181c5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f181c5030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6f140af040 tx=0x7f6f1401abb0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 shutdown_connections 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6efc041030 0x7f6efc0434b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6efc03b8b0 0x7f6efc03dd70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 --2- 172.21.15.70:0/331590427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f18071a00 0x7f6f181c5030 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 >> 172.21.15.70:0/331590427 conn(0x7f6f1809c7a0 msgr2=0x7f6f180991b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 shutdown_connections 2024-09-14T10:43:58.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f6f1f923640 1 -- 172.21.15.70:0/331590427 wait complete. 2024-09-14T10:43:58.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4441ffb640 1 -- 172.21.15.70:0/3354673611 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f444c12a480 con 0x7f4430041060 2024-09-14T10:43:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7f4430041060 msgr2=0x7f44300434e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7f4430041060 0x7f44300434e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f443003b8e0 msgr2=0x7f443003dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f443003b8e0 0x7f443003dda0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f443c0af000 tx=0x7f443c0a7000 comp rx=0 tx=0).stop 2024-09-14T10:43:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c12a0a0 msgr2=0x7f444c126d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c12a0a0 0x7f444c126d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f444800c3a0 tx=0x7f444800c860 comp rx=0 tx=0).stop 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 shutdown_connections 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7f4430041060 0x7f44300434e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f443003b8e0 0x7f443003dda0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 --2- 172.21.15.70:0/3354673611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f444c12a0a0 0x7f444c126d10 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f444800c3a0 tx=0x7f444800c860 comp rx=0 tx=0).stop 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.909+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 >> 172.21.15.70:0/3354673611 conn(0x7f444c09c950 msgr2=0x7f444c12e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.913+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 shutdown_connections 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.913+0000 7f4453986640 1 -- 172.21.15.70:0/3354673611 wait complete. 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.913+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ef0071d90 con 0x7f6ed0041030 2024-09-14T10:43:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.913+0000 7f6edeffd640 1 -- 172.21.15.70:0/3643120809 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ef0071d90 con 0x7f6ed0041030 2024-09-14T10:43:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.913+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6ed0041030 msgr2=0x7f6ed00434b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.913+0000 7f6ef4c1a640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6ed0041030 0x7f6ed00434b0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ed003b8b0 msgr2=0x7f6ed003dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ed003b8b0 0x7f6ed003dd70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40af000 tx=0x7f6ee40a7000 comp rx=0 tx=0).stop 2024-09-14T10:43:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef00719b0 msgr2=0x7f6ef0099490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef00719b0 0x7f6ef0099490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c480 tx=0x7f6ee000c940 comp rx=0 tx=0).stop 2024-09-14T10:43:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 shutdown_connections 2024-09-14T10:43:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6ed0041030 0x7f6ed00434b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ed003b8b0 0x7f6ed003dd70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 --2- 172.21.15.70:0/3643120809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ef00719b0 0x7f6ef0099490 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 >> 172.21.15.70:0/3643120809 conn(0x7f6ef009cc30 msgr2=0x7f6ef01329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 shutdown_connections 2024-09-14T10:43:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.917+0000 7f6ef4c1a640 1 -- 172.21.15.70:0/3643120809 wait complete. 2024-09-14T10:43:58.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0cac090d70 con 0x7f0c90041080 2024-09-14T10:43:58.924 INFO:teuthology.orchestra.run.smithi070.stdout:47244640262 2024-09-14T10:43:58.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:43:58.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0ca2ffd640 1 -- 172.21.15.70:0/1387866068 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0cac090d70 con 0x7f0c90041080 2024-09-14T10:43:58.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7f0c90041080 msgr2=0x7f0c90043500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7f0c90041080 0x7f0c90043500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0c9003b900 msgr2=0x7f0c9003ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0c9003b900 0x7f0c9003ddc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0af000 tx=0x7f0c9c0a7000 comp rx=0 tx=0).stop 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac069540 msgr2=0x7f0cac08e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac069540 0x7f0cac08e4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800c450 tx=0x7f0ca800c910 comp rx=0 tx=0).stop 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 shutdown_connections 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7f0c90041080 0x7f0c90043500 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0c9003b900 0x7f0c9003ddc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 --2- 172.21.15.70:0/1387866068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cac069540 0x7f0cac08e4c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 >> 172.21.15.70:0/1387866068 conn(0x7f0cac09e9d0 msgr2=0x7f0cac098dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 shutdown_connections 2024-09-14T10:43:58.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:58.925+0000 7f0cb455b640 1 -- 172.21.15.70:0/1387866068 wait complete. 2024-09-14T10:43:58.928 INFO:teuthology.orchestra.run.smithi070.stdout:42949672964 2024-09-14T10:43:58.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:43:58.934 INFO:teuthology.orchestra.run.smithi070.stdout:38654705668 2024-09-14T10:43:58.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:43:58.940 INFO:teuthology.orchestra.run.smithi070.stdout:42949672964 2024-09-14T10:43:58.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:43:59.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da394d640 1 Processor -- start 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da394d640 1 -- start start 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da394d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4d9c130040 0x7f4d9c134a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da394d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c069af0 con 0x7f4d9c12f550 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da394d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9c0916b0 con 0x7f4d9c130040 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da0ee8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4d9c130040 0x7f4d9c134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da16e9640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4d9c12f550 0x7f4d9c12f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40432/0 (socket says 172.21.15.70:40432) 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da16e9640 1 -- 172.21.15.70:0/3918435500 learned_addr learned my addr 172.21.15.70:0/3918435500 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da0ee8640 1 -- 172.21.15.70:0/3918435500 >> v1:172.21.15.70:6789/0 conn(0x7f4d9c12f550 legacy=0x7f4d9c12f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.033+0000 7f4da0ee8640 1 -- 172.21.15.70:0/3918435500 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c09b5a0 con 0x7f4d9c130040 2024-09-14T10:43:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da0ee8640 1 --2- 172.21.15.70:0/3918435500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c130040 0x7f4d9c134a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009740 tx=0x7f4d8c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79159d070fd77d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4d93fff640 1 -- 172.21.15.70:0/3918435500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8c0b0070 con 0x7f4d9c130040 2024-09-14T10:43:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4d93fff640 1 -- 172.21.15.70:0/3918435500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c0ab530 con 0x7f4d9c130040 2024-09-14T10:43:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4d93fff640 1 -- 172.21.15.70:0/3918435500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8c0ab830 con 0x7f4d9c130040 2024-09-14T10:43:59.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 -- 172.21.15.70:0/3918435500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c130040 msgr2=0x7f4d9c134a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 --2- 172.21.15.70:0/3918435500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c130040 0x7f4d9c134a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009740 tx=0x7f4d8c01c370 comp rx=0 tx=0).stop 2024-09-14T10:43:59.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 -- 172.21.15.70:0/3918435500 shutdown_connections 2024-09-14T10:43:59.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 --2- 172.21.15.70:0/3918435500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c130040 0x7f4d9c134a80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 -- 172.21.15.70:0/3918435500 >> 172.21.15.70:0/3918435500 conn(0x7f4d9c09e8f0 msgr2=0x7f4d9c09adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:59.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 -- 172.21.15.70:0/3918435500 shutdown_connections 2024-09-14T10:43:59.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 -- 172.21.15.70:0/3918435500 wait complete. 2024-09-14T10:43:59.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 Processor -- start 2024-09-14T10:43:59.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 -- start start 2024-09-14T10:43:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c12f550 0x7f4d9c1c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.037+0000 7f4da394d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1379f0 con 0x7f4d9c12f550 2024-09-14T10:43:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da16e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c12f550 0x7f4d9c1c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da16e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c12f550 0x7f4d9c1c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60588/0 (socket says 172.21.15.70:60588) 2024-09-14T10:43:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da16e9640 1 -- 172.21.15.70:0/3125737262 learned_addr learned my addr 172.21.15.70:0/3125737262 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da16e9640 1 -- 172.21.15.70:0/3125737262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c072c20 con 0x7f4d9c12f550 2024-09-14T10:43:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da16e9640 1 --2- 172.21.15.70:0/3125737262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c12f550 0x7f4d9c1c6c30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800c450 tx=0x7f4d9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4d91ffb640 1 -- 172.21.15.70:0/3125737262 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d98017070 con 0x7f4d9c12f550 2024-09-14T10:43:59.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c1c7170 con 0x7f4d9c12f550 2024-09-14T10:43:59.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c1c7680 con 0x7f4d9c12f550 2024-09-14T10:43:59.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4d91ffb640 1 -- 172.21.15.70:0/3125737262 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d98005c20 con 0x7f4d9c12f550 2024-09-14T10:43:59.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4d91ffb640 1 -- 172.21.15.70:0/3125737262 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d980070d0 con 0x7f4d9c12f550 2024-09-14T10:43:59.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c005090 con 0x7f4d9c12f550 2024-09-14T10:43:59.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4d91ffb640 1 -- 172.21.15.70:0/3125737262 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f4d9801a070 con 0x7f4d9c12f550 2024-09-14T10:43:59.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4d91ffb640 1 --2- 172.21.15.70:0/3125737262 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4d8003b860 0x7f4d8003dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4d91ffb640 1 -- 172.21.15.70:0/3125737262 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f4d9804e970 con 0x7f4d9c12f550 2024-09-14T10:43:59.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da0ee8640 1 --2- 172.21.15.70:0/3125737262 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4d8003b860 0x7f4d8003dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.041+0000 7f4da0ee8640 1 --2- 172.21.15.70:0/3125737262 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4d8003b860 0x7f4d8003dd20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0ad000 tx=0x7f4d8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27e2831640 1 Processor -- start 2024-09-14T10:43:59.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27e2831640 1 -- start start 2024-09-14T10:43:59.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27e2831640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f27dc06e7b0 0x7f27dc134b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27e2831640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27dc06f5d0 con 0x7f27dc098ae0 2024-09-14T10:43:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27e2831640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f27dc06fa30 con 0x7f27dc06e7b0 2024-09-14T10:43:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27d3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f27dc06e7b0 0x7f27dc134b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27dbfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f27dc098ae0 0x7f27dc06e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40442/0 (socket says 172.21.15.70:40442) 2024-09-14T10:43:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27d3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f27dc06e7b0 0x7f27dc134b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60594/0 (socket says 172.21.15.70:60594) 2024-09-14T10:43:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27dbfff640 1 -- 172.21.15.70:0/38401516 learned_addr learned my addr 172.21.15.70:0/38401516 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f4d91ffb640 1 -- 172.21.15.70:0/3125737262 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f4d98050e20 con 0x7f4d9c12f550 2024-09-14T10:43:59.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27d3fff640 1 -- 172.21.15.70:0/38401516 >> v1:172.21.15.70:6789/0 conn(0x7f27dc098ae0 legacy=0x7f27dc06e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27db7fe640 1 -- 172.21.15.70:0/38401516 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606207159 0 0) 0x7f27dc06f5d0 con 0x7f27dc098ae0 2024-09-14T10:43:59.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.049+0000 7f27d3fff640 1 -- 172.21.15.70:0/38401516 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc06fc70 con 0x7f27dc06e7b0 2024-09-14T10:43:59.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27d3fff640 1 --2- 172.21.15.70:0/38401516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc134b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009740 tx=0x7f27c401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a123ceefe7411235 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27db7fe640 1 -- 172.21.15.70:0/38401516 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c40b1070 con 0x7f27dc06e7b0 2024-09-14T10:43:59.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27db7fe640 1 -- 172.21.15.70:0/38401516 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c40ac520 con 0x7f27dc06e7b0 2024-09-14T10:43:59.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27db7fe640 1 -- 172.21.15.70:0/38401516 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c40ac820 con 0x7f27dc06e7b0 2024-09-14T10:43:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27e2831640 1 -- 172.21.15.70:0/38401516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 msgr2=0x7f27dc134b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27e2831640 1 --2- 172.21.15.70:0/38401516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc134b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009740 tx=0x7f27c401c370 comp rx=0 tx=0).stop 2024-09-14T10:43:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27e2831640 1 -- 172.21.15.70:0/38401516 shutdown_connections 2024-09-14T10:43:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27e2831640 1 --2- 172.21.15.70:0/38401516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc134b80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27e2831640 1 -- 172.21.15.70:0/38401516 >> 172.21.15.70:0/38401516 conn(0x7f27dc09c8d0 msgr2=0x7f27dc09cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27e2831640 1 -- 172.21.15.70:0/38401516 shutdown_connections 2024-09-14T10:43:59.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.053+0000 7f27e2831640 1 -- 172.21.15.70:0/38401516 wait complete. 2024-09-14T10:43:59.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27e2831640 1 Processor -- start 2024-09-14T10:43:59.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27e2831640 1 -- start start 2024-09-14T10:43:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27e2831640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc1335f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27e2831640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc137c70 con 0x7f27dc06e7b0 2024-09-14T10:43:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27dbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc1335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27dbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc1335f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60610/0 (socket says 172.21.15.70:60610) 2024-09-14T10:43:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27dbfff640 1 -- 172.21.15.70:0/3277542687 learned_addr learned my addr 172.21.15.70:0/3277542687 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:59.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27dbfff640 1 -- 172.21.15.70:0/3277542687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc134d70 con 0x7f27dc06e7b0 2024-09-14T10:43:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27dbfff640 1 --2- 172.21.15.70:0/3277542687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc1335f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00c3d0 tx=0x7f27cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27d97fa640 1 -- 172.21.15.70:0/3277542687 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27cc007410 con 0x7f27dc06e7b0 2024-09-14T10:43:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27d97fa640 1 -- 172.21.15.70:0/3277542687 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc0075d0 con 0x7f27dc06e7b0 2024-09-14T10:43:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27dc126c90 con 0x7f27dc06e7b0 2024-09-14T10:43:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27d97fa640 1 -- 172.21.15.70:0/3277542687 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27cc004960 con 0x7f27dc06e7b0 2024-09-14T10:43:59.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27dc126fc0 con 0x7f27dc06e7b0 2024-09-14T10:43:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27d97fa640 1 -- 172.21.15.70:0/3277542687 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f27cc011070 con 0x7f27dc06e7b0 2024-09-14T10:43:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27d97fa640 1 --2- 172.21.15.70:0/3277542687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27bc03b8b0 0x7f27bc03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27d97fa640 1 -- 172.21.15.70:0/3277542687 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f27cc04f1e0 con 0x7f27dc06e7b0 2024-09-14T10:43:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27dc06e0a0 con 0x7f27dc06e7b0 2024-09-14T10:43:59.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.057+0000 7f27d3fff640 1 --2- 172.21.15.70:0/3277542687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27bc03b8b0 0x7f27bc03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.061+0000 7f27d3fff640 1 --2- 172.21.15.70:0/3277542687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27bc03b8b0 0x7f27bc03dd70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009740 tx=0x7f27c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.069+0000 7f27d97fa640 1 -- 172.21.15.70:0/3277542687 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f27cc010d50 con 0x7f27dc06e7b0 2024-09-14T10:43:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e65ab7640 1 Processor -- start 2024-09-14T10:43:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e65ab7640 1 -- start start 2024-09-14T10:43:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e65ab7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e6012f8b0 0x7f9e6012fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e65ab7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e60070a60 con 0x7f9e601301d0 2024-09-14T10:43:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e65ab7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6012f4f0 con 0x7f9e6012f8b0 2024-09-14T10:43:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e5f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e6012f8b0 0x7f9e6012fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e5effd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9e601301d0 0x7f9e6006f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40450/0 (socket says 172.21.15.70:40450) 2024-09-14T10:43:59.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e5effd640 1 -- 172.21.15.70:0/2136075781 learned_addr learned my addr 172.21.15.70:0/2136075781 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:59.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e5f7fe640 1 -- 172.21.15.70:0/2136075781 >> v1:172.21.15.70:6789/0 conn(0x7f9e601301d0 legacy=0x7f9e6006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e5e7fc640 1 -- 172.21.15.70:0/2136075781 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3969153814 0 0) 0x7f9e60070a60 con 0x7f9e601301d0 2024-09-14T10:43:59.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.097+0000 7f9e5f7fe640 1 -- 172.21.15.70:0/2136075781 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6009f300 con 0x7f9e6012f8b0 2024-09-14T10:43:59.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e5f7fe640 1 --2- 172.21.15.70:0/2136075781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e6012fc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009740 tx=0x7f9e5001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766d3aa7a0986ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e5e7fc640 1 -- 172.21.15.70:0/2136075781 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e500b0070 con 0x7f9e6012f8b0 2024-09-14T10:43:59.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e5e7fc640 1 -- 172.21.15.70:0/2136075781 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e500ab530 con 0x7f9e6012f8b0 2024-09-14T10:43:59.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e5e7fc640 1 -- 172.21.15.70:0/2136075781 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e500ab830 con 0x7f9e6012f8b0 2024-09-14T10:43:59.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e65ab7640 1 -- 172.21.15.70:0/2136075781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 msgr2=0x7f9e6012fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e65ab7640 1 --2- 172.21.15.70:0/2136075781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e6012fc90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009740 tx=0x7f9e5001c370 comp rx=0 tx=0).stop 2024-09-14T10:43:59.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e65ab7640 1 -- 172.21.15.70:0/2136075781 shutdown_connections 2024-09-14T10:43:59.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e65ab7640 1 --2- 172.21.15.70:0/2136075781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e6012fc90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.101+0000 7f9e65ab7640 1 -- 172.21.15.70:0/2136075781 >> 172.21.15.70:0/2136075781 conn(0x7f9e600a2520 msgr2=0x7f9e6009ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:59.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e65ab7640 1 -- 172.21.15.70:0/2136075781 shutdown_connections 2024-09-14T10:43:59.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e65ab7640 1 -- 172.21.15.70:0/2136075781 wait complete. 2024-09-14T10:43:59.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e65ab7640 1 Processor -- start 2024-09-14T10:43:59.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e65ab7640 1 -- start start 2024-09-14T10:43:59.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e65ab7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e60130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e65ab7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60138250 con 0x7f9e6012f8b0 2024-09-14T10:43:59.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e60130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e60130840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60630/0 (socket says 172.21.15.70:60630) 2024-09-14T10:43:59.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e5f7fe640 1 -- 172.21.15.70:0/910218879 learned_addr learned my addr 172.21.15.70:0/910218879 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:59.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e5f7fe640 1 -- 172.21.15.70:0/910218879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6012a010 con 0x7f9e6012f8b0 2024-09-14T10:43:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e5f7fe640 1 --2- 172.21.15.70:0/910218879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e60130840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e500ae040 tx=0x7f9e5001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e47fff640 1 -- 172.21.15.70:0/910218879 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e500b0050 con 0x7f9e6012f8b0 2024-09-14T10:43:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e47fff640 1 -- 172.21.15.70:0/910218879 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e500b1040 con 0x7f9e6012f8b0 2024-09-14T10:43:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e65ab7640 1 -- 172.21.15.70:0/910218879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e601329b0 con 0x7f9e6012f8b0 2024-09-14T10:43:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e47fff640 1 -- 172.21.15.70:0/910218879 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e500aab80 con 0x7f9e6012f8b0 2024-09-14T10:43:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e65ab7640 1 -- 172.21.15.70:0/910218879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e60130d80 con 0x7f9e6012f8b0 2024-09-14T10:43:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e45ffb640 1 -- 172.21.15.70:0/910218879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e38005090 con 0x7f9e6012f8b0 2024-09-14T10:43:59.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e47fff640 1 -- 172.21.15.70:0/910218879 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9e500be030 con 0x7f9e6012f8b0 2024-09-14T10:43:59.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e47fff640 1 --2- 172.21.15.70:0/910218879 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9e4c03b8e0 0x7f9e4c03dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.105+0000 7f9e47fff640 1 -- 172.21.15.70:0/910218879 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9e500bc070 con 0x7f9e6012f8b0 2024-09-14T10:43:59.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f9e5effd640 1 --2- 172.21.15.70:0/910218879 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9e4c03b8e0 0x7f9e4c03dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f9e5effd640 1 --2- 172.21.15.70:0/910218879 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9e4c03b8e0 0x7f9e4c03dda0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9e54007fd0 tx=0x7f9e54007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10f3155640 1 Processor -- start 2024-09-14T10:43:59.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10f3155640 1 -- start start 2024-09-14T10:43:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10f3155640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10ec06fbf0 0x7f10ec134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10f3155640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10ec099e50 con 0x7f10ec06f100 2024-09-14T10:43:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10f3155640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f10ec09bb80 con 0x7f10ec06fbf0 2024-09-14T10:43:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10ebfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10ec06fbf0 0x7f10ec134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10f0ef1640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f10ec06f100 0x7f10ec06f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40466/0 (socket says 172.21.15.70:40466) 2024-09-14T10:43:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10ebfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10ec06fbf0 0x7f10ec134bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60644/0 (socket says 172.21.15.70:60644) 2024-09-14T10:43:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10f0ef1640 1 -- 172.21.15.70:0/1996561663 learned_addr learned my addr 172.21.15.70:0/1996561663 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:43:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10ebfff640 1 -- 172.21.15.70:0/1996561663 >> v1:172.21.15.70:6789/0 conn(0x7f10ec06f100 legacy=0x7f10ec06f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.109+0000 7f10ebfff640 1 -- 172.21.15.70:0/1996561663 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ec09c040 con 0x7f10ec06fbf0 2024-09-14T10:43:59.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.113+0000 7f10ebfff640 1 --2- 172.21.15.70:0/1996561663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06fbf0 0x7f10ec134bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009740 tx=0x7f10d801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4c463b2bfd7fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f10eb7fe640 1 -- 172.21.15.70:0/1996561663 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d80b0070 con 0x7f10ec06fbf0 2024-09-14T10:43:59.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f10eb7fe640 1 -- 172.21.15.70:0/1996561663 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d80ab530 con 0x7f10ec06fbf0 2024-09-14T10:43:59.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f10eb7fe640 1 -- 172.21.15.70:0/1996561663 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d80ab830 con 0x7f10ec06fbf0 2024-09-14T10:43:59.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f9e47fff640 1 -- 172.21.15.70:0/910218879 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f9e500c5060 con 0x7f9e6012f8b0 2024-09-14T10:43:59.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f10f3155640 1 -- 172.21.15.70:0/1996561663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06fbf0 msgr2=0x7f10ec134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f10f3155640 1 --2- 172.21.15.70:0/1996561663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06fbf0 0x7f10ec134bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009740 tx=0x7f10d801c370 comp rx=0 tx=0).stop 2024-09-14T10:43:59.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f10f3155640 1 -- 172.21.15.70:0/1996561663 shutdown_connections 2024-09-14T10:43:59.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f10f3155640 1 --2- 172.21.15.70:0/1996561663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06fbf0 0x7f10ec134bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.117+0000 7f10f3155640 1 -- 172.21.15.70:0/1996561663 >> 172.21.15.70:0/1996561663 conn(0x7f10ec09c950 msgr2=0x7f10ec09cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:59.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 -- 172.21.15.70:0/1996561663 shutdown_connections 2024-09-14T10:43:59.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 -- 172.21.15.70:0/1996561663 wait complete. 2024-09-14T10:43:59.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 Processor -- start 2024-09-14T10:43:59.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 -- start start 2024-09-14T10:43:59.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06f100 0x7f10ec131830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f10ec137ce0 con 0x7f10ec06f100 2024-09-14T10:43:59.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f0ef1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06f100 0x7f10ec131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f0ef1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06f100 0x7f10ec131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60660/0 (socket says 172.21.15.70:60660) 2024-09-14T10:43:59.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f0ef1640 1 -- 172.21.15.70:0/2308312663 learned_addr learned my addr 172.21.15.70:0/2308312663 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:43:59.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f0ef1640 1 -- 172.21.15.70:0/2308312663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ec097cb0 con 0x7f10ec06f100 2024-09-14T10:43:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f0ef1640 1 --2- 172.21.15.70:0/2308312663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06f100 0x7f10ec131830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c450 tx=0x7f10e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10e97fa640 1 -- 172.21.15.70:0/2308312663 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e0017070 con 0x7f10ec06f100 2024-09-14T10:43:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10e97fa640 1 -- 172.21.15.70:0/2308312663 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e0005c20 con 0x7f10ec06f100 2024-09-14T10:43:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10e97fa640 1 -- 172.21.15.70:0/2308312663 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e00070d0 con 0x7f10ec06f100 2024-09-14T10:43:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ec0989b0 con 0x7f10ec06f100 2024-09-14T10:43:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ec131d70 con 0x7f10ec06f100 2024-09-14T10:43:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ec06f4e0 con 0x7f10ec06f100 2024-09-14T10:43:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.121+0000 7f10e97fa640 1 -- 172.21.15.70:0/2308312663 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f10e001a070 con 0x7f10ec06f100 2024-09-14T10:43:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.125+0000 7f10e97fa640 1 --2- 172.21.15.70:0/2308312663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f10d003b8e0 0x7f10d003dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:43:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.125+0000 7f10e97fa640 1 -- 172.21.15.70:0/2308312663 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f10e004e850 con 0x7f10ec06f100 2024-09-14T10:43:59.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.125+0000 7f10ebfff640 1 --2- 172.21.15.70:0/2308312663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f10d003b8e0 0x7f10d003dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:43:59.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.125+0000 7f10ebfff640 1 --2- 172.21.15.70:0/2308312663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f10d003b8e0 0x7f10d003dda0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f10d80ad000 tx=0x7f10d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:43:59.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.133+0000 7f10e97fa640 1 -- 172.21.15.70:0/2308312663 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f10e0019cd0 con 0x7f10ec06f100 2024-09-14T10:43:59.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.229+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4d7c005380 con 0x7f4d9c12f550 2024-09-14T10:43:59.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.229+0000 7f4d91ffb640 1 -- 172.21.15.70:0/3125737262 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d9801b3b0 con 0x7f4d9c12f550 2024-09-14T10:43:59.226 INFO:teuthology.orchestra.run.smithi070.stdout:47244640261 2024-09-14T10:43:59.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4d8003b860 msgr2=0x7f4d8003dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 --2- 172.21.15.70:0/3125737262 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4d8003b860 0x7f4d8003dd20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0ad000 tx=0x7f4d8c008040 comp rx=0 tx=0).stop 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c12f550 msgr2=0x7f4d9c1c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 --2- 172.21.15.70:0/3125737262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c12f550 0x7f4d9c1c6c30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800c450 tx=0x7f4d9800c910 comp rx=0 tx=0).stop 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 shutdown_connections 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 --2- 172.21.15.70:0/3125737262 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4d8003b860 0x7f4d8003dd20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 --2- 172.21.15.70:0/3125737262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d9c12f550 0x7f4d9c1c6c30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 >> 172.21.15.70:0/3125737262 conn(0x7f4d9c09e8f0 msgr2=0x7f4d9c097800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 shutdown_connections 2024-09-14T10:43:59.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.233+0000 7f4da394d640 1 -- 172.21.15.70:0/3125737262 wait complete. 2024-09-14T10:43:59.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-09-14T10:43:59.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 -- 172.21.15.70:0/910218879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9e38005380 con 0x7f9e6012f8b0 2024-09-14T10:43:59.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e47fff640 1 -- 172.21.15.70:0/910218879 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e6012a010 con 0x7f9e6012f8b0 2024-09-14T10:43:59.277 INFO:teuthology.orchestra.run.smithi070.stdout:38654705666 2024-09-14T10:43:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 -- 172.21.15.70:0/910218879 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9e4c03b8e0 msgr2=0x7f9e4c03dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 --2- 172.21.15.70:0/910218879 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9e4c03b8e0 0x7f9e4c03dda0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9e54007fd0 tx=0x7f9e54007900 comp rx=0 tx=0).stop 2024-09-14T10:43:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 -- 172.21.15.70:0/910218879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 msgr2=0x7f9e60130840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 --2- 172.21.15.70:0/910218879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e60130840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9e500ae040 tx=0x7f9e5001abb0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 -- 172.21.15.70:0/910218879 shutdown_connections 2024-09-14T10:43:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 --2- 172.21.15.70:0/910218879 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9e4c03b8e0 0x7f9e4c03dda0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 --2- 172.21.15.70:0/910218879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e6012f8b0 0x7f9e60130840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 -- 172.21.15.70:0/910218879 >> 172.21.15.70:0/910218879 conn(0x7f9e600a2520 msgr2=0x7f9e6009d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 -- 172.21.15.70:0/910218879 shutdown_connections 2024-09-14T10:43:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.281+0000 7f9e45ffb640 1 -- 172.21.15.70:0/910218879 wait complete. 2024-09-14T10:43:59.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.0 2024-09-14T10:43:59.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f27dc06c890 con 0x7f27dc06e7b0 2024-09-14T10:43:59.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27d97fa640 1 -- 172.21.15.70:0/3277542687 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f27cc012d70 con 0x7f27dc06e7b0 2024-09-14T10:43:59.321 INFO:teuthology.orchestra.run.smithi070.stdout:42949672963 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27bc03b8b0 msgr2=0x7f27bc03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 --2- 172.21.15.70:0/3277542687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27bc03b8b0 0x7f27bc03dd70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009740 tx=0x7f27c4008040 comp rx=0 tx=0).stop 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 msgr2=0x7f27dc1335f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 --2- 172.21.15.70:0/3277542687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc1335f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00c3d0 tx=0x7f27cc00c890 comp rx=0 tx=0).stop 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 shutdown_connections 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 --2- 172.21.15.70:0/3277542687 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27bc03b8b0 0x7f27bc03dd70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 --2- 172.21.15.70:0/3277542687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27dc06e7b0 0x7f27dc1335f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 >> 172.21.15.70:0/3277542687 conn(0x7f27dc09c8d0 msgr2=0x7f27dc073120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 shutdown_connections 2024-09-14T10:43:59.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.325+0000 7f27e2831640 1 -- 172.21.15.70:0/3277542687 wait complete. 2024-09-14T10:43:59.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2024-09-14T10:43:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.365+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f10ec06c890 con 0x7f10ec06f100 2024-09-14T10:43:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.365+0000 7f10e97fa640 1 -- 172.21.15.70:0/2308312663 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f10e001b400 con 0x7f10ec06f100 2024-09-14T10:43:59.363 INFO:teuthology.orchestra.run.smithi070.stdout:42949672963 2024-09-14T10:43:59.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f10d003b8e0 msgr2=0x7f10d003dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 --2- 172.21.15.70:0/2308312663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f10d003b8e0 0x7f10d003dda0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f10d80ad000 tx=0x7f10d80a6000 comp rx=0 tx=0).stop 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06f100 msgr2=0x7f10ec131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 --2- 172.21.15.70:0/2308312663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06f100 0x7f10ec131830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c450 tx=0x7f10e000c910 comp rx=0 tx=0).stop 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 shutdown_connections 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 --2- 172.21.15.70:0/2308312663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f10d003b8e0 0x7f10d003dda0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 --2- 172.21.15.70:0/2308312663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec06f100 0x7f10ec131830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 >> 172.21.15.70:0/2308312663 conn(0x7f10ec09c950 msgr2=0x7f10ec072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 shutdown_connections 2024-09-14T10:43:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:43:59.369+0000 7f10f3155640 1 -- 172.21.15.70:0/2308312663 wait complete. 2024-09-14T10:43:59.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.1 2024-09-14T10:44:00.245 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:44:00.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:44:00.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:44:00.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7fa005e97640 1 Processor -- start 2024-09-14T10:44:00.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7fa005e97640 1 -- start start 2024-09-14T10:44:00.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7fa005e97640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa000130480 0x7fa000132870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7fa005e97640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa000072980 con 0x7fa00012a0a0 2024-09-14T10:44:00.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7fa005e97640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa000129c70 con 0x7fa000130480 2024-09-14T10:44:00.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7f9ffeffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa000130480 0x7fa000132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7f9fff7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa00012a0a0 0x7fa00012a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40480/0 (socket says 172.21.15.70:40480) 2024-09-14T10:44:00.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7f9fff7fe640 1 -- 172.21.15.70:0/4216172508 learned_addr learned my addr 172.21.15.70:0/4216172508 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:44:00.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7f9ffeffd640 1 -- 172.21.15.70:0/4216172508 >> v1:172.21.15.70:6789/0 conn(0x7fa00012a0a0 legacy=0x7fa00012a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.369+0000 7f9ffeffd640 1 -- 172.21.15.70:0/4216172508 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00009ba20 con 0x7fa000130480 2024-09-14T10:44:00.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9ffeffd640 1 --2- 172.21.15.70:0/4216172508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa000130480 0x7fa000132870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009740 tx=0x7f9ff401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a0ff5f0f38cad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9ffe7fc640 1 -- 172.21.15.70:0/4216172508 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff40b1070 con 0x7fa000130480 2024-09-14T10:44:00.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9ffe7fc640 1 -- 172.21.15.70:0/4216172508 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff40ac520 con 0x7fa000130480 2024-09-14T10:44:00.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9ffe7fc640 1 -- 172.21.15.70:0/4216172508 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff40ac820 con 0x7fa000130480 2024-09-14T10:44:00.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- 172.21.15.70:0/4216172508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa000130480 msgr2=0x7fa000132870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 --2- 172.21.15.70:0/4216172508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa000130480 0x7fa000132870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009740 tx=0x7f9ff401c370 comp rx=0 tx=0).stop 2024-09-14T10:44:00.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- 172.21.15.70:0/4216172508 shutdown_connections 2024-09-14T10:44:00.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 --2- 172.21.15.70:0/4216172508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa000130480 0x7fa000132870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- 172.21.15.70:0/4216172508 >> 172.21.15.70:0/4216172508 conn(0x7fa00009c950 msgr2=0x7fa00009cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- 172.21.15.70:0/4216172508 shutdown_connections 2024-09-14T10:44:00.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- 172.21.15.70:0/4216172508 wait complete. 2024-09-14T10:44:00.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 Processor -- start 2024-09-14T10:44:00.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- start start 2024-09-14T10:44:00.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa00012a0a0 0x7fa000099730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa000135960 con 0x7fa00012a0a0 2024-09-14T10:44:00.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9fff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa00012a0a0 0x7fa000099730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9fff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa00012a0a0 0x7fa000099730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60676/0 (socket says 172.21.15.70:60676) 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9fff7fe640 1 -- 172.21.15.70:0/531493944 learned_addr learned my addr 172.21.15.70:0/531493944 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9fff7fe640 1 -- 172.21.15.70:0/531493944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa000127050 con 0x7fa00012a0a0 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9fff7fe640 1 --2- 172.21.15.70:0/531493944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa00012a0a0 0x7fa000099730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c450 tx=0x7f9ff000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9fe7fff640 1 -- 172.21.15.70:0/531493944 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff0017070 con 0x7fa00012a0a0 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9fe7fff640 1 -- 172.21.15.70:0/531493944 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff0005c20 con 0x7fa00012a0a0 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0001275e0 con 0x7fa00012a0a0 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7f9fe7fff640 1 -- 172.21.15.70:0/531493944 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ff00070d0 con 0x7fa00012a0a0 2024-09-14T10:44:00.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.373+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa000099e40 con 0x7fa00012a0a0 2024-09-14T10:44:00.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.377+0000 7f9fe7fff640 1 -- 172.21.15.70:0/531493944 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9ff001a070 con 0x7fa00012a0a0 2024-09-14T10:44:00.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.377+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00012a480 con 0x7fa00012a0a0 2024-09-14T10:44:00.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.377+0000 7f9fe7fff640 1 --2- 172.21.15.70:0/531493944 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9fec03b8e0 0x7f9fec03dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.377+0000 7f9fe7fff640 1 -- 172.21.15.70:0/531493944 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9ff004e910 con 0x7fa00012a0a0 2024-09-14T10:44:00.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.377+0000 7f9ffeffd640 1 --2- 172.21.15.70:0/531493944 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9fec03b8e0 0x7f9fec03dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.377+0000 7f9ffeffd640 1 --2- 172.21.15.70:0/531493944 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9fec03b8e0 0x7f9fec03dda0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40ae000 tx=0x7f9ff40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.381+0000 7f9fe7fff640 1 -- 172.21.15.70:0/531493944 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fa000072980 con 0x7fa00012a0a0 2024-09-14T10:44:00.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:44:00.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.417+0000 7f9d35b1d640 1 Processor -- start 2024-09-14T10:44:00.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.417+0000 7f9d35b1d640 1 -- start start 2024-09-14T10:44:00.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d35b1d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9d30093e60 0x7f9d30132690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d35b1d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d30097a00 con 0x7f9d30093370 2024-09-14T10:44:00.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d35b1d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f9d30069740 con 0x7f9d30093e60 2024-09-14T10:44:00.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d2effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9d30093e60 0x7f9d30132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d2effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9d30093e60 0x7f9d30132690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60690/0 (socket says 172.21.15.70:60690) 2024-09-14T10:44:00.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d2f7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9d30093370 0x7f9d30093750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40490/0 (socket says 172.21.15.70:40490) 2024-09-14T10:44:00.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d2effd640 1 -- 172.21.15.70:0/1603264947 learned_addr learned my addr 172.21.15.70:0/1603264947 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:44:00.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d2effd640 1 -- 172.21.15.70:0/1603264947 >> v1:172.21.15.70:6789/0 conn(0x7f9d30093370 legacy=0x7f9d30093750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d2effd640 1 -- 172.21.15.70:0/1603264947 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d30133be0 con 0x7f9d30093e60 2024-09-14T10:44:00.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.421+0000 7f9d2e7fc640 1 -- 172.21.15.70:0/1603264947 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599223803 0 0) 0x7f9d30097a00 con 0x7f9d30093370 2024-09-14T10:44:00.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d2effd640 1 --2- 172.21.15.70:0/1603264947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093e60 0x7f9d30132690 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9d240097f0 tx=0x7f9d2401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6366016a6e3754d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d2e7fc640 1 -- 172.21.15.70:0/1603264947 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d240b0070 con 0x7f9d30093e60 2024-09-14T10:44:00.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d2e7fc640 1 -- 172.21.15.70:0/1603264947 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d240ab530 con 0x7f9d30093e60 2024-09-14T10:44:00.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d2e7fc640 1 -- 172.21.15.70:0/1603264947 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d240ab830 con 0x7f9d30093e60 2024-09-14T10:44:00.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1603264947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093e60 msgr2=0x7f9d30132690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 --2- 172.21.15.70:0/1603264947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093e60 0x7f9d30132690 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9d240097f0 tx=0x7f9d2401c430 comp rx=0 tx=0).stop 2024-09-14T10:44:00.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1603264947 shutdown_connections 2024-09-14T10:44:00.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 --2- 172.21.15.70:0/1603264947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093e60 0x7f9d30132690 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1603264947 >> 172.21.15.70:0/1603264947 conn(0x7f9d3009e8f0 msgr2=0x7f9d3009adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1603264947 shutdown_connections 2024-09-14T10:44:00.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1603264947 wait complete. 2024-09-14T10:44:00.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 Processor -- start 2024-09-14T10:44:00.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 -- start start 2024-09-14T10:44:00.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093370 0x7f9d30090030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d35b1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d30133770 con 0x7f9d30093370 2024-09-14T10:44:00.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d2f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093370 0x7f9d30090030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d2f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093370 0x7f9d30090030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60702/0 (socket says 172.21.15.70:60702) 2024-09-14T10:44:00.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d2f7fe640 1 -- 172.21.15.70:0/1701754373 learned_addr learned my addr 172.21.15.70:0/1701754373 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:44:00.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.425+0000 7f9d2f7fe640 1 -- 172.21.15.70:0/1701754373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d30091680 con 0x7f9d30093370 2024-09-14T10:44:00.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d2f7fe640 1 --2- 172.21.15.70:0/1701754373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093370 0x7f9d30090030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000c3d0 tx=0x7f9d2000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d17fff640 1 -- 172.21.15.70:0/1701754373 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d20007410 con 0x7f9d30093370 2024-09-14T10:44:00.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d17fff640 1 -- 172.21.15.70:0/1701754373 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d200075d0 con 0x7f9d30093370 2024-09-14T10:44:00.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d30123aa0 con 0x7f9d30093370 2024-09-14T10:44:00.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d17fff640 1 -- 172.21.15.70:0/1701754373 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d20004960 con 0x7f9d30093370 2024-09-14T10:44:00.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d30090570 con 0x7f9d30093370 2024-09-14T10:44:00.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d30093750 con 0x7f9d30093370 2024-09-14T10:44:00.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d17fff640 1 -- 172.21.15.70:0/1701754373 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9d20011070 con 0x7f9d30093370 2024-09-14T10:44:00.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d17fff640 1 --2- 172.21.15.70:0/1701754373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d1c03b8b0 0x7f9d1c03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d17fff640 1 -- 172.21.15.70:0/1701754373 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9d2004f850 con 0x7f9d30093370 2024-09-14T10:44:00.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d2effd640 1 --2- 172.21.15.70:0/1701754373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d1c03b8b0 0x7f9d1c03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.429+0000 7f9d2effd640 1 --2- 172.21.15.70:0/1701754373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d1c03b8b0 0x7f9d1c03dd70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d30076b20 tx=0x7f9d240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.437+0000 7f9d17fff640 1 -- 172.21.15.70:0/1701754373 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f9d20012d90 con 0x7f9d30093370 2024-09-14T10:44:00.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e3357640 1 Processor -- start 2024-09-14T10:44:00.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e3357640 1 -- start start 2024-09-14T10:44:00.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e3357640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f65dc132800 0x7f65dc134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e3357640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc1303a0 con 0x7f65dc12f8b0 2024-09-14T10:44:00.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e3357640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f65dc12f4f0 con 0x7f65dc132800 2024-09-14T10:44:00.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e08f2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f65dc132800 0x7f65dc134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e10f3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f65dc12f8b0 0x7f65dc12fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40494/0 (socket says 172.21.15.70:40494) 2024-09-14T10:44:00.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e10f3640 1 -- 172.21.15.70:0/2196241229 learned_addr learned my addr 172.21.15.70:0/2196241229 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:44:00.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e08f2640 1 -- 172.21.15.70:0/2196241229 >> v1:172.21.15.70:6789/0 conn(0x7f65dc12f8b0 legacy=0x7f65dc12fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e08f2640 1 -- 172.21.15.70:0/2196241229 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc070a60 con 0x7f65dc132800 2024-09-14T10:44:00.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65e08f2640 1 --2- 172.21.15.70:0/2196241229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc132800 0x7f65dc134bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009770 tx=0x7f65cc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20dd8476daf8cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65d3fff640 1 -- 172.21.15.70:0/2196241229 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65cc0b0070 con 0x7f65dc132800 2024-09-14T10:44:00.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65d3fff640 1 -- 172.21.15.70:0/2196241229 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65cc0ab530 con 0x7f65dc132800 2024-09-14T10:44:00.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.461+0000 7f65d3fff640 1 -- 172.21.15.70:0/2196241229 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65cc0ab870 con 0x7f65dc132800 2024-09-14T10:44:00.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- 172.21.15.70:0/2196241229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc132800 msgr2=0x7f65dc134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 --2- 172.21.15.70:0/2196241229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc132800 0x7f65dc134bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009770 tx=0x7f65cc01c390 comp rx=0 tx=0).stop 2024-09-14T10:44:00.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- 172.21.15.70:0/2196241229 shutdown_connections 2024-09-14T10:44:00.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 --2- 172.21.15.70:0/2196241229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc132800 0x7f65dc134bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- 172.21.15.70:0/2196241229 >> 172.21.15.70:0/2196241229 conn(0x7f65dc0a2520 msgr2=0x7f65dc09ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- 172.21.15.70:0/2196241229 shutdown_connections 2024-09-14T10:44:00.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- 172.21.15.70:0/2196241229 wait complete. 2024-09-14T10:44:00.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 Processor -- start 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- start start 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc12f8b0 0x7f65dc12b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc137b60 con 0x7f65dc12f8b0 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e10f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc12f8b0 0x7f65dc12b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e10f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc12f8b0 0x7f65dc12b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60730/0 (socket says 172.21.15.70:60730) 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e10f3640 1 -- 172.21.15.70:0/263025786 learned_addr learned my addr 172.21.15.70:0/263025786 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e10f3640 1 -- 172.21.15.70:0/263025786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc0715c0 con 0x7f65dc12f8b0 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e10f3640 1 --2- 172.21.15.70:0/263025786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc12f8b0 0x7f65dc12b240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f65d800c450 tx=0x7f65d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65d1ffb640 1 -- 172.21.15.70:0/263025786 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d8017070 con 0x7f65dc12f8b0 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65d1ffb640 1 -- 172.21.15.70:0/263025786 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d8005c20 con 0x7f65dc12f8b0 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65dc12b780 con 0x7f65dc12f8b0 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65d1ffb640 1 -- 172.21.15.70:0/263025786 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d80070d0 con 0x7f65dc12f8b0 2024-09-14T10:44:00.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65dc12bc40 con 0x7f65dc12f8b0 2024-09-14T10:44:00.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.465+0000 7f65d1ffb640 1 -- 172.21.15.70:0/263025786 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f65d801a070 con 0x7f65dc12f8b0 2024-09-14T10:44:00.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.469+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65dc071090 con 0x7f65dc12f8b0 2024-09-14T10:44:00.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.469+0000 7f65d1ffb640 1 --2- 172.21.15.70:0/263025786 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f65c003b8b0 0x7f65c003dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.469+0000 7f65d1ffb640 1 -- 172.21.15.70:0/263025786 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f65d804e940 con 0x7f65dc12f8b0 2024-09-14T10:44:00.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.469+0000 7f65e08f2640 1 --2- 172.21.15.70:0/263025786 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f65c003b8b0 0x7f65c003dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.469+0000 7f65e08f2640 1 --2- 172.21.15.70:0/263025786 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f65c003b8b0 0x7f65c003dd70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0ad000 tx=0x7f65cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.473+0000 7f65d1ffb640 1 -- 172.21.15.70:0/263025786 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f65d8019cd0 con 0x7f65dc12f8b0 2024-09-14T10:44:00.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.509+0000 7f95911c5640 1 Processor -- start 2024-09-14T10:44:00.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.509+0000 7f95911c5640 1 -- start start 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.509+0000 7f95911c5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f958c071a00 0x7f958c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.509+0000 7f95911c5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958c09c280 con 0x7f958c12d1d0 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.509+0000 7f95911c5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f958c09c050 con 0x7f958c071a00 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.509+0000 7f958ad9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f958c071a00 0x7f958c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.509+0000 7f958a59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f958c12d1d0 0x7f958c12d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40496/0 (socket says 172.21.15.70:40496) 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.509+0000 7f958a59c640 1 -- 172.21.15.70:0/4108307058 learned_addr learned my addr 172.21.15.70:0/4108307058 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f958ad9d640 1 -- 172.21.15.70:0/4108307058 >> v1:172.21.15.70:6789/0 conn(0x7f958c12d1d0 legacy=0x7f958c12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f9589d9b640 1 -- 172.21.15.70:0/4108307058 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531355615 0 0) 0x7f958c09c280 con 0x7f958c12d1d0 2024-09-14T10:44:00.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f958ad9d640 1 -- 172.21.15.70:0/4108307058 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c09b910 con 0x7f958c071a00 2024-09-14T10:44:00.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f958ad9d640 1 --2- 172.21.15.70:0/4108307058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c071de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f957c009740 tx=0x7f957c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802318a97fc62c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f9589d9b640 1 -- 172.21.15.70:0/4108307058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c0b1070 con 0x7f958c071a00 2024-09-14T10:44:00.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f9589d9b640 1 -- 172.21.15.70:0/4108307058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c0ac520 con 0x7f958c071a00 2024-09-14T10:44:00.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f9589d9b640 1 -- 172.21.15.70:0/4108307058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c0ac820 con 0x7f958c071a00 2024-09-14T10:44:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f95911c5640 1 -- 172.21.15.70:0/4108307058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 msgr2=0x7f958c071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f95911c5640 1 --2- 172.21.15.70:0/4108307058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c071de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f957c009740 tx=0x7f957c01c370 comp rx=0 tx=0).stop 2024-09-14T10:44:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f95911c5640 1 -- 172.21.15.70:0/4108307058 shutdown_connections 2024-09-14T10:44:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f95911c5640 1 --2- 172.21.15.70:0/4108307058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c071de0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f95911c5640 1 -- 172.21.15.70:0/4108307058 >> 172.21.15.70:0/4108307058 conn(0x7f958c09c7a0 msgr2=0x7f958c09cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f95911c5640 1 -- 172.21.15.70:0/4108307058 shutdown_connections 2024-09-14T10:44:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.513+0000 7f95911c5640 1 -- 172.21.15.70:0/4108307058 wait complete. 2024-09-14T10:44:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95911c5640 1 Processor -- start 2024-09-14T10:44:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95911c5640 1 -- start start 2024-09-14T10:44:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95911c5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c129170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95911c5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f958c135d20 con 0x7f958c071a00 2024-09-14T10:44:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f958ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c129170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f958ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c129170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60742/0 (socket says 172.21.15.70:60742) 2024-09-14T10:44:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f958ad9d640 1 -- 172.21.15.70:0/1937329252 learned_addr learned my addr 172.21.15.70:0/1937329252 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:44:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f958ad9d640 1 -- 172.21.15.70:0/1937329252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c06fcb0 con 0x7f958c071a00 2024-09-14T10:44:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f958ad9d640 1 --2- 172.21.15.70:0/1937329252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c129170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f957c0af040 tx=0x7f957c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95737fe640 1 -- 172.21.15.70:0/1937329252 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c0b1050 con 0x7f958c071a00 2024-09-14T10:44:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95737fe640 1 -- 172.21.15.70:0/1937329252 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c0b2040 con 0x7f958c071a00 2024-09-14T10:44:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95737fe640 1 -- 172.21.15.70:0/1937329252 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c0b6870 con 0x7f958c071a00 2024-09-14T10:44:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c070b70 con 0x7f958c071a00 2024-09-14T10:44:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c06f9e0 con 0x7f958c071a00 2024-09-14T10:44:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958c071de0 con 0x7f958c071a00 2024-09-14T10:44:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95737fe640 1 -- 172.21.15.70:0/1937329252 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f957c0bf030 con 0x7f958c071a00 2024-09-14T10:44:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95737fe640 1 --2- 172.21.15.70:0/1937329252 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f957803b8b0 0x7f957803dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.517+0000 7f95737fe640 1 -- 172.21.15.70:0/1937329252 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f957c0bd070 con 0x7f958c071a00 2024-09-14T10:44:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.521+0000 7f958a59c640 1 --2- 172.21.15.70:0/1937329252 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f957803b8b0 0x7f957803dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.521+0000 7f958a59c640 1 --2- 172.21.15.70:0/1937329252 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f957803b8b0 0x7f957803dd70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9580007fd0 tx=0x7f9580007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.529+0000 7f95737fe640 1 -- 172.21.15.70:0/1937329252 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f957c0c6020 con 0x7f958c071a00 2024-09-14T10:44:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.561+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa000126df0 con 0x7fa00012a0a0 2024-09-14T10:44:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7f9fe7fff640 1 -- 172.21.15.70:0/531493944 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ff0019cd0 con 0x7fa00012a0a0 2024-09-14T10:44:00.560 INFO:teuthology.orchestra.run.smithi070.stdout:47244640262 2024-09-14T10:44:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9fec03b8e0 msgr2=0x7f9fec03dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 --2- 172.21.15.70:0/531493944 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9fec03b8e0 0x7f9fec03dda0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40ae000 tx=0x7f9ff40a7000 comp rx=0 tx=0).stop 2024-09-14T10:44:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa00012a0a0 msgr2=0x7fa000099730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 --2- 172.21.15.70:0/531493944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa00012a0a0 0x7fa000099730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c450 tx=0x7f9ff000c910 comp rx=0 tx=0).stop 2024-09-14T10:44:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 shutdown_connections 2024-09-14T10:44:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 --2- 172.21.15.70:0/531493944 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9fec03b8e0 0x7f9fec03dda0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 --2- 172.21.15.70:0/531493944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa00012a0a0 0x7fa000099730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 >> 172.21.15.70:0/531493944 conn(0x7fa00009c950 msgr2=0x7fa00012e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 shutdown_connections 2024-09-14T10:44:00.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.565+0000 7fa005e97640 1 -- 172.21.15.70:0/531493944 wait complete. 2024-09-14T10:44:00.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.2 2024-09-14T10:44:00.577 DEBUG:teuthology.parallel:result is None 2024-09-14T10:44:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f65dc12be70 con 0x7f65dc12f8b0 2024-09-14T10:44:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65d1ffb640 1 -- 172.21.15.70:0/263025786 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65d801b400 con 0x7f65dc12f8b0 2024-09-14T10:44:00.636 INFO:teuthology.orchestra.run.smithi070.stdout:42949672964 2024-09-14T10:44:00.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f65c003b8b0 msgr2=0x7f65c003dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 --2- 172.21.15.70:0/263025786 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f65c003b8b0 0x7f65c003dd70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0ad000 tx=0x7f65cc0a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc12f8b0 msgr2=0x7f65dc12b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 --2- 172.21.15.70:0/263025786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc12f8b0 0x7f65dc12b240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f65d800c450 tx=0x7f65d800c910 comp rx=0 tx=0).stop 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 shutdown_connections 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 --2- 172.21.15.70:0/263025786 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f65c003b8b0 0x7f65c003dd70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 --2- 172.21.15.70:0/263025786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc12f8b0 0x7f65dc12b240 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 >> 172.21.15.70:0/263025786 conn(0x7f65dc0a2520 msgr2=0x7f65dc06e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 shutdown_connections 2024-09-14T10:44:00.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.641+0000 7f65e3357640 1 -- 172.21.15.70:0/263025786 wait complete. 2024-09-14T10:44:00.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.3 2024-09-14T10:44:00.653 DEBUG:teuthology.parallel:result is None 2024-09-14T10:44:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9d301233b0 con 0x7f9d30093370 2024-09-14T10:44:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d17fff640 1 -- 172.21.15.70:0/1701754373 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d20011360 con 0x7f9d30093370 2024-09-14T10:44:00.664 INFO:teuthology.orchestra.run.smithi070.stdout:38654705668 2024-09-14T10:44:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d1c03b8b0 msgr2=0x7f9d1c03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 --2- 172.21.15.70:0/1701754373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d1c03b8b0 0x7f9d1c03dd70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d30076b20 tx=0x7f9d240a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093370 msgr2=0x7f9d30090030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 --2- 172.21.15.70:0/1701754373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093370 0x7f9d30090030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000c3d0 tx=0x7f9d2000c890 comp rx=0 tx=0).stop 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 shutdown_connections 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 --2- 172.21.15.70:0/1701754373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d1c03b8b0 0x7f9d1c03dd70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 --2- 172.21.15.70:0/1701754373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d30093370 0x7f9d30090030 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 >> 172.21.15.70:0/1701754373 conn(0x7f9d3009e8f0 msgr2=0x7f9d30099510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 shutdown_connections 2024-09-14T10:44:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.669+0000 7f9d35b1d640 1 -- 172.21.15.70:0/1701754373 wait complete. 2024-09-14T10:44:00.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-09-14T10:44:00.681 DEBUG:teuthology.parallel:result is None 2024-09-14T10:44:00.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f958c050ef0 con 0x7f958c071a00 2024-09-14T10:44:00.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95737fe640 1 -- 172.21.15.70:0/1937329252 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f957c0a9070 con 0x7f958c071a00 2024-09-14T10:44:00.721 INFO:teuthology.orchestra.run.smithi070.stdout:42949672964 2024-09-14T10:44:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f957803b8b0 msgr2=0x7f957803dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 --2- 172.21.15.70:0/1937329252 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f957803b8b0 0x7f957803dd70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9580007fd0 tx=0x7f9580007900 comp rx=0 tx=0).stop 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 msgr2=0x7f958c129170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 --2- 172.21.15.70:0/1937329252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c129170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f957c0af040 tx=0x7f957c01abb0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 shutdown_connections 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 --2- 172.21.15.70:0/1937329252 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f957803b8b0 0x7f957803dd70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 --2- 172.21.15.70:0/1937329252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f958c071a00 0x7f958c129170 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 >> 172.21.15.70:0/1937329252 conn(0x7f958c09c7a0 msgr2=0x7f958c0991b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 shutdown_connections 2024-09-14T10:44:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.725+0000 7f95911c5640 1 -- 172.21.15.70:0/1937329252 wait complete. 2024-09-14T10:44:00.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.1 2024-09-14T10:44:00.739 DEBUG:teuthology.parallel:result is None 2024-09-14T10:44:00.739 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:44:00.739 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:44:00.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d7ab5640 1 Processor -- start 2024-09-14T10:44:00.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d7ab5640 1 -- start start 2024-09-14T10:44:00.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d7ab5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f33d0094570 0x7f33d0094950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d7ab5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d0069740 con 0x7f33d0094e90 2024-09-14T10:44:00.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d7ab5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f33d009f250 con 0x7f33d0094570 2024-09-14T10:44:00.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d5851640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f33d0094570 0x7f33d0094950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d5050640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f33d0094e90 0x7f33d012d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40504/0 (socket says 172.21.15.70:40504) 2024-09-14T10:44:00.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d5050640 1 -- 172.21.15.70:0/1494681701 learned_addr learned my addr 172.21.15.70:0/1494681701 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:44:00.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d5851640 1 -- 172.21.15.70:0/1494681701 >> v1:172.21.15.70:6789/0 conn(0x7f33d0094e90 legacy=0x7f33d012d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d5851640 1 -- 172.21.15.70:0/1494681701 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d0096980 con 0x7f33d0094570 2024-09-14T10:44:00.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.893+0000 7f33d484f640 1 -- 172.21.15.70:0/1494681701 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465046465 0 0) 0x7f33d0069740 con 0x7f33d0094e90 2024-09-14T10:44:00.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d5851640 1 --2- 172.21.15.70:0/1494681701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d0094950 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009740 tx=0x7f33cc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706834d9512c4eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d484f640 1 -- 172.21.15.70:0/1494681701 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc0b0070 con 0x7f33d0094570 2024-09-14T10:44:00.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d484f640 1 -- 172.21.15.70:0/1494681701 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc0a4e50 con 0x7f33d0094570 2024-09-14T10:44:00.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d484f640 1 -- 172.21.15.70:0/1494681701 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc0ab680 con 0x7f33d0094570 2024-09-14T10:44:00.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 -- 172.21.15.70:0/1494681701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 msgr2=0x7f33d0094950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:00.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 --2- 172.21.15.70:0/1494681701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d0094950 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009740 tx=0x7f33cc01c370 comp rx=0 tx=0).stop 2024-09-14T10:44:00.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 -- 172.21.15.70:0/1494681701 shutdown_connections 2024-09-14T10:44:00.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 --2- 172.21.15.70:0/1494681701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d0094950 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:00.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 -- 172.21.15.70:0/1494681701 >> 172.21.15.70:0/1494681701 conn(0x7f33d009e9d0 msgr2=0x7f33d009aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:00.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 -- 172.21.15.70:0/1494681701 shutdown_connections 2024-09-14T10:44:00.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 -- 172.21.15.70:0/1494681701 wait complete. 2024-09-14T10:44:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 Processor -- start 2024-09-14T10:44:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 -- start start 2024-09-14T10:44:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d01c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d7ab5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33d0135b20 con 0x7f33d0094570 2024-09-14T10:44:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d5851640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d01c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d5851640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d01c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60766/0 (socket says 172.21.15.70:60766) 2024-09-14T10:44:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d5851640 1 -- 172.21.15.70:0/2122692551 learned_addr learned my addr 172.21.15.70:0/2122692551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:44:00.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d5851640 1 -- 172.21.15.70:0/2122692551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d00927b0 con 0x7f33d0094570 2024-09-14T10:44:00.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.897+0000 7f33d5851640 1 --2- 172.21.15.70:0/2122692551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d01c6ee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33cc019fa0 tx=0x7f33cc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33c67fc640 1 -- 172.21.15.70:0/2122692551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc0b0050 con 0x7f33d0094570 2024-09-14T10:44:00.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d0091dd0 con 0x7f33d0094570 2024-09-14T10:44:00.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33c67fc640 1 -- 172.21.15.70:0/2122692551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc0b1040 con 0x7f33d0094570 2024-09-14T10:44:00.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33c67fc640 1 -- 172.21.15.70:0/2122692551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc0b7450 con 0x7f33d0094570 2024-09-14T10:44:00.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d01c7420 con 0x7f33d0094570 2024-09-14T10:44:00.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d0094950 con 0x7f33d0094570 2024-09-14T10:44:00.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33c67fc640 1 -- 172.21.15.70:0/2122692551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f33cc0be030 con 0x7f33d0094570 2024-09-14T10:44:00.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33c67fc640 1 --2- 172.21.15.70:0/2122692551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f33b403b8b0 0x7f33b403dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:00.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33c67fc640 1 -- 172.21.15.70:0/2122692551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f33cc0bc070 con 0x7f33d0094570 2024-09-14T10:44:00.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33d5050640 1 --2- 172.21.15.70:0/2122692551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f33b403b8b0 0x7f33b403dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:00.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.901+0000 7f33d5050640 1 --2- 172.21.15.70:0/2122692551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f33b403b8b0 0x7f33b403dd70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f33c0007fd0 tx=0x7f33c00078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:00.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:00.905+0000 7f33c67fc640 1 -- 172.21.15.70:0/2122692551 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f33cc0c5020 con 0x7f33d0094570 2024-09-14T10:44:01.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.053+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33d0092030 con 0x7f33b403b8b0 2024-09-14T10:44:01.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.057+0000 7f33c67fc640 1 -- 172.21.15.70:0/2122692551 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32216 (secure 0 0 0) 0x7f33d0092030 con 0x7f33b403b8b0 2024-09-14T10:44:01.054 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:44:01.055 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:44:01.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f33b403b8b0 msgr2=0x7f33b403dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 --2- 172.21.15.70:0/2122692551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f33b403b8b0 0x7f33b403dd70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f33c0007fd0 tx=0x7f33c00078e0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 msgr2=0x7f33d01c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 --2- 172.21.15.70:0/2122692551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d01c6ee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33cc019fa0 tx=0x7f33cc01abb0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 shutdown_connections 2024-09-14T10:44:01.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 --2- 172.21.15.70:0/2122692551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f33b403b8b0 0x7f33b403dd70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 --2- 172.21.15.70:0/2122692551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d0094570 0x7f33d01c6ee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 >> 172.21.15.70:0/2122692551 conn(0x7f33d009e9d0 msgr2=0x7f33d012f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 shutdown_connections 2024-09-14T10:44:01.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.061+0000 7f33d7ab5640 1 -- 172.21.15.70:0/2122692551 wait complete. 2024-09-14T10:44:01.071 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-14T10:43:59.339661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":122348,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377365012,"statfs":{"total":386547056640,"available":386421772288,"internally_reserved":0,"allocated":1785856,"data_stored":1371530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":123397910},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.898079"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.467362+0000","last_change":"2024-09-14T10:43:57.467362+0000","last_active":"2024-09-14T10:43:57.467362+0000","last_peered":"2024-09-14T10:43:57.467362+0000","last_clean":"2024-09-14T10:43:57.467362+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:43:57.467362+0000","last_undegraded":"2024-09-14T10:43:57.467362+0000","last_fullsized":"2024-09-14T10:43:57.467362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.939647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.471052+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:43:57.471052+0000","last_peered":"2024-09-14T10:43:57.471052+0000","last_clean":"2024-09-14T10:43:57.471052+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:43:57.471052+0000","last_undegraded":"2024-09-14T10:43:57.471052+0000","last_fullsized":"2024-09-14T10:43:57.471052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.947188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.465338+0000","last_change":"2024-09-14T10:43:57.465338+0000","last_active":"2024-09-14T10:43:57.465338+0000","last_peered":"2024-09-14T10:43:57.465338+0000","last_clean":"2024-09-14T10:43:57.465338+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:43:57.465338+0000","last_undegraded":"2024-09-14T10:43:57.465338+0000","last_fullsized":"2024-09-14T10:43:57.465338+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.995453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.471130+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:43:57.471130+0000","last_peered":"2024-09-14T10:43:57.471130+0000","last_clean":"2024-09-14T10:43:57.471130+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:43:57.471130+0000","last_undegraded":"2024-09-14T10:43:57.471130+0000","last_fullsized":"2024-09-14T10:43:57.471130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.379980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.468229+0000","last_change":"2024-09-14T10:43:57.466709+0000","last_active":"2024-09-14T10:43:57.468229+0000","last_peered":"2024-09-14T10:43:57.468229+0000","last_clean":"2024-09-14T10:43:57.468229+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:43:57.468229+0000","last_undegraded":"2024-09-14T10:43:57.468229+0000","last_fullsized":"2024-09-14T10:43:57.468229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:59.740099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.621370+0000","last_change":"2024-09-14T10:43:57.622013+0000","last_active":"2024-09-14T10:43:57.621370+0000","last_peered":"2024-09-14T10:43:57.621370+0000","last_clean":"2024-09-14T10:43:57.621370+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:43:57.621370+0000","last_undegraded":"2024-09-14T10:43:57.621370+0000","last_fullsized":"2024-09-14T10:43:57.621370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.465589+0000","last_change":"2024-09-14T10:43:57.465589+0000","last_active":"2024-09-14T10:43:57.465589+0000","last_peered":"2024-09-14T10:43:57.465589+0000","last_clean":"2024-09-14T10:43:57.465589+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:43:57.465589+0000","last_undegraded":"2024-09-14T10:43:57.465589+0000","last_fullsized":"2024-09-14T10:43:57.465589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.853418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.466810+0000","last_change":"2024-09-14T10:43:57.466810+0000","last_active":"2024-09-14T10:43:57.466810+0000","last_peered":"2024-09-14T10:43:57.466810+0000","last_clean":"2024-09-14T10:43:57.466810+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:43:57.466810+0000","last_undegraded":"2024-09-14T10:43:57.466810+0000","last_fullsized":"2024-09-14T10:43:57.466810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:33.230423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.459195+0000","last_change":"2024-09-14T10:43:50.584788+0000","last_active":"2024-09-14T10:43:57.459195+0000","last_peered":"2024-09-14T10:43:57.459195+0000","last_clean":"2024-09-14T10:43:57.459195+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:43:57.459195+0000","last_undegraded":"2024-09-14T10:43:57.459195+0000","last_fullsized":"2024-09-14T10:43:57.459195+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_clean_scrub_stamp":"2024-09-14T10:43:49.418142+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:43.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":741376,"data_stored":638057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672964,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":47708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":638057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35496,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336344,"statfs":{"total":96636764160,"available":96600416256,"internally_reserved":0,"allocated":151552,"data_stored":47708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:44:01.072 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:44:01.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd42261b640 1 Processor -- start 2024-09-14T10:44:01.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd42261b640 1 -- start start 2024-09-14T10:44:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd42261b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd41c12f8b0 0x7fd41c12fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd42261b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c070a60 con 0x7fd41c1301d0 2024-09-14T10:44:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd42261b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c12f4f0 con 0x7fd41c12f8b0 2024-09-14T10:44:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd41bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd41c12f8b0 0x7fd41c12fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd41b7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd41c1301d0 0x7fd41c06f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40520/0 (socket says 172.21.15.70:40520) 2024-09-14T10:44:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd41b7fe640 1 -- 172.21.15.70:0/46760955 learned_addr learned my addr 172.21.15.70:0/46760955 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:44:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd41bfff640 1 -- 172.21.15.70:0/46760955 >> v1:172.21.15.70:6789/0 conn(0x7fd41c1301d0 legacy=0x7fd41c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.193+0000 7fd41bfff640 1 -- 172.21.15.70:0/46760955 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c09f300 con 0x7fd41c12f8b0 2024-09-14T10:44:01.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41bfff640 1 --2- 172.21.15.70:0/46760955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c12fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009740 tx=0x7fd40c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157eb0ce0b18dd3f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41affd640 1 -- 172.21.15.70:0/46760955 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd40c0b0070 con 0x7fd41c12f8b0 2024-09-14T10:44:01.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41affd640 1 -- 172.21.15.70:0/46760955 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40c0ab530 con 0x7fd41c12f8b0 2024-09-14T10:44:01.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41affd640 1 -- 172.21.15.70:0/46760955 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd40c0ab830 con 0x7fd41c12f8b0 2024-09-14T10:44:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 -- 172.21.15.70:0/46760955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 msgr2=0x7fd41c12fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 --2- 172.21.15.70:0/46760955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c12fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009740 tx=0x7fd40c01c370 comp rx=0 tx=0).stop 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 -- 172.21.15.70:0/46760955 shutdown_connections 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 --2- 172.21.15.70:0/46760955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c12fc90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 -- 172.21.15.70:0/46760955 >> 172.21.15.70:0/46760955 conn(0x7fd41c0a2520 msgr2=0x7fd41c09ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 -- 172.21.15.70:0/46760955 shutdown_connections 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 -- 172.21.15.70:0/46760955 wait complete. 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 Processor -- start 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 -- start start 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd42261b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c138250 con 0x7fd41c12f8b0 2024-09-14T10:44:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c130840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60778/0 (socket says 172.21.15.70:60778) 2024-09-14T10:44:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41bfff640 1 -- 172.21.15.70:0/3583021815 learned_addr learned my addr 172.21.15.70:0/3583021815 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:44:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41bfff640 1 -- 172.21.15.70:0/3583021815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c12a010 con 0x7fd41c12f8b0 2024-09-14T10:44:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd41bfff640 1 --2- 172.21.15.70:0/3583021815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c130840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd40c018f80 tx=0x7fd40c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.197+0000 7fd418ff9640 1 -- 172.21.15.70:0/3583021815 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd40c0b0050 con 0x7fd41c12f8b0 2024-09-14T10:44:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd418ff9640 1 -- 172.21.15.70:0/3583021815 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40c0b1040 con 0x7fd41c12f8b0 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c131dd0 con 0x7fd41c12f8b0 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd418ff9640 1 -- 172.21.15.70:0/3583021815 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd40c0aaa10 con 0x7fd41c12f8b0 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c133140 con 0x7fd41c12f8b0 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c12fc90 con 0x7fd41c12f8b0 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd418ff9640 1 -- 172.21.15.70:0/3583021815 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd40c0be030 con 0x7fd41c12f8b0 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd418ff9640 1 --2- 172.21.15.70:0/3583021815 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40803b8b0 0x7fd40803dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd418ff9640 1 -- 172.21.15.70:0/3583021815 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd40c0bc070 con 0x7fd41c12f8b0 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd41b7fe640 1 --2- 172.21.15.70:0/3583021815 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40803b8b0 0x7fd40803dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.201+0000 7fd41b7fe640 1 --2- 172.21.15.70:0/3583021815 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40803b8b0 0x7fd40803dd70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4100015f0 tx=0x7fd410007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.205+0000 7fd418ff9640 1 -- 172.21.15.70:0/3583021815 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fd40c0c5020 con 0x7fd41c12f8b0 2024-09-14T10:44:01.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.369+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd41c135520 con 0x7fd40803b8b0 2024-09-14T10:44:01.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd418ff9640 1 -- 172.21.15.70:0/3583021815 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32180 (secure 0 0 0) 0x7fd41c135520 con 0x7fd40803b8b0 2024-09-14T10:44:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:44:01.369 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:44:01.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40803b8b0 msgr2=0x7fd40803dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 --2- 172.21.15.70:0/3583021815 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40803b8b0 0x7fd40803dd70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4100015f0 tx=0x7fd410007ab0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 msgr2=0x7fd41c130840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 --2- 172.21.15.70:0/3583021815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c130840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd40c018f80 tx=0x7fd40c01abb0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 shutdown_connections 2024-09-14T10:44:01.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 --2- 172.21.15.70:0/3583021815 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40803b8b0 0x7fd40803dd70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 --2- 172.21.15.70:0/3583021815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c12f8b0 0x7fd41c130840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 >> 172.21.15.70:0/3583021815 conn(0x7fd41c0a2520 msgr2=0x7fd41c128ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:01.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 shutdown_connections 2024-09-14T10:44:01.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.373+0000 7fd42261b640 1 -- 172.21.15.70:0/3583021815 wait complete. 2024-09-14T10:44:01.386 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-14T10:44:01.340259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":122348,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377365012,"statfs":{"total":386547056640,"available":386421772288,"internally_reserved":0,"allocated":1785856,"data_stored":1371530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":123397910},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001761"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.467362+0000","last_change":"2024-09-14T10:43:57.467362+0000","last_active":"2024-09-14T10:43:57.467362+0000","last_peered":"2024-09-14T10:43:57.467362+0000","last_clean":"2024-09-14T10:43:57.467362+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:43:57.467362+0000","last_undegraded":"2024-09-14T10:43:57.467362+0000","last_fullsized":"2024-09-14T10:43:57.467362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.939647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.471052+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:43:57.471052+0000","last_peered":"2024-09-14T10:43:57.471052+0000","last_clean":"2024-09-14T10:43:57.471052+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:43:57.471052+0000","last_undegraded":"2024-09-14T10:43:57.471052+0000","last_fullsized":"2024-09-14T10:43:57.471052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.947188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.465338+0000","last_change":"2024-09-14T10:43:57.465338+0000","last_active":"2024-09-14T10:43:57.465338+0000","last_peered":"2024-09-14T10:43:57.465338+0000","last_clean":"2024-09-14T10:43:57.465338+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:43:57.465338+0000","last_undegraded":"2024-09-14T10:43:57.465338+0000","last_fullsized":"2024-09-14T10:43:57.465338+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.995453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.471130+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:43:57.471130+0000","last_peered":"2024-09-14T10:43:57.471130+0000","last_clean":"2024-09-14T10:43:57.471130+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:43:57.471130+0000","last_undegraded":"2024-09-14T10:43:57.471130+0000","last_fullsized":"2024-09-14T10:43:57.471130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.379980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.468229+0000","last_change":"2024-09-14T10:43:57.466709+0000","last_active":"2024-09-14T10:43:57.468229+0000","last_peered":"2024-09-14T10:43:57.468229+0000","last_clean":"2024-09-14T10:43:57.468229+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:43:57.468229+0000","last_undegraded":"2024-09-14T10:43:57.468229+0000","last_fullsized":"2024-09-14T10:43:57.468229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:59.740099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.621370+0000","last_change":"2024-09-14T10:43:57.622013+0000","last_active":"2024-09-14T10:43:57.621370+0000","last_peered":"2024-09-14T10:43:57.621370+0000","last_clean":"2024-09-14T10:43:57.621370+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:43:57.621370+0000","last_undegraded":"2024-09-14T10:43:57.621370+0000","last_fullsized":"2024-09-14T10:43:57.621370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.465589+0000","last_change":"2024-09-14T10:43:57.465589+0000","last_active":"2024-09-14T10:43:57.465589+0000","last_peered":"2024-09-14T10:43:57.465589+0000","last_clean":"2024-09-14T10:43:57.465589+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:43:57.465589+0000","last_undegraded":"2024-09-14T10:43:57.465589+0000","last_fullsized":"2024-09-14T10:43:57.465589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.853418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.466810+0000","last_change":"2024-09-14T10:43:57.466810+0000","last_active":"2024-09-14T10:43:57.466810+0000","last_peered":"2024-09-14T10:43:57.466810+0000","last_clean":"2024-09-14T10:43:57.466810+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:43:57.466810+0000","last_undegraded":"2024-09-14T10:43:57.466810+0000","last_fullsized":"2024-09-14T10:43:57.466810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:33.230423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-14T10:43:57.459195+0000","last_change":"2024-09-14T10:43:50.584788+0000","last_active":"2024-09-14T10:43:57.459195+0000","last_peered":"2024-09-14T10:43:57.459195+0000","last_clean":"2024-09-14T10:43:57.459195+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:43:57.459195+0000","last_undegraded":"2024-09-14T10:43:57.459195+0000","last_fullsized":"2024-09-14T10:43:57.459195+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_clean_scrub_stamp":"2024-09-14T10:43:49.418142+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:43.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":741376,"data_stored":638057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":151552,"data_stored":47708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":638057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35496,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336344,"statfs":{"total":96636764160,"available":96600416256,"internally_reserved":0,"allocated":151552,"data_stored":47708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:44:01.387 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:44:01.387 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T10:44:01.387 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T10:44:01.387 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T10:44:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.505+0000 7f26dba80640 1 Processor -- start 2024-09-14T10:44:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.505+0000 7f26dba80640 1 -- start start 2024-09-14T10:44:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.505+0000 7f26dba80640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f26d4132800 0x7f26d4134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.505+0000 7f26dba80640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d41303a0 con 0x7f26d412f8b0 2024-09-14T10:44:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.505+0000 7f26dba80640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f26d412f4f0 con 0x7f26d4132800 2024-09-14T10:44:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.505+0000 7f26d901b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f26d4132800 0x7f26d4134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.505+0000 7f26d981c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f26d412f8b0 0x7f26d412fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40530/0 (socket says 172.21.15.70:40530) 2024-09-14T10:44:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.505+0000 7f26d981c640 1 -- 172.21.15.70:0/3065254600 learned_addr learned my addr 172.21.15.70:0/3065254600 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:44:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26d901b640 1 -- 172.21.15.70:0/3065254600 >> v1:172.21.15.70:6789/0 conn(0x7f26d412f8b0 legacy=0x7f26d412fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26d901b640 1 -- 172.21.15.70:0/3065254600 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d4070a60 con 0x7f26d4132800 2024-09-14T10:44:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26d881a640 1 -- 172.21.15.70:0/3065254600 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556823698 0 0) 0x7f26d41303a0 con 0x7f26d412f8b0 2024-09-14T10:44:01.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26d901b640 1 --2- 172.21.15.70:0/3065254600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d4132800 0x7f26d4134bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009770 tx=0x7f26c401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182abd0a5b175efa server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26d881a640 1 -- 172.21.15.70:0/3065254600 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26c40b0070 con 0x7f26d4132800 2024-09-14T10:44:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26d881a640 1 -- 172.21.15.70:0/3065254600 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c40ab530 con 0x7f26d4132800 2024-09-14T10:44:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26d881a640 1 -- 172.21.15.70:0/3065254600 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26c40ab830 con 0x7f26d4132800 2024-09-14T10:44:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26dba80640 1 -- 172.21.15.70:0/3065254600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d4132800 msgr2=0x7f26d4134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26dba80640 1 --2- 172.21.15.70:0/3065254600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d4132800 0x7f26d4134bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009770 tx=0x7f26c401c370 comp rx=0 tx=0).stop 2024-09-14T10:44:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26dba80640 1 -- 172.21.15.70:0/3065254600 shutdown_connections 2024-09-14T10:44:01.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26dba80640 1 --2- 172.21.15.70:0/3065254600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d4132800 0x7f26d4134bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26dba80640 1 -- 172.21.15.70:0/3065254600 >> 172.21.15.70:0/3065254600 conn(0x7f26d40a2520 msgr2=0x7f26d409ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26dba80640 1 -- 172.21.15.70:0/3065254600 shutdown_connections 2024-09-14T10:44:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.509+0000 7f26dba80640 1 -- 172.21.15.70:0/3065254600 wait complete. 2024-09-14T10:44:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26dba80640 1 Processor -- start 2024-09-14T10:44:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26dba80640 1 -- start start 2024-09-14T10:44:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26dba80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d412f8b0 0x7f26d412b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26dba80640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4070690 con 0x7f26d412f8b0 2024-09-14T10:44:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26d981c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d412f8b0 0x7f26d412b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26d981c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d412f8b0 0x7f26d412b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60794/0 (socket says 172.21.15.70:60794) 2024-09-14T10:44:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26d981c640 1 -- 172.21.15.70:0/711137393 learned_addr learned my addr 172.21.15.70:0/711137393 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:44:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26d981c640 1 -- 172.21.15.70:0/711137393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d40718d0 con 0x7f26d412f8b0 2024-09-14T10:44:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26d981c640 1 --2- 172.21.15.70:0/711137393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d412f8b0 0x7f26d412b240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c3d0 tx=0x7f26d000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26ca7fc640 1 -- 172.21.15.70:0/711137393 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d0007410 con 0x7f26d412f8b0 2024-09-14T10:44:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26ca7fc640 1 -- 172.21.15.70:0/711137393 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d00075d0 con 0x7f26d412f8b0 2024-09-14T10:44:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d412c8e0 con 0x7f26d412f8b0 2024-09-14T10:44:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26ca7fc640 1 -- 172.21.15.70:0/711137393 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d0004960 con 0x7f26d412f8b0 2024-09-14T10:44:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d412b780 con 0x7f26d412f8b0 2024-09-14T10:44:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26ca7fc640 1 -- 172.21.15.70:0/711137393 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f26d0011070 con 0x7f26d412f8b0 2024-09-14T10:44:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d412fc90 con 0x7f26d412f8b0 2024-09-14T10:44:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26ca7fc640 1 --2- 172.21.15.70:0/711137393 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26b803b8b0 0x7f26b803dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26ca7fc640 1 -- 172.21.15.70:0/711137393 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f26d004f2a0 con 0x7f26d412f8b0 2024-09-14T10:44:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26d901b640 1 --2- 172.21.15.70:0/711137393 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26b803b8b0 0x7f26b803dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.513+0000 7f26d901b640 1 --2- 172.21.15.70:0/711137393 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26b803b8b0 0x7f26b803dd70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f26c40ad000 tx=0x7f26c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.517+0000 7f26ca7fc640 1 -- 172.21.15.70:0/711137393 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f26d0010d50 con 0x7f26d412f8b0 2024-09-14T10:44:01.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.725+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26d4050ef0 con 0x7f26d412f8b0 2024-09-14T10:44:01.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.725+0000 7f26ca7fc640 1 -- 172.21.15.70:0/711137393 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f26d0012d70 con 0x7f26d412f8b0 2024-09-14T10:44:01.721 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:44:01.721 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.725+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26b803b8b0 msgr2=0x7f26b803dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.725+0000 7f26dba80640 1 --2- 172.21.15.70:0/711137393 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26b803b8b0 0x7f26b803dd70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f26c40ad000 tx=0x7f26c4008040 comp rx=0 tx=0).stop 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.725+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d412f8b0 msgr2=0x7f26d412b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.725+0000 7f26dba80640 1 --2- 172.21.15.70:0/711137393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d412f8b0 0x7f26d412b240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c3d0 tx=0x7f26d000c890 comp rx=0 tx=0).stop 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.729+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 shutdown_connections 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.729+0000 7f26dba80640 1 --2- 172.21.15.70:0/711137393 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26b803b8b0 0x7f26b803dd70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.729+0000 7f26dba80640 1 --2- 172.21.15.70:0/711137393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26d412f8b0 0x7f26d412b240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.729+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 >> 172.21.15.70:0/711137393 conn(0x7f26d40a2520 msgr2=0x7f26d406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.729+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 shutdown_connections 2024-09-14T10:44:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:44:01.729+0000 7f26dba80640 1 -- 172.21.15.70:0/711137393 wait complete. 2024-09-14T10:44:01.740 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T10:44:01.740 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T10:44:01.760 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-14T10:44:01.760 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T10:44:01.761 INFO:tasks.rgw:Creating data pools 2024-09-14T10:44:01.761 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T10:44:01.761 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-14T10:44:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6f7098640 1 Processor -- start 2024-09-14T10:44:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6f7098640 1 -- start start 2024-09-14T10:44:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6f7098640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc6f01186c0 0x7fc6f011aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6f7098640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f011b0b0 con 0x7fc6f0111780 2024-09-14T10:44:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6f7098640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f011c2b0 con 0x7fc6f01186c0 2024-09-14T10:44:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6effff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc6f01186c0 0x7fc6f011aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6f4e34640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc6f0111780 0x7fc6f0111b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:51236/0 (socket says 172.21.15.96:51236) 2024-09-14T10:44:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6f4e34640 1 -- 172.21.15.96:0/743761490 learned_addr learned my addr 172.21.15.96:0/743761490 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6effff640 1 -- 172.21.15.96:0/743761490 >> v1:172.21.15.70:6789/0 conn(0x7fc6f0111780 legacy=0x7fc6f0111b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.900+0000 7fc6effff640 1 -- 172.21.15.96:0/743761490 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f011c460 con 0x7fc6f01186c0 2024-09-14T10:44:01.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6effff640 1 --2- 172.21.15.96:0/743761490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f01186c0 0x7fc6f011aab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009740 tx=0x7fc6e401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bf76bf311f6669 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6ef7fe640 1 -- 172.21.15.96:0/743761490 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e40b1070 con 0x7fc6f01186c0 2024-09-14T10:44:01.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6ef7fe640 1 -- 172.21.15.96:0/743761490 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e40ac520 con 0x7fc6f01186c0 2024-09-14T10:44:01.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6ef7fe640 1 -- 172.21.15.96:0/743761490 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e40ac820 con 0x7fc6f01186c0 2024-09-14T10:44:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 -- 172.21.15.96:0/743761490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f01186c0 msgr2=0x7fc6f011aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 --2- 172.21.15.96:0/743761490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f01186c0 0x7fc6f011aab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009740 tx=0x7fc6e401c370 comp rx=0 tx=0).stop 2024-09-14T10:44:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 -- 172.21.15.96:0/743761490 shutdown_connections 2024-09-14T10:44:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 --2- 172.21.15.96:0/743761490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f01186c0 0x7fc6f011aab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 -- 172.21.15.96:0/743761490 >> 172.21.15.96:0/743761490 conn(0x7fc6f0070270 msgr2=0x7fc6f0072690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 -- 172.21.15.96:0/743761490 shutdown_connections 2024-09-14T10:44:01.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 -- 172.21.15.96:0/743761490 wait complete. 2024-09-14T10:44:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 Processor -- start 2024-09-14T10:44:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 -- start start 2024-09-14T10:44:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.904+0000 7fc6f7098640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f0111780 0x7fc6f01a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f7098640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f011bf70 con 0x7fc6f0111780 2024-09-14T10:44:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f4e34640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f0111780 0x7fc6f01a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f4e34640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f0111780 0x7fc6f01a7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:56886/0 (socket says 172.21.15.96:56886) 2024-09-14T10:44:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f4e34640 1 -- 172.21.15.96:0/3814998995 learned_addr learned my addr 172.21.15.96:0/3814998995 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f4e34640 1 -- 172.21.15.96:0/3814998995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f01a8410 con 0x7fc6f0111780 2024-09-14T10:44:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f4e34640 1 --2- 172.21.15.96:0/3814998995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f0111780 0x7fc6f01a7e40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000c480 tx=0x7fc6e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6ed7fa640 1 -- 172.21.15.96:0/3814998995 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0017070 con 0x7fc6f0111780 2024-09-14T10:44:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6ed7fa640 1 -- 172.21.15.96:0/3814998995 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e0005c20 con 0x7fc6f0111780 2024-09-14T10:44:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f01a8700 con 0x7fc6f0111780 2024-09-14T10:44:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6ed7fa640 1 -- 172.21.15.96:0/3814998995 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e00070d0 con 0x7fc6f0111780 2024-09-14T10:44:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f01ad8d0 con 0x7fc6f0111780 2024-09-14T10:44:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f0111be0 con 0x7fc6f0111780 2024-09-14T10:44:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6ed7fa640 1 -- 172.21.15.96:0/3814998995 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc6e001a070 con 0x7fc6f0111780 2024-09-14T10:44:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6ed7fa640 1 --2- 172.21.15.96:0/3814998995 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6dc03b890 0x7fc6dc03dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6ed7fa640 1 -- 172.21.15.96:0/3814998995 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fc6e004eca0 con 0x7fc6f0111780 2024-09-14T10:44:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6effff640 1 --2- 172.21.15.96:0/3814998995 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6dc03b890 0x7fc6dc03dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:01.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.908+0000 7fc6effff640 1 --2- 172.21.15.96:0/3814998995 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6dc03b890 0x7fc6dc03dd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40ae000 tx=0x7fc6e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:01.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:01.920+0000 7fc6ed7fa640 1 -- 172.21.15.96:0/3814998995 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fc6e001ad80 con 0x7fc6f0111780 2024-09-14T10:44:02.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.108+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7fc6f01a8a40 con 0x7fc6f0111780 2024-09-14T10:44:02.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.624+0000 7fc6ed7fa640 1 -- 172.21.15.96:0/3814998995 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v18) ==== 171+0+0 (secure 0 0 0) 0x7fc6e002f070 con 0x7fc6f0111780 2024-09-14T10:44:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6dc03b890 msgr2=0x7fc6dc03dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 --2- 172.21.15.96:0/3814998995 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6dc03b890 0x7fc6dc03dd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40ae000 tx=0x7fc6e4008040 comp rx=0 tx=0).stop 2024-09-14T10:44:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f0111780 msgr2=0x7fc6f01a7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 --2- 172.21.15.96:0/3814998995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f0111780 0x7fc6f01a7e40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000c480 tx=0x7fc6e000c940 comp rx=0 tx=0).stop 2024-09-14T10:44:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 shutdown_connections 2024-09-14T10:44:02.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 --2- 172.21.15.96:0/3814998995 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6dc03b890 0x7fc6dc03dd50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:02.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 --2- 172.21.15.96:0/3814998995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6f0111780 0x7fc6f01a7e40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:02.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 >> 172.21.15.96:0/3814998995 conn(0x7fc6f0070270 msgr2=0x7fc6f0110630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:02.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 shutdown_connections 2024-09-14T10:44:02.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.628+0000 7fc6f7098640 1 -- 172.21.15.96:0/3814998995 wait complete. 2024-09-14T10:44:02.646 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T10:44:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f9109836640 1 Processor -- start 2024-09-14T10:44:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f9109836640 1 -- start start 2024-09-14T10:44:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f9109836640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f91041104c0 0x7f910411c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:02.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f9109836640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9104110950 con 0x7f9104074dc0 2024-09-14T10:44:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f9109836640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f9104110b20 con 0x7f91041104c0 2024-09-14T10:44:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f91027fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f91041104c0 0x7f910411c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f9102ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9104074dc0 0x7f910410fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:51244/0 (socket says 172.21.15.96:51244) 2024-09-14T10:44:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f9102ffd640 1 -- 172.21.15.96:0/2456555941 learned_addr learned my addr 172.21.15.96:0/2456555941 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:02.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f91027fc640 1 -- 172.21.15.96:0/2456555941 >> v1:172.21.15.70:6789/0 conn(0x7f9104074dc0 legacy=0x7f910410fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:02.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.776+0000 7f91027fc640 1 -- 172.21.15.96:0/2456555941 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910411d690 con 0x7f91041104c0 2024-09-14T10:44:02.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f91027fc640 1 --2- 172.21.15.96:0/2456555941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91041104c0 0x7f910411c140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009740 tx=0x7f90f401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64b1bcfe0f4e66d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9101ffb640 1 -- 172.21.15.96:0/2456555941 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f40b1070 con 0x7f91041104c0 2024-09-14T10:44:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9101ffb640 1 -- 172.21.15.96:0/2456555941 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f40ac520 con 0x7f91041104c0 2024-09-14T10:44:02.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9101ffb640 1 -- 172.21.15.96:0/2456555941 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f40ac820 con 0x7f91041104c0 2024-09-14T10:44:02.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 -- 172.21.15.96:0/2456555941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91041104c0 msgr2=0x7f910411c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:02.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 --2- 172.21.15.96:0/2456555941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91041104c0 0x7f910411c140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009740 tx=0x7f90f401c370 comp rx=0 tx=0).stop 2024-09-14T10:44:02.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 -- 172.21.15.96:0/2456555941 shutdown_connections 2024-09-14T10:44:02.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 --2- 172.21.15.96:0/2456555941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91041104c0 0x7f910411c140 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:02.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 -- 172.21.15.96:0/2456555941 >> 172.21.15.96:0/2456555941 conn(0x7f9104070270 msgr2=0x7f9104072690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:02.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 -- 172.21.15.96:0/2456555941 shutdown_connections 2024-09-14T10:44:02.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 -- 172.21.15.96:0/2456555941 wait complete. 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 Processor -- start 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 -- start start 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9104074dc0 0x7f91041a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9109836640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f910411d2e0 con 0x7f9104074dc0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9102ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9104074dc0 0x7f91041a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9102ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9104074dc0 0x7f91041a7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:56896/0 (socket says 172.21.15.96:56896) 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9102ffd640 1 -- 172.21.15.96:0/2099743998 learned_addr learned my addr 172.21.15.96:0/2099743998 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.780+0000 7f9102ffd640 1 -- 172.21.15.96:0/2099743998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91041a8410 con 0x7f9104074dc0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f9102ffd640 1 --2- 172.21.15.96:0/2099743998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9104074dc0 0x7f91041a7e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00c450 tx=0x7f90ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f90fbfff640 1 -- 172.21.15.96:0/2099743998 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90ec017070 con 0x7f9104074dc0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f90fbfff640 1 -- 172.21.15.96:0/2099743998 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ec005c20 con 0x7f9104074dc0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f90fbfff640 1 -- 172.21.15.96:0/2099743998 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90ec0070d0 con 0x7f9104074dc0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91041a8700 con 0x7f9104074dc0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91041ad8d0 con 0x7f9104074dc0 2024-09-14T10:44:02.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910410fe30 con 0x7f9104074dc0 2024-09-14T10:44:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f90fbfff640 1 -- 172.21.15.96:0/2099743998 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f90ec01a070 con 0x7f9104074dc0 2024-09-14T10:44:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f90fbfff640 1 --2- 172.21.15.96:0/2099743998 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f90e403b8e0 0x7f90e403dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f90fbfff640 1 -- 172.21.15.96:0/2099743998 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3825+0+0 (secure 0 0 0) 0x7f90ec04ef50 con 0x7f9104074dc0 2024-09-14T10:44:02.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f91027fc640 1 --2- 172.21.15.96:0/2099743998 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f90e403b8e0 0x7f90e403dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:02.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.784+0000 7f91027fc640 1 --2- 172.21.15.96:0/2099743998 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f90e403b8e0 0x7f90e403dda0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ae000 tx=0x7f90f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:02.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.796+0000 7f90fbfff640 1 -- 172.21.15.96:0/2099743998 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f90ec04cd10 con 0x7f9104074dc0 2024-09-14T10:44:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:02.964+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f91041a8a40 con 0x7f9104074dc0 2024-09-14T10:44:04.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.260+0000 7f90fbfff640 1 -- 172.21.15.96:0/2099743998 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7f90ec04d090 con 0x7f9104074dc0 2024-09-14T10:44:04.259 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T10:44:04.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f90e403b8e0 msgr2=0x7f90e403dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:04.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 --2- 172.21.15.96:0/2099743998 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f90e403b8e0 0x7f90e403dda0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ae000 tx=0x7f90f4008040 comp rx=0 tx=0).stop 2024-09-14T10:44:04.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9104074dc0 msgr2=0x7f91041a7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:04.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 --2- 172.21.15.96:0/2099743998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9104074dc0 0x7f91041a7e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00c450 tx=0x7f90ec00c910 comp rx=0 tx=0).stop 2024-09-14T10:44:04.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 shutdown_connections 2024-09-14T10:44:04.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 --2- 172.21.15.96:0/2099743998 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f90e403b8e0 0x7f90e403dda0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:04.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 --2- 172.21.15.96:0/2099743998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9104074dc0 0x7f91041a7e40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:04.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 >> 172.21.15.96:0/2099743998 conn(0x7f9104070270 msgr2=0x7f910411b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:04.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 shutdown_connections 2024-09-14T10:44:04.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.264+0000 7f9109836640 1 -- 172.21.15.96:0/2099743998 wait complete. 2024-09-14T10:44:04.293 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T10:44:04.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ecc4640 1 Processor -- start 2024-09-14T10:44:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ecc4640 1 -- start start 2024-09-14T10:44:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ecc4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5a78074e00 0x7f5a7810fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ecc4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a78110780 con 0x7f5a781102f0 2024-09-14T10:44:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ecc4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f5a78110950 con 0x7f5a78074e00 2024-09-14T10:44:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ca60640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5a78074e00 0x7f5a7810fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ca60640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5a78074e00 0x7f5a7810fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:56910/0 (socket says 172.21.15.96:56910) 2024-09-14T10:44:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ca60640 1 -- 172.21.15.96:0/3322907576 learned_addr learned my addr 172.21.15.96:0/3322907576 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:04.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ca60640 1 -- 172.21.15.96:0/3322907576 >> v1:172.21.15.70:6789/0 conn(0x7f5a781102f0 legacy=0x7f5a7811b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:04.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.424+0000 7f5a7ca60640 1 -- 172.21.15.96:0/3322907576 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a78110b00 con 0x7f5a78074e00 2024-09-14T10:44:04.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ca60640 1 --2- 172.21.15.96:0/3322907576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a7810fdb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5a680097f0 tx=0x7f5a6801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9451bb06b60887 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:04.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a777fe640 1 -- 172.21.15.96:0/3322907576 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680b1070 con 0x7f5a78074e00 2024-09-14T10:44:04.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a777fe640 1 -- 172.21.15.96:0/3322907576 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a680ac540 con 0x7f5a78074e00 2024-09-14T10:44:04.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a777fe640 1 -- 172.21.15.96:0/3322907576 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680ac840 con 0x7f5a78074e00 2024-09-14T10:44:04.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/3322907576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 msgr2=0x7f5a7810fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:04.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 --2- 172.21.15.96:0/3322907576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a7810fdb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5a680097f0 tx=0x7f5a6801c4a0 comp rx=0 tx=0).stop 2024-09-14T10:44:04.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/3322907576 shutdown_connections 2024-09-14T10:44:04.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 --2- 172.21.15.96:0/3322907576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a7810fdb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:04.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/3322907576 >> 172.21.15.96:0/3322907576 conn(0x7f5a78070370 msgr2=0x7f5a78072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:04.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/3322907576 shutdown_connections 2024-09-14T10:44:04.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/3322907576 wait complete. 2024-09-14T10:44:04.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 Processor -- start 2024-09-14T10:44:04.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 -- start start 2024-09-14T10:44:04.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a781aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ecc4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7811f4c0 con 0x7f5a78074e00 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ca60640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a781aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ca60640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a781aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:56918/0 (socket says 172.21.15.96:56918) 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ca60640 1 -- 172.21.15.96:0/2788635530 learned_addr learned my addr 172.21.15.96:0/2788635530 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ca60640 1 -- 172.21.15.96:0/2788635530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a781aa6c0 con 0x7f5a78074e00 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.428+0000 7f5a7ca60640 1 --2- 172.21.15.96:0/2788635530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a781aa0f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5a6801a0d0 tx=0x7f5a6801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a757fa640 1 -- 172.21.15.96:0/2788635530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680bb020 con 0x7f5a78074e00 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a757fa640 1 -- 172.21.15.96:0/2788635530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a680ab6e0 con 0x7f5a78074e00 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a781aa950 con 0x7f5a78074e00 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a757fa640 1 -- 172.21.15.96:0/2788635530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680b1040 con 0x7f5a78074e00 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a781af930 con 0x7f5a78074e00 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7810fe30 con 0x7f5a78074e00 2024-09-14T10:44:04.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a757fa640 1 -- 172.21.15.96:0/2788635530 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5a680be020 con 0x7f5a78074e00 2024-09-14T10:44:04.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a757fa640 1 --2- 172.21.15.96:0/2788635530 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6403b890 0x7f5a6403dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:04.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a757fa640 1 -- 172.21.15.96:0/2788635530 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4272+0+0 (secure 0 0 0) 0x7f5a680a9070 con 0x7f5a78074e00 2024-09-14T10:44:04.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a77fff640 1 --2- 172.21.15.96:0/2788635530 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6403b890 0x7f5a6403dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:04.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.432+0000 7f5a77fff640 1 --2- 172.21.15.96:0/2788635530 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6403b890 0x7f5a6403dd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000f70 tx=0x7f5a6c007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.444+0000 7f5a757fa640 1 -- 172.21.15.96:0/2788635530 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f5a680c5030 con 0x7f5a78074e00 2024-09-14T10:44:04.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:04.616+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f5a781102f0 con 0x7f5a78074e00 2024-09-14T10:44:05.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.268+0000 7f5a757fa640 1 -- 172.21.15.96:0/2788635530 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7f5a68016090 con 0x7f5a78074e00 2024-09-14T10:44:05.265 INFO:teuthology.orchestra.run.smithi096.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T10:44:05.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6403b890 msgr2=0x7f5a6403dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:05.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 --2- 172.21.15.96:0/2788635530 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6403b890 0x7f5a6403dd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000f70 tx=0x7f5a6c007a40 comp rx=0 tx=0).stop 2024-09-14T10:44:05.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 msgr2=0x7f5a781aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:05.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 --2- 172.21.15.96:0/2788635530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a781aa0f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5a6801a0d0 tx=0x7f5a6801ace0 comp rx=0 tx=0).stop 2024-09-14T10:44:05.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 shutdown_connections 2024-09-14T10:44:05.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 --2- 172.21.15.96:0/2788635530 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6403b890 0x7f5a6403dd50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:05.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 --2- 172.21.15.96:0/2788635530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a78074e00 0x7f5a781aa0f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:05.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 >> 172.21.15.96:0/2788635530 conn(0x7f5a78070370 msgr2=0x7f5a78118780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:05.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 shutdown_connections 2024-09-14T10:44:05.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.272+0000 7f5a7ecc4640 1 -- 172.21.15.96:0/2788635530 wait complete. 2024-09-14T10:44:05.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T10:44:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efccf9c8640 1 Processor -- start 2024-09-14T10:44:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efccf9c8640 1 -- start start 2024-09-14T10:44:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efccf9c8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efcc81187b0 0x7efcc811aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efccf9c8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc811b170 con 0x7efcc8110070 2024-09-14T10:44:05.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efccf9c8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7efcc811c350 con 0x7efcc81187b0 2024-09-14T10:44:05.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efcccf63640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efcc81187b0 0x7efcc811aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:05.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efccd764640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efcc8110070 0x7efcc8110450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:51258/0 (socket says 172.21.15.96:51258) 2024-09-14T10:44:05.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efccd764640 1 -- 172.21.15.96:0/1617698476 learned_addr learned my addr 172.21.15.96:0/1617698476 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:05.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efcccf63640 1 -- 172.21.15.96:0/1617698476 >> v1:172.21.15.70:6789/0 conn(0x7efcc8110070 legacy=0x7efcc8110450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:05.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.448+0000 7efcccf63640 1 -- 172.21.15.96:0/1617698476 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc811c4d0 con 0x7efcc81187b0 2024-09-14T10:44:05.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efcccf63640 1 --2- 172.21.15.96:0/1617698476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc81187b0 0x7efcc811aba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009740 tx=0x7efcbc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24712ef873f5f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:05.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efcc7fff640 1 -- 172.21.15.96:0/1617698476 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcbc0b1070 con 0x7efcc81187b0 2024-09-14T10:44:05.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efcc7fff640 1 -- 172.21.15.96:0/1617698476 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc0ac520 con 0x7efcc81187b0 2024-09-14T10:44:05.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efcc7fff640 1 -- 172.21.15.96:0/1617698476 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcbc0ac820 con 0x7efcc81187b0 2024-09-14T10:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 -- 172.21.15.96:0/1617698476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc81187b0 msgr2=0x7efcc811aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 --2- 172.21.15.96:0/1617698476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc81187b0 0x7efcc811aba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009740 tx=0x7efcbc01c370 comp rx=0 tx=0).stop 2024-09-14T10:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 -- 172.21.15.96:0/1617698476 shutdown_connections 2024-09-14T10:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 --2- 172.21.15.96:0/1617698476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc81187b0 0x7efcc811aba0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 -- 172.21.15.96:0/1617698476 >> 172.21.15.96:0/1617698476 conn(0x7efcc80711e0 msgr2=0x7efcc8073600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 -- 172.21.15.96:0/1617698476 shutdown_connections 2024-09-14T10:44:05.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 -- 172.21.15.96:0/1617698476 wait complete. 2024-09-14T10:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 Processor -- start 2024-09-14T10:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 -- start start 2024-09-14T10:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc8110070 0x7efcc81a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efcc811c000 con 0x7efcc8110070 2024-09-14T10:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccd764640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc8110070 0x7efcc81a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccd764640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc8110070 0x7efcc81a8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:56934/0 (socket says 172.21.15.96:56934) 2024-09-14T10:44:05.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccd764640 1 -- 172.21.15.96:0/1371731594 learned_addr learned my addr 172.21.15.96:0/1371731594 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccd764640 1 -- 172.21.15.96:0/1371731594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc81a90d0 con 0x7efcc8110070 2024-09-14T10:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccd764640 1 --2- 172.21.15.96:0/1371731594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc8110070 0x7efcc81a8b90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcc000cbd0 tx=0x7efcc000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efcc5ffb640 1 -- 172.21.15.96:0/1371731594 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc0017070 con 0x7efcc8110070 2024-09-14T10:44:05.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efcc5ffb640 1 -- 172.21.15.96:0/1371731594 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc000abc0 con 0x7efcc8110070 2024-09-14T10:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc81a93c0 con 0x7efcc8110070 2024-09-14T10:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.452+0000 7efcc5ffb640 1 -- 172.21.15.96:0/1371731594 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc0012400 con 0x7efcc8110070 2024-09-14T10:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.456+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc81a9950 con 0x7efcc8110070 2024-09-14T10:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.456+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc8110450 con 0x7efcc8110070 2024-09-14T10:44:05.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.456+0000 7efcc5ffb640 1 -- 172.21.15.96:0/1371731594 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7efcc001a070 con 0x7efcc8110070 2024-09-14T10:44:05.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.456+0000 7efcc5ffb640 1 --2- 172.21.15.96:0/1371731594 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcb403b8e0 0x7efcb403dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:05.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.456+0000 7efcc5ffb640 1 -- 172.21.15.96:0/1371731594 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4283+0+0 (secure 0 0 0) 0x7efcc004fd30 con 0x7efcc8110070 2024-09-14T10:44:05.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.456+0000 7efcccf63640 1 --2- 172.21.15.96:0/1371731594 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcb403b8e0 0x7efcb403dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:05.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.456+0000 7efcccf63640 1 --2- 172.21.15.96:0/1371731594 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcb403b8e0 0x7efcb403dda0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0ae000 tx=0x7efcbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:05.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.468+0000 7efcc5ffb640 1 -- 172.21.15.96:0/1371731594 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7efcc004d930 con 0x7efcc8110070 2024-09-14T10:44:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:05.640+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7efcc81187b0 con 0x7efcc8110070 2024-09-14T10:44:06.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.276+0000 7efcc5ffb640 1 -- 172.21.15.96:0/1371731594 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7efcc004dcb0 con 0x7efcc8110070 2024-09-14T10:44:06.272 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T10:44:06.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcb403b8e0 msgr2=0x7efcb403dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:06.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 --2- 172.21.15.96:0/1371731594 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcb403b8e0 0x7efcb403dda0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0ae000 tx=0x7efcbc008040 comp rx=0 tx=0).stop 2024-09-14T10:44:06.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc8110070 msgr2=0x7efcc81a8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:06.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 --2- 172.21.15.96:0/1371731594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc8110070 0x7efcc81a8b90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcc000cbd0 tx=0x7efcc000a430 comp rx=0 tx=0).stop 2024-09-14T10:44:06.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 shutdown_connections 2024-09-14T10:44:06.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 --2- 172.21.15.96:0/1371731594 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcb403b8e0 0x7efcb403dda0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:06.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 --2- 172.21.15.96:0/1371731594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcc8110070 0x7efcc81a8b90 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcc000cbd0 tx=0x7efcc000a430 comp rx=0 tx=0).stop 2024-09-14T10:44:06.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 >> 172.21.15.96:0/1371731594 conn(0x7efcc80711e0 msgr2=0x7efcc8113480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:06.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 shutdown_connections 2024-09-14T10:44:06.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.280+0000 7efccf9c8640 1 -- 172.21.15.96:0/1371731594 wait complete. 2024-09-14T10:44:06.306 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T10:44:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fddaae5a640 1 Processor -- start 2024-09-14T10:44:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fddaae5a640 1 -- start start 2024-09-14T10:44:06.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fddaae5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdda4116b30 0x7fdda4116f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:06.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fddaae5a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda4117630 con 0x7fdda4112dd0 2024-09-14T10:44:06.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fddaae5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fdda4113970 con 0x7fdda4116b30 2024-09-14T10:44:06.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fdda8bf6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdda4116b30 0x7fdda4116f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:06.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fdd9bfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fdda4112dd0 0x7fdda4113260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:51270/0 (socket says 172.21.15.96:51270) 2024-09-14T10:44:06.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fdda8bf6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdda4116b30 0x7fdda4116f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:56946/0 (socket says 172.21.15.96:56946) 2024-09-14T10:44:06.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fdd9bfff640 1 -- 172.21.15.96:0/1532355312 learned_addr learned my addr 172.21.15.96:0/1532355312 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:06.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fdda8bf6640 1 -- 172.21.15.96:0/1532355312 >> v1:172.21.15.70:6789/0 conn(0x7fdda4112dd0 legacy=0x7fdda4113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:06.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.428+0000 7fdda8bf6640 1 -- 172.21.15.96:0/1532355312 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda4113b20 con 0x7fdda4116b30 2024-09-14T10:44:06.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fdda8bf6640 1 --2- 172.21.15.96:0/1532355312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4116b30 0x7fdda4116f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009740 tx=0x7fdda001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e52a3c94db53e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:06.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fdd9b7fe640 1 -- 172.21.15.96:0/1532355312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda00b1070 con 0x7fdda4116b30 2024-09-14T10:44:06.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fdd9b7fe640 1 -- 172.21.15.96:0/1532355312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda00ac520 con 0x7fdda4116b30 2024-09-14T10:44:06.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fdd9b7fe640 1 -- 172.21.15.96:0/1532355312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda00ac820 con 0x7fdda4116b30 2024-09-14T10:44:06.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fddaae5a640 1 -- 172.21.15.96:0/1532355312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4116b30 msgr2=0x7fdda4116f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fddaae5a640 1 --2- 172.21.15.96:0/1532355312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4116b30 0x7fdda4116f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009740 tx=0x7fdda001c370 comp rx=0 tx=0).stop 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fddaae5a640 1 -- 172.21.15.96:0/1532355312 shutdown_connections 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fddaae5a640 1 --2- 172.21.15.96:0/1532355312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4116b30 0x7fdda4116f10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fddaae5a640 1 -- 172.21.15.96:0/1532355312 >> 172.21.15.96:0/1532355312 conn(0x7fdda406f840 msgr2=0x7fdda406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fddaae5a640 1 -- 172.21.15.96:0/1532355312 shutdown_connections 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fddaae5a640 1 -- 172.21.15.96:0/1532355312 wait complete. 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.432+0000 7fddaae5a640 1 Processor -- start 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fddaae5a640 1 -- start start 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fddaae5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4112dd0 0x7fdda41a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fddaae5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41216f0 con 0x7fdda4112dd0 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdda8bf6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4112dd0 0x7fdda41a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdda8bf6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4112dd0 0x7fdda41a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:56954/0 (socket says 172.21.15.96:56954) 2024-09-14T10:44:06.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdda8bf6640 1 -- 172.21.15.96:0/4239593785 learned_addr learned my addr 172.21.15.96:0/4239593785 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdda8bf6640 1 -- 172.21.15.96:0/4239593785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda41aa5c0 con 0x7fdda4112dd0 2024-09-14T10:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdda8bf6640 1 --2- 172.21.15.96:0/4239593785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4112dd0 0x7fdda41a9ff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdda001aa20 tx=0x7fdda001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdd997fa640 1 -- 172.21.15.96:0/4239593785 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda00b1050 con 0x7fdda4112dd0 2024-09-14T10:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdd997fa640 1 -- 172.21.15.96:0/4239593785 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda00b2040 con 0x7fdda4112dd0 2024-09-14T10:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda41aa850 con 0x7fdda4112dd0 2024-09-14T10:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdd997fa640 1 -- 172.21.15.96:0/4239593785 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdda00aba40 con 0x7fdda4112dd0 2024-09-14T10:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda41af830 con 0x7fdda4112dd0 2024-09-14T10:44:06.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda4116b30 con 0x7fdda4112dd0 2024-09-14T10:44:06.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdd997fa640 1 -- 172.21.15.96:0/4239593785 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fdda00bf030 con 0x7fdda4112dd0 2024-09-14T10:44:06.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdd997fa640 1 --2- 172.21.15.96:0/4239593785 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fdd9003b8e0 0x7fdd9003dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:06.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdd997fa640 1 -- 172.21.15.96:0/4239593785 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4647+0+0 (secure 0 0 0) 0x7fdda00bd070 con 0x7fdda4112dd0 2024-09-14T10:44:06.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.436+0000 7fdd9bfff640 1 --2- 172.21.15.96:0/4239593785 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fdd9003b8e0 0x7fdd9003dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:06.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.440+0000 7fdd9bfff640 1 --2- 172.21.15.96:0/4239593785 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fdd9003b8e0 0x7fdd9003dda0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdd94005890 tx=0x7fdd94007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:06.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.452+0000 7fdd997fa640 1 -- 172.21.15.96:0/4239593785 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fdda00c6060 con 0x7fdda4112dd0 2024-09-14T10:44:06.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:06.620+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fdda4116d70 con 0x7fdda4112dd0 2024-09-14T10:44:07.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.276+0000 7fdd997fa640 1 -- 172.21.15.96:0/4239593785 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7fdda00a9070 con 0x7fdda4112dd0 2024-09-14T10:44:07.274 INFO:teuthology.orchestra.run.smithi096.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T10:44:07.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fdd9003b8e0 msgr2=0x7fdd9003dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:07.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 --2- 172.21.15.96:0/4239593785 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fdd9003b8e0 0x7fdd9003dda0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdd94005890 tx=0x7fdd94007ab0 comp rx=0 tx=0).stop 2024-09-14T10:44:07.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4112dd0 msgr2=0x7fdda41a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:07.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 --2- 172.21.15.96:0/4239593785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4112dd0 0x7fdda41a9ff0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdda001aa20 tx=0x7fdda001abb0 comp rx=0 tx=0).stop 2024-09-14T10:44:07.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 shutdown_connections 2024-09-14T10:44:07.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 --2- 172.21.15.96:0/4239593785 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fdd9003b8e0 0x7fdd9003dda0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:07.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 --2- 172.21.15.96:0/4239593785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda4112dd0 0x7fdda41a9ff0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:07.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 >> 172.21.15.96:0/4239593785 conn(0x7fdda406f840 msgr2=0x7fdda4111e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:07.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.280+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 shutdown_connections 2024-09-14T10:44:07.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:07.284+0000 7fddaae5a640 1 -- 172.21.15.96:0/4239593785 wait complete. 2024-09-14T10:44:07.323 DEBUG:tasks.rgw:Pools created 2024-09-14T10:44:07.323 INFO:tasks.rgw:Starting rgw... 2024-09-14T10:44:07.323 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-14T10:44:07.324 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T10:44:07.324 DEBUG:teuthology.orchestra.run.smithi096:> sudo echo -n http://smithi096.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T10:44:07.335 INFO:teuthology.orchestra.run.smithi096.stdout:http://smithi096.front.sepia.ceph.com:80 2024-09-14T10:44:07.336 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T10:44:07.387 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T10:44:07.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T10:44:07.430 INFO:tasks.rgw.client.0:Started 2024-09-14T10:44:07.430 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi096.front.sepia.ceph.com:80/ 2024-09-14T10:44:07.430 DEBUG:teuthology.orchestra.run.smithi096:> curl http://smithi096.front.sepia.ceph.com:80/ 2024-09-14T10:44:07.543 INFO:teuthology.orchestra.run.smithi096.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:44:07.544 INFO:teuthology.orchestra.run.smithi096.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:44:07.545 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:44:07.546 INFO:teuthology.orchestra.run.smithi096.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:44:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:curl: (7) Failed to connect to smithi096.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-14T10:44:08.547 DEBUG:teuthology.orchestra.run.smithi096:> curl http://smithi096.front.sepia.ceph.com:80/ 2024-09-14T10:44:08.560 INFO:teuthology.orchestra.run.smithi096.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:44:08.560 INFO:teuthology.orchestra.run.smithi096.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:44:08.560 INFO:teuthology.orchestra.run.smithi096.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:44:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:curl: (7) Failed to connect to smithi096.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-14T10:44:08.560 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:44:10.562 DEBUG:teuthology.orchestra.run.smithi096:> curl http://smithi096.front.sepia.ceph.com:80/ 2024-09-14T10:44:10.574 INFO:teuthology.orchestra.run.smithi096.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:44:10.574 INFO:teuthology.orchestra.run.smithi096.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:44:10.574 INFO:teuthology.orchestra.run.smithi096.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:44:10.574 INFO:teuthology.orchestra.run.smithi096.stderr:curl: (7) Failed to connect to smithi096.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-14T10:44:10.574 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:44:14.576 DEBUG:teuthology.orchestra.run.smithi096:> curl http://smithi096.front.sepia.ceph.com:80/ 2024-09-14T10:44:14.587 INFO:teuthology.orchestra.run.smithi096.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:44:14.588 INFO:teuthology.orchestra.run.smithi096.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:44:14.588 INFO:teuthology.orchestra.run.smithi096.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:44:14.588 INFO:teuthology.orchestra.run.smithi096.stderr:curl: (7) Failed to connect to smithi096.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-14T10:44:14.588 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:44:22.589 DEBUG:teuthology.orchestra.run.smithi096:> curl http://smithi096.front.sepia.ceph.com:80/ 2024-09-14T10:44:22.602 INFO:teuthology.orchestra.run.smithi096.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:44:22.602 INFO:teuthology.orchestra.run.smithi096.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:44:22.605 INFO:teuthology.orchestra.run.smithi096.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 55522 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-14T10:44:22.606 INFO:teuthology.orchestra.run.smithi096.stdout:anonymous 2024-09-14T10:44:22.606 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-14T10:44:23.247 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-14T10:44:23.247 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-14T10:44:23.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-14T10:44:23.247 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-14T10:44:23.285 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:23.285 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:23.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe18c549c0 1 Processor -- start 2024-09-14T10:44:23.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe18c549c0 1 -- start start 2024-09-14T10:44:23.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe18c549c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5571edd78e40 0x5571edd79220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe18c549c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5571edc227a0 con 0x5571edd7c020 2024-09-14T10:44:23.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe18c549c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5571edc7e1b0 con 0x5571edd78e40 2024-09-14T10:44:23.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe1675a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5571edd78e40 0x5571edd79220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe15f59640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5571edd7c020 0x5571edd7e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34116/0 (socket says 172.21.15.96:34116) 2024-09-14T10:44:23.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe15f59640 1 -- 172.21.15.96:0/4261484865 learned_addr learned my addr 172.21.15.96:0/4261484865 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:23.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe1675a640 1 -- 172.21.15.96:0/4261484865 >> v1:172.21.15.70:6789/0 conn(0x5571edd7c020 legacy=0x5571edd7e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.288+0000 7efe1675a640 1 -- 172.21.15.96:0/4261484865 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571edbfcda0 con 0x5571edd78e40 2024-09-14T10:44:23.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe1675a640 1 --2- 172.21.15.96:0/4261484865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edd79220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe1000a480 tx=0x7efe1001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae09c2f64d993e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe15758640 1 -- 172.21.15.96:0/4261484865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe100b0070 con 0x5571edd78e40 2024-09-14T10:44:23.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe15758640 1 -- 172.21.15.96:0/4261484865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe100ab540 con 0x5571edd78e40 2024-09-14T10:44:23.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe15758640 1 -- 172.21.15.96:0/4261484865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe100ab840 con 0x5571edd78e40 2024-09-14T10:44:23.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe18c549c0 1 -- 172.21.15.96:0/4261484865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 msgr2=0x5571edd79220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe18c549c0 1 --2- 172.21.15.96:0/4261484865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edd79220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe1000a480 tx=0x7efe1001b280 comp rx=0 tx=0).stop 2024-09-14T10:44:23.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe18c549c0 1 -- 172.21.15.96:0/4261484865 shutdown_connections 2024-09-14T10:44:23.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe18c549c0 1 --2- 172.21.15.96:0/4261484865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edd79220 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe18c549c0 1 -- 172.21.15.96:0/4261484865 >> 172.21.15.96:0/4261484865 conn(0x5571edd74960 msgr2=0x5571edd76d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe18c549c0 1 -- 172.21.15.96:0/4261484865 shutdown_connections 2024-09-14T10:44:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.292+0000 7efe18c549c0 1 -- 172.21.15.96:0/4261484865 wait complete. 2024-09-14T10:44:23.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 Processor -- start 2024-09-14T10:44:23.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 -- start start 2024-09-14T10:44:23.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edceddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571edc81fc0 con 0x5571edd78e40 2024-09-14T10:44:23.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe1675a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edceddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe1675a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edceddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38072/0 (socket says 172.21.15.96:38072) 2024-09-14T10:44:23.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe1675a640 1 -- 172.21.15.96:0/388193553 learned_addr learned my addr 172.21.15.96:0/388193553 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe1675a640 1 -- 172.21.15.96:0/388193553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571edcee3b0 con 0x5571edd78e40 2024-09-14T10:44:23.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe1675a640 1 --2- 172.21.15.96:0/388193553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edceddc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe10018eb0 tx=0x7efe10003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a41945da5f8f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efd04608640 1 -- 172.21.15.96:0/388193553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe100b0070 con 0x5571edd78e40 2024-09-14T10:44:23.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efd04608640 1 -- 172.21.15.96:0/388193553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe100b1040 con 0x5571edd78e40 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efd04608640 1 -- 172.21.15.96:0/388193553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe100ab6f0 con 0x5571edd78e40 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 -- 172.21.15.96:0/388193553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 msgr2=0x5571edceddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 --2- 172.21.15.96:0/388193553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edceddc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe10018eb0 tx=0x7efe10003030 comp rx=0 tx=0).stop 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 -- 172.21.15.96:0/388193553 shutdown_connections 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 --2- 172.21.15.96:0/388193553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571edceddc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 -- 172.21.15.96:0/388193553 >> 172.21.15.96:0/388193553 conn(0x5571edd74960 msgr2=0x5571ede5fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 -- 172.21.15.96:0/388193553 shutdown_connections 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 -- 172.21.15.96:0/388193553 wait complete. 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 Processor -- start 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.312+0000 7efe18c549c0 1 -- start start 2024-09-14T10:44:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe18c549c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571ede73260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe18c549c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571edc23a50 con 0x5571edd78e40 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe1675a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571ede73260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe1675a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571ede73260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38088/0 (socket says 172.21.15.96:38088) 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe1675a640 1 -- 172.21.15.96:0/2003590195 learned_addr learned my addr 172.21.15.96:0/2003590195 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe1675a640 1 -- 172.21.15.96:0/2003590195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ede737c0 con 0x5571edd78e40 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe1675a640 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571ede73260 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe100ab510 tx=0x7efe10018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efd02e05640 1 -- 172.21.15.96:0/2003590195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe100c4070 con 0x5571edd78e40 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efd02e05640 1 -- 172.21.15.96:0/2003590195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe100b75b0 con 0x5571edd78e40 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ede73a50 con 0x5571edd78e40 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efd02e05640 1 -- 172.21.15.96:0/2003590195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe100b7890 con 0x5571edd78e40 2024-09-14T10:44:23.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ede743b0 con 0x5571edd78e40 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efd02e05640 1 -- 172.21.15.96:0/2003590195 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7efe100c7070 con 0x5571edd78e40 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efd02e05640 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcfc03a150 0x7efcfc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efd02e05640 1 -- 172.21.15.96:0/2003590195 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efe100bc070 con 0x5571edd78e40 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe15f59640 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcfc03a150 0x7efcfc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edd7c020 0x5571ede7a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571ede7a8c0 con 0x5571edd7c020 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edd7c020 0x5571ede7a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe15f59640 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcfc03a150 0x7efcfc03c610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe00001d80 tx=0x7efe000012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.316+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edd7c020 0x5571ede7a380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe16f5b640 1 -- 172.21.15.96:0/2003590195 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe0800a4d0 con 0x5571edd7c020 2024-09-14T10:44:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571ede746f0 con 0x5571edd7c020 2024-09-14T10:44:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe16f5b640 1 -- 172.21.15.96:0/2003590195 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe0800a4d0 con 0x5571edd7c020 2024-09-14T10:44:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571ede7c620 con 0x5571edd7c020 2024-09-14T10:44:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe16f5b640 1 -- 172.21.15.96:0/2003590195 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efe0800a4d0 con 0x5571edd7c020 2024-09-14T10:44:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571ede7b880 con 0x5571edd7c020 2024-09-14T10:44:23.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe16f5b640 1 -- 172.21.15.96:0/2003590195 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe0800a4d0 con 0x5571edd7c020 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571ede7bcd0 con 0x5571edd7c020 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe16f5b640 1 -- 172.21.15.96:0/2003590195 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efe0800a4d0 con 0x5571edd7c020 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 Processor -- start 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 -- start start 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede8a960 0x5571ede8ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571edc8ed80 con 0x5571ede8a960 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe15f59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede8a960 0x5571ede8ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe15f59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede8a960 0x5571ede8ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38092/0 (socket says 172.21.15.96:38092) 2024-09-14T10:44:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe15f59640 1 -- 172.21.15.96:0/2756791831 learned_addr learned my addr 172.21.15.96:0/2756791831 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe15f59640 1 -- 172.21.15.96:0/2756791831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ede8b3c0 con 0x5571ede8a960 2024-09-14T10:44:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe15f59640 1 --2- 172.21.15.96:0/2756791831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede8a960 0x5571ede8ad80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efe0000d660 tx=0x7efe0000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efcfbfff640 1 -- 172.21.15.96:0/2756791831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe0000c6b0 con 0x5571ede8a960 2024-09-14T10:44:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efcfbfff640 1 -- 172.21.15.96:0/2756791831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0000c850 con 0x5571ede8a960 2024-09-14T10:44:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 -- 172.21.15.96:0/2756791831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ede8bc20 con 0x5571ede8a960 2024-09-14T10:44:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efcfbfff640 1 -- 172.21.15.96:0/2756791831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe0000cb30 con 0x5571ede8a960 2024-09-14T10:44:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.320+0000 7efe18c549c0 1 -- 172.21.15.96:0/2756791831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ede8c190 con 0x5571ede8a960 2024-09-14T10:44:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efcfbfff640 1 -- 172.21.15.96:0/2756791831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7efe00023020 con 0x5571ede8a960 2024-09-14T10:44:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efcfbfff640 1 --2- 172.21.15.96:0/2756791831 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcf003a150 0x7efcf003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efcfbfff640 1 -- 172.21.15.96:0/2756791831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efe00021020 con 0x5571ede8a960 2024-09-14T10:44:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2756791831 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcf003a150 0x7efcf003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe18c549c0 1 Processor -- start 2024-09-14T10:44:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe18c549c0 1 -- start start 2024-09-14T10:44:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe18c549c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe18c549c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571edcee720 con 0x5571ede972c0 2024-09-14T10:44:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2756791831 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcf003a150 0x7efcf003c610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5571ede7b3a0 tx=0x7efe08005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe15f59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe15f59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38104/0 (socket says 172.21.15.96:38104) 2024-09-14T10:44:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe15f59640 1 -- 172.21.15.96:0/3565183192 learned_addr learned my addr 172.21.15.96:0/3565183192 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe15f59640 1 -- 172.21.15.96:0/3565183192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ede97c90 con 0x5571ede972c0 2024-09-14T10:44:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efe15f59640 1 --2- 172.21.15.96:0/3565183192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede976a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe000517d0 tx=0x7efe00044710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b451da2e8251a318 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efcf9ffb640 1 -- 172.21.15.96:0/3565183192 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe0000cd20 con 0x5571ede972c0 2024-09-14T10:44:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efcf9ffb640 1 -- 172.21.15.96:0/3565183192 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0001bcc0 con 0x5571ede972c0 2024-09-14T10:44:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.324+0000 7efcf9ffb640 1 -- 172.21.15.96:0/3565183192 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00050270 con 0x5571ede972c0 2024-09-14T10:44:23.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- 172.21.15.96:0/3565183192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 msgr2=0x5571ede976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 --2- 172.21.15.96:0/3565183192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede976a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe000517d0 tx=0x7efe00044710 comp rx=0 tx=0).stop 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- 172.21.15.96:0/3565183192 shutdown_connections 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 --2- 172.21.15.96:0/3565183192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede976a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- 172.21.15.96:0/3565183192 >> 172.21.15.96:0/3565183192 conn(0x5571ede936f0 msgr2=0x5571ede91930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- 172.21.15.96:0/3565183192 shutdown_connections 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- 172.21.15.96:0/3565183192 wait complete. 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 Processor -- start 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- start start 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede9e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571ede982d0 con 0x5571ede972c0 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe15f59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede9e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe15f59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede9e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38110/0 (socket says 172.21.15.96:38110) 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 learned_addr learned my addr 172.21.15.96:0/2975965347 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ede9edd0 con 0x5571ede972c0 2024-09-14T10:44:23.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe15f59640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede9e870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efe00023850 tx=0x7efe00051760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efce7fff640 1 -- 172.21.15.96:0/2975965347 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00050270 con 0x5571ede972c0 2024-09-14T10:44:23.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efce7fff640 1 -- 172.21.15.96:0/2975965347 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe00035070 con 0x5571ede972c0 2024-09-14T10:44:23.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ede9f060 con 0x5571ede972c0 2024-09-14T10:44:23.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efce7fff640 1 -- 172.21.15.96:0/2975965347 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00043170 con 0x5571ede972c0 2024-09-14T10:44:23.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ede9f060 con 0x5571ede972c0 2024-09-14T10:44:23.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.328+0000 7efce7fff640 1 -- 172.21.15.96:0/2975965347 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7efe00019a70 con 0x5571ede972c0 2024-09-14T10:44:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efce7fff640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce003a150 0x7efce003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efce7fff640 1 -- 172.21.15.96:0/2975965347 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efe0004a040 con 0x5571ede972c0 2024-09-14T10:44:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce003a150 0x7efce003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edea9b60 0x5571edeabff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeac740 con 0x5571edea9b60 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe1675a640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edea9b60 0x5571edeabff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce003a150 0x7efce003c610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5571ede74630 tx=0x7efe0801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe1675a640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edea9b60 0x5571edeabff0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 realm 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeacb50 con 0x5571edea9b60 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:23.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edead420 con 0x5571edea9b60 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edead7c0 con 0x5571edea9b60 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeadc60 con 0x5571edea9b60 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:23.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 20 searching for the correct realm 2024-09-14T10:44:23.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571edeafc60 0x5571edeb2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe15f59640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571edeafc60 0x5571edeb2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe15f59640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571edeafc60 0x5571edeb2050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe15f59640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efe0003f800 0x7efe00044840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe0003f800 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.332+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efe0003f800 0x7efe00044840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efe0003f800 0x7efe00044840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0801f070 con 0x7efe0003f800 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe16f5b640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efe08031040 0x7efe08032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efe08031040 0x7efe08032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efe08031040 0x7efe08032430 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edea9b60 2024-09-14T10:44:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edea9b60 2024-09-14T10:44:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.336+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe0003f800 2024-09-14T10:44:23.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0801f070 con 0x7efe0003f800 2024-09-14T10:44:23.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edea9b60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edea9b60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe0003f800 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efe0801f070 con 0x7efe0003f800 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.340+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edea9b60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edea9b60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe0003f800 2024-09-14T10:44:23.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0801f070 con 0x7efe0003f800 2024-09-14T10:44:23.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edea9b60 2024-09-14T10:44:23.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe0003f800 2024-09-14T10:44:23.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0801f070 con 0x7efe0003f800 2024-09-14T10:44:23.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.344+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edeafc60 2024-09-14T10:44:23.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe08031040 2024-09-14T10:44:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x5571edea9b60 2024-09-14T10:44:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb2700 con 0x7efe0003f800 2024-09-14T10:44:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0801f070 con 0x7efe0003f800 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeae700 con 0x5571edea9b60 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeaefa0 con 0x5571edea9b60 2024-09-14T10:44:23.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeae340 con 0x5571edea9b60 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 zone default found 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 4 Realm: () 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 zonegroup default 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeaefa0 con 0x7efe08031040 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb4550 con 0x5571edeafc60 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.348+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb48f0 con 0x5571edeafc60 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe18c549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe18c549c0 20 started sync module instance, tier type = 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe18c549c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:23.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe0003f800 2024-09-14T10:44:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93947811282400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb5190 con 0x7efe0003f800 2024-09-14T10:44:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb59e0 con 0x5571edea9b60 2024-09-14T10:44:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93947811282400] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93947811286240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb5690 con 0x5571edea9b60 2024-09-14T10:44:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.352+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb61b0 con 0x5571edeafc60 2024-09-14T10:44:23.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.356+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93947811286240] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.356+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.356+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93947811290240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb65a0 con 0x5571edeafc60 2024-09-14T10:44:23.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.356+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb6f60 con 0x7efe0003f800 2024-09-14T10:44:23.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.356+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.356+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93947811294144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb7630 con 0x7efe0003f800 2024-09-14T10:44:23.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.356+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb8150 con 0x5571edea9b60 2024-09-14T10:44:23.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.360+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93947811290240] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.360+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93947811294144] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.360+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.360+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93947811298336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb8110 con 0x5571edea9b60 2024-09-14T10:44:23.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.360+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb89f0 con 0x7efe08031040 2024-09-14T10:44:23.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.360+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93947811298336] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.364+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.364+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93947811287296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb85c0 con 0x7efe08031040 2024-09-14T10:44:23.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.364+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb8e90 con 0x7efe08031040 2024-09-14T10:44:23.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.364+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93947811287296] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.364+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.364+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93947811299600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb9070 con 0x7efe08031040 2024-09-14T10:44:23.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.364+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb98c0 con 0x7efe08031040 2024-09-14T10:44:23.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93947811299600] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93947811303536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb9940 con 0x7efe08031040 2024-09-14T10:44:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 20 add_watcher() i=0 2024-09-14T10:44:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 20 add_watcher() i=1 2024-09-14T10:44:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 20 add_watcher() i=2 2024-09-14T10:44:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 20 add_watcher() i=3 2024-09-14T10:44:23.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 20 add_watcher() i=4 2024-09-14T10:44:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 20 add_watcher() i=5 2024-09-14T10:44:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 20 add_watcher() i=6 2024-09-14T10:44:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93947811303536] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 20 add_watcher() i=7 2024-09-14T10:44:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:23.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571edebcc00 con 0x5571edea9b60 2024-09-14T10:44:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.368+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93947811304960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb9ed0 con 0x5571edea9b60 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93947811304960] v32'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efcccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe18c549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe18c549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe18c549c0 5 note: GC not initialized 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efc477fe640 20 reqs_thread_entry: start 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe18c549c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe18c549c0 20 Filter name: none 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efc457fa640 20 reqs_thread_entry: start 2024-09-14T10:44:23.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571ededf8b0 con 0x5571edeafc60 2024-09-14T10:44:23.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571ededf8b0 con 0x5571edeafc60 2024-09-14T10:44:23.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571ededf8b0 con 0x5571edea9b60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeae700 con 0x5571edea9b60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeae700 con 0x7efe0003f800 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edeafc60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.372+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edea9b60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edeafc60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe0003f800 2024-09-14T10:44:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edeafc60 2024-09-14T10:44:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edea9b60 2024-09-14T10:44:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe08031040 2024-09-14T10:44:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe08031040 2024-09-14T10:44:23.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edeafc60 2024-09-14T10:44:23.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe08031040 2024-09-14T10:44:23.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.376+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe08031040 2024-09-14T10:44:23.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe08031040 2024-09-14T10:44:23.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edeafc60 2024-09-14T10:44:23.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe0003f800 2024-09-14T10:44:23.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edea9b60 2024-09-14T10:44:23.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edea9b60 2024-09-14T10:44:23.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edeafc60 2024-09-14T10:44:23.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe0003f800 2024-09-14T10:44:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe08031040 2024-09-14T10:44:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edea9b60 2024-09-14T10:44:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.380+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe08031040 2024-09-14T10:44:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edeafc60 2024-09-14T10:44:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe0003f800 2024-09-14T10:44:23.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe08031040 2024-09-14T10:44:23.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edea9b60 2024-09-14T10:44:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x5571edeafc60 2024-09-14T10:44:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb39f0 con 0x7efe0003f800 2024-09-14T10:44:23.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.384+0000 7efcccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:23.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.388+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93947811304960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeae6e0 con 0x5571edea9b60 2024-09-14T10:44:23.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.388+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93947811304960] v32'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.388+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93947811282400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb9600 con 0x7efe0003f800 2024-09-14T10:44:23.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.388+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93947811282400] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.388+0000 7efe18c549c0 20 remove_watcher() i=0 2024-09-14T10:44:23.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.388+0000 7efe18c549c0 2 removed watcher, disabling cache 2024-09-14T10:44:23.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.388+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93947811286240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb9600 con 0x5571edea9b60 2024-09-14T10:44:23.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.392+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93947811286240] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.392+0000 7efe18c549c0 20 remove_watcher() i=1 2024-09-14T10:44:23.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.392+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93947811290240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb4ce0 con 0x5571edeafc60 2024-09-14T10:44:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.392+0000 7efe15f59640 1 -- 172.21.15.96:0/2975965347 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93947811290240] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe00043310 con 0x5571edeafc60 2024-09-14T10:44:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.392+0000 7efe18c549c0 20 remove_watcher() i=2 2024-09-14T10:44:23.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.392+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93947811294144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb9600 con 0x7efe0003f800 2024-09-14T10:44:23.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.396+0000 7efe16f5b640 1 -- 172.21.15.96:0/2975965347 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93947811294144] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe08040040 con 0x7efe0003f800 2024-09-14T10:44:23.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.396+0000 7efe18c549c0 20 remove_watcher() i=3 2024-09-14T10:44:23.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.396+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93947811298336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb6bc0 con 0x5571edea9b60 2024-09-14T10:44:23.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.396+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93947811298336] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x5571edea9b60 2024-09-14T10:44:23.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.396+0000 7efe18c549c0 20 remove_watcher() i=4 2024-09-14T10:44:23.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.396+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93947811287296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb9600 con 0x7efe08031040 2024-09-14T10:44:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.400+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93947811287296] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.400+0000 7efe18c549c0 20 remove_watcher() i=5 2024-09-14T10:44:23.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.400+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93947811299600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb6bc0 con 0x7efe08031040 2024-09-14T10:44:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.400+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93947811299600] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.400+0000 7efe18c549c0 20 remove_watcher() i=6 2024-09-14T10:44:23.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.400+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93947811303536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571edeb9600 con 0x7efe08031040 2024-09-14T10:44:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93947811303536] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe100d0070 con 0x7efe08031040 2024-09-14T10:44:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 20 remove_watcher() i=7 2024-09-14T10:44:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efe08031040 msgr2=0x7efe08032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efe08031040 0x7efe08032430 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edea9b60 msgr2=0x5571edeabff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edea9b60 0x5571edeabff0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efe0003f800 msgr2=0x7efe00044840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efe0003f800 0x7efe00044840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571edeafc60 msgr2=0x5571edeb2050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571edeafc60 0x5571edeb2050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce003a150 msgr2=0x7efce003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce003a150 0x7efce003c610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x5571ede74630 tx=0x7efe0801f000 comp rx=0 tx=0).stop 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 msgr2=0x5571ede9e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe1675a640 1 -- 172.21.15.96:0/2975965347 reap_dead start 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede9e870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efe00023850 tx=0x7efe00051760 comp rx=0 tx=0).stop 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 shutdown_connections 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2975965347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede972c0 0x5571ede9e870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 >> 172.21.15.96:0/2975965347 conn(0x5571ede936f0 msgr2=0x5571ede91900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 shutdown_connections 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2975965347 wait complete. 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2756791831 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcf003a150 msgr2=0x7efcf003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2756791831 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcf003a150 0x7efcf003c610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5571ede7b3a0 tx=0x7efe08005850 comp rx=0 tx=0).stop 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2756791831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede8a960 msgr2=0x5571ede8ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2756791831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede8a960 0x5571ede8ad80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efe0000d660 tx=0x7efe0000da60 comp rx=0 tx=0).stop 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2756791831 shutdown_connections 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2756791831 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcf003a150 0x7efcf003c610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2756791831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571ede8a960 0x5571ede8ad80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2756791831 >> 172.21.15.96:0/2756791831 conn(0x5571ede80310 msgr2=0x5571ede806f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2756791831 shutdown_connections 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2756791831 wait complete. 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edd7c020 msgr2=0x5571ede7a380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edd7c020 0x5571ede7a380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcfc03a150 msgr2=0x7efcfc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcfc03a150 0x7efcfc03c610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe00001d80 tx=0x7efe000012e0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 msgr2=0x5571ede73260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571ede73260 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe100ab510 tx=0x7efe10018020 comp rx=0 tx=0).stop 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 shutdown_connections 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571edd7c020 0x5571ede7a380 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcfc03a150 0x7efcfc03c610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 --2- 172.21.15.96:0/2003590195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571edd78e40 0x5571ede73260 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 >> 172.21.15.96:0/2003590195 conn(0x5571edd74960 msgr2=0x5571ede5e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 shutdown_connections 2024-09-14T10:44:23.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.404+0000 7efe18c549c0 1 -- 172.21.15.96:0/2003590195 wait complete. 2024-09-14T10:44:23.412 INFO:teuthology.orchestra.run.smithi096.stdout:[] 2024-09-14T10:44:23.413 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:44:23.413 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-14T10:44:23.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-14T10:44:23.413 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-14T10:44:23.489 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:23.489 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:23.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f15096529c0 1 Processor -- start 2024-09-14T10:44:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f15096529c0 1 -- start start 2024-09-14T10:44:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f15096529c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557155783270 0x557155785660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f15096529c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5571556257a0 con 0x55715577f760 2024-09-14T10:44:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f15096529c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5571556811b0 con 0x557155783270 2024-09-14T10:44:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f1506957640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557155783270 0x557155785660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f1507158640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55715577f760 0x557155781b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34132/0 (socket says 172.21.15.96:34132) 2024-09-14T10:44:23.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f1507158640 1 -- 172.21.15.96:0/3286918711 learned_addr learned my addr 172.21.15.96:0/3286918711 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:23.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f1506957640 1 -- 172.21.15.96:0/3286918711 >> v1:172.21.15.70:6789/0 conn(0x55715577f760 legacy=0x557155781b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.492+0000 7f1506957640 1 -- 172.21.15.96:0/3286918711 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571555ffda0 con 0x557155783270 2024-09-14T10:44:23.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f1506957640 1 --2- 172.21.15.96:0/3286918711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x557155785660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00a480 tx=0x7f14fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd1cfd72803220c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f1506156640 1 -- 172.21.15.96:0/3286918711 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc0b0070 con 0x557155783270 2024-09-14T10:44:23.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f1506156640 1 -- 172.21.15.96:0/3286918711 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14fc0ab540 con 0x557155783270 2024-09-14T10:44:23.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f1506156640 1 -- 172.21.15.96:0/3286918711 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc0ab840 con 0x557155783270 2024-09-14T10:44:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f15096529c0 1 -- 172.21.15.96:0/3286918711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 msgr2=0x557155785660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f15096529c0 1 --2- 172.21.15.96:0/3286918711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x557155785660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00a480 tx=0x7f14fc01b280 comp rx=0 tx=0).stop 2024-09-14T10:44:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f15096529c0 1 -- 172.21.15.96:0/3286918711 shutdown_connections 2024-09-14T10:44:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f15096529c0 1 --2- 172.21.15.96:0/3286918711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x557155785660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f15096529c0 1 -- 172.21.15.96:0/3286918711 >> 172.21.15.96:0/3286918711 conn(0x5571556f2af0 msgr2=0x5571556f2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f15096529c0 1 -- 172.21.15.96:0/3286918711 shutdown_connections 2024-09-14T10:44:23.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.496+0000 7f15096529c0 1 -- 172.21.15.96:0/3286918711 wait complete. 2024-09-14T10:44:23.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f15096529c0 1 Processor -- start 2024-09-14T10:44:23.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f15096529c0 1 -- start start 2024-09-14T10:44:23.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f15096529c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55715577f760 0x55715586a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f15096529c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557155684fc0 con 0x55715577f760 2024-09-14T10:44:23.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f1507158640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55715577f760 0x55715586a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f1507158640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55715577f760 0x55715586a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38122/0 (socket says 172.21.15.96:38122) 2024-09-14T10:44:23.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f1507158640 1 -- 172.21.15.96:0/1211939168 learned_addr learned my addr 172.21.15.96:0/1211939168 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f1507158640 1 -- 172.21.15.96:0/1211939168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715586abf0 con 0x55715577f760 2024-09-14T10:44:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.512+0000 7f1507158640 1 --2- 172.21.15.96:0/1211939168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55715577f760 0x55715586a600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f14f8001e50 tx=0x7f14f8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2074d2b129cc7d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f13f560a640 1 -- 172.21.15.96:0/1211939168 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f8012020 con 0x55715577f760 2024-09-14T10:44:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f13f560a640 1 -- 172.21.15.96:0/1211939168 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f800e7c0 con 0x55715577f760 2024-09-14T10:44:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f13f560a640 1 -- 172.21.15.96:0/1211939168 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f800eaa0 con 0x55715577f760 2024-09-14T10:44:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- 172.21.15.96:0/1211939168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55715577f760 msgr2=0x55715586a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 --2- 172.21.15.96:0/1211939168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55715577f760 0x55715586a600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f14f8001e50 tx=0x7f14f8001e80 comp rx=0 tx=0).stop 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- 172.21.15.96:0/1211939168 shutdown_connections 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 --2- 172.21.15.96:0/1211939168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55715577f760 0x55715586a600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- 172.21.15.96:0/1211939168 >> 172.21.15.96:0/1211939168 conn(0x5571556f2af0 msgr2=0x557155866240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- 172.21.15.96:0/1211939168 shutdown_connections 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- 172.21.15.96:0/1211939168 wait complete. 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 Processor -- start 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- start start 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x5571558721b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557155626a50 con 0x557155783270 2024-09-14T10:44:23.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f1507158640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x5571558721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f1507158640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x5571558721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38138/0 (socket says 172.21.15.96:38138) 2024-09-14T10:44:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f1507158640 1 -- 172.21.15.96:0/2112669880 learned_addr learned my addr 172.21.15.96:0/2112669880 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f1507158640 1 -- 172.21.15.96:0/2112669880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557155872710 con 0x557155783270 2024-09-14T10:44:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f1507158640 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x5571558721b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55715586b590 tx=0x7f14f8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f13f3e07640 1 -- 172.21.15.96:0/2112669880 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f8012030 con 0x557155783270 2024-09-14T10:44:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f13f3e07640 1 -- 172.21.15.96:0/2112669880 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f801a700 con 0x557155783270 2024-09-14T10:44:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f13f3e07640 1 -- 172.21.15.96:0/2112669880 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f801aa20 con 0x557155783270 2024-09-14T10:44:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571558729a0 con 0x557155783270 2024-09-14T10:44:23.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.516+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557155873260 con 0x557155783270 2024-09-14T10:44:23.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f13f3e07640 1 -- 172.21.15.96:0/2112669880 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f14f8015020 con 0x557155783270 2024-09-14T10:44:23.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f13f3e07640 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13ec03a150 0x7f13ec03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f13f3e07640 1 -- 172.21.15.96:0/2112669880 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f14f8020070 con 0x557155783270 2024-09-14T10:44:23.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1506957640 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13ec03a150 0x7f13ec03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f15096529c0 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557155877220 0x557155879610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557155879b50 con 0x557155877220 2024-09-14T10:44:23.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1507959640 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557155877220 0x557155879610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1506957640 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13ec03a150 0x7f13ec03c610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0ad000 tx=0x7f14fc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1507959640 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557155877220 0x557155879610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1507959640 1 -- 172.21.15.96:0/2112669880 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f150000a4d0 con 0x557155877220 2024-09-14T10:44:23.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557155879f10 con 0x557155877220 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1507959640 1 -- 172.21.15.96:0/2112669880 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f150000a4d0 con 0x557155877220 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55715587b810 con 0x557155877220 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1507959640 1 -- 172.21.15.96:0/2112669880 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f150000a4d0 con 0x557155877220 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55715587aa40 con 0x557155877220 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1507959640 1 -- 172.21.15.96:0/2112669880 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f150000a4d0 con 0x557155877220 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55715587ae60 con 0x557155877220 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.520+0000 7f1507959640 1 -- 172.21.15.96:0/2112669880 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f150000a4d0 con 0x557155877220 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f15096529c0 1 Processor -- start 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f15096529c0 1 -- start start 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f15096529c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155889bf0 0x55715588a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f15096529c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557155691d80 con 0x557155889bf0 2024-09-14T10:44:23.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f1506957640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155889bf0 0x55715588a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f1506957640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155889bf0 0x55715588a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38148/0 (socket says 172.21.15.96:38148) 2024-09-14T10:44:23.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f1506957640 1 -- 172.21.15.96:0/1697945907 learned_addr learned my addr 172.21.15.96:0/1697945907 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f1506957640 1 -- 172.21.15.96:0/1697945907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715588a650 con 0x557155889bf0 2024-09-14T10:44:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f1506957640 1 --2- 172.21.15.96:0/1697945907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155889bf0 0x55715588a010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14fc096e80 tx=0x7f14fc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f13f1602640 1 -- 172.21.15.96:0/1697945907 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc0c7070 con 0x557155889bf0 2024-09-14T10:44:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f13f1602640 1 -- 172.21.15.96:0/1697945907 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14fc0b7dd0 con 0x557155889bf0 2024-09-14T10:44:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f15096529c0 1 -- 172.21.15.96:0/1697945907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55715588aeb0 con 0x557155889bf0 2024-09-14T10:44:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f13f1602640 1 -- 172.21.15.96:0/1697945907 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc0b0040 con 0x557155889bf0 2024-09-14T10:44:23.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f15096529c0 1 -- 172.21.15.96:0/1697945907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715588b3c0 con 0x557155889bf0 2024-09-14T10:44:23.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f13f1602640 1 -- 172.21.15.96:0/1697945907 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f14fc0ca070 con 0x557155889bf0 2024-09-14T10:44:23.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f13f1602640 1 --2- 172.21.15.96:0/1697945907 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13e003a150 0x7f13e003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f13f1602640 1 -- 172.21.15.96:0/1697945907 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f14fc0a8070 con 0x557155889bf0 2024-09-14T10:44:23.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.524+0000 7f1507959640 1 --2- 172.21.15.96:0/1697945907 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13e003a150 0x7f13e003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 Processor -- start 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- start start 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1507959640 1 --2- 172.21.15.96:0/1697945907 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13e003a150 0x7f13e003c610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55715587ade0 tx=0x7f1500005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x5571558978a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55715586b020 con 0x5571558974a0 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1506957640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x5571558978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1506957640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x5571558978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38156/0 (socket says 172.21.15.96:38156) 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1506957640 1 -- 172.21.15.96:0/3949728536 learned_addr learned my addr 172.21.15.96:0/3949728536 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1506957640 1 -- 172.21.15.96:0/3949728536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557155897e90 con 0x5571558974a0 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1506957640 1 --2- 172.21.15.96:0/3949728536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x5571558978a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0ca8c0 tx=0x7f14fc0cae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e470c7b43ece927d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f13eaffd640 1 -- 172.21.15.96:0/3949728536 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc0d9020 con 0x5571558974a0 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f13eaffd640 1 -- 172.21.15.96:0/3949728536 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14fc0cb3b0 con 0x5571558974a0 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f13eaffd640 1 -- 172.21.15.96:0/3949728536 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc0c1cc0 con 0x5571558974a0 2024-09-14T10:44:23.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- 172.21.15.96:0/3949728536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 msgr2=0x5571558978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 --2- 172.21.15.96:0/3949728536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x5571558978a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0ca8c0 tx=0x7f14fc0cae70 comp rx=0 tx=0).stop 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- 172.21.15.96:0/3949728536 shutdown_connections 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 --2- 172.21.15.96:0/3949728536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x5571558978a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- 172.21.15.96:0/3949728536 >> 172.21.15.96:0/3949728536 conn(0x5571558928c0 msgr2=0x557155890b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- 172.21.15.96:0/3949728536 shutdown_connections 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- 172.21.15.96:0/3949728536 wait complete. 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 Processor -- start 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- start start 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x55715589da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f15096529c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571558963f0 con 0x5571558974a0 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1506957640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x55715589da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1506957640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x55715589da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38162/0 (socket says 172.21.15.96:38162) 2024-09-14T10:44:23.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.528+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 learned_addr learned my addr 172.21.15.96:0/3635941207 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715589df70 con 0x5571558974a0 2024-09-14T10:44:23.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1506957640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x55715589da10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0ca8c0 tx=0x7f14fc0eb670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f13e97fa640 1 -- 172.21.15.96:0/3635941207 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc0b5cf0 con 0x5571558974a0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f13e97fa640 1 -- 172.21.15.96:0/3635941207 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14fc0eb170 con 0x5571558974a0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55715589e200 con 0x5571558974a0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f13e97fa640 1 -- 172.21.15.96:0/3635941207 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14fc0b5e90 con 0x5571558974a0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715589ebb0 con 0x5571558974a0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f13e97fa640 1 -- 172.21.15.96:0/3635941207 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f14fc0dc020 con 0x5571558974a0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f13e97fa640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13d003a150 0x7f13d003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f13e97fa640 1 -- 172.21.15.96:0/3635941207 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f14fc0eed30 con 0x5571558974a0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1507959640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13d003a150 0x7f13d003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571558a8fb0 0x5571558ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558abb90 con 0x5571558a8fb0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1507158640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571558a8fb0 0x5571558ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1507959640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13d003a150 0x7f13d003c610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55715587a560 tx=0x7f150001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1507158640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571558a8fb0 0x5571558ab440 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 20 realm 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558abfa0 con 0x5571558a8fb0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558ac870 con 0x5571558a8fb0 2024-09-14T10:44:23.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.532+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558acc10 con 0x5571558a8fb0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f15096529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558ad460 con 0x5571558a8fb0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f15096529c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f15096529c0 20 searching for the correct realm 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571558af1d0 0x5571558b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1506957640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571558af1d0 0x5571558b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1506957640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571558af1d0 0x5571558b15c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1506957640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f14fc0de040 0x7f14fc0065c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f14fc0de040 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507959640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f14fc0de040 0x7f14fc0065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507959640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f14fc0de040 0x7f14fc0065c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f150001f070 con 0x7f14fc0de040 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507959640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1500031040 0x7f1500032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507158640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1500031040 0x7f1500032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507158640 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1500031040 0x7f1500032940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x7f1500031040 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.536+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558a8fb0 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558a8fb0 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x7f1500031040 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x7f1500031040 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f14fc0de040 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f150001f070 con 0x7f14fc0de040 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558a8fb0 2024-09-14T10:44:23.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x7f1500031040 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558a8fb0 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f14fc0de040 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f150001f070 con 0x7f14fc0de040 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.540+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x7f1500031040 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558a8fb0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8008030 con 0x5571558a8fb0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558a8fb0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f14fc0de040 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f150001f070 con 0x7f14fc0de040 2024-09-14T10:44:23.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558a8fb0 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.544+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f14fc0de040 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f150001f070 con 0x7f14fc0de040 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558af1d0 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f1500031040 2024-09-14T10:44:23.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x5571558a8fb0 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5571558b1bf0 con 0x7f14fc0de040 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f150001f070 con 0x7f14fc0de040 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f15096529c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f15096529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f15096529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f15096529c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f15096529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f15096529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.548+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558adde0 con 0x5571558a8fb0 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558ae680 con 0x5571558a8fb0 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558ae680 con 0x5571558a8fb0 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 zone default found 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 4 Realm: () 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:23.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 zonegroup default 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558b2050 con 0x7f1500031040 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558b3b40 con 0x5571558af1d0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558b4010 con 0x5571558af1d0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 started sync module instance, tier type = 2024-09-14T10:44:23.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:23.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b2ee0 con 0x7f14fc0de040 2024-09-14T10:44:23.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93945254851280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b4920 con 0x7f14fc0de040 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.552+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b5170 con 0x5571558a8fb0 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.556+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93945254851280] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.556+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.556+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93945254855792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b4d40 con 0x5571558a8fb0 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.556+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b5800 con 0x5571558af1d0 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.556+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.556+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93945254859472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b60a0 con 0x5571558af1d0 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.556+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b6aa0 con 0x7f14fc0de040 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93945254855792] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93945254856848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b6e90 con 0x7f14fc0de040 2024-09-14T10:44:23.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b7850 con 0x5571558a8fb0 2024-09-14T10:44:23.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93945254859472] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93945254861808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b7850 con 0x5571558a8fb0 2024-09-14T10:44:23.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b8260 con 0x7f1500031040 2024-09-14T10:44:23.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.560+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93945254856848] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.564+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93945254861808] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.564+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.564+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93945254867872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b77c0 con 0x7f1500031040 2024-09-14T10:44:23.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.564+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b8710 con 0x7f1500031040 2024-09-14T10:44:23.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93945254867872] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93945254870448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b8680 con 0x7f1500031040 2024-09-14T10:44:23.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b8f50 con 0x7f1500031040 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93945254870448] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93945254871504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b9130 con 0x7f1500031040 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 20 add_watcher() i=0 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 20 add_watcher() i=1 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 20 add_watcher() i=2 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 20 add_watcher() i=3 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 20 add_watcher() i=4 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 20 add_watcher() i=5 2024-09-14T10:44:23.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.568+0000 7f15096529c0 20 add_watcher() i=6 2024-09-14T10:44:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93945254871504] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f15096529c0 20 add_watcher() i=7 2024-09-14T10:44:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f15096529c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558bc500 con 0x5571558a8fb0 2024-09-14T10:44:23.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93945254875168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b98f0 con 0x5571558a8fb0 2024-09-14T10:44:23.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93945254875168] v32'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f13bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:23.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f15096529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:23.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f15096529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:23.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.572+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c4e40 con 0x5571558a8fb0 2024-09-14T10:44:23.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.576+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.576+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c5450 con 0x7f1500031040 2024-09-14T10:44:23.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.576+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.576+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c5410 con 0x5571558af1d0 2024-09-14T10:44:23.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.580+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.580+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c59e0 con 0x5571558a8fb0 2024-09-14T10:44:23.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.580+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.580+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c5900 con 0x7f14fc0de040 2024-09-14T10:44:23.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.584+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.584+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c5f50 con 0x5571558af1d0 2024-09-14T10:44:23.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.584+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.584+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c64e0 con 0x5571558a8fb0 2024-09-14T10:44:23.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.588+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.588+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c6420 con 0x7f1500031040 2024-09-14T10:44:23.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.588+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.588+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c63c0 con 0x7f14fc0de040 2024-09-14T10:44:23.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.592+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.592+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c6a30 con 0x5571558af1d0 2024-09-14T10:44:23.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.592+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.592+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c69f0 con 0x7f14fc0de040 2024-09-14T10:44:23.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.596+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.596+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c6fe0 con 0x7f1500031040 2024-09-14T10:44:23.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.596+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.596+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c6f60 con 0x7f14fc0de040 2024-09-14T10:44:23.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.596+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.596+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7550 con 0x7f1500031040 2024-09-14T10:44:23.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.600+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.600+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7500 con 0x5571558a8fb0 2024-09-14T10:44:23.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.600+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.600+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c74a0 con 0x5571558af1d0 2024-09-14T10:44:23.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.604+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.604+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c74a0 con 0x7f14fc0de040 2024-09-14T10:44:23.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.604+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.604+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c74a0 con 0x5571558af1d0 2024-09-14T10:44:23.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.608+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.608+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c74a0 con 0x5571558a8fb0 2024-09-14T10:44:23.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.608+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.608+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7410 con 0x5571558a8fb0 2024-09-14T10:44:23.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.612+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.612+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7410 con 0x5571558af1d0 2024-09-14T10:44:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.612+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.612+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7410 con 0x7f14fc0de040 2024-09-14T10:44:23.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.616+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.616+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7410 con 0x5571558af1d0 2024-09-14T10:44:23.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.616+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.616+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7410 con 0x5571558af1d0 2024-09-14T10:44:23.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.620+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.620+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7410 con 0x5571558af1d0 2024-09-14T10:44:23.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.624+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.624+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7410 con 0x5571558af1d0 2024-09-14T10:44:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.624+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.624+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7410 con 0x7f1500031040 2024-09-14T10:44:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.628+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.628+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7430 con 0x5571558af1d0 2024-09-14T10:44:23.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.632+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.632+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7460 con 0x7f1500031040 2024-09-14T10:44:23.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.632+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.632+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7460 con 0x5571558af1d0 2024-09-14T10:44:23.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.636+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.636+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c7460 con 0x7f1500031040 2024-09-14T10:44:23.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c74a0 con 0x7f14fc0de040 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f13bcfe1640 20 reqs_thread_entry: start 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f15096529c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f15096529c0 20 Filter name: none 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f13367fc640 20 reqs_thread_entry: start 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f15096529c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f15096529c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.640+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5571558c4730 con 0x7f14fc0de040 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.644+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.644+0000 7f15096529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.644+0000 7f15096529c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-14T10:44:23.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.644+0000 7f15096529c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:44:23.641 INFO:teuthology.orchestra.run.smithi096.stderr:could not remove user: unable to remove user, user does not exist 2024-09-14T10:44:23.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.644+0000 7f13bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:23.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.644+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93945254875168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558c4110 con 0x5571558a8fb0 2024-09-14T10:44:23.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.644+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93945254875168] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.644+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93945254851280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b9020 con 0x7f14fc0de040 2024-09-14T10:44:23.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.648+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93945254851280] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.648+0000 7f15096529c0 20 remove_watcher() i=0 2024-09-14T10:44:23.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.648+0000 7f15096529c0 2 removed watcher, disabling cache 2024-09-14T10:44:23.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.648+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93945254855792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b9020 con 0x5571558a8fb0 2024-09-14T10:44:23.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.648+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93945254855792] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.648+0000 7f15096529c0 20 remove_watcher() i=1 2024-09-14T10:44:23.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.648+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93945254859472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b4470 con 0x5571558af1d0 2024-09-14T10:44:23.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.652+0000 7f1506957640 1 -- 172.21.15.96:0/3635941207 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93945254859472] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14fc0c9030 con 0x5571558af1d0 2024-09-14T10:44:23.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.652+0000 7f15096529c0 20 remove_watcher() i=2 2024-09-14T10:44:23.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.652+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93945254856848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b4470 con 0x7f14fc0de040 2024-09-14T10:44:23.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.652+0000 7f1507959640 1 -- 172.21.15.96:0/3635941207 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93945254856848] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1500040040 con 0x7f14fc0de040 2024-09-14T10:44:23.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.652+0000 7f15096529c0 20 remove_watcher() i=3 2024-09-14T10:44:23.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.652+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93945254861808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b9020 con 0x5571558a8fb0 2024-09-14T10:44:23.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.656+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93945254861808] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x5571558a8fb0 2024-09-14T10:44:23.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.656+0000 7f15096529c0 20 remove_watcher() i=4 2024-09-14T10:44:23.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.656+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93945254867872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b9020 con 0x7f1500031040 2024-09-14T10:44:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.656+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93945254867872] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.656+0000 7f15096529c0 20 remove_watcher() i=5 2024-09-14T10:44:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.656+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93945254870448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b73a0 con 0x7f1500031040 2024-09-14T10:44:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93945254870448] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 20 remove_watcher() i=6 2024-09-14T10:44:23.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93945254871504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5571558b7db0 con 0x7f1500031040 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93945254871504] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f8054060 con 0x7f1500031040 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 20 remove_watcher() i=7 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1500031040 msgr2=0x7f1500032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1500031040 0x7f1500032940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571558a8fb0 msgr2=0x5571558ab440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5571558a8fb0 0x5571558ab440 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f14fc0de040 msgr2=0x7f14fc0065c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f14fc0de040 0x7f14fc0065c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571558af1d0 msgr2=0x5571558b15c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5571558af1d0 0x5571558b15c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13d003a150 msgr2=0x7f13d003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13d003a150 0x7f13d003c610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55715587a560 tx=0x7f150001f000 comp rx=0 tx=0).stop 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f1507158640 1 -- 172.21.15.96:0/3635941207 reap_dead start 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 msgr2=0x55715589da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x55715589da10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0ca8c0 tx=0x7f14fc0eb670 comp rx=0 tx=0).stop 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 shutdown_connections 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/3635941207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571558974a0 0x55715589da10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 >> 172.21.15.96:0/3635941207 conn(0x5571558928c0 msgr2=0x557155890ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 shutdown_connections 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/3635941207 wait complete. 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/1697945907 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13e003a150 msgr2=0x7f13e003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/1697945907 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13e003a150 0x7f13e003c610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55715587ade0 tx=0x7f1500005850 comp rx=0 tx=0).stop 2024-09-14T10:44:23.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/1697945907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155889bf0 msgr2=0x55715588a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/1697945907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155889bf0 0x55715588a010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14fc096e80 tx=0x7f14fc018020 comp rx=0 tx=0).stop 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/1697945907 shutdown_connections 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/1697945907 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13e003a150 0x7f13e003c610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 --2- 172.21.15.96:0/1697945907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155889bf0 0x55715588a010 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.660+0000 7f15096529c0 1 -- 172.21.15.96:0/1697945907 >> 172.21.15.96:0/1697945907 conn(0x55715587f5a0 msgr2=0x55715587f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/1697945907 shutdown_connections 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/1697945907 wait complete. 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557155877220 msgr2=0x557155879610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557155877220 0x557155879610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13ec03a150 msgr2=0x7f13ec03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13ec03a150 0x7f13ec03c610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0ad000 tx=0x7f14fc0a5040 comp rx=0 tx=0).stop 2024-09-14T10:44:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 msgr2=0x5571558721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x5571558721b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55715586b590 tx=0x7f14f8000ee0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 shutdown_connections 2024-09-14T10:44:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557155877220 0x557155879610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f13ec03a150 0x7f13ec03c610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 --2- 172.21.15.96:0/2112669880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557155783270 0x5571558721b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 >> 172.21.15.96:0/2112669880 conn(0x5571556f2af0 msgr2=0x55715586baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 shutdown_connections 2024-09-14T10:44:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.664+0000 7f15096529c0 1 -- 172.21.15.96:0/2112669880 wait complete. 2024-09-14T10:44:23.672 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-14T10:44:23.672 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-14T10:44:23.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-14T10:44:23.672 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-14T10:44:23.752 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:23.752 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:23.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d9c669c0 1 Processor -- start 2024-09-14T10:44:23.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d9c669c0 1 -- start start 2024-09-14T10:44:23.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d9c669c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555ad4624270 0x555ad4626660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d9c669c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555ad44c67a0 con 0x555ad4620760 2024-09-14T10:44:23.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d9c669c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x555ad45221b0 con 0x555ad4624270 2024-09-14T10:44:23.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d6f6b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555ad4624270 0x555ad4626660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d6f6b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555ad4624270 0x555ad4626660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38176/0 (socket says 172.21.15.96:38176) 2024-09-14T10:44:23.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d776c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x555ad4620760 0x555ad4622b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34148/0 (socket says 172.21.15.96:34148) 2024-09-14T10:44:23.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2043669495 learned_addr learned my addr 172.21.15.96:0/2043669495 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2043669495 >> v1:172.21.15.70:6789/0 conn(0x555ad4620760 legacy=0x555ad4622b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.756+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2043669495 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad44a0da0 con 0x555ad4624270 2024-09-14T10:44:23.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/2043669495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4624270 0x555ad4626660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00a5c0 tx=0x7fb1cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cad4f6b99e5684 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d676a640 1 -- 172.21.15.96:0/2043669495 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1cc0a6070 con 0x555ad4624270 2024-09-14T10:44:23.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d676a640 1 -- 172.21.15.96:0/2043669495 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0af070 con 0x555ad4624270 2024-09-14T10:44:23.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d676a640 1 -- 172.21.15.96:0/2043669495 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1cc0aa5c0 con 0x555ad4624270 2024-09-14T10:44:23.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2043669495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4624270 msgr2=0x555ad4626660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2043669495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4624270 0x555ad4626660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00a5c0 tx=0x7fb1cc01b340 comp rx=0 tx=0).stop 2024-09-14T10:44:23.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2043669495 shutdown_connections 2024-09-14T10:44:23.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2043669495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4624270 0x555ad4626660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2043669495 >> 172.21.15.96:0/2043669495 conn(0x555ad4593af0 msgr2=0x555ad4593f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2043669495 shutdown_connections 2024-09-14T10:44:23.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.760+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2043669495 wait complete. 2024-09-14T10:44:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d9c669c0 1 Processor -- start 2024-09-14T10:44:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d9c669c0 1 -- start start 2024-09-14T10:44:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d9c669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad45958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d9c669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ad4525fc0 con 0x555ad4620760 2024-09-14T10:44:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d776c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad45958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d776c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad45958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38192/0 (socket says 172.21.15.96:38192) 2024-09-14T10:44:23.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d776c640 1 -- 172.21.15.96:0/1971341252 learned_addr learned my addr 172.21.15.96:0/1971341252 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d776c640 1 -- 172.21.15.96:0/1971341252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad4595ed0 con 0x555ad4620760 2024-09-14T10:44:23.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d776c640 1 --2- 172.21.15.96:0/1971341252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad45958e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0001680 tx=0x7fb1d0001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cf7bd8a85d4ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb0c560a640 1 -- 172.21.15.96:0/1971341252 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1d0013420 con 0x555ad4620760 2024-09-14T10:44:23.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb0c560a640 1 -- 172.21.15.96:0/1971341252 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d00135c0 con 0x555ad4620760 2024-09-14T10:44:23.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb0c560a640 1 -- 172.21.15.96:0/1971341252 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1d00138e0 con 0x555ad4620760 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/1971341252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 msgr2=0x555ad45958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.776+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/1971341252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad45958e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0001680 tx=0x7fb1d0001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/1971341252 shutdown_connections 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/1971341252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad45958e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/1971341252 >> 172.21.15.96:0/1971341252 conn(0x555ad4593af0 msgr2=0x555ad4707240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/1971341252 shutdown_connections 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/1971341252 wait complete. 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 Processor -- start 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 -- start start 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad47172f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ad44c7a50 con 0x555ad4620760 2024-09-14T10:44:23.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d776c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad47172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d776c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad47172f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38194/0 (socket says 172.21.15.96:38194) 2024-09-14T10:44:23.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d776c640 1 -- 172.21.15.96:0/730548733 learned_addr learned my addr 172.21.15.96:0/730548733 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d776c640 1 -- 172.21.15.96:0/730548733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad4717850 con 0x555ad4620760 2024-09-14T10:44:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d776c640 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad47172f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x555ad4596850 tx=0x7fb1d0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb0c3e07640 1 -- 172.21.15.96:0/730548733 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1d00037a0 con 0x555ad4620760 2024-09-14T10:44:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb0c3e07640 1 -- 172.21.15.96:0/730548733 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d0023070 con 0x555ad4620760 2024-09-14T10:44:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ad4717ae0 con 0x555ad4620760 2024-09-14T10:44:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb0c3e07640 1 -- 172.21.15.96:0/730548733 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1d0003ad0 con 0x555ad4620760 2024-09-14T10:44:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ad4718440 con 0x555ad4620760 2024-09-14T10:44:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb0c3e07640 1 -- 172.21.15.96:0/730548733 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb1d0010070 con 0x555ad4620760 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb0c3e07640 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0bc03a1a0 0x7fb0bc03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.780+0000 7fb0c3e07640 1 -- 172.21.15.96:0/730548733 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb1d0050b80 con 0x555ad4620760 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0bc03a1a0 0x7fb0bc03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad4624270 0x555ad471e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad471e950 con 0x555ad4624270 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad4624270 0x555ad471e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0bc03a1a0 0x7fb0bc03c660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0ae000 tx=0x7fb1cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad4624270 0x555ad471e410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/730548733 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1c80083f0 con 0x555ad4624270 2024-09-14T10:44:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad471eda0 con 0x555ad4624270 2024-09-14T10:44:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/730548733 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1c80083f0 con 0x555ad4624270 2024-09-14T10:44:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad47206a0 con 0x555ad4624270 2024-09-14T10:44:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/730548733 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb1c80083f0 con 0x555ad4624270 2024-09-14T10:44:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad471f8d0 con 0x555ad4624270 2024-09-14T10:44:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/730548733 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1c80083f0 con 0x555ad4624270 2024-09-14T10:44:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad471fd20 con 0x555ad4624270 2024-09-14T10:44:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/730548733 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1c80083f0 con 0x555ad4624270 2024-09-14T10:44:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 Processor -- start 2024-09-14T10:44:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 -- start start 2024-09-14T10:44:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad472ea60 0x555ad472ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d9c669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ad4532d80 con 0x555ad472ea60 2024-09-14T10:44:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d6f6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad472ea60 0x555ad472ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d6f6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad472ea60 0x555ad472ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38210/0 (socket says 172.21.15.96:38210) 2024-09-14T10:44:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/427700990 learned_addr learned my addr 172.21.15.96:0/427700990 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.784+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/427700990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad472f4c0 con 0x555ad472ea60 2024-09-14T10:44:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/427700990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad472ea60 0x555ad472ee80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc096f40 tx=0x7fb1cc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb0c1602640 1 -- 172.21.15.96:0/427700990 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1cc0b3b90 con 0x555ad472ea60 2024-09-14T10:44:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/427700990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ad472fd20 con 0x555ad472ea60 2024-09-14T10:44:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb0c1602640 1 -- 172.21.15.96:0/427700990 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0b3d50 con 0x555ad472ea60 2024-09-14T10:44:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb0c1602640 1 -- 172.21.15.96:0/427700990 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1cc0c85a0 con 0x555ad472ea60 2024-09-14T10:44:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/427700990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ad4730230 con 0x555ad472ea60 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb0c1602640 1 -- 172.21.15.96:0/427700990 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb1cc0d1440 con 0x555ad472ea60 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb0c1602640 1 --2- 172.21.15.96:0/427700990 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0b003a190 0x7fb0b003c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb0c1602640 1 -- 172.21.15.96:0/427700990 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb1cc0ee4a0 con 0x555ad472ea60 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/427700990 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0b003a190 0x7fb0b003c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d9c669c0 1 Processor -- start 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d9c669c0 1 -- start start 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/427700990 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0b003a190 0x7fb0b003c650 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x555ad471f3f0 tx=0x7fb1c8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d9c669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad473c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d9c669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ad4596300 con 0x555ad473c2b0 2024-09-14T10:44:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d6f6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad473c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d6f6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad473c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38218/0 (socket says 172.21.15.96:38218) 2024-09-14T10:44:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.788+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2330596834 learned_addr learned my addr 172.21.15.96:0/2330596834 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2330596834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad473cca0 con 0x555ad473c2b0 2024-09-14T10:44:23.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/2330596834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad473c6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0ec7d0 tx=0x7fb1cc0bd9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae6569884fb2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb0baffd640 1 -- 172.21.15.96:0/2330596834 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1cc0e1070 con 0x555ad473c2b0 2024-09-14T10:44:23.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb0baffd640 1 -- 172.21.15.96:0/2330596834 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0be540 con 0x555ad473c2b0 2024-09-14T10:44:23.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb0baffd640 1 -- 172.21.15.96:0/2330596834 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1cc0d1d80 con 0x555ad473c2b0 2024-09-14T10:44:23.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2330596834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 msgr2=0x555ad473c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2330596834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad473c6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0ec7d0 tx=0x7fb1cc0bd9d0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2330596834 shutdown_connections 2024-09-14T10:44:23.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2330596834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad473c6b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2330596834 >> 172.21.15.96:0/2330596834 conn(0x555ad47376d0 msgr2=0x555ad4735910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2330596834 shutdown_connections 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2330596834 wait complete. 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 Processor -- start 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- start start 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad4742870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555ad473b200 con 0x555ad473c2b0 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d6f6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad4742870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d6f6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad4742870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38222/0 (socket says 172.21.15.96:38222) 2024-09-14T10:44:23.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 learned_addr learned my addr 172.21.15.96:0/2373487298 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:23.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ad4742dd0 con 0x555ad473c2b0 2024-09-14T10:44:23.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad4742870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0d1b50 tx=0x7fb1cc0ec760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb0b97fa640 1 -- 172.21.15.96:0/2373487298 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1cc0ea070 con 0x555ad473c2b0 2024-09-14T10:44:23.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb0b97fa640 1 -- 172.21.15.96:0/2373487298 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0ee260 con 0x555ad473c2b0 2024-09-14T10:44:23.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ad4743060 con 0x555ad473c2b0 2024-09-14T10:44:23.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.792+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ad4743a10 con 0x555ad473c2b0 2024-09-14T10:44:23.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb0b97fa640 1 -- 172.21.15.96:0/2373487298 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1cc0e1040 con 0x555ad473c2b0 2024-09-14T10:44:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb0b97fa640 1 -- 172.21.15.96:0/2373487298 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb1cc0ec410 con 0x555ad473c2b0 2024-09-14T10:44:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb0b97fa640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0a003a140 0x7fb0a003c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb0b97fa640 1 -- 172.21.15.96:0/2373487298 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb1cc0d9070 con 0x555ad473c2b0 2024-09-14T10:44:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0a003a140 0x7fb0a003c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad474dd60 0x555ad47501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4750940 con 0x555ad474dd60 2024-09-14T10:44:23.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d776c640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad474dd60 0x555ad47501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0a003a140 0x7fb0a003c600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800f010 tx=0x7fb1c801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d776c640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad474dd60 0x555ad47501f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 realm 2024-09-14T10:44:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4750d50 con 0x555ad474dd60 2024-09-14T10:44:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4751620 con 0x555ad474dd60 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad47519c0 con 0x555ad474dd60 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.796+0000 7fb1d9c669c0 20 searching for the correct realm 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555ad4753f80 0x555ad4756370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad47569a0 con 0x555ad4753f80 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555ad4753f80 0x555ad4756370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555ad4753f80 0x555ad4756370 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d6f6b640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb1cc009040 0x7fb1cc0eda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad47569a0 con 0x7fb1cc009040 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb1cc009040 0x7fb1cc0eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb1cc009040 0x7fb1cc0eda00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d7f6d640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb1c8019040 0x7fb1c8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad47569a0 con 0x7fb1c8019040 2024-09-14T10:44:23.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d776c640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb1c8019040 0x7fb1c8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d776c640 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb1c8019040 0x7fb1c8019930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.800+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1c8019040 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1c8019040 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1cc009040 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad4753f80 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1c8019040 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1cc009040 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad4753f80 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad4753f80 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.804+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1c8019040 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad4753f80 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad4753f80 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1c8019040 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad4753f80 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1cc009040 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1c8019040 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad4753f80 2024-09-14T10:44:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.808+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1c8019040 2024-09-14T10:44:23.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1cc009040 2024-09-14T10:44:23.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad4753f80 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1c8019040 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x555ad474dd60 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752210 con 0x7fb1cc009040 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:23.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752a60 con 0x555ad474dd60 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752e50 con 0x555ad474dd60 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4752e50 con 0x555ad474dd60 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 zone default found 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 4 Realm: () 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 zonegroup default 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.812+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4753320 con 0x7fb1c8019040 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad47587f0 con 0x555ad4753f80 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4758b90 con 0x555ad4753f80 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 20 started sync module instance, tier type = 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4757c90 con 0x7fb1cc009040 2024-09-14T10:44:23.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93848599888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad47578f0 con 0x7fb1cc009040 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4759890 con 0x555ad474dd60 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.816+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93848599888048] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93848599891760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4759800 con 0x555ad474dd60 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475a2a0 con 0x555ad4753f80 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93848599891760] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93848599895536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475ab40 con 0x555ad4753f80 2024-09-14T10:44:23.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475b050 con 0x7fb1cc009040 2024-09-14T10:44:23.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.820+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93848599892816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475b8f0 con 0x7fb1cc009040 2024-09-14T10:44:23.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.824+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475c2f0 con 0x555ad474dd60 2024-09-14T10:44:23.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.824+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93848599895536] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.824+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93848599892816] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.824+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.824+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93848599897744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475b440 con 0x555ad474dd60 2024-09-14T10:44:23.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.824+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475cb90 con 0x7fb1c8019040 2024-09-14T10:44:23.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.824+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93848599897744] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.828+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.828+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93848599903744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475b440 con 0x7fb1c8019040 2024-09-14T10:44:23.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.828+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475d080 con 0x7fb1c8019040 2024-09-14T10:44:23.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.828+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93848599903744] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.828+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.828+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93848599907152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475d040 con 0x7fb1c8019040 2024-09-14T10:44:23.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.828+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475da40 con 0x7fb1c8019040 2024-09-14T10:44:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93848599907152] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93848599905504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475da00 con 0x7fb1c8019040 2024-09-14T10:44:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 20 add_watcher() i=0 2024-09-14T10:44:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 20 add_watcher() i=1 2024-09-14T10:44:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 20 add_watcher() i=2 2024-09-14T10:44:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 20 add_watcher() i=3 2024-09-14T10:44:23.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 20 add_watcher() i=4 2024-09-14T10:44:23.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 20 add_watcher() i=5 2024-09-14T10:44:23.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 20 add_watcher() i=6 2024-09-14T10:44:23.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93848599905504] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 20 add_watcher() i=7 2024-09-14T10:44:23.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:23.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4760e60 con 0x555ad474dd60 2024-09-14T10:44:23.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.832+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93848599910176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475e380 con 0x555ad474dd60 2024-09-14T10:44:23.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.836+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93848599910176] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.836+0000 7fb08e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.836+0000 7fb1d9c669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.836+0000 7fb1d9c669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.836+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4769920 con 0x555ad474dd60 2024-09-14T10:44:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.836+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.836+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4769f30 con 0x7fb1c8019040 2024-09-14T10:44:23.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.840+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.840+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4769ef0 con 0x555ad4753f80 2024-09-14T10:44:23.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.840+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.840+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476a740 con 0x555ad474dd60 2024-09-14T10:44:23.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.840+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.840+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476a740 con 0x7fb1cc009040 2024-09-14T10:44:23.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.844+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.844+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad47654c0 con 0x555ad4753f80 2024-09-14T10:44:23.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.844+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.844+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad47654c0 con 0x555ad474dd60 2024-09-14T10:44:23.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.848+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.848+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad47654c0 con 0x7fb1c8019040 2024-09-14T10:44:23.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.848+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.848+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad47654c0 con 0x7fb1cc009040 2024-09-14T10:44:23.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.852+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.852+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b2a0 con 0x555ad4753f80 2024-09-14T10:44:23.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.852+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.852+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b2a0 con 0x7fb1cc009040 2024-09-14T10:44:23.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.852+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.852+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b750 con 0x7fb1c8019040 2024-09-14T10:44:23.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.856+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.856+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b750 con 0x7fb1cc009040 2024-09-14T10:44:23.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.856+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.856+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b750 con 0x7fb1c8019040 2024-09-14T10:44:23.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.860+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.860+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b750 con 0x555ad474dd60 2024-09-14T10:44:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.860+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.860+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b750 con 0x555ad4753f80 2024-09-14T10:44:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.864+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.864+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b750 con 0x7fb1cc009040 2024-09-14T10:44:23.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.864+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.864+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b750 con 0x555ad4753f80 2024-09-14T10:44:23.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.864+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.864+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b770 con 0x555ad474dd60 2024-09-14T10:44:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.868+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.868+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b770 con 0x555ad474dd60 2024-09-14T10:44:23.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.872+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.872+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b770 con 0x555ad4753f80 2024-09-14T10:44:23.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.872+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.872+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b770 con 0x7fb1cc009040 2024-09-14T10:44:23.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.876+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.876+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b880 con 0x555ad4753f80 2024-09-14T10:44:23.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.876+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.876+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b880 con 0x555ad4753f80 2024-09-14T10:44:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.880+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.880+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b880 con 0x555ad4753f80 2024-09-14T10:44:23.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.880+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.880+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b8b0 con 0x555ad4753f80 2024-09-14T10:44:23.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.880+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.880+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b920 con 0x7fb1c8019040 2024-09-14T10:44:23.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.884+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.884+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b920 con 0x555ad4753f80 2024-09-14T10:44:23.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.884+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.884+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b920 con 0x7fb1c8019040 2024-09-14T10:44:23.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.888+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.888+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b920 con 0x555ad4753f80 2024-09-14T10:44:23.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.888+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.888+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b920 con 0x7fb1c8019040 2024-09-14T10:44:23.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.892+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.892+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476b920 con 0x7fb1cc009040 2024-09-14T10:44:23.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb08d7e2640 20 reqs_thread_entry: start 2024-09-14T10:44:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 20 Filter name: none 2024-09-14T10:44:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb0867fc640 20 reqs_thread_entry: start 2024-09-14T10:44:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-14T10:44:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ad4768ea0 con 0x7fb1c8019040 2024-09-14T10:44:23.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:23.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-14T10:44:23.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:44:23.894 INFO:teuthology.orchestra.run.smithi096.stderr:could not remove user: unable to remove user, user does not exist 2024-09-14T10:44:23.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb08e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:23.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.896+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93848599910176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad476a290 con 0x555ad474dd60 2024-09-14T10:44:23.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.900+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93848599910176] v32'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.900+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93848599888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475d6f0 con 0x7fb1cc009040 2024-09-14T10:44:23.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.900+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93848599888048] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.900+0000 7fb1d9c669c0 20 remove_watcher() i=0 2024-09-14T10:44:23.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.900+0000 7fb1d9c669c0 2 removed watcher, disabling cache 2024-09-14T10:44:23.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.900+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93848599891760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad47580b0 con 0x555ad474dd60 2024-09-14T10:44:23.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93848599891760] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d9c669c0 20 remove_watcher() i=1 2024-09-14T10:44:23.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93848599895536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4768fe0 con 0x555ad4753f80 2024-09-14T10:44:23.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d6f6b640 1 -- 172.21.15.96:0/2373487298 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93848599895536] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1cc0f4020 con 0x555ad4753f80 2024-09-14T10:44:23.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d9c669c0 20 remove_watcher() i=2 2024-09-14T10:44:23.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93848599892816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4768fe0 con 0x7fb1cc009040 2024-09-14T10:44:23.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d7f6d640 1 -- 172.21.15.96:0/2373487298 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93848599892816] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1c802f040 con 0x7fb1cc009040 2024-09-14T10:44:23.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d9c669c0 20 remove_watcher() i=3 2024-09-14T10:44:23.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.904+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93848599897744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad4759df0 con 0x555ad474dd60 2024-09-14T10:44:23.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.908+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93848599897744] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x555ad474dd60 2024-09-14T10:44:23.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.908+0000 7fb1d9c669c0 20 remove_watcher() i=4 2024-09-14T10:44:23.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.908+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93848599903744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475a690 con 0x7fb1c8019040 2024-09-14T10:44:23.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.912+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93848599903744] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.912+0000 7fb1d9c669c0 20 remove_watcher() i=5 2024-09-14T10:44:23.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.912+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93848599907152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475a690 con 0x7fb1c8019040 2024-09-14T10:44:23.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.912+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93848599907152] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.912+0000 7fb1d9c669c0 20 remove_watcher() i=6 2024-09-14T10:44:23.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.912+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93848599905504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ad475a690 con 0x7fb1c8019040 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93848599905504] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1d000f030 con 0x7fb1c8019040 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 20 remove_watcher() i=7 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb1c8019040 msgr2=0x7fb1c8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb1c8019040 0x7fb1c8019930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad474dd60 msgr2=0x555ad47501f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad474dd60 0x555ad47501f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb1cc009040 msgr2=0x7fb1cc0eda00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb1cc009040 0x7fb1cc0eda00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555ad4753f80 msgr2=0x555ad4756370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555ad4753f80 0x555ad4756370 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0a003a140 msgr2=0x7fb0a003c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0a003a140 0x7fb0a003c600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800f010 tx=0x7fb1c801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 msgr2=0x555ad4742870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d776c640 1 -- 172.21.15.96:0/2373487298 reap_dead start 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad4742870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0d1b50 tx=0x7fb1cc0ec760 comp rx=0 tx=0).stop 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 shutdown_connections 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/2373487298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad473c2b0 0x555ad4742870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 >> 172.21.15.96:0/2373487298 conn(0x555ad47376d0 msgr2=0x555ad47358e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 shutdown_connections 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/2373487298 wait complete. 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/427700990 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0b003a190 msgr2=0x7fb0b003c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/427700990 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0b003a190 0x7fb0b003c650 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x555ad471f3f0 tx=0x7fb1c8003070 comp rx=0 tx=0).stop 2024-09-14T10:44:23.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/427700990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad472ea60 msgr2=0x555ad472ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/427700990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad472ea60 0x555ad472ee80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc096f40 tx=0x7fb1cc0180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/427700990 shutdown_connections 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/427700990 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0b003a190 0x7fb0b003c650 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/427700990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad472ea60 0x555ad472ee80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/427700990 >> 172.21.15.96:0/427700990 conn(0x555ad4724410 msgr2=0x555ad47247f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/427700990 shutdown_connections 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/427700990 wait complete. 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad4624270 msgr2=0x555ad471e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad4624270 0x555ad471e410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0bc03a1a0 msgr2=0x7fb0bc03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0bc03a1a0 0x7fb0bc03c660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0ae000 tx=0x7fb1cc0a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:23.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 msgr2=0x555ad47172f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad47172f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x555ad4596850 tx=0x7fb1d0000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 shutdown_connections 2024-09-14T10:44:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555ad4624270 0x555ad471e410 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb0bc03a1a0 0x7fb0bc03c660 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 --2- 172.21.15.96:0/730548733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555ad4620760 0x555ad47172f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 >> 172.21.15.96:0/730548733 conn(0x555ad4593af0 msgr2=0x555ad4596ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 shutdown_connections 2024-09-14T10:44:23.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:23.916+0000 7fb1d9c669c0 1 -- 172.21.15.96:0/730548733 wait complete. 2024-09-14T10:44:23.925 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-14T10:44:23.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-14T10:44:23.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-14T10:44:23.926 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-14T10:44:24.005 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:24.005 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e95d9a9c0 1 Processor -- start 2024-09-14T10:44:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e95d9a9c0 1 -- start start 2024-09-14T10:44:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e95d9a9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5574a2525290 0x5574a25b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e95d9a9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5574a24597a0 con 0x5574a2525670 2024-09-14T10:44:24.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e95d9a9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5574a24b51b0 con 0x5574a2525290 2024-09-14T10:44:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e938a0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5574a2525290 0x5574a25b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e938a0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5574a2525290 0x5574a25b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38230/0 (socket says 172.21.15.96:38230) 2024-09-14T10:44:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e9309f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5574a2525670 0x5574a25b8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34160/0 (socket says 172.21.15.96:34160) 2024-09-14T10:44:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e938a0640 1 -- 172.21.15.96:0/3736180682 learned_addr learned my addr 172.21.15.96:0/3736180682 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e938a0640 1 -- 172.21.15.96:0/3736180682 >> v1:172.21.15.70:6789/0 conn(0x5574a2525670 legacy=0x5574a25b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.008+0000 7f9e938a0640 1 -- 172.21.15.96:0/3736180682 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a2433da0 con 0x5574a2525290 2024-09-14T10:44:24.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e938a0640 1 --2- 172.21.15.96:0/3736180682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a25b6040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00a4e0 tx=0x7f9e8c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7dbae430fdc52a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e9289e640 1 -- 172.21.15.96:0/3736180682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c0aa540 con 0x5574a2525290 2024-09-14T10:44:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e9289e640 1 -- 172.21.15.96:0/3736180682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0aa6e0 con 0x5574a2525290 2024-09-14T10:44:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e9289e640 1 -- 172.21.15.96:0/3736180682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c0aaa40 con 0x5574a2525290 2024-09-14T10:44:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3736180682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 msgr2=0x5574a25b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3736180682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a25b6040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00a4e0 tx=0x7f9e8c01b090 comp rx=0 tx=0).stop 2024-09-14T10:44:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3736180682 shutdown_connections 2024-09-14T10:44:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3736180682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a25b6040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3736180682 >> 172.21.15.96:0/3736180682 conn(0x5574a25ab970 msgr2=0x5574a25add90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3736180682 shutdown_connections 2024-09-14T10:44:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.012+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3736180682 wait complete. 2024-09-14T10:44:24.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e95d9a9c0 1 Processor -- start 2024-09-14T10:44:24.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e95d9a9c0 1 -- start start 2024-09-14T10:44:24.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e95d9a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a269e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e95d9a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574a24b8fc0 con 0x5574a2525290 2024-09-14T10:44:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e938a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a269e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e938a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a269e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38238/0 (socket says 172.21.15.96:38238) 2024-09-14T10:44:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e938a0640 1 -- 172.21.15.96:0/1433207281 learned_addr learned my addr 172.21.15.96:0/1433207281 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e938a0640 1 -- 172.21.15.96:0/1433207281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a269eba0 con 0x5574a2525290 2024-09-14T10:44:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.028+0000 7f9e938a0640 1 --2- 172.21.15.96:0/1433207281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a269e5b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c018cc0 tx=0x7f9e8c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c4c4b6518bae37 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9d81e0b640 1 -- 172.21.15.96:0/1433207281 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c0b9070 con 0x5574a2525290 2024-09-14T10:44:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9d81e0b640 1 -- 172.21.15.96:0/1433207281 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0aaa80 con 0x5574a2525290 2024-09-14T10:44:24.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9d81e0b640 1 -- 172.21.15.96:0/1433207281 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c0aad60 con 0x5574a2525290 2024-09-14T10:44:24.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/1433207281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 msgr2=0x5574a269e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/1433207281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a269e5b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c018cc0 tx=0x7f9e8c0033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/1433207281 shutdown_connections 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/1433207281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a269e5b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/1433207281 >> 172.21.15.96:0/1433207281 conn(0x5574a25ab970 msgr2=0x5574a269a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/1433207281 shutdown_connections 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/1433207281 wait complete. 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 Processor -- start 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- start start 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a26a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574a245aa50 con 0x5574a2525290 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e938a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a26a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e938a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a26a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38252/0 (socket says 172.21.15.96:38252) 2024-09-14T10:44:24.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e938a0640 1 -- 172.21.15.96:0/3910700616 learned_addr learned my addr 172.21.15.96:0/3910700616 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e938a0640 1 -- 172.21.15.96:0/3910700616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a26a6210 con 0x5574a2525290 2024-09-14T10:44:24.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e938a0640 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a26a5cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c018cc0 tx=0x7f9e8c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9d7bfff640 1 -- 172.21.15.96:0/3910700616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c0b9070 con 0x5574a2525290 2024-09-14T10:44:24.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9d7bfff640 1 -- 172.21.15.96:0/3910700616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0b5b10 con 0x5574a2525290 2024-09-14T10:44:24.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9d7bfff640 1 -- 172.21.15.96:0/3910700616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c0b5df0 con 0x5574a2525290 2024-09-14T10:44:24.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574a26a64a0 con 0x5574a2525290 2024-09-14T10:44:24.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.032+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574a26a6e50 con 0x5574a2525290 2024-09-14T10:44:24.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9d7bfff640 1 -- 172.21.15.96:0/3910700616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9e8c0b3040 con 0x5574a2525290 2024-09-14T10:44:24.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9d7bfff640 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d7c03a150 0x7f9d7c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9d7bfff640 1 -- 172.21.15.96:0/3910700616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9e8c0c4070 con 0x5574a2525290 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e9309f640 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d7c03a150 0x7f9d7c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a2525670 0x5574a26ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26ad360 con 0x5574a2525670 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e940a1640 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a2525670 0x5574a26ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e9309f640 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d7c03a150 0x7f9d7c03c610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e88001e90 tx=0x7f9e880013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e940a1640 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a2525670 0x5574a26ace20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e940a1640 1 -- 172.21.15.96:0/3910700616 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e840083f0 con 0x5574a2525670 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26a7220 con 0x5574a2525670 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e940a1640 1 -- 172.21.15.96:0/3910700616 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9e840083f0 con 0x5574a2525670 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26af140 con 0x5574a2525670 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e940a1640 1 -- 172.21.15.96:0/3910700616 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9e840083f0 con 0x5574a2525670 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26ae370 con 0x5574a2525670 2024-09-14T10:44:24.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e940a1640 1 -- 172.21.15.96:0/3910700616 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9e840083f0 con 0x5574a2525670 2024-09-14T10:44:24.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26ae7c0 con 0x5574a2525670 2024-09-14T10:44:24.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e940a1640 1 -- 172.21.15.96:0/3910700616 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9e840083f0 con 0x5574a2525670 2024-09-14T10:44:24.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 Processor -- start 2024-09-14T10:44:24.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 -- start start 2024-09-14T10:44:24.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26bd500 0x5574a26bd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.036+0000 7f9e95d9a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574a24c5d80 con 0x5574a26bd500 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e9309f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26bd500 0x5574a26bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e9309f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26bd500 0x5574a26bd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38258/0 (socket says 172.21.15.96:38258) 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e9309f640 1 -- 172.21.15.96:0/3541922889 learned_addr learned my addr 172.21.15.96:0/3541922889 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e9309f640 1 -- 172.21.15.96:0/3541922889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a26bdf60 con 0x5574a26bd500 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e9309f640 1 --2- 172.21.15.96:0/3541922889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26bd500 0x5574a26bd920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800e670 tx=0x7f9e8800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9d797fa640 1 -- 172.21.15.96:0/3541922889 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e88022070 con 0x5574a26bd500 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3541922889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574a26be7c0 con 0x5574a26bd500 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9d797fa640 1 -- 172.21.15.96:0/3541922889 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8800d660 con 0x5574a26bd500 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9d797fa640 1 -- 172.21.15.96:0/3541922889 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e88006070 con 0x5574a26bd500 2024-09-14T10:44:24.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3541922889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574a26bed30 con 0x5574a26bd500 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9d797fa640 1 -- 172.21.15.96:0/3541922889 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9e88025070 con 0x5574a26bd500 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9d797fa640 1 --2- 172.21.15.96:0/3541922889 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d6c03a140 0x7f9d6c03c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9d797fa640 1 -- 172.21.15.96:0/3541922889 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9e88052550 con 0x5574a26bd500 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e940a1640 1 --2- 172.21.15.96:0/3541922889 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d6c03a140 0x7f9d6c03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e95d9a9c0 1 Processor -- start 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e95d9a9c0 1 -- start start 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e940a1640 1 --2- 172.21.15.96:0/3541922889 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d6c03a140 0x7f9d6c03c600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e3f0 tx=0x7f9e84003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e95d9a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.040+0000 7f9e95d9a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574a269ef10 con 0x5574a26cae70 2024-09-14T10:44:24.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38266/0 (socket says 172.21.15.96:38266) 2024-09-14T10:44:24.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 -- 172.21.15.96:0/952560729 learned_addr learned my addr 172.21.15.96:0/952560729 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 -- 172.21.15.96:0/952560729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a26cb860 con 0x5574a26cae70 2024-09-14T10:44:24.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 --2- 172.21.15.96:0/952560729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26cb270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e88050970 tx=0x7f9e8800df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6be0599cfced947 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9d72ffd640 1 -- 172.21.15.96:0/952560729 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8804e070 con 0x5574a26cae70 2024-09-14T10:44:24.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9d72ffd640 1 -- 172.21.15.96:0/952560729 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8801a320 con 0x5574a26cae70 2024-09-14T10:44:24.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9d72ffd640 1 -- 172.21.15.96:0/952560729 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e88026a20 con 0x5574a26cae70 2024-09-14T10:44:24.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/952560729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 msgr2=0x5574a26cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/952560729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26cb270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e88050970 tx=0x7f9e8800df30 comp rx=0 tx=0).stop 2024-09-14T10:44:24.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/952560729 shutdown_connections 2024-09-14T10:44:24.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/952560729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26cb270 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/952560729 >> 172.21.15.96:0/952560729 conn(0x5574a26c6290 msgr2=0x5574a26c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/952560729 shutdown_connections 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/952560729 wait complete. 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 Processor -- start 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 -- start start 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e95d9a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574a26c9dc0 con 0x5574a26cae70 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38282/0 (socket says 172.21.15.96:38282) 2024-09-14T10:44:24.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 learned_addr learned my addr 172.21.15.96:0/984299729 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574a26d1900 con 0x5574a26cae70 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9e9309f640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26d13a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9e8801bfd0 tx=0x7f9e880508d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.044+0000 7f9d717fa640 1 -- 172.21.15.96:0/984299729 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8804e030 con 0x5574a26cae70 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9d717fa640 1 -- 172.21.15.96:0/984299729 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8801a320 con 0x5574a26cae70 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574a26d1900 con 0x5574a26cae70 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9d717fa640 1 -- 172.21.15.96:0/984299729 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e880521c0 con 0x5574a26cae70 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574a26d1900 con 0x5574a26cae70 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9d717fa640 1 -- 172.21.15.96:0/984299729 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9e8804f270 con 0x5574a26cae70 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9d717fa640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d5c03a150 0x7f9d5c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9d717fa640 1 -- 172.21.15.96:0/984299729 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9e8804f070 con 0x5574a26cae70 2024-09-14T10:44:24.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e940a1640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d5c03a150 0x7f9d5c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a26dc5d0 0x5574a26dea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26df1e0 con 0x5574a26dc5d0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e938a0640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a26dc5d0 0x5574a26dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e940a1640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d5c03a150 0x7f9d5c03c610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400f010 tx=0x7f9e8401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e938a0640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a26dc5d0 0x5574a26dea90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 realm 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26df5f0 con 0x5574a26dc5d0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26dfec0 con 0x5574a26dc5d0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e0260 con 0x5574a26dc5d0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e0ab0 con 0x5574a26dc5d0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 20 searching for the correct realm 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574a26e2820 0x5574a26e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.048+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e51d0 con 0x5574a26e2820 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e9309f640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574a26e2820 0x5574a26e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e9309f640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574a26e2820 0x5574a26e4c10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e9309f640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9e88027060 0x7f9e88014070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e51d0 con 0x7f9e88027060 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e940a1640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9e88027060 0x7f9e88014070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e940a1640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9e88027060 0x7f9e88014070 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e940a1640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9e84019040 0x7f9e84019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e51d0 con 0x7f9e84019040 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e938a0640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9e84019040 0x7f9e84019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e938a0640 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9e84019040 0x7f9e84019930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x7f9e84019040 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e51d0 con 0x5574a26dc5d0 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e51d0 con 0x5574a26dc5d0 2024-09-14T10:44:24.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.052+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e51d0 con 0x7f9e84019040 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x7f9e84019040 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e51d0 con 0x7f9e84019040 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x7f9e84019040 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e88027060 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26e2820 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26dc5d0 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e84019040 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x7f9e84019040 2024-09-14T10:44:24.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26dc5d0 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e88027060 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26e2820 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26e2820 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.056+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e84019040 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x7f9e84019040 2024-09-14T10:44:24.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26e2820 2024-09-14T10:44:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26e2820 2024-09-14T10:44:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26dc5d0 2024-09-14T10:44:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26dc5d0 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9e8c0cd060 con 0x5574a26dc5d0 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e84019040 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26e2820 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e88027060 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26dc5d0 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e84019040 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.060+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26e2820 2024-09-14T10:44:24.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e84019040 2024-09-14T10:44:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e88027060 2024-09-14T10:44:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26e2820 2024-09-14T10:44:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e84019040 2024-09-14T10:44:24.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x5574a26dc5d0 2024-09-14T10:44:24.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9e8c0df040 con 0x7f9e88027060 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e1300 con 0x5574a26dc5d0 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e16f0 con 0x5574a26dc5d0 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e16f0 con 0x5574a26dc5d0 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 zone default found 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 4 Realm: () 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:24.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 zonegroup default 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.064+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e0e80 con 0x7f9e84019040 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e7040 con 0x5574a26e2820 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e73e0 con 0x5574a26e2820 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 20 started sync module instance, tier type = 2024-09-14T10:44:24.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:24.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e64e0 con 0x7f9e88027060 2024-09-14T10:44:24.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93959429712128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e6140 con 0x7f9e88027060 2024-09-14T10:44:24.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e80e0 con 0x5574a26dc5d0 2024-09-14T10:44:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.068+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93959429712128] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.072+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.072+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93959429715840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e8050 con 0x5574a26dc5d0 2024-09-14T10:44:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.072+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e8b30 con 0x5574a26e2820 2024-09-14T10:44:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.072+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93959429715840] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.072+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.072+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93959429716896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e7fc0 con 0x5574a26e2820 2024-09-14T10:44:24.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.072+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e9880 con 0x7f9e88027060 2024-09-14T10:44:24.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.076+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.076+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93959429723360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e9fb0 con 0x7f9e88027060 2024-09-14T10:44:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.076+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eaad0 con 0x5574a26dc5d0 2024-09-14T10:44:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.076+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93959429716896] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.076+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.076+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93959429727648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eaa90 con 0x5574a26dc5d0 2024-09-14T10:44:24.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.076+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb4e0 con 0x7f9e84019040 2024-09-14T10:44:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.076+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93959429723360] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.080+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93959429727648] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.080+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.080+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93959429721888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb030 con 0x7f9e84019040 2024-09-14T10:44:24.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.080+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb880 con 0x7f9e84019040 2024-09-14T10:44:24.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.080+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93959429721888] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.080+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.080+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93959429730352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb900 con 0x7f9e84019040 2024-09-14T10:44:24.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26ec2c0 con 0x7f9e84019040 2024-09-14T10:44:24.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93959429733904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26ec6e0 con 0x7f9e84019040 2024-09-14T10:44:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 20 add_watcher() i=0 2024-09-14T10:44:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 20 add_watcher() i=1 2024-09-14T10:44:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 20 add_watcher() i=2 2024-09-14T10:44:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 20 add_watcher() i=3 2024-09-14T10:44:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 20 add_watcher() i=4 2024-09-14T10:44:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 20 add_watcher() i=5 2024-09-14T10:44:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93959429730352] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 20 add_watcher() i=6 2024-09-14T10:44:24.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93959429733904] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 20 add_watcher() i=7 2024-09-14T10:44:24.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:24.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.084+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb450 con 0x5574a26dc5d0 2024-09-14T10:44:24.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.088+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.088+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93959429731408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26ecb70 con 0x5574a26dc5d0 2024-09-14T10:44:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.088+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93959429731408] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.088+0000 7f9d49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.088+0000 7f9e95d9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.088+0000 7f9e95d9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.088+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f8480 con 0x5574a26dc5d0 2024-09-14T10:44:24.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.092+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.092+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f8480 con 0x7f9e84019040 2024-09-14T10:44:24.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.092+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.092+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f8480 con 0x5574a26e2820 2024-09-14T10:44:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.092+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.092+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f8a90 con 0x5574a26dc5d0 2024-09-14T10:44:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.096+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.096+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f8980 con 0x7f9e88027060 2024-09-14T10:44:24.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.096+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.096+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f8fd0 con 0x5574a26e2820 2024-09-14T10:44:24.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.096+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.096+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f9560 con 0x5574a26dc5d0 2024-09-14T10:44:24.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.100+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.100+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f9540 con 0x7f9e84019040 2024-09-14T10:44:24.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.104+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.104+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f9540 con 0x7f9e88027060 2024-09-14T10:44:24.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.104+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.104+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f9b70 con 0x5574a26e2820 2024-09-14T10:44:24.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.104+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.104+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f9f10 con 0x7f9e88027060 2024-09-14T10:44:24.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.108+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.108+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa480 con 0x7f9e84019040 2024-09-14T10:44:24.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.108+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.108+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa480 con 0x7f9e88027060 2024-09-14T10:44:24.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.112+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.112+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa340 con 0x7f9e84019040 2024-09-14T10:44:24.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.112+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.112+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa340 con 0x5574a26dc5d0 2024-09-14T10:44:24.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.112+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.112+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa370 con 0x5574a26e2820 2024-09-14T10:44:24.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.116+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.116+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa370 con 0x7f9e88027060 2024-09-14T10:44:24.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.116+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.116+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa490 con 0x5574a26e2820 2024-09-14T10:44:24.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.120+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.120+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa490 con 0x5574a26dc5d0 2024-09-14T10:44:24.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.120+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.120+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa490 con 0x5574a26dc5d0 2024-09-14T10:44:24.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.120+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.124+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa490 con 0x5574a26e2820 2024-09-14T10:44:24.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.124+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.124+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa4d0 con 0x7f9e88027060 2024-09-14T10:44:24.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.124+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.124+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa5d0 con 0x5574a26e2820 2024-09-14T10:44:24.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.128+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.128+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa5d0 con 0x5574a26e2820 2024-09-14T10:44:24.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.128+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.128+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa620 con 0x5574a26e2820 2024-09-14T10:44:24.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.128+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.132+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa620 con 0x5574a26e2820 2024-09-14T10:44:24.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.132+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.132+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa660 con 0x7f9e84019040 2024-09-14T10:44:24.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.136+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.136+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa6a0 con 0x5574a26e2820 2024-09-14T10:44:24.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.136+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.136+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa6a0 con 0x7f9e84019040 2024-09-14T10:44:24.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.136+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.140+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa6a0 con 0x5574a26e2820 2024-09-14T10:44:24.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.140+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.140+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa6a0 con 0x7f9e84019040 2024-09-14T10:44:24.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.144+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.144+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26fa6e0 con 0x7f9e88027060 2024-09-14T10:44:24.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.144+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.144+0000 7f9d48fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:24.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:24.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 20 Filter name: none 2024-09-14T10:44:24.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9cc27fc640 20 reqs_thread_entry: start 2024-09-14T10:44:24.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:44:24.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f7e80 con 0x7f9e84019040 2024-09-14T10:44:24.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-14T10:44:24.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:24.146 INFO:teuthology.orchestra.run.smithi096.stderr:could not remove user: unable to remove user, user does not exist 2024-09-14T10:44:24.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9d49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:24.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.148+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93959429731408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26f7880 con 0x5574a26dc5d0 2024-09-14T10:44:24.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93959429731408] v32'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93959429712128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb450 con 0x7f9e88027060 2024-09-14T10:44:24.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93959429712128] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e95d9a9c0 20 remove_watcher() i=0 2024-09-14T10:44:24.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e95d9a9c0 2 removed watcher, disabling cache 2024-09-14T10:44:24.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93959429715840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e6900 con 0x5574a26dc5d0 2024-09-14T10:44:24.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93959429715840] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e95d9a9c0 20 remove_watcher() i=1 2024-09-14T10:44:24.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.152+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93959429716896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e7780 con 0x5574a26e2820 2024-09-14T10:44:24.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.156+0000 7f9e9309f640 1 -- 172.21.15.96:0/984299729 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93959429716896] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e88036020 con 0x5574a26e2820 2024-09-14T10:44:24.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.156+0000 7f9e95d9a9c0 20 remove_watcher() i=2 2024-09-14T10:44:24.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.156+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93959429723360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb450 con 0x7f9e88027060 2024-09-14T10:44:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.156+0000 7f9e940a1640 1 -- 172.21.15.96:0/984299729 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93959429723360] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8402f040 con 0x7f9e88027060 2024-09-14T10:44:24.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.156+0000 7f9e95d9a9c0 20 remove_watcher() i=3 2024-09-14T10:44:24.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.156+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93959429727648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb450 con 0x5574a26dc5d0 2024-09-14T10:44:24.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.160+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93959429727648] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x5574a26dc5d0 2024-09-14T10:44:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.160+0000 7f9e95d9a9c0 20 remove_watcher() i=4 2024-09-14T10:44:24.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.160+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93959429721888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26eb450 con 0x7f9e84019040 2024-09-14T10:44:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.160+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93959429721888] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.160+0000 7f9e95d9a9c0 20 remove_watcher() i=5 2024-09-14T10:44:24.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.160+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93959429730352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26e8f20 con 0x7f9e84019040 2024-09-14T10:44:24.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.164+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93959429730352] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.164+0000 7f9e95d9a9c0 20 remove_watcher() i=6 2024-09-14T10:44:24.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.164+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93959429733904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574a26ea5a0 con 0x7f9e84019040 2024-09-14T10:44:24.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.164+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93959429733904] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9e8c0f1040 con 0x7f9e84019040 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.164+0000 7f9e95d9a9c0 20 remove_watcher() i=7 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9e84019040 msgr2=0x7f9e84019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9e84019040 0x7f9e84019930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a26dc5d0 msgr2=0x5574a26dea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a26dc5d0 0x5574a26dea90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9e88027060 msgr2=0x7f9e88014070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9e88027060 0x7f9e88014070 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574a26e2820 msgr2=0x5574a26e4c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574a26e2820 0x5574a26e4c10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d5c03a150 msgr2=0x7f9d5c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d5c03a150 0x7f9d5c03c610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400f010 tx=0x7f9e8401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e938a0640 1 -- 172.21.15.96:0/984299729 reap_dead start 2024-09-14T10:44:24.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 msgr2=0x5574a26d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26d13a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9e8801bfd0 tx=0x7f9e880508d0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 shutdown_connections 2024-09-14T10:44:24.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/984299729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26cae70 0x5574a26d13a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 >> 172.21.15.96:0/984299729 conn(0x5574a26c6290 msgr2=0x5574a26c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 shutdown_connections 2024-09-14T10:44:24.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/984299729 wait complete. 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3541922889 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d6c03a140 msgr2=0x7f9d6c03c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3541922889 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d6c03a140 0x7f9d6c03c600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e3f0 tx=0x7f9e84003070 comp rx=0 tx=0).stop 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3541922889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26bd500 msgr2=0x5574a26bd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3541922889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26bd500 0x5574a26bd920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800e670 tx=0x7f9e8800ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3541922889 shutdown_connections 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3541922889 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d6c03a140 0x7f9d6c03c600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3541922889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a26bd500 0x5574a26bd920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3541922889 >> 172.21.15.96:0/3541922889 conn(0x5574a26b2eb0 msgr2=0x5574a26b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3541922889 shutdown_connections 2024-09-14T10:44:24.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3541922889 wait complete. 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a2525670 msgr2=0x5574a26ace20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a2525670 0x5574a26ace20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d7c03a150 msgr2=0x7f9d7c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d7c03a150 0x7f9d7c03c610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e88001e90 tx=0x7f9e880013f0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 msgr2=0x5574a26a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a26a5cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c018cc0 tx=0x7f9e8c017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 shutdown_connections 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574a2525670 0x5574a26ace20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f9d7c03a150 0x7f9d7c03c610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 --2- 172.21.15.96:0/3910700616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574a2525290 0x5574a26a5cb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 >> 172.21.15.96:0/3910700616 conn(0x5574a25ab970 msgr2=0x5574a2698c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 shutdown_connections 2024-09-14T10:44:24.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.168+0000 7f9e95d9a9c0 1 -- 172.21.15.96:0/3910700616 wait complete. 2024-09-14T10:44:24.181 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-14T10:44:24.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-14T10:44:24.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-14T10:44:24.182 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-14T10:44:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.260+0000 7fd6e3fe29c0 1 Processor -- start 2024-09-14T10:44:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e3fe29c0 1 -- start start 2024-09-14T10:44:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e3fe29c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558e75fcc000 0x558e75fcc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e3fe29c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e75e747a0 con 0x558e75fcf190 2024-09-14T10:44:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e3fe29c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x558e75ed01b0 con 0x558e75fcc000 2024-09-14T10:44:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e1ae8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558e75fcc000 0x558e75fcc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e12e7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x558e75fcf190 0x558e75fd1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34166/0 (socket says 172.21.15.96:34166) 2024-09-14T10:44:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e1ae8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558e75fcc000 0x558e75fcc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38288/0 (socket says 172.21.15.96:38288) 2024-09-14T10:44:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e12e7640 1 -- 172.21.15.96:0/4078239175 learned_addr learned my addr 172.21.15.96:0/4078239175 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/4078239175 >> v1:172.21.15.70:6789/0 conn(0x558e75fcf190 legacy=0x558e75fd1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/4078239175 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e75e4eda0 con 0x558e75fcc000 2024-09-14T10:44:24.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e1ae8640 1 --2- 172.21.15.96:0/4078239175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e75fcc3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00a420 tx=0x7fd6dc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cbc6c611a28829 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.264+0000 7fd6e0ae6640 1 -- 172.21.15.96:0/4078239175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6dc0af070 con 0x558e75fcc000 2024-09-14T10:44:24.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e0ae6640 1 -- 172.21.15.96:0/4078239175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0aa530 con 0x558e75fcc000 2024-09-14T10:44:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e0ae6640 1 -- 172.21.15.96:0/4078239175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6dc0aa850 con 0x558e75fcc000 2024-09-14T10:44:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/4078239175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 msgr2=0x558e75fcc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/4078239175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e75fcc3e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00a420 tx=0x7fd6dc01afd0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/4078239175 shutdown_connections 2024-09-14T10:44:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/4078239175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e75fcc3e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/4078239175 >> 172.21.15.96:0/4078239175 conn(0x558e75fc7b20 msgr2=0x558e75fc9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/4078239175 shutdown_connections 2024-09-14T10:44:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.268+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/4078239175 wait complete. 2024-09-14T10:44:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 Processor -- start 2024-09-14T10:44:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- start start 2024-09-14T10:44:24.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760b7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e75ed3fc0 con 0x558e75fcc000 2024-09-14T10:44:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e1ae8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e1ae8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38298/0 (socket says 172.21.15.96:38298) 2024-09-14T10:44:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/3178708883 learned_addr learned my addr 172.21.15.96:0/3178708883 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/3178708883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e760b7930 con 0x558e75fcc000 2024-09-14T10:44:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e1ae8640 1 --2- 172.21.15.96:0/3178708883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760b7340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc018c00 tx=0x7fd6dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33f5db33d46b571 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd5cfe07640 1 -- 172.21.15.96:0/3178708883 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6dc0af040 con 0x558e75fcc000 2024-09-14T10:44:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd5cfe07640 1 -- 172.21.15.96:0/3178708883 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0aaa00 con 0x558e75fcc000 2024-09-14T10:44:24.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd5cfe07640 1 -- 172.21.15.96:0/3178708883 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6dc0aace0 con 0x558e75fcc000 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3178708883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 msgr2=0x558e760b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/3178708883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760b7340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc018c00 tx=0x7fd6dc0033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3178708883 shutdown_connections 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/3178708883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760b7340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3178708883 >> 172.21.15.96:0/3178708883 conn(0x558e75fc7b20 msgr2=0x558e760b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3178708883 shutdown_connections 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3178708883 wait complete. 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 Processor -- start 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- start start 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e3fe29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e75e75a50 con 0x558e75fcc000 2024-09-14T10:44:24.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.284+0000 7fd6e1ae8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e1ae8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760beab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38302/0 (socket says 172.21.15.96:38302) 2024-09-14T10:44:24.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/2415821762 learned_addr learned my addr 172.21.15.96:0/2415821762 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/2415821762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e760bf010 con 0x558e75fcc000 2024-09-14T10:44:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e1ae8640 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760beab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc018c00 tx=0x7fd6dc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd5ce604640 1 -- 172.21.15.96:0/2415821762 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6dc0c5070 con 0x558e75fcc000 2024-09-14T10:44:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e760bf2a0 con 0x558e75fcc000 2024-09-14T10:44:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd5ce604640 1 -- 172.21.15.96:0/2415821762 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0c1690 con 0x558e75fcc000 2024-09-14T10:44:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd5ce604640 1 -- 172.21.15.96:0/2415821762 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6dc0c19b0 con 0x558e75fcc000 2024-09-14T10:44:24.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e760bfc80 con 0x558e75fcc000 2024-09-14T10:44:24.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd5ce604640 1 -- 172.21.15.96:0/2415821762 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd6dc0b5470 con 0x558e75fcc000 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd5ce604640 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5c803a150 0x7fd5c803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd5ce604640 1 -- 172.21.15.96:0/2415821762 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd6dc0bb070 con 0x558e75fcc000 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e12e7640 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5c803a150 0x7fd5c803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e75fcf190 0x558e760c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760c6110 con 0x558e75fcf190 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e75fcf190 0x558e760c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e12e7640 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5c803a150 0x7fd5c803c610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8001d80 tx=0x7fd6d80012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e75fcf190 0x558e760c5bd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.288+0000 7fd6e22e9640 1 -- 172.21.15.96:0/2415821762 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6d40083f0 con 0x558e75fcf190 2024-09-14T10:44:24.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760c6580 con 0x558e75fcf190 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e22e9640 1 -- 172.21.15.96:0/2415821762 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd6d40083f0 con 0x558e75fcf190 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760c7e80 con 0x558e75fcf190 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e22e9640 1 -- 172.21.15.96:0/2415821762 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd6d40083f0 con 0x558e75fcf190 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760c70b0 con 0x558e75fcf190 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e22e9640 1 -- 172.21.15.96:0/2415821762 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd6d40083f0 con 0x558e75fcf190 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760c7500 con 0x558e75fcf190 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e22e9640 1 -- 172.21.15.96:0/2415821762 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd6d40083f0 con 0x558e75fcf190 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 Processor -- start 2024-09-14T10:44:24.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 -- start start 2024-09-14T10:44:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760d6240 0x558e760d6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e75ee0d80 con 0x558e760d6240 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e12e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760d6240 0x558e760d6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e12e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760d6240 0x558e760d6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38304/0 (socket says 172.21.15.96:38304) 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e12e7640 1 -- 172.21.15.96:0/3285917000 learned_addr learned my addr 172.21.15.96:0/3285917000 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e12e7640 1 -- 172.21.15.96:0/3285917000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e760d6ca0 con 0x558e760d6240 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e12e7640 1 --2- 172.21.15.96:0/3285917000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760d6240 0x558e760d6660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800d660 tx=0x7fd6d800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd5c77fe640 1 -- 172.21.15.96:0/3285917000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d800c6b0 con 0x558e760d6240 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd5c77fe640 1 -- 172.21.15.96:0/3285917000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d800c850 con 0x558e760d6240 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3285917000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e760d7500 con 0x558e760d6240 2024-09-14T10:44:24.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.292+0000 7fd5c77fe640 1 -- 172.21.15.96:0/3285917000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d800cb30 con 0x558e760d6240 2024-09-14T10:44:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3285917000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e760d7a70 con 0x558e760d6240 2024-09-14T10:44:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd5c77fe640 1 -- 172.21.15.96:0/3285917000 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd6d8023020 con 0x558e760d6240 2024-09-14T10:44:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd5c77fe640 1 --2- 172.21.15.96:0/3285917000 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5bc03a140 0x7fd5bc03c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd5c77fe640 1 -- 172.21.15.96:0/3285917000 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd6d8021020 con 0x558e760d6240 2024-09-14T10:44:24.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/3285917000 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5bc03a140 0x7fd5bc03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e3fe29c0 1 Processor -- start 2024-09-14T10:44:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/3285917000 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5bc03a140 0x7fd5bc03c600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400e3f0 tx=0x7fd6d4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e3fe29c0 1 -- start start 2024-09-14T10:44:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e3fe29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e3fe29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e760b7ca0 con 0x558e760e3bb0 2024-09-14T10:44:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e12e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e12e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760e3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38306/0 (socket says 172.21.15.96:38306) 2024-09-14T10:44:24.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1959927779 learned_addr learned my addr 172.21.15.96:0/1959927779 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1959927779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e760e45a0 con 0x558e760e3bb0 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.296+0000 7fd6e12e7640 1 --2- 172.21.15.96:0/1959927779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760e3fb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80517d0 tx=0x7fd6d8044710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1695d0c93125cf91 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd5c57fa640 1 -- 172.21.15.96:0/1959927779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d800cd20 con 0x558e760e3bb0 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd5c57fa640 1 -- 172.21.15.96:0/1959927779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d801bcc0 con 0x558e760e3bb0 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd5c57fa640 1 -- 172.21.15.96:0/1959927779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d8050270 con 0x558e760e3bb0 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1959927779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 msgr2=0x558e760e3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1959927779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760e3fb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80517d0 tx=0x7fd6d8044710 comp rx=0 tx=0).stop 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1959927779 shutdown_connections 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1959927779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760e3fb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1959927779 >> 172.21.15.96:0/1959927779 conn(0x558e760defd0 msgr2=0x558e760dd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1959927779 shutdown_connections 2024-09-14T10:44:24.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1959927779 wait complete. 2024-09-14T10:44:24.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 Processor -- start 2024-09-14T10:44:24.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- start start 2024-09-14T10:44:24.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e760e2b00 con 0x558e760e3bb0 2024-09-14T10:44:24.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e12e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e12e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760ea0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38320/0 (socket says 172.21.15.96:38320) 2024-09-14T10:44:24.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 learned_addr learned my addr 172.21.15.96:0/1280353480 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e760ea630 con 0x558e760e3bb0 2024-09-14T10:44:24.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e12e7640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760ea0d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8023fd0 tx=0x7fd6d8051760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd5b37fe640 1 -- 172.21.15.96:0/1280353480 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d8034020 con 0x558e760e3bb0 2024-09-14T10:44:24.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd5b37fe640 1 -- 172.21.15.96:0/1280353480 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d8053290 con 0x558e760e3bb0 2024-09-14T10:44:24.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e760ea8c0 con 0x558e760e3bb0 2024-09-14T10:44:24.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd5b37fe640 1 -- 172.21.15.96:0/1280353480 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d8043170 con 0x558e760e3bb0 2024-09-14T10:44:24.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.300+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e760ea8c0 con 0x558e760e3bb0 2024-09-14T10:44:24.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd5b37fe640 1 -- 172.21.15.96:0/1280353480 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd6d8037020 con 0x558e760e3bb0 2024-09-14T10:44:24.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd5b37fe640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5ac03a120 0x7fd5ac03c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd5b37fe640 1 -- 172.21.15.96:0/1280353480 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd6d804a040 con 0x558e760e3bb0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5ac03a120 0x7fd5ac03c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e760f54c0 0x558e760f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f80d0 con 0x558e760f54c0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e1ae8640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e760f54c0 0x558e760f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5ac03a120 0x7fd5ac03c5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400f010 tx=0x7fd6d401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e1ae8640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e760f54c0 0x558e760f7980 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 realm 2024-09-14T10:44:24.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f47f0 con 0x558e760f54c0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f8b60 con 0x558e760f54c0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f9400 con 0x558e760f54c0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 20 searching for the correct realm 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e760fb680 0x558e760fda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760fe0f0 con 0x558e760fb680 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e12e7640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e760fb680 0x558e760fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e12e7640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e760fb680 0x558e760fda70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e12e7640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd6d8039020 0x7fd6d8015510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760fe0f0 con 0x7fd6d8039020 2024-09-14T10:44:24.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.304+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd6d8039020 0x7fd6d8015510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd6d8039020 0x7fd6d8015510 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e22e9640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd6d4019040 0x7fd6d4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760fe0f0 con 0x7fd6d4019040 2024-09-14T10:44:24.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd6d4019040 0x7fd6d4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd6d4019040 0x7fd6d4019930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d4019040 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d4019040 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.308+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d8039020 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760fb680 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d4019040 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d8039020 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760fb680 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760fb680 2024-09-14T10:44:24.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d4019040 2024-09-14T10:44:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760fb680 2024-09-14T10:44:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760fb680 2024-09-14T10:44:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.312+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d4019040 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760fb680 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d8039020 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d4019040 2024-09-14T10:44:24.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760fb680 2024-09-14T10:44:24.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d4019040 2024-09-14T10:44:24.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d8039020 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.316+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760fb680 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d4019040 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x558e760f54c0 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e760f97a0 con 0x7fd6d8039020 2024-09-14T10:44:24.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f9ff0 con 0x558e760f54c0 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f9ff0 con 0x558e760f54c0 2024-09-14T10:44:24.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f9ff0 con 0x558e760f54c0 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 zone default found 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 4 Realm: () 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 zonegroup default 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760f9fa0 con 0x7fd6d4019040 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760fa970 con 0x558e760fb680 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e760fff40 con 0x558e760fb680 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 started sync module instance, tier type = 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:24.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.320+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e760ff3e0 con 0x7fd6d8039020 2024-09-14T10:44:24.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.324+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.324+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94070354474960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76100790 con 0x7fd6d8039020 2024-09-14T10:44:24.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.324+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76100fe0 con 0x558e760f54c0 2024-09-14T10:44:24.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.324+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94070354474960] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.324+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.324+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94070354477792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76100bb0 con 0x558e760f54c0 2024-09-14T10:44:24.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.324+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76101610 con 0x558e760fb680 2024-09-14T10:44:24.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.328+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94070354477792] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.328+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.328+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94070354478848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76100b20 con 0x558e760fb680 2024-09-14T10:44:24.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.328+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e761023e0 con 0x7fd6d8039020 2024-09-14T10:44:24.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.328+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.328+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94070354484912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76102c80 con 0x7fd6d8039020 2024-09-14T10:44:24.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.328+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e761036c0 con 0x558e760f54c0 2024-09-14T10:44:24.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.328+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94070354478848] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.332+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94070354484912] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.332+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.332+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94070354489744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e761027d0 con 0x558e760f54c0 2024-09-14T10:44:24.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.332+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76103f60 con 0x7fd6d4019040 2024-09-14T10:44:24.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.332+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.332+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94070354491616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e761041b0 con 0x7fd6d4019040 2024-09-14T10:44:24.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.332+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76104a00 con 0x7fd6d4019040 2024-09-14T10:44:24.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.332+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94070354489744] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94070354493872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76104a80 con 0x7fd6d4019040 2024-09-14T10:44:24.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76105440 con 0x7fd6d4019040 2024-09-14T10:44:24.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94070354491616] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94070354492672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76105440 con 0x7fd6d4019040 2024-09-14T10:44:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 20 add_watcher() i=0 2024-09-14T10:44:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 20 add_watcher() i=1 2024-09-14T10:44:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 20 add_watcher() i=2 2024-09-14T10:44:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 20 add_watcher() i=3 2024-09-14T10:44:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 20 add_watcher() i=4 2024-09-14T10:44:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.336+0000 7fd6e3fe29c0 20 add_watcher() i=5 2024-09-14T10:44:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94070354493872] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e3fe29c0 20 add_watcher() i=6 2024-09-14T10:44:24.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94070354492672] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e3fe29c0 20 add_watcher() i=7 2024-09-14T10:44:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e3fe29c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e76108470 con 0x558e760f54c0 2024-09-14T10:44:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94070354497424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76105860 con 0x558e760f54c0 2024-09-14T10:44:24.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94070354497424] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd5937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:24.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e3fe29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:24.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e3fe29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:24.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.340+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76110d70 con 0x558e760f54c0 2024-09-14T10:44:24.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.344+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.344+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76111420 con 0x7fd6d4019040 2024-09-14T10:44:24.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.344+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.348+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76111420 con 0x558e760fb680 2024-09-14T10:44:24.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.348+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.348+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e761118d0 con 0x558e760f54c0 2024-09-14T10:44:24.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.348+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.348+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76111960 con 0x7fd6d8039020 2024-09-14T10:44:24.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.348+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.352+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76111f10 con 0x558e760fb680 2024-09-14T10:44:24.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.352+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.352+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76111ef0 con 0x558e760f54c0 2024-09-14T10:44:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.352+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.352+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e7610a6d0 con 0x7fd6d4019040 2024-09-14T10:44:24.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.356+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.356+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e7610a6a0 con 0x7fd6d8039020 2024-09-14T10:44:24.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.356+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.356+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112740 con 0x558e760fb680 2024-09-14T10:44:24.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.360+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.360+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112b60 con 0x7fd6d8039020 2024-09-14T10:44:24.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.360+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.360+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112d50 con 0x7fd6d4019040 2024-09-14T10:44:24.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.364+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.364+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112d50 con 0x7fd6d8039020 2024-09-14T10:44:24.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.364+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.364+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112d50 con 0x7fd6d4019040 2024-09-14T10:44:24.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.364+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.364+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112d50 con 0x558e760f54c0 2024-09-14T10:44:24.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.368+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.368+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112d50 con 0x558e760fb680 2024-09-14T10:44:24.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.368+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.368+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112d50 con 0x7fd6d8039020 2024-09-14T10:44:24.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.372+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.372+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e60 con 0x558e760fb680 2024-09-14T10:44:24.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.372+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.372+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e20 con 0x558e760f54c0 2024-09-14T10:44:24.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.372+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.372+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e20 con 0x558e760f54c0 2024-09-14T10:44:24.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.376+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.376+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e20 con 0x558e760fb680 2024-09-14T10:44:24.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.376+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.376+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e20 con 0x7fd6d8039020 2024-09-14T10:44:24.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.380+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.380+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e60 con 0x558e760fb680 2024-09-14T10:44:24.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.380+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.380+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e20 con 0x558e760fb680 2024-09-14T10:44:24.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.380+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.380+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e60 con 0x558e760fb680 2024-09-14T10:44:24.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.384+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.384+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e20 con 0x558e760fb680 2024-09-14T10:44:24.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.384+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.384+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e80 con 0x7fd6d4019040 2024-09-14T10:44:24.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.384+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.388+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e40 con 0x558e760fb680 2024-09-14T10:44:24.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.388+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.388+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e40 con 0x7fd6d4019040 2024-09-14T10:44:24.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.388+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.388+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e40 con 0x558e760fb680 2024-09-14T10:44:24.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.392+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.392+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e80 con 0x7fd6d4019040 2024-09-14T10:44:24.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.392+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.392+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e76112e40 con 0x7fd6d8039020 2024-09-14T10:44:24.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd5927fc640 20 reqs_thread_entry: start 2024-09-14T10:44:24.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e3fe29c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:24.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e3fe29c0 20 Filter name: none 2024-09-14T10:44:24.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd503fff640 20 reqs_thread_entry: start 2024-09-14T10:44:24.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e3fe29c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:24.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e3fe29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e761107c0 con 0x558e760f54c0 2024-09-14T10:44:24.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e3fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e3fe29c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-14T10:44:24.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd6e3fe29c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:24.395 INFO:teuthology.orchestra.run.smithi096.stderr:could not remove user: unable to remove user, user does not exist 2024-09-14T10:44:24.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.396+0000 7fd5937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:24.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.400+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94070354497424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e761101e0 con 0x558e760f54c0 2024-09-14T10:44:24.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.400+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94070354497424] v32'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.400+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94070354474960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e7610e630 con 0x7fd6d8039020 2024-09-14T10:44:24.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.400+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94070354474960] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.400+0000 7fd6e3fe29c0 20 remove_watcher() i=0 2024-09-14T10:44:24.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.400+0000 7fd6e3fe29c0 2 removed watcher, disabling cache 2024-09-14T10:44:24.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.400+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94070354477792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e760ff7d0 con 0x558e760f54c0 2024-09-14T10:44:24.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.404+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94070354477792] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.404+0000 7fd6e3fe29c0 20 remove_watcher() i=1 2024-09-14T10:44:24.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.404+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94070354478848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e760ff7d0 con 0x558e760fb680 2024-09-14T10:44:24.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.404+0000 7fd6e12e7640 1 -- 172.21.15.96:0/1280353480 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94070354478848] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d8032db0 con 0x558e760fb680 2024-09-14T10:44:24.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.404+0000 7fd6e3fe29c0 20 remove_watcher() i=2 2024-09-14T10:44:24.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.404+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94070354484912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e760ff7d0 con 0x7fd6d8039020 2024-09-14T10:44:24.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.408+0000 7fd6e22e9640 1 -- 172.21.15.96:0/1280353480 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94070354484912] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6d402f040 con 0x7fd6d8039020 2024-09-14T10:44:24.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.408+0000 7fd6e3fe29c0 20 remove_watcher() i=3 2024-09-14T10:44:24.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.408+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94070354489744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e760ff7d0 con 0x558e760f54c0 2024-09-14T10:44:24.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.408+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94070354489744] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x558e760f54c0 2024-09-14T10:44:24.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.408+0000 7fd6e3fe29c0 20 remove_watcher() i=4 2024-09-14T10:44:24.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.408+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94070354491616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e760ff7d0 con 0x7fd6d4019040 2024-09-14T10:44:24.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.412+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94070354491616] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.412+0000 7fd6e3fe29c0 20 remove_watcher() i=5 2024-09-14T10:44:24.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.412+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94070354493872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e761038e0 con 0x7fd6d4019040 2024-09-14T10:44:24.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.412+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94070354493872] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.412+0000 7fd6e3fe29c0 20 remove_watcher() i=6 2024-09-14T10:44:24.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.412+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94070354492672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e760ff7d0 con 0x7fd6d4019040 2024-09-14T10:44:24.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94070354492672] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6dc0c7070 con 0x7fd6d4019040 2024-09-14T10:44:24.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 20 remove_watcher() i=7 2024-09-14T10:44:24.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd6d4019040 msgr2=0x7fd6d4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd6d4019040 0x7fd6d4019930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e760f54c0 msgr2=0x558e760f7980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e760f54c0 0x558e760f7980 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd6d8039020 msgr2=0x7fd6d8015510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd6d8039020 0x7fd6d8015510 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e760fb680 msgr2=0x558e760fda70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e760fb680 0x558e760fda70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5ac03a120 msgr2=0x7fd5ac03c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5ac03a120 0x7fd5ac03c5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400f010 tx=0x7fd6d401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 msgr2=0x558e760ea0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e1ae8640 1 -- 172.21.15.96:0/1280353480 reap_dead start 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760ea0d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8023fd0 tx=0x7fd6d8051760 comp rx=0 tx=0).stop 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 shutdown_connections 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/1280353480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760e3bb0 0x558e760ea0d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 >> 172.21.15.96:0/1280353480 conn(0x558e760defd0 msgr2=0x558e760dd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 shutdown_connections 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/1280353480 wait complete. 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3285917000 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5bc03a140 msgr2=0x7fd5bc03c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/3285917000 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5bc03a140 0x7fd5bc03c600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400e3f0 tx=0x7fd6d4003070 comp rx=0 tx=0).stop 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3285917000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760d6240 msgr2=0x558e760d6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/3285917000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760d6240 0x558e760d6660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800d660 tx=0x7fd6d800da60 comp rx=0 tx=0).stop 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3285917000 shutdown_connections 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/3285917000 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5bc03a140 0x7fd5bc03c600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/3285917000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e760d6240 0x558e760d6660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3285917000 >> 172.21.15.96:0/3285917000 conn(0x558e760cbbf0 msgr2=0x558e760cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3285917000 shutdown_connections 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/3285917000 wait complete. 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e75fcf190 msgr2=0x558e760c5bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e75fcf190 0x558e760c5bd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5c803a150 msgr2=0x7fd5c803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5c803a150 0x7fd5c803c610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8001d80 tx=0x7fd6d80012e0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 msgr2=0x558e760beab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760beab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc018c00 tx=0x7fd6dc017d70 comp rx=0 tx=0).stop 2024-09-14T10:44:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 shutdown_connections 2024-09-14T10:44:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e75fcf190 0x558e760c5bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd5c803a150 0x7fd5c803c610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 --2- 172.21.15.96:0/2415821762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e75fcc000 0x558e760beab0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 >> 172.21.15.96:0/2415821762 conn(0x558e75fc7b20 msgr2=0x558e760b86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 shutdown_connections 2024-09-14T10:44:24.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.416+0000 7fd6e3fe29c0 1 -- 172.21.15.96:0/2415821762 wait complete. 2024-09-14T10:44:24.428 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-14T10:44:24.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-14T10:44:24.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-14T10:44:24.429 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-14T10:44:24.510 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:24.510 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:24.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.512+0000 7fa4a41669c0 1 Processor -- start 2024-09-14T10:44:24.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.512+0000 7fa4a41669c0 1 -- start start 2024-09-14T10:44:24.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.512+0000 7fa4a41669c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f56f977ed0 0x55f56f9782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.512+0000 7fa4a41669c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f56f8217a0 con 0x55f56f97b0b0 2024-09-14T10:44:24.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.512+0000 7fa4a41669c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55f56f87d1b0 con 0x55f56f977ed0 2024-09-14T10:44:24.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.512+0000 7fa4a1c6c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f56f977ed0 0x55f56f9782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a146b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55f56f97b0b0 0x55f56f97d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34182/0 (socket says 172.21.15.96:34182) 2024-09-14T10:44:24.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a1c6c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f56f977ed0 0x55f56f9782b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38330/0 (socket says 172.21.15.96:38330) 2024-09-14T10:44:24.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a146b640 1 -- 172.21.15.96:0/1740130797 learned_addr learned my addr 172.21.15.96:0/1740130797 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:24.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a1c6c640 1 -- 172.21.15.96:0/1740130797 >> v1:172.21.15.70:6789/0 conn(0x55f56f97b0b0 legacy=0x55f56f97d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a1c6c640 1 -- 172.21.15.96:0/1740130797 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56f7fbda0 con 0x55f56f977ed0 2024-09-14T10:44:24.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a1c6c640 1 --2- 172.21.15.96:0/1740130797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56f9782b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c6d0 tx=0x7fa49401d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3258e8520c98653 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a0c6a640 1 -- 172.21.15.96:0/1740130797 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4940a76b0 con 0x55f56f977ed0 2024-09-14T10:44:24.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a0c6a640 1 -- 172.21.15.96:0/1740130797 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4940a7850 con 0x55f56f977ed0 2024-09-14T10:44:24.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a0c6a640 1 -- 172.21.15.96:0/1740130797 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4940a7bb0 con 0x55f56f977ed0 2024-09-14T10:44:24.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.516+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1740130797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 msgr2=0x55f56f9782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.520+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1740130797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56f9782b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c6d0 tx=0x7fa49401d6c0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.520+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1740130797 shutdown_connections 2024-09-14T10:44:24.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.520+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1740130797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56f9782b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.520+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1740130797 >> 172.21.15.96:0/1740130797 conn(0x55f56f9739f0 msgr2=0x55f56f975e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.520+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1740130797 shutdown_connections 2024-09-14T10:44:24.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.520+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1740130797 wait complete. 2024-09-14T10:44:24.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.532+0000 7fa4a41669c0 1 Processor -- start 2024-09-14T10:44:24.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.532+0000 7fa4a41669c0 1 -- start start 2024-09-14T10:44:24.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.532+0000 7fa4a41669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa66830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.532+0000 7fa4a41669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f56f880fc0 con 0x55f56f977ed0 2024-09-14T10:44:24.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a1c6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa66830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a1c6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa66830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38332/0 (socket says 172.21.15.96:38332) 2024-09-14T10:44:24.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a1c6c640 1 -- 172.21.15.96:0/1515727840 learned_addr learned my addr 172.21.15.96:0/1515727840 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a1c6c640 1 -- 172.21.15.96:0/1515727840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56fa66e20 con 0x55f56f977ed0 2024-09-14T10:44:24.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a1c6c640 1 --2- 172.21.15.96:0/1515727840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa66830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa49401a2d0 tx=0x7fa4940a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d4772010632ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa38fe07640 1 -- 172.21.15.96:0/1515727840 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4940a7cf0 con 0x55f56f977ed0 2024-09-14T10:44:24.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa38fe07640 1 -- 172.21.15.96:0/1515727840 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4940af440 con 0x55f56f977ed0 2024-09-14T10:44:24.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa38fe07640 1 -- 172.21.15.96:0/1515727840 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4940af740 con 0x55f56f977ed0 2024-09-14T10:44:24.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1515727840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 msgr2=0x55f56fa66830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1515727840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa66830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa49401a2d0 tx=0x7fa4940a8000 comp rx=0 tx=0).stop 2024-09-14T10:44:24.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1515727840 shutdown_connections 2024-09-14T10:44:24.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1515727840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa66830 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1515727840 >> 172.21.15.96:0/1515727840 conn(0x55f56f9739f0 msgr2=0x55f56fa5e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1515727840 shutdown_connections 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1515727840 wait complete. 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 Processor -- start 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 -- start start 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a41669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f56f822a50 con 0x55f56f977ed0 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a1c6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a1c6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa6e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38340/0 (socket says 172.21.15.96:38340) 2024-09-14T10:44:24.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.536+0000 7fa4a1c6c640 1 -- 172.21.15.96:0/1222137113 learned_addr learned my addr 172.21.15.96:0/1222137113 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a1c6c640 1 -- 172.21.15.96:0/1222137113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56fa6e600 con 0x55f56f977ed0 2024-09-14T10:44:24.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a1c6c640 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa6e0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa494005fd0 tx=0x7fa49401a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa38e604640 1 -- 172.21.15.96:0/1222137113 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4940afdb0 con 0x55f56f977ed0 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f56fa6e890 con 0x55f56f977ed0 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa38e604640 1 -- 172.21.15.96:0/1222137113 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4940c0070 con 0x55f56f977ed0 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa38e604640 1 -- 172.21.15.96:0/1222137113 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4940c55c0 con 0x55f56f977ed0 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56fa6f240 con 0x55f56f977ed0 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a41669c0 1 Processor -- start 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a41669c0 1 -- start start 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a41669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa7b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a41669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f56f88dd80 con 0x55f56fa7ad20 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa38e604640 1 -- 172.21.15.96:0/1222137113 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa4940bc420 con 0x55f56f977ed0 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a246d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa7b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a246d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa7b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38350/0 (socket says 172.21.15.96:38350) 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a246d640 1 -- 172.21.15.96:0/3796875429 learned_addr learned my addr 172.21.15.96:0/3796875429 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa38e604640 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa38803a150 0x7fa38803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa38e604640 1 -- 172.21.15.96:0/1222137113 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa4940ebd80 con 0x55f56f977ed0 2024-09-14T10:44:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a1c6c640 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa38803a150 0x7fa38803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a246d640 1 -- 172.21.15.96:0/3796875429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56fa7b710 con 0x55f56fa7ad20 2024-09-14T10:44:24.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a1c6c640 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa38803a150 0x7fa38803c610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa49401d4f0 tx=0x7fa4940c4ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa4a246d640 1 --2- 172.21.15.96:0/3796875429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa7b120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00a440 tx=0x7fa49c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7cd8faf522ed3e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa387fff640 1 -- 172.21.15.96:0/3796875429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49c008850 con 0x55f56fa7ad20 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa387fff640 1 -- 172.21.15.96:0/3796875429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c008a10 con 0x55f56fa7ad20 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.540+0000 7fa387fff640 1 -- 172.21.15.96:0/3796875429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49c008d30 con 0x55f56fa7ad20 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3796875429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 msgr2=0x55f56fa7b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/3796875429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa7b120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00a440 tx=0x7fa49c00a900 comp rx=0 tx=0).stop 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3796875429 shutdown_connections 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/3796875429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa7b120 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3796875429 >> 172.21.15.96:0/3796875429 conn(0x55f56f97b0b0 msgr2=0x55f56fa76760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3796875429 shutdown_connections 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3796875429 wait complete. 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 Processor -- start 2024-09-14T10:44:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- start start 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa82070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f56fa7bf00 con 0x55f56fa7ad20 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a246d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa82070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a246d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa82070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38362/0 (socket says 172.21.15.96:38362) 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a246d640 1 -- 172.21.15.96:0/3880464248 learned_addr learned my addr 172.21.15.96:0/3880464248 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a246d640 1 -- 172.21.15.96:0/3880464248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56fa825d0 con 0x55f56fa7ad20 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a246d640 1 --2- 172.21.15.96:0/3880464248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa82070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55f56fa7bc20 tx=0x7fa49c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa3867fc640 1 -- 172.21.15.96:0/3880464248 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49c013a70 con 0x55f56fa7ad20 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3880464248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f56fa82860 con 0x55f56fa7ad20 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa3867fc640 1 -- 172.21.15.96:0/3880464248 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c023070 con 0x55f56fa7ad20 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3880464248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56fa83210 con 0x55f56fa7ad20 2024-09-14T10:44:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa3867fc640 1 -- 172.21.15.96:0/3880464248 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa49c013d80 con 0x55f56fa7ad20 2024-09-14T10:44:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa3867fc640 1 -- 172.21.15.96:0/3880464248 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa49c028460 con 0x55f56fa7ad20 2024-09-14T10:44:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa4a41669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.544+0000 7fa3867fc640 1 --2- 172.21.15.96:0/3880464248 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa37c03a150 0x7fa37c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a41669c0 1 Processor -- start 2024-09-14T10:44:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa3867fc640 1 -- 172.21.15.96:0/3880464248 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa49c050ff0 con 0x55f56fa7ad20 2024-09-14T10:44:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a246d640 1 --2- 172.21.15.96:0/3880464248 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa37c03a150 0x7fa37c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a41669c0 1 -- start start 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a41669c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa9b9f0 0x55f56fa9be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a41669c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f56fa67190 con 0x55f56fa9b9f0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a246d640 1 --2- 172.21.15.96:0/3880464248 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa37c03a150 0x7fa37c03c610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa49c027fd0 tx=0x7fa49c01dea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a1c6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa9b9f0 0x55f56fa9be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a1c6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa9b9f0 0x55f56fa9be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38378/0 (socket says 172.21.15.96:38378) 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a1c6c640 1 -- 172.21.15.96:0/90768741 learned_addr learned my addr 172.21.15.96:0/90768741 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a1c6c640 1 -- 172.21.15.96:0/90768741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56fa9c450 con 0x55f56fa9b9f0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a1c6c640 1 --2- 172.21.15.96:0/90768741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa9b9f0 0x55f56fa9be10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa4940ea1a0 tx=0x7fa4940ba770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa3667e4640 1 -- 172.21.15.96:0/90768741 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4940ba8a0 con 0x55f56fa9b9f0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa3667e4640 1 -- 172.21.15.96:0/90768741 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4940bbd70 con 0x55f56fa9b9f0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a41669c0 1 -- 172.21.15.96:0/90768741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f56fa9cbf0 con 0x55f56fa9b9f0 2024-09-14T10:44:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa3667e4640 1 -- 172.21.15.96:0/90768741 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4940c58b0 con 0x55f56fa9b9f0 2024-09-14T10:44:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a41669c0 1 -- 172.21.15.96:0/90768741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56fa9cbf0 con 0x55f56fa9b9f0 2024-09-14T10:44:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa3667e4640 1 -- 172.21.15.96:0/90768741 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa4940f1020 con 0x55f56fa9b9f0 2024-09-14T10:44:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa3667e4640 1 --2- 172.21.15.96:0/90768741 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa2e403a100 0x7fa2e403c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa3667e4640 1 -- 172.21.15.96:0/90768741 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa4940e2070 con 0x55f56fa9b9f0 2024-09-14T10:44:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a146b640 1 --2- 172.21.15.96:0/90768741 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa2e403a100 0x7fa2e403c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa2d7fff640 20 reqs_thread_entry: start 2024-09-14T10:44:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f56faa1200 0x55f56faa3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a146b640 1 --2- 172.21.15.96:0/90768741 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa2e403a100 0x7fa2e403c5c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa48c001d00 tx=0x7fa48c001260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.548+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f56faa3d10 con 0x55f56faa1200 2024-09-14T10:44:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.552+0000 7fa4a246d640 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f56faa1200 0x55f56faa3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.552+0000 7fa4a246d640 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f56faa1200 0x55f56faa3670 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.552+0000 7fa4a246d640 1 -- 172.21.15.96:0/1222137113 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa49c01e7a0 con 0x55f56faa1200 2024-09-14T10:44:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.552+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f56faa5620 con 0x55f56faa1200 2024-09-14T10:44:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.552+0000 7fa4a246d640 1 -- 172.21.15.96:0/1222137113 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa49c01e7a0 con 0x55f56faa1200 2024-09-14T10:44:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.552+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f56faaa4a0 con 0x55f56faa1200 2024-09-14T10:44:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.552+0000 7fa4a246d640 1 -- 172.21.15.96:0/1222137113 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fa49c01e7a0 con 0x55f56faa1200 2024-09-14T10:44:24.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3880464248 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa37c03a150 msgr2=0x7fa37c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/3880464248 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa37c03a150 0x7fa37c03c610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa49c027fd0 tx=0x7fa49c01dea0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3880464248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 msgr2=0x55f56fa82070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/3880464248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa82070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55f56fa7bc20 tx=0x7fa49c003000 comp rx=0 tx=0).stop 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3880464248 shutdown_connections 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/3880464248 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa37c03a150 0x7fa37c03c610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/3880464248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa7ad20 0x55f56fa82070 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3880464248 >> 172.21.15.96:0/3880464248 conn(0x55f56f97b0b0 msgr2=0x55f56fa76250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3880464248 shutdown_connections 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/3880464248 wait complete. 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/90768741 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa2e403a100 msgr2=0x7fa2e403c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/90768741 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa2e403a100 0x7fa2e403c5c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa48c001d00 tx=0x7fa48c001260 comp rx=0 tx=0).stop 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/90768741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa9b9f0 msgr2=0x55f56fa9be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/90768741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa9b9f0 0x55f56fa9be10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa4940ea1a0 tx=0x7fa4940ba770 comp rx=0 tx=0).stop 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/90768741 shutdown_connections 2024-09-14T10:44:24.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/90768741 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa2e403a100 0x7fa2e403c5c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/90768741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56fa9b9f0 0x55f56fa9be10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/90768741 >> 172.21.15.96:0/90768741 conn(0x55f56fa90ff0 msgr2=0x55f56fa913d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/90768741 shutdown_connections 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/90768741 wait complete. 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f56faa1200 msgr2=0x55f56faa3670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f56faa1200 0x55f56faa3670 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa38803a150 msgr2=0x7fa38803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa38803a150 0x7fa38803c610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa49401d4f0 tx=0x7fa4940c4ee0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 msgr2=0x55f56fa6e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa6e0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa494005fd0 tx=0x7fa49401a460 comp rx=0 tx=0).stop 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 shutdown_connections 2024-09-14T10:44:24.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f56faa1200 0x55f56faa3670 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa38803a150 0x7fa38803c610 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 --2- 172.21.15.96:0/1222137113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f56f977ed0 0x55f56fa6e0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 >> 172.21.15.96:0/1222137113 conn(0x55f56f9739f0 msgr2=0x55f56fa67be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 shutdown_connections 2024-09-14T10:44:24.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.556+0000 7fa4a41669c0 1 -- 172.21.15.96:0/1222137113 wait complete. 2024-09-14T10:44:24.564 INFO:teuthology.orchestra.run.smithi096.stdout:{"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:44:24.564 DEBUG:tasks.util.rgw: json result: {'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:44:24.566 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-14T10:44:24.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-14T10:44:24.566 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-14T10:44:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.640+0000 7f95912ae9c0 1 Processor -- start 2024-09-14T10:44:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.640+0000 7f95912ae9c0 1 -- start start 2024-09-14T10:44:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.640+0000 7f95912ae9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558e348ad030 0x558e348af420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.640+0000 7f95912ae9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e347527a0 con 0x558e348a8e40 2024-09-14T10:44:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.640+0000 7f95912ae9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x558e347ae1b0 con 0x558e348ad030 2024-09-14T10:44:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.640+0000 7f958e5b3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558e348ad030 0x558e348af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.640+0000 7f958edb4640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x558e348a8e40 0x558e348a9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34194/0 (socket says 172.21.15.96:34194) 2024-09-14T10:44:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.640+0000 7f958edb4640 1 -- 172.21.15.96:0/1635973099 learned_addr learned my addr 172.21.15.96:0/1635973099 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f958ddb2640 1 -- 172.21.15.96:0/1635973099 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007345035 0 0) 0x558e347527a0 con 0x558e348a8e40 2024-09-14T10:44:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f958ddb2640 1 -- 172.21.15.96:0/1635973099 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9578001e20 con 0x558e348a8e40 2024-09-14T10:44:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f958e5b3640 1 -- 172.21.15.96:0/1635973099 >> v1:172.21.15.70:6789/0 conn(0x558e348a8e40 legacy=0x558e348a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f958e5b3640 1 -- 172.21.15.96:0/1635973099 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3472cda0 con 0x558e348ad030 2024-09-14T10:44:24.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f958e5b3640 1 --2- 172.21.15.96:0/1635973099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348ad030 0x558e348af420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f958400a420 tx=0x7f958401b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0eca7d17e8446e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f958ddb2640 1 -- 172.21.15.96:0/1635973099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95840af070 con 0x558e348ad030 2024-09-14T10:44:24.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f958ddb2640 1 -- 172.21.15.96:0/1635973099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840aa530 con 0x558e348ad030 2024-09-14T10:44:24.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f958ddb2640 1 -- 172.21.15.96:0/1635973099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95840aa810 con 0x558e348ad030 2024-09-14T10:44:24.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f95912ae9c0 1 -- 172.21.15.96:0/1635973099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348ad030 msgr2=0x558e348af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/1635973099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348ad030 0x558e348af420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f958400a420 tx=0x7f958401b060 comp rx=0 tx=0).stop 2024-09-14T10:44:24.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f95912ae9c0 1 -- 172.21.15.96:0/1635973099 shutdown_connections 2024-09-14T10:44:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/1635973099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348ad030 0x558e348af420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f95912ae9c0 1 -- 172.21.15.96:0/1635973099 >> 172.21.15.96:0/1635973099 conn(0x558e348a4960 msgr2=0x558e348a6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f95912ae9c0 1 -- 172.21.15.96:0/1635973099 shutdown_connections 2024-09-14T10:44:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.644+0000 7f95912ae9c0 1 -- 172.21.15.96:0/1635973099 wait complete. 2024-09-14T10:44:24.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.660+0000 7f95912ae9c0 1 Processor -- start 2024-09-14T10:44:24.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.660+0000 7f95912ae9c0 1 -- start start 2024-09-14T10:44:24.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.660+0000 7f95912ae9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e349940e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.660+0000 7f95912ae9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e347b1fc0 con 0x558e348a8e40 2024-09-14T10:44:24.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.660+0000 7f958edb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e349940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.660+0000 7f958edb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e349940e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38404/0 (socket says 172.21.15.96:38404) 2024-09-14T10:44:24.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.660+0000 7f958edb4640 1 -- 172.21.15.96:0/2803509903 learned_addr learned my addr 172.21.15.96:0/2803509903 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f958edb4640 1 -- 172.21.15.96:0/2803509903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e349946d0 con 0x558e348a8e40 2024-09-14T10:44:24.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f958edb4640 1 --2- 172.21.15.96:0/2803509903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e349940e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9580001e40 tx=0x7f958000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2260ba9e6f75723b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f947ce09640 1 -- 172.21.15.96:0/2803509903 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9580012020 con 0x558e348a8e40 2024-09-14T10:44:24.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f947ce09640 1 -- 172.21.15.96:0/2803509903 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958000e690 con 0x558e348a8e40 2024-09-14T10:44:24.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f947ce09640 1 -- 172.21.15.96:0/2803509903 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f958000e9b0 con 0x558e348a8e40 2024-09-14T10:44:24.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2803509903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 msgr2=0x558e349940e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/2803509903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e349940e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9580001e40 tx=0x7f958000b790 comp rx=0 tx=0).stop 2024-09-14T10:44:24.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2803509903 shutdown_connections 2024-09-14T10:44:24.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/2803509903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e349940e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2803509903 >> 172.21.15.96:0/2803509903 conn(0x558e348a4960 msgr2=0x558e3498fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2803509903 shutdown_connections 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2803509903 wait complete. 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 Processor -- start 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- start start 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e3499b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e34753a50 con 0x558e348a8e40 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f958edb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e3499b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f958edb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e3499b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38414/0 (socket says 172.21.15.96:38414) 2024-09-14T10:44:24.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f958edb4640 1 -- 172.21.15.96:0/4197915724 learned_addr learned my addr 172.21.15.96:0/4197915724 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f958edb4640 1 -- 172.21.15.96:0/4197915724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3499bf40 con 0x558e348a8e40 2024-09-14T10:44:24.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f958edb4640 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e3499b9e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x558e349950a0 tx=0x7f95800040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f947b606640 1 -- 172.21.15.96:0/4197915724 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9580012030 con 0x558e348a8e40 2024-09-14T10:44:24.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e3499c1d0 con 0x558e348a8e40 2024-09-14T10:44:24.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f947b606640 1 -- 172.21.15.96:0/4197915724 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958001a720 con 0x558e348a8e40 2024-09-14T10:44:24.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f947b606640 1 -- 172.21.15.96:0/4197915724 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f958001aa60 con 0x558e348a8e40 2024-09-14T10:44:24.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.664+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3499cb80 con 0x558e348a8e40 2024-09-14T10:44:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f947b606640 1 -- 172.21.15.96:0/4197915724 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9580015020 con 0x558e348a8e40 2024-09-14T10:44:24.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f947b606640 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f947403a150 0x7f947403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f947b606640 1 -- 172.21.15.96:0/4197915724 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9580020070 con 0x558e348a8e40 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958e5b3640 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f947403a150 0x7f947403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e348ad030 0x558e349a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349a3090 con 0x558e348ad030 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958f5b5640 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e348ad030 0x558e349a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958f5b5640 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e348ad030 0x558e349a2b50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958e5b3640 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f947403a150 0x7f947403c610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95840ac000 tx=0x7f95840a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958f5b5640 1 -- 172.21.15.96:0/4197915724 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95880083f0 con 0x558e348ad030 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e3499cee0 con 0x558e348ad030 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958f5b5640 1 -- 172.21.15.96:0/4197915724 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95880083f0 con 0x558e348ad030 2024-09-14T10:44:24.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349a4e20 con 0x558e348ad030 2024-09-14T10:44:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958f5b5640 1 -- 172.21.15.96:0/4197915724 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f95880083f0 con 0x558e348ad030 2024-09-14T10:44:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349a4050 con 0x558e348ad030 2024-09-14T10:44:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958f5b5640 1 -- 172.21.15.96:0/4197915724 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95880083f0 con 0x558e348ad030 2024-09-14T10:44:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349a44a0 con 0x558e348ad030 2024-09-14T10:44:24.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.668+0000 7f958f5b5640 1 -- 172.21.15.96:0/4197915724 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f95880083f0 con 0x558e348ad030 2024-09-14T10:44:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f95912ae9c0 1 Processor -- start 2024-09-14T10:44:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f95912ae9c0 1 -- start start 2024-09-14T10:44:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f95912ae9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3481e3d0 0x558e349b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f95912ae9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e347bed80 con 0x558e3481e3d0 2024-09-14T10:44:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f958e5b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3481e3d0 0x558e349b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f958e5b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3481e3d0 0x558e349b6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38416/0 (socket says 172.21.15.96:38416) 2024-09-14T10:44:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f958e5b3640 1 -- 172.21.15.96:0/2487204591 learned_addr learned my addr 172.21.15.96:0/2487204591 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f958e5b3640 1 -- 172.21.15.96:0/2487204591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3481e8f0 con 0x558e3481e3d0 2024-09-14T10:44:24.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f958e5b3640 1 --2- 172.21.15.96:0/2487204591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3481e3d0 0x558e349b6f60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f958401b5d0 tx=0x7f9584017e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f9478e01640 1 -- 172.21.15.96:0/2487204591 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95840c0520 con 0x558e3481e3d0 2024-09-14T10:44:24.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2487204591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e349b7500 con 0x558e3481e3d0 2024-09-14T10:44:24.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f9478e01640 1 -- 172.21.15.96:0/2487204591 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840c5070 con 0x558e3481e3d0 2024-09-14T10:44:24.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2487204591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e349b7a70 con 0x558e3481e3d0 2024-09-14T10:44:24.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f9478e01640 1 -- 172.21.15.96:0/2487204591 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95840c06c0 con 0x558e3481e3d0 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f9478e01640 1 -- 172.21.15.96:0/2487204591 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f95840a3d10 con 0x558e3481e3d0 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f9478e01640 1 --2- 172.21.15.96:0/2487204591 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f946803a140 0x7f946803c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f9478e01640 1 -- 172.21.15.96:0/2487204591 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f95840ed830 con 0x558e3481e3d0 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.672+0000 7f958f5b5640 1 --2- 172.21.15.96:0/2487204591 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f946803a140 0x7f946803c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 Processor -- start 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- start start 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e34994b00 con 0x558e349c0b70 2024-09-14T10:44:24.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958f5b5640 1 --2- 172.21.15.96:0/2487204591 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f946803a140 0x7f946803c600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f958800e3f0 tx=0x7f9588003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38422/0 (socket says 172.21.15.96:38422) 2024-09-14T10:44:24.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 -- 172.21.15.96:0/698145971 learned_addr learned my addr 172.21.15.96:0/698145971 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 -- 172.21.15.96:0/698145971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e349c1520 con 0x558e349c0b70 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 --2- 172.21.15.96:0/698145971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c0f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95840ebc20 tx=0x7f95840c0c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f4c750c6c1cf9a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f94727fc640 1 -- 172.21.15.96:0/698145971 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95840c9e00 con 0x558e349c0b70 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f94727fc640 1 -- 172.21.15.96:0/698145971 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840b0040 con 0x558e349c0b70 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f94727fc640 1 -- 172.21.15.96:0/698145971 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95840ca460 con 0x558e349c0b70 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- 172.21.15.96:0/698145971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 msgr2=0x558e349c0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/698145971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c0f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95840ebc20 tx=0x7f95840c0c30 comp rx=0 tx=0).stop 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- 172.21.15.96:0/698145971 shutdown_connections 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/698145971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c0f50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- 172.21.15.96:0/698145971 >> 172.21.15.96:0/698145971 conn(0x558e349bcfa0 msgr2=0x558e349bb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- 172.21.15.96:0/698145971 shutdown_connections 2024-09-14T10:44:24.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- 172.21.15.96:0/698145971 wait complete. 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 Processor -- start 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- start start 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f95912ae9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e349c1b80 con 0x558e349c0b70 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38434/0 (socket says 172.21.15.96:38434) 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 learned_addr learned my addr 172.21.15.96:0/3752382310 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.676+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e349c8620 con 0x558e349c0b70 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958e5b3640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c80c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f95840edba0 tx=0x7f95840ebbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f9470ff9640 1 -- 172.21.15.96:0/3752382310 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95840b4400 con 0x558e349c0b70 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f9470ff9640 1 -- 172.21.15.96:0/3752382310 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840b0040 con 0x558e349c0b70 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e349c88b0 con 0x558e349c0b70 2024-09-14T10:44:24.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f9470ff9640 1 -- 172.21.15.96:0/3752382310 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95840b57e0 con 0x558e349c0b70 2024-09-14T10:44:24.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e349c9260 con 0x558e349c0b70 2024-09-14T10:44:24.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f9470ff9640 1 -- 172.21.15.96:0/3752382310 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f95840b5980 con 0x558e349c0b70 2024-09-14T10:44:24.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f9470ff9640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f945803a1a0 0x7f945803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f9470ff9640 1 -- 172.21.15.96:0/3752382310 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f95840e2030 con 0x558e349c0b70 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958f5b5640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f945803a1a0 0x7f945803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e349d3600 0x558e349d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d61c0 con 0x558e349d3600 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958edb4640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e349d3600 0x558e349d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958f5b5640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f945803a1a0 0x7f945803c660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f958800f010 tx=0x7f958801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958edb4640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e349d3600 0x558e349d5a70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 realm 2024-09-14T10:44:24.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d65d0 con 0x558e349d3600 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d6ea0 con 0x558e349d3600 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d7240 con 0x558e349d3600 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.680+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d76e0 con 0x558e349d3600 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f95912ae9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f95912ae9c0 20 searching for the correct realm 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e349d9680 0x558e349dba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x558e349d9680 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958e5b3640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e349d9680 0x558e349dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958e5b3640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e349d9680 0x558e349dba90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958e5b3640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f95840b6070 0x7f95840c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x7f95840b6070 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958f5b5640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f95840b6070 0x7f95840c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958f5b5640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f95840b6070 0x7f95840c2aa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958f5b5640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9588019040 0x7f9588019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x7f9588019040 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9588019040 0x7f9588019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9588019040 0x7f9588019930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x558e349d3600 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x558e349d3600 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.684+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x7f9588019040 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x7f9588019040 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x7f95840b6070 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e349dc160 con 0x558e349d9680 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d3600 2024-09-14T10:44:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f9588019040 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d3600 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f95840b6070 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d9680 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d9680 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.688+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f9588019040 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d9680 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d9680 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d3600 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d3600 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f9588019040 2024-09-14T10:44:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d9680 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f95840b6070 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d3600 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f9588019040 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d9680 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.692+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f9588019040 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f95840b6070 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d9680 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f9588019040 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x558e349d3600 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9584103040 con 0x7f95840b6070 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d80f0 con 0x558e349d3600 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d8990 con 0x558e349d3600 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d7d30 con 0x558e349d3600 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 zone default found 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 4 Realm: () 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 zonegroup default 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.696+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349d8990 con 0x7f9588019040 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349ddfd0 con 0x558e349d9680 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349de370 con 0x558e349d9680 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 20 started sync module instance, tier type = 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:24.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349dd470 con 0x7f95840b6070 2024-09-14T10:44:24.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069256476816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349debc0 con 0x7f95840b6070 2024-09-14T10:44:24.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349df410 con 0x558e349d3600 2024-09-14T10:44:24.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.700+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94069256476816] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.704+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.704+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94069256480528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349df020 con 0x558e349d3600 2024-09-14T10:44:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.704+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349dfb40 con 0x558e349d9680 2024-09-14T10:44:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.704+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.704+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94069256484368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e03e0 con 0x558e349d9680 2024-09-14T10:44:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.704+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e0de0 con 0x7f95840b6070 2024-09-14T10:44:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.704+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94069256480528] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.708+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94069256484368] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.708+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.708+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94069256486704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e08f0 con 0x7f95840b6070 2024-09-14T10:44:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.708+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e1680 con 0x558e349d3600 2024-09-14T10:44:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.708+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94069256486704] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.708+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.708+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069256481584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e1680 con 0x558e349d3600 2024-09-14T10:44:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.708+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e2090 con 0x7f9588019040 2024-09-14T10:44:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.712+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94069256481584] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.712+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.712+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069256494320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e1680 con 0x7f9588019040 2024-09-14T10:44:24.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.712+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e2990 con 0x7f9588019040 2024-09-14T10:44:24.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.712+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94069256494320] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94069256496256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e2b70 con 0x7f9588019040 2024-09-14T10:44:24.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e33c0 con 0x7f9588019040 2024-09-14T10:44:24.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94069256496256] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069256498112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e3490 con 0x7f9588019040 2024-09-14T10:44:24.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 20 add_watcher() i=0 2024-09-14T10:44:24.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 20 add_watcher() i=1 2024-09-14T10:44:24.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 20 add_watcher() i=2 2024-09-14T10:44:24.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 20 add_watcher() i=3 2024-09-14T10:44:24.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 20 add_watcher() i=4 2024-09-14T10:44:24.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 20 add_watcher() i=5 2024-09-14T10:44:24.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.716+0000 7f95912ae9c0 20 add_watcher() i=6 2024-09-14T10:44:24.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94069256498112] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 20 add_watcher() i=7 2024-09-14T10:44:24.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:24.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e349e6770 con 0x558e349d3600 2024-09-14T10:44:24.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94069256499536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e349e3a20 con 0x558e349d3600 2024-09-14T10:44:24.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94069256499536] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f94457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:24.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:24.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:24.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 5 note: GC not initialized 2024-09-14T10:44:24.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f93bffff640 20 reqs_thread_entry: start 2024-09-14T10:44:24.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:24.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 20 Filter name: none 2024-09-14T10:44:24.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f93bdffb640 20 reqs_thread_entry: start 2024-09-14T10:44:24.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0a400 con 0x558e349d3600 2024-09-14T10:44:24.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.720+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0a400 con 0x7f95840b6070 2024-09-14T10:44:24.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0a400 con 0x558e349d3600 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0a3c0 con 0x558e349d9680 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0a8f0 con 0x558e349d9680 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f9588019040 2024-09-14T10:44:24.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f95840b6070 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.724+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f9588019040 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0acd0 con 0x7f9588019040 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f9588019040 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f9588019040 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f95840b6070 2024-09-14T10:44:24.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.728+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f9588019040 2024-09-14T10:44:24.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f9588019040 2024-09-14T10:44:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.732+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.736+0000 7f94457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:24.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.736+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94069256499536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.736+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94069256499536] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.736+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94069256476816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f95840b6070 2024-09-14T10:44:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.740+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94069256476816] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.740+0000 7f95912ae9c0 20 remove_watcher() i=0 2024-09-14T10:44:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.740+0000 7f95912ae9c0 2 removed watcher, disabling cache 2024-09-14T10:44:24.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.740+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94069256480528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a077b0 con 0x558e349d3600 2024-09-14T10:44:24.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.740+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94069256480528] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.740+0000 7f95912ae9c0 20 remove_watcher() i=1 2024-09-14T10:44:24.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.740+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94069256484368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d9680 2024-09-14T10:44:24.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f958e5b3640 1 -- 172.21.15.96:0/3752382310 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94069256484368] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95840e5070 con 0x558e349d9680 2024-09-14T10:44:24.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f95912ae9c0 20 remove_watcher() i=2 2024-09-14T10:44:24.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94069256486704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a077b0 con 0x7f95840b6070 2024-09-14T10:44:24.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f958f5b5640 1 -- 172.21.15.96:0/3752382310 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94069256486704] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958802f040 con 0x7f95840b6070 2024-09-14T10:44:24.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f95912ae9c0 20 remove_watcher() i=3 2024-09-14T10:44:24.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94069256481584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x558e349d3600 2024-09-14T10:44:24.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94069256481584] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x558e349d3600 2024-09-14T10:44:24.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f95912ae9c0 20 remove_watcher() i=4 2024-09-14T10:44:24.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.744+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94069256494320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a077b0 con 0x7f9588019040 2024-09-14T10:44:24.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.748+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94069256494320] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.748+0000 7f95912ae9c0 20 remove_watcher() i=5 2024-09-14T10:44:24.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.748+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94069256496256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a0ac90 con 0x7f9588019040 2024-09-14T10:44:24.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.748+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94069256496256] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.748+0000 7f95912ae9c0 20 remove_watcher() i=6 2024-09-14T10:44:24.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.748+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94069256498112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e34a077b0 con 0x7f9588019040 2024-09-14T10:44:24.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94069256498112] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9580008030 con 0x7f9588019040 2024-09-14T10:44:24.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 20 remove_watcher() i=7 2024-09-14T10:44:24.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9588019040 msgr2=0x7f9588019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f9588019040 0x7f9588019930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e349d3600 msgr2=0x558e349d5a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e349d3600 0x558e349d5a70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f95840b6070 msgr2=0x7f95840c2aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f95840b6070 0x7f95840c2aa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e349d9680 msgr2=0x558e349dba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558e349d9680 0x558e349dba90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f945803a1a0 msgr2=0x7f945803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f945803a1a0 0x7f945803c660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f958800f010 tx=0x7f958801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 msgr2=0x558e349c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f958edb4640 1 -- 172.21.15.96:0/3752382310 reap_dead start 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c80c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f95840edba0 tx=0x7f95840ebbb0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 shutdown_connections 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/3752382310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e349c0b70 0x558e349c80c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 >> 172.21.15.96:0/3752382310 conn(0x558e349bcfa0 msgr2=0x558e349bb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 shutdown_connections 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/3752382310 wait complete. 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2487204591 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f946803a140 msgr2=0x7f946803c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/2487204591 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f946803a140 0x7f946803c600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f958800e3f0 tx=0x7f9588003070 comp rx=0 tx=0).stop 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2487204591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3481e3d0 msgr2=0x558e349b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/2487204591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3481e3d0 0x558e349b6f60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f958401b5d0 tx=0x7f9584017e00 comp rx=0 tx=0).stop 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2487204591 shutdown_connections 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/2487204591 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f946803a140 0x7f946803c600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/2487204591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3481e3d0 0x558e349b6f60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2487204591 >> 172.21.15.96:0/2487204591 conn(0x558e349a8b70 msgr2=0x558e349a8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2487204591 shutdown_connections 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/2487204591 wait complete. 2024-09-14T10:44:24.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e348ad030 msgr2=0x558e349a2b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e348ad030 0x558e349a2b50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f947403a150 msgr2=0x7f947403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f947403a150 0x7f947403c610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95840ac000 tx=0x7f95840a5000 comp rx=0 tx=0).stop 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 msgr2=0x558e3499b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e3499b9e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x558e349950a0 tx=0x7f95800040f0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 shutdown_connections 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558e348ad030 0x558e349a2b50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f947403a150 0x7f947403c610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 --2- 172.21.15.96:0/4197915724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e348a8e40 0x558e3499b9e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 >> 172.21.15.96:0/4197915724 conn(0x558e348a4960 msgr2=0x558e34995530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 shutdown_connections 2024-09-14T10:44:24.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.752+0000 7f95912ae9c0 1 -- 172.21.15.96:0/4197915724 wait complete. 2024-09-14T10:44:24.764 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[],"summary":[]} 2024-09-14T10:44:24.764 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-14T10:44:24.764 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:44:24.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:44:24.765 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:44:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f86158779c0 1 Processor -- start 2024-09-14T10:44:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f86158779c0 1 -- start start 2024-09-14T10:44:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f86158779c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56349667a800 0x5634966793d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f86158779c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634965ac7a0 con 0x56349667a2d0 2024-09-14T10:44:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f86158779c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5634966081b0 con 0x56349667a800 2024-09-14T10:44:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f8612b7c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56349667a800 0x5634966793d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f8612b7c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56349667a800 0x5634966793d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38440/0 (socket says 172.21.15.96:38440) 2024-09-14T10:44:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f861337d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x56349667a2d0 0x563496678cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34202/0 (socket says 172.21.15.96:34202) 2024-09-14T10:44:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f8612b7c640 1 -- 172.21.15.96:0/767344206 learned_addr learned my addr 172.21.15.96:0/767344206 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f8612b7c640 1 -- 172.21.15.96:0/767344206 >> v1:172.21.15.70:6789/0 conn(0x56349667a2d0 legacy=0x563496678cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.848+0000 7f8612b7c640 1 -- 172.21.15.96:0/767344206 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563496586da0 con 0x56349667a800 2024-09-14T10:44:24.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f8612b7c640 1 --2- 172.21.15.96:0/767344206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a800 0x5634966793d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00a5c0 tx=0x7f85fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b903f6aa8272864 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f861237b640 1 -- 172.21.15.96:0/767344206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0b0070 con 0x56349667a800 2024-09-14T10:44:24.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f861237b640 1 -- 172.21.15.96:0/767344206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0ab540 con 0x56349667a800 2024-09-14T10:44:24.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f861237b640 1 -- 172.21.15.96:0/767344206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0ab840 con 0x56349667a800 2024-09-14T10:44:24.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f86158779c0 1 -- 172.21.15.96:0/767344206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a800 msgr2=0x5634966793d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f86158779c0 1 --2- 172.21.15.96:0/767344206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a800 0x5634966793d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00a5c0 tx=0x7f85fc01b280 comp rx=0 tx=0).stop 2024-09-14T10:44:24.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f86158779c0 1 -- 172.21.15.96:0/767344206 shutdown_connections 2024-09-14T10:44:24.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f86158779c0 1 --2- 172.21.15.96:0/767344206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a800 0x5634966793d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f86158779c0 1 -- 172.21.15.96:0/767344206 >> 172.21.15.96:0/767344206 conn(0x5634966ffaf0 msgr2=0x563496701f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f86158779c0 1 -- 172.21.15.96:0/767344206 shutdown_connections 2024-09-14T10:44:24.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.852+0000 7f86158779c0 1 -- 172.21.15.96:0/767344206 wait complete. 2024-09-14T10:44:24.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.868+0000 7f86158779c0 1 Processor -- start 2024-09-14T10:44:24.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.868+0000 7f86158779c0 1 -- start start 2024-09-14T10:44:24.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.868+0000 7f86158779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.868+0000 7f86158779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56349660bfc0 con 0x56349667a2d0 2024-09-14T10:44:24.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.868+0000 7f861337d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.868+0000 7f861337d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38450/0 (socket says 172.21.15.96:38450) 2024-09-14T10:44:24.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.868+0000 7f861337d640 1 -- 172.21.15.96:0/3107799925 learned_addr learned my addr 172.21.15.96:0/3107799925 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f861337d640 1 -- 172.21.15.96:0/3107799925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634967f1f00 con 0x56349667a2d0 2024-09-14T10:44:24.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f861337d640 1 --2- 172.21.15.96:0/3107799925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f1910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f86040016f0 tx=0x7f8604001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d602390b0326cb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f850160a640 1 -- 172.21.15.96:0/3107799925 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8604003460 con 0x56349667a2d0 2024-09-14T10:44:24.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f850160a640 1 -- 172.21.15.96:0/3107799925 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8604003620 con 0x56349667a2d0 2024-09-14T10:44:24.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f850160a640 1 -- 172.21.15.96:0/3107799925 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8604003940 con 0x56349667a2d0 2024-09-14T10:44:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 -- 172.21.15.96:0/3107799925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 msgr2=0x5634967f1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 --2- 172.21.15.96:0/3107799925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f1910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f86040016f0 tx=0x7f8604001bb0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 -- 172.21.15.96:0/3107799925 shutdown_connections 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 --2- 172.21.15.96:0/3107799925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f1910 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 -- 172.21.15.96:0/3107799925 >> 172.21.15.96:0/3107799925 conn(0x5634966ffaf0 msgr2=0x5634967ed520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 -- 172.21.15.96:0/3107799925 shutdown_connections 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 -- 172.21.15.96:0/3107799925 wait complete. 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 Processor -- start 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 -- start start 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f86158779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5634965ada50 con 0x56349667a2d0 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f861337d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f861337d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38454/0 (socket says 172.21.15.96:38454) 2024-09-14T10:44:24.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f861337d640 1 -- 172.21.15.96:0/768987802 learned_addr learned my addr 172.21.15.96:0/768987802 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f861337d640 1 -- 172.21.15.96:0/768987802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634967f96d0 con 0x56349667a2d0 2024-09-14T10:44:24.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.872+0000 7f861337d640 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f9170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5634967f28d0 tx=0x7f8604001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f84ffe07640 1 -- 172.21.15.96:0/768987802 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8604022020 con 0x56349667a2d0 2024-09-14T10:44:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634967f9960 con 0x56349667a2d0 2024-09-14T10:44:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f84ffe07640 1 -- 172.21.15.96:0/768987802 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f860401e480 con 0x56349667a2d0 2024-09-14T10:44:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f84ffe07640 1 -- 172.21.15.96:0/768987802 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f860401e780 con 0x56349667a2d0 2024-09-14T10:44:24.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634967fa390 con 0x56349667a2d0 2024-09-14T10:44:24.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f84ffe07640 1 -- 172.21.15.96:0/768987802 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f8604025020 con 0x56349667a2d0 2024-09-14T10:44:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f84ffe07640 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84f803a150 0x7f84f803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f84ffe07640 1 -- 172.21.15.96:0/768987802 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8604050a70 con 0x56349667a2d0 2024-09-14T10:44:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f8612b7c640 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84f803a150 0x7f84f803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f86158779c0 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349667a800 0x5634968002e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496800820 con 0x56349667a800 2024-09-14T10:44:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f8613b7e640 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349667a800 0x5634968002e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f8612b7c640 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84f803a150 0x7f84f803c610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0ad000 tx=0x7f85fc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f8613b7e640 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349667a800 0x5634968002e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f8613b7e640 1 -- 172.21.15.96:0/768987802 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f860c0083f0 con 0x56349667a800 2024-09-14T10:44:24.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634967fa770 con 0x56349667a800 2024-09-14T10:44:24.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f8613b7e640 1 -- 172.21.15.96:0/768987802 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f860c0083f0 con 0x56349667a800 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634968025b0 con 0x56349667a800 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f8613b7e640 1 -- 172.21.15.96:0/768987802 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f860c0083f0 con 0x56349667a800 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.876+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634968017e0 con 0x56349667a800 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f8613b7e640 1 -- 172.21.15.96:0/768987802 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f860c0083f0 con 0x56349667a800 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496801c00 con 0x56349667a800 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f8613b7e640 1 -- 172.21.15.96:0/768987802 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f860c0083f0 con 0x56349667a800 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f86158779c0 1 Processor -- start 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f86158779c0 1 -- start start 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f86158779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634968109a0 0x563496810dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f86158779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563496618d80 con 0x5634968109a0 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f8612b7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634968109a0 0x563496810dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f8612b7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634968109a0 0x563496810dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38460/0 (socket says 172.21.15.96:38460) 2024-09-14T10:44:24.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f8612b7c640 1 -- 172.21.15.96:0/2825628727 learned_addr learned my addr 172.21.15.96:0/2825628727 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f8612b7c640 1 -- 172.21.15.96:0/2825628727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563496811400 con 0x5634968109a0 2024-09-14T10:44:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f8612b7c640 1 --2- 172.21.15.96:0/2825628727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634968109a0 0x563496810dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f85fc000c10 tx=0x7f85fc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f84fd602640 1 -- 172.21.15.96:0/2825628727 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0b0040 con 0x5634968109a0 2024-09-14T10:44:24.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f86158779c0 1 -- 172.21.15.96:0/2825628727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563496811c60 con 0x5634968109a0 2024-09-14T10:44:24.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f84fd602640 1 -- 172.21.15.96:0/2825628727 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0c6070 con 0x5634968109a0 2024-09-14T10:44:24.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f84fd602640 1 -- 172.21.15.96:0/2825628727 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0abdc0 con 0x5634968109a0 2024-09-14T10:44:24.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.880+0000 7f86158779c0 1 -- 172.21.15.96:0/2825628727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563496812170 con 0x5634968109a0 2024-09-14T10:44:24.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f84fd602640 1 -- 172.21.15.96:0/2825628727 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f85fc0cb460 con 0x5634968109a0 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f84fd602640 1 --2- 172.21.15.96:0/2825628727 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84ec03a1a0 0x7f84ec03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f84fd602640 1 -- 172.21.15.96:0/2825628727 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85fc0a8070 con 0x5634968109a0 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f8613b7e640 1 --2- 172.21.15.96:0/2825628727 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84ec03a1a0 0x7f84ec03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 Processor -- start 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- start start 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f8613b7e640 1 --2- 172.21.15.96:0/2825628727 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84ec03a1a0 0x7f84ec03c660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x563496801b80 tx=0x7f860c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x56349681e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5634967f22d0 con 0x56349681e250 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f8612b7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x56349681e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f8612b7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x56349681e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38462/0 (socket says 172.21.15.96:38462) 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f8612b7c640 1 -- 172.21.15.96:0/2913529819 learned_addr learned my addr 172.21.15.96:0/2913529819 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f8612b7c640 1 -- 172.21.15.96:0/2913529819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349681ec20 con 0x56349681e250 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f8612b7c640 1 --2- 172.21.15.96:0/2913529819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x56349681e630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0ebe70 tx=0x7f85fc0cbb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb77f3ab3296af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f84f6ffd640 1 -- 172.21.15.96:0/2913529819 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc006e30 con 0x56349681e250 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f84f6ffd640 1 -- 172.21.15.96:0/2913529819 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0b6680 con 0x56349681e250 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f84f6ffd640 1 -- 172.21.15.96:0/2913529819 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0aabf0 con 0x56349681e250 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- 172.21.15.96:0/2913529819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 msgr2=0x56349681e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 --2- 172.21.15.96:0/2913529819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x56349681e630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0ebe70 tx=0x7f85fc0cbb20 comp rx=0 tx=0).stop 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- 172.21.15.96:0/2913529819 shutdown_connections 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 --2- 172.21.15.96:0/2913529819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x56349681e630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- 172.21.15.96:0/2913529819 >> 172.21.15.96:0/2913529819 conn(0x563496819610 msgr2=0x563496817850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- 172.21.15.96:0/2913529819 shutdown_connections 2024-09-14T10:44:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- 172.21.15.96:0/2913529819 wait complete. 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 Processor -- start 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- start start 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x563496824750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.884+0000 7f86158779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56349681d140 con 0x56349681e250 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f8612b7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x563496824750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f8612b7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x563496824750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38476/0 (socket says 172.21.15.96:38476) 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 learned_addr learned my addr 172.21.15.96:0/883909369 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563496824cb0 con 0x56349681e250 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f8612b7c640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x563496824750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0b7ca0 tx=0x7f85fc0ebdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f84f57fa640 1 -- 172.21.15.96:0/883909369 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0c1d90 con 0x56349681e250 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563496824f40 con 0x56349681e250 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f84f57fa640 1 -- 172.21.15.96:0/883909369 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0db070 con 0x56349681e250 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f84f57fa640 1 -- 172.21.15.96:0/883909369 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0aa4e0 con 0x56349681e250 2024-09-14T10:44:24.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634968258f0 con 0x56349681e250 2024-09-14T10:44:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f84f57fa640 1 -- 172.21.15.96:0/883909369 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f85fc0dd070 con 0x56349681e250 2024-09-14T10:44:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f84f57fa640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84dc03a150 0x7f84dc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f84f57fa640 1 -- 172.21.15.96:0/883909369 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85fc0e2cd0 con 0x56349681e250 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f8613b7e640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84dc03a150 0x7f84dc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349682fcd0 0x563496832160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634968328b0 con 0x56349682fcd0 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f861337d640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349682fcd0 0x563496832160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f8613b7e640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84dc03a150 0x7f84dc03c610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f860c00f010 tx=0x7f860c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.888+0000 7f861337d640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349682fcd0 0x563496832160 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 realm 2024-09-14T10:44:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496832cc0 con 0x56349682fcd0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496833590 con 0x56349682fcd0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496833930 con 0x56349682fcd0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496833dd0 con 0x56349682fcd0 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 20 searching for the correct realm 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x563496835dd0 0x5634968381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8612b7c640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x563496835dd0 0x5634968381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8612b7c640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x563496835dd0 0x5634968381c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8612b7c640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f85fc0ab030 0x7f85fc0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f85fc0ab030 2024-09-14T10:44:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8613b7e640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f85fc0ab030 0x7f85fc0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8613b7e640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f85fc0ab030 0x7f85fc0cda20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8613b7e640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f860c019040 0x7f860c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f861337d640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f860c019040 0x7f860c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.892+0000 7f861337d640 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f860c019040 0x7f860c019930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x7f860c019040 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x56349682fcd0 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x56349682fcd0 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x7f860c019040 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x7f860c019040 2024-09-14T10:44:24.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f85fc0ab030 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x56349682fcd0 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x7f860c019040 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x56349682fcd0 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.896+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f85fc0ab030 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x7f860c019040 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x56349682fcd0 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x56349682fcd0 2024-09-14T10:44:24.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860401b040 con 0x7f860c019040 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f85fc0ab030 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.900+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x56349682fcd0 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f860401b040 con 0x56349682fcd0 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f85fc0ab030 2024-09-14T10:44:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x563496835dd0 2024-09-14T10:44:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f860c019040 2024-09-14T10:44:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x56349682fcd0 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563496838870 con 0x7f85fc0ab030 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496834870 con 0x56349682fcd0 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.904+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496835110 con 0x56349682fcd0 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5634968344b0 con 0x56349682fcd0 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 zone default found 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 4 Realm: () 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:24.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 zonegroup default 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496838cf0 con 0x7f860c019040 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349683ab90 con 0x563496835dd0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349683af30 con 0x563496835dd0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 started sync module instance, tier type = 2024-09-14T10:44:24.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:24.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563496839fd0 con 0x7f85fc0ab030 2024-09-14T10:44:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94783863497712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683b780 con 0x7f85fc0ab030 2024-09-14T10:44:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.908+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683bfd0 con 0x56349682fcd0 2024-09-14T10:44:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.912+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.912+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94783863502720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683c110 con 0x56349682fcd0 2024-09-14T10:44:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.912+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683cc30 con 0x563496835dd0 2024-09-14T10:44:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.912+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94783863497712] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.912+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94783863502720] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.916+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.916+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94783863503776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683b2d0 con 0x563496835dd0 2024-09-14T10:44:24.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.916+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683d4d0 con 0x7f85fc0ab030 2024-09-14T10:44:24.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.916+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.916+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94783863509296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683dbc0 con 0x7f85fc0ab030 2024-09-14T10:44:24.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.916+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683e6c0 con 0x56349682fcd0 2024-09-14T10:44:24.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.916+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94783863503776] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.916+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.920+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94783863513520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683e680 con 0x56349682fcd0 2024-09-14T10:44:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.920+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683f100 con 0x7f860c019040 2024-09-14T10:44:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.920+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94783863509296] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.920+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94783863513520] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.920+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.920+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94783863506688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683ec50 con 0x7f860c019040 2024-09-14T10:44:24.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.920+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683f4a0 con 0x7f860c019040 2024-09-14T10:44:24.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94783863506688] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94783863516240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683f520 con 0x7f860c019040 2024-09-14T10:44:24.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683fdd0 con 0x7f860c019040 2024-09-14T10:44:24.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94783863516240] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94783863517296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349683ffb0 con 0x7f860c019040 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f86158779c0 20 add_watcher() i=0 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f86158779c0 20 add_watcher() i=1 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f86158779c0 20 add_watcher() i=2 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.924+0000 7f86158779c0 20 add_watcher() i=3 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f86158779c0 20 add_watcher() i=4 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f86158779c0 20 add_watcher() i=5 2024-09-14T10:44:24.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f86158779c0 20 add_watcher() i=6 2024-09-14T10:44:24.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94783863517296] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f86158779c0 20 add_watcher() i=7 2024-09-14T10:44:24.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f86158779c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:24.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496843380 con 0x56349682fcd0 2024-09-14T10:44:24.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94783863520928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563496840770 con 0x56349682fcd0 2024-09-14T10:44:24.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94783863520928] v32'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.928+0000 7f84c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:24.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:24.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:24.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 5 note: GC not initialized 2024-09-14T10:44:24.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f84c8fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:24.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:24.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 20 Filter name: none 2024-09-14T10:44:24.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f84427fc640 20 reqs_thread_entry: start 2024-09-14T10:44:24.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:24.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563496866550 con 0x56349682fcd0 2024-09-14T10:44:24.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:24.930 INFO:teuthology.orchestra.run.smithi096.stderr:could not fetch user info: no user info saved 2024-09-14T10:44:24.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f84c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:24.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94783863520928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563496866510 con 0x56349682fcd0 2024-09-14T10:44:24.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94783863520928] v32'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.932+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94783863497712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563496866510 con 0x7f85fc0ab030 2024-09-14T10:44:24.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.936+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94783863497712] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.936+0000 7f86158779c0 20 remove_watcher() i=0 2024-09-14T10:44:24.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.936+0000 7f86158779c0 2 removed watcher, disabling cache 2024-09-14T10:44:24.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.936+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94783863502720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563496866510 con 0x56349682fcd0 2024-09-14T10:44:24.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.936+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94783863502720] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.936+0000 7f86158779c0 20 remove_watcher() i=1 2024-09-14T10:44:24.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.936+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94783863503776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563496866510 con 0x563496835dd0 2024-09-14T10:44:24.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.940+0000 7f8612b7c640 1 -- 172.21.15.96:0/883909369 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94783863503776] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85fc0b3040 con 0x563496835dd0 2024-09-14T10:44:24.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.940+0000 7f86158779c0 20 remove_watcher() i=2 2024-09-14T10:44:24.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.940+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94783863509296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634968641b0 con 0x7f85fc0ab030 2024-09-14T10:44:24.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.940+0000 7f8613b7e640 1 -- 172.21.15.96:0/883909369 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94783863509296] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f860c02f040 con 0x7f85fc0ab030 2024-09-14T10:44:24.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.940+0000 7f86158779c0 20 remove_watcher() i=3 2024-09-14T10:44:24.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.940+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94783863513520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634968641b0 con 0x56349682fcd0 2024-09-14T10:44:24.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.944+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94783863513520] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x56349682fcd0 2024-09-14T10:44:24.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.944+0000 7f86158779c0 20 remove_watcher() i=4 2024-09-14T10:44:24.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.944+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94783863506688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634968641b0 con 0x7f860c019040 2024-09-14T10:44:24.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.944+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94783863506688] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.944+0000 7f86158779c0 20 remove_watcher() i=5 2024-09-14T10:44:24.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.944+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94783863516240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634968641b0 con 0x7f860c019040 2024-09-14T10:44:24.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94783863516240] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 20 remove_watcher() i=6 2024-09-14T10:44:24.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94783863517296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5634968641b0 con 0x7f860c019040 2024-09-14T10:44:24.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94783863517296] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8604058040 con 0x7f860c019040 2024-09-14T10:44:24.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 20 remove_watcher() i=7 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f860c019040 msgr2=0x7f860c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f860c019040 0x7f860c019930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349682fcd0 msgr2=0x563496832160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349682fcd0 0x563496832160 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f85fc0ab030 msgr2=0x7f85fc0cda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f85fc0ab030 0x7f85fc0cda20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x563496835dd0 msgr2=0x5634968381c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x563496835dd0 0x5634968381c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84dc03a150 msgr2=0x7f84dc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84dc03a150 0x7f84dc03c610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f860c00f010 tx=0x7f860c01b070 comp rx=0 tx=0).stop 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 msgr2=0x563496824750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x563496824750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0b7ca0 tx=0x7f85fc0ebdd0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f861337d640 1 -- 172.21.15.96:0/883909369 reap_dead start 2024-09-14T10:44:24.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 shutdown_connections 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/883909369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349681e250 0x563496824750 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 >> 172.21.15.96:0/883909369 conn(0x563496819610 msgr2=0x563496817820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 shutdown_connections 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/883909369 wait complete. 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/2825628727 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84ec03a1a0 msgr2=0x7f84ec03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/2825628727 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84ec03a1a0 0x7f84ec03c660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x563496801b80 tx=0x7f860c003070 comp rx=0 tx=0).stop 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/2825628727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634968109a0 msgr2=0x563496810dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/2825628727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634968109a0 0x563496810dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f85fc000c10 tx=0x7f85fc018020 comp rx=0 tx=0).stop 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/2825628727 shutdown_connections 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/2825628727 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84ec03a1a0 0x7f84ec03c660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 --2- 172.21.15.96:0/2825628727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634968109a0 0x563496810dc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/2825628727 >> 172.21.15.96:0/2825628727 conn(0x563496806350 msgr2=0x563496806730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/2825628727 shutdown_connections 2024-09-14T10:44:24.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.948+0000 7f86158779c0 1 -- 172.21.15.96:0/2825628727 wait complete. 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349667a800 msgr2=0x5634968002e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349667a800 0x5634968002e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84f803a150 msgr2=0x7f84f803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84f803a150 0x7f84f803c610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0ad000 tx=0x7f85fc0a5040 comp rx=0 tx=0).stop 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 msgr2=0x5634967f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f9170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x5634967f28d0 tx=0x7f8604001260 comp rx=0 tx=0).stop 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 shutdown_connections 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56349667a800 0x5634968002e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f84f803a150 0x7f84f803c610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 --2- 172.21.15.96:0/768987802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56349667a2d0 0x5634967f9170 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 >> 172.21.15.96:0/768987802 conn(0x5634966ffaf0 msgr2=0x5634967f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 shutdown_connections 2024-09-14T10:44:24.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:24.952+0000 7f86158779c0 1 -- 172.21.15.96:0/768987802 wait complete. 2024-09-14T10:44:24.959 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T10:44:24.959 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-14T10:44:24.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-14T10:44:24.960 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-14T10:44:25.048 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:25.048 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:25.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d83e139c0 1 Processor -- start 2024-09-14T10:44:25.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d83e139c0 1 -- start start 2024-09-14T10:44:25.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d83e139c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556db36b51f0 0x556db3746020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d83e139c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556db35e97a0 con 0x556db36b55d0 2024-09-14T10:44:25.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d83e139c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x556db36451b0 con 0x556db36b51f0 2024-09-14T10:44:25.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d81919640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556db36b51f0 0x556db3746020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d81118640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x556db36b55d0 0x556db3748570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34214/0 (socket says 172.21.15.96:34214) 2024-09-14T10:44:25.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d81118640 1 -- 172.21.15.96:0/1335301861 learned_addr learned my addr 172.21.15.96:0/1335301861 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:25.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d81919640 1 -- 172.21.15.96:0/1335301861 >> v1:172.21.15.70:6789/0 conn(0x556db36b55d0 legacy=0x556db3748570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.052+0000 7f6d81919640 1 -- 172.21.15.96:0/1335301861 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db35c3da0 con 0x556db36b51f0 2024-09-14T10:44:25.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d81919640 1 --2- 172.21.15.96:0/1335301861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3746020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00a420 tx=0x7f6d7c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5c418808374de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d80917640 1 -- 172.21.15.96:0/1335301861 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c0af070 con 0x556db36b51f0 2024-09-14T10:44:25.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d80917640 1 -- 172.21.15.96:0/1335301861 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0aa530 con 0x556db36b51f0 2024-09-14T10:44:25.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d80917640 1 -- 172.21.15.96:0/1335301861 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c0aa850 con 0x556db36b51f0 2024-09-14T10:44:25.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1335301861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 msgr2=0x556db3746020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1335301861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3746020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00a420 tx=0x7f6d7c01afd0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1335301861 shutdown_connections 2024-09-14T10:44:25.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1335301861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3746020 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1335301861 >> 172.21.15.96:0/1335301861 conn(0x556db373b910 msgr2=0x556db373dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1335301861 shutdown_connections 2024-09-14T10:44:25.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.056+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1335301861 wait complete. 2024-09-14T10:44:25.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 Processor -- start 2024-09-14T10:44:25.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 -- start start 2024-09-14T10:44:25.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db382e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556db3648fc0 con 0x556db36b51f0 2024-09-14T10:44:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d81919640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db382e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d81919640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db382e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38492/0 (socket says 172.21.15.96:38492) 2024-09-14T10:44:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d81919640 1 -- 172.21.15.96:0/805092793 learned_addr learned my addr 172.21.15.96:0/805092793 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d81919640 1 -- 172.21.15.96:0/805092793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db382ec50 con 0x556db36b51f0 2024-09-14T10:44:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d81919640 1 --2- 172.21.15.96:0/805092793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db382e660 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c018c00 tx=0x7f6d7c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef78c2fc04d94e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6c6fe07640 1 -- 172.21.15.96:0/805092793 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c0af050 con 0x556db36b51f0 2024-09-14T10:44:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6c6fe07640 1 -- 172.21.15.96:0/805092793 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0b0040 con 0x556db36b51f0 2024-09-14T10:44:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6c6fe07640 1 -- 172.21.15.96:0/805092793 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c0aabb0 con 0x556db36b51f0 2024-09-14T10:44:25.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 -- 172.21.15.96:0/805092793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 msgr2=0x556db382e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/805092793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db382e660 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c018c00 tx=0x7f6d7c0033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 -- 172.21.15.96:0/805092793 shutdown_connections 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/805092793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db382e660 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 -- 172.21.15.96:0/805092793 >> 172.21.15.96:0/805092793 conn(0x556db373b910 msgr2=0x556db382a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 -- 172.21.15.96:0/805092793 shutdown_connections 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.072+0000 7f6d83e139c0 1 -- 172.21.15.96:0/805092793 wait complete. 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d83e139c0 1 Processor -- start 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d83e139c0 1 -- start start 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d83e139c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3835d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d83e139c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556db35eaa50 con 0x556db36b51f0 2024-09-14T10:44:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d81919640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3835d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d81919640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3835d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38496/0 (socket says 172.21.15.96:38496) 2024-09-14T10:44:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d81919640 1 -- 172.21.15.96:0/3593147489 learned_addr learned my addr 172.21.15.96:0/3593147489 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d81919640 1 -- 172.21.15.96:0/3593147489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db38362f0 con 0x556db36b51f0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d81919640 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3835d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c019680 tx=0x7f6d7c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6c6e604640 1 -- 172.21.15.96:0/3593147489 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c0c4070 con 0x556db36b51f0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6c6e604640 1 -- 172.21.15.96:0/3593147489 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0b6ce0 con 0x556db36b51f0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556db3836580 con 0x556db36b51f0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6c6e604640 1 -- 172.21.15.96:0/3593147489 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d7c0c0470 con 0x556db36b51f0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db3836f30 con 0x556db36b51f0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.076+0000 7f6c6e604640 1 -- 172.21.15.96:0/3593147489 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6d7c0c7070 con 0x556db36b51f0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6c6e604640 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c6803a1f0 0x7f6c6803c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6c6e604640 1 -- 172.21.15.96:0/3593147489 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6d7c0bb070 con 0x556db36b51f0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d81118640 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c6803a1f0 0x7f6c6803c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db36b55d0 0x556db383cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db383d440 con 0x556db36b55d0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d8211a640 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db36b55d0 0x556db383cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d81118640 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c6803a1f0 0x7f6c6803c6b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c004180 tx=0x7f6d6c001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d8211a640 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db36b55d0 0x556db383cf00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d8211a640 1 -- 172.21.15.96:0/3593147489 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d740083f0 con 0x556db36b55d0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db383d840 con 0x556db36b55d0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d8211a640 1 -- 172.21.15.96:0/3593147489 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d740083f0 con 0x556db36b55d0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db383f140 con 0x556db36b55d0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d8211a640 1 -- 172.21.15.96:0/3593147489 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d740083f0 con 0x556db36b55d0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db383e370 con 0x556db36b55d0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d8211a640 1 -- 172.21.15.96:0/3593147489 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d740083f0 con 0x556db36b55d0 2024-09-14T10:44:25.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db383e7c0 con 0x556db36b55d0 2024-09-14T10:44:25.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d8211a640 1 -- 172.21.15.96:0/3593147489 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d740083f0 con 0x556db36b55d0 2024-09-14T10:44:25.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 Processor -- start 2024-09-14T10:44:25.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 -- start start 2024-09-14T10:44:25.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db384d500 0x556db384d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d83e139c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556db3655d80 con 0x556db384d500 2024-09-14T10:44:25.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d81118640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db384d500 0x556db384d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d81118640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db384d500 0x556db384d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38502/0 (socket says 172.21.15.96:38502) 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.080+0000 7f6d81118640 1 -- 172.21.15.96:0/3153715206 learned_addr learned my addr 172.21.15.96:0/3153715206 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d81118640 1 -- 172.21.15.96:0/3153715206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db384df60 con 0x556db384d500 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d81118640 1 --2- 172.21.15.96:0/3153715206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db384d500 0x556db384d920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00d660 tx=0x7f6d6c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6c677fe640 1 -- 172.21.15.96:0/3153715206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d6c00c6b0 con 0x556db384d500 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3153715206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556db384e7c0 con 0x556db384d500 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6c677fe640 1 -- 172.21.15.96:0/3153715206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6c00c850 con 0x556db384d500 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6c677fe640 1 -- 172.21.15.96:0/3153715206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d6c00cb30 con 0x556db384d500 2024-09-14T10:44:25.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3153715206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db384ed30 con 0x556db384d500 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6c677fe640 1 -- 172.21.15.96:0/3153715206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6d6c023020 con 0x556db384d500 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6c677fe640 1 --2- 172.21.15.96:0/3153715206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c5c03a140 0x7f6c5c03c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6c677fe640 1 -- 172.21.15.96:0/3153715206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6d6c021020 con 0x556db384d500 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d8211a640 1 --2- 172.21.15.96:0/3153715206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c5c03a140 0x7f6c5c03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d83e139c0 1 Processor -- start 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d83e139c0 1 -- start start 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d8211a640 1 --2- 172.21.15.96:0/3153715206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c5c03a140 0x7f6c5c03c600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400e3f0 tx=0x7f6d74003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d83e139c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db385a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d83e139c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556db382efc0 con 0x556db3859e60 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d81118640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db385a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d81118640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db385a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38510/0 (socket says 172.21.15.96:38510) 2024-09-14T10:44:25.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.084+0000 7f6d81118640 1 -- 172.21.15.96:0/684154575 learned_addr learned my addr 172.21.15.96:0/684154575 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d81118640 1 -- 172.21.15.96:0/684154575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db385a810 con 0x556db3859e60 2024-09-14T10:44:25.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d81118640 1 --2- 172.21.15.96:0/684154575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db385a240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c051820 tx=0x7f6d6c044760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcec73499b88228 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6c657fa640 1 -- 172.21.15.96:0/684154575 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d6c00cd20 con 0x556db3859e60 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6c657fa640 1 -- 172.21.15.96:0/684154575 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6c04ae50 con 0x556db3859e60 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6c657fa640 1 -- 172.21.15.96:0/684154575 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d6c01bcc0 con 0x556db3859e60 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- 172.21.15.96:0/684154575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 msgr2=0x556db385a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/684154575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db385a240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c051820 tx=0x7f6d6c044760 comp rx=0 tx=0).stop 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- 172.21.15.96:0/684154575 shutdown_connections 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/684154575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db385a240 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- 172.21.15.96:0/684154575 >> 172.21.15.96:0/684154575 conn(0x556db3856290 msgr2=0x556db38544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- 172.21.15.96:0/684154575 shutdown_connections 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- 172.21.15.96:0/684154575 wait complete. 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 Processor -- start 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- start start 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db38613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556db385ae70 con 0x556db3859e60 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d81118640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db38613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d81118640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db38613f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38516/0 (socket says 172.21.15.96:38516) 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 learned_addr learned my addr 172.21.15.96:0/1160605596 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db3861950 con 0x556db3859e60 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d81118640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db38613f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c023850 tx=0x7f6d6c0517b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6c537fe640 1 -- 172.21.15.96:0/1160605596 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d6c034020 con 0x556db3859e60 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556db3861be0 con 0x556db3859e60 2024-09-14T10:44:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6c537fe640 1 -- 172.21.15.96:0/1160605596 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6c043170 con 0x556db3859e60 2024-09-14T10:44:25.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6c537fe640 1 -- 172.21.15.96:0/1160605596 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d6c043450 con 0x556db3859e60 2024-09-14T10:44:25.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.088+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db3861be0 con 0x556db3859e60 2024-09-14T10:44:25.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6c537fe640 1 -- 172.21.15.96:0/1160605596 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6d6c037020 con 0x556db3859e60 2024-09-14T10:44:25.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6c537fe640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c4c03a150 0x7f6c4c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6c537fe640 1 -- 172.21.15.96:0/1160605596 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6d6c050070 con 0x556db3859e60 2024-09-14T10:44:25.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d8211a640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c4c03a150 0x7f6c4c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db386c770 0x556db386ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db386f380 con 0x556db386c770 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81919640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db386c770 0x556db386ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d8211a640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c4c03a150 0x7f6c4c03c610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400f010 tx=0x7f6d7401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81919640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db386c770 0x556db386ec30 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 realm 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db386f790 con 0x556db386c770 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:25.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db3870060 con 0x556db386c770 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db3870400 con 0x556db386c770 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db3870c50 con 0x556db386c770 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 20 searching for the correct realm 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556db38729c0 0x556db3874db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db38729c0 2024-09-14T10:44:25.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81118640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556db38729c0 0x556db3874db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.092+0000 7f6d81118640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556db38729c0 0x556db3874db0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81118640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6d6c039020 0x7f6d6c054000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d6c039020 2024-09-14T10:44:25.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d8211a640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6d6c039020 0x7f6d6c054000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d8211a640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6d6c039020 0x7f6d6c054000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d8211a640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6d74019040 0x7f6d74019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d74019040 2024-09-14T10:44:25.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6d74019040 0x7f6d74019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6d74019040 0x7f6d74019930 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db386c770 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db386c770 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d74019040 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.096+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d74019040 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d6c039020 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db38729c0 2024-09-14T10:44:25.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db386c770 2024-09-14T10:44:25.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d74019040 2024-09-14T10:44:25.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db386c770 2024-09-14T10:44:25.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d6c039020 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db38729c0 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db38729c0 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d74019040 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db38729c0 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.100+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db38729c0 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db386c770 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db386c770 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d74019040 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db38729c0 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d6c039020 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db386c770 2024-09-14T10:44:25.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d74019040 2024-09-14T10:44:25.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x556db38729c0 2024-09-14T10:44:25.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556db3875340 con 0x7f6d74019040 2024-09-14T10:44:25.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.104+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6d7c0fd040 con 0x7f6d6c039020 2024-09-14T10:44:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6d7c0fd040 con 0x556db38729c0 2024-09-14T10:44:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6d7c0fd040 con 0x7f6d74019040 2024-09-14T10:44:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6d7c0fd040 con 0x556db386c770 2024-09-14T10:44:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6d7c0fd040 con 0x7f6d6c039020 2024-09-14T10:44:25.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:25.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:25.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:25.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:25.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38715a0 con 0x556db386c770 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db3871e40 con 0x556db386c770 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db3871e40 con 0x556db386c770 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 zone default found 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 4 Realm: () 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 zonegroup default 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38757c0 con 0x7f6d74019040 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38772b0 con 0x556db38729c0 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.108+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db3877730 con 0x556db38729c0 2024-09-14T10:44:25.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d83e139c0 20 started sync module instance, tier type = 2024-09-14T10:44:25.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d83e139c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:25.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3876650 con 0x7f6d6c039020 2024-09-14T10:44:25.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93929651792448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3878040 con 0x7f6d6c039020 2024-09-14T10:44:25.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3878890 con 0x556db386c770 2024-09-14T10:44:25.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.112+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93929651792448] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.116+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.116+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93929651796880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38784a0 con 0x556db386c770 2024-09-14T10:44:25.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.116+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3878f80 con 0x556db38729c0 2024-09-14T10:44:25.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.116+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93929651796880] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.116+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.116+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93929651797936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38793a0 con 0x556db38729c0 2024-09-14T10:44:25.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.116+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3879d60 con 0x7f6d6c039020 2024-09-14T10:44:25.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.116+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.120+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93929651804608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387a470 con 0x7f6d6c039020 2024-09-14T10:44:25.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.120+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387af90 con 0x556db386c770 2024-09-14T10:44:25.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.120+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93929651797936] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.120+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.120+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93929651808864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387af50 con 0x556db386c770 2024-09-14T10:44:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.120+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387b9a0 con 0x7f6d74019040 2024-09-14T10:44:25.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.120+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93929651804608] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.120+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93929651808864] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.124+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.124+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93929651800720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387b4f0 con 0x7f6d74019040 2024-09-14T10:44:25.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.124+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387bd40 con 0x7f6d74019040 2024-09-14T10:44:25.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.124+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93929651800720] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.124+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.124+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93929651811568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387bdc0 con 0x7f6d74019040 2024-09-14T10:44:25.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.124+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387c780 con 0x7f6d74019040 2024-09-14T10:44:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93929651811568] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93929651812896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387c780 con 0x7f6d74019040 2024-09-14T10:44:25.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 20 add_watcher() i=0 2024-09-14T10:44:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 20 add_watcher() i=1 2024-09-14T10:44:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 20 add_watcher() i=2 2024-09-14T10:44:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 20 add_watcher() i=3 2024-09-14T10:44:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 20 add_watcher() i=4 2024-09-14T10:44:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 20 add_watcher() i=5 2024-09-14T10:44:25.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 20 add_watcher() i=6 2024-09-14T10:44:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93929651812896] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 20 add_watcher() i=7 2024-09-14T10:44:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:25.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db387fa60 con 0x556db386c770 2024-09-14T10:44:25.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.128+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93929651815488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db387cd10 con 0x556db386c770 2024-09-14T10:44:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93929651815488] v32'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6c337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 5 note: GC not initialized 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6c327fc640 20 reqs_thread_entry: start 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 Filter name: none 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6ba3fff640 20 reqs_thread_entry: start 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38a3390 con 0x556db386c770 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38a18d0 con 0x556db386c770 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38a18d0 con 0x7f6d74019040 2024-09-14T10:44:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-14T10:44:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-14T10:44:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-14T10:44:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-14T10:44:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.132+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38a6930 con 0x556db386c770 2024-09-14T10:44:25.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 93929651970880 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38a70a0 con 0x556db386c770 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify (1) cookie 93929651808864 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x556db38a1ee0 con 0x556db386c770 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 notify.4 [notify cookie 93929651970880 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6c64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 93929651808864 notifier 4291 bl.length()=567 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6c64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6c64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6c64ff9640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6bac003440 con 0x556db386c770 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== watch-notify(notify_complete (2) cookie 93929651970880 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d7c0dd040 con 0x556db386c770 2024-09-14T10:44:25.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38a2310 con 0x556db386c770 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.136+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 93929651970832 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38a6f80 con 0x7f6d6c039020 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== watch-notify(notify (1) cookie 93929651804608 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f6d74010040 con 0x7f6d6c039020 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6c64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 93929651804608 notifier 4291 bl.length()=169 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6c64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6c64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-14T10:44:25.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(69 notify.3 [notify cookie 93929651970832 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6c64ff9640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6bac003480 con 0x7f6d6c039020 2024-09-14T10:44:25.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== watch-notify(notify_complete (2) cookie 93929651970832 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d74026930 con 0x7f6d6c039020 2024-09-14T10:44:25.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38a2310 con 0x7f6d74019040 2024-09-14T10:44:25.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d83e139c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d83e139c0 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d83e139c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 93929651989040 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556db38a74d0 con 0x7f6d6c039020 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== watch-notify(notify (1) cookie 93929651804608 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f6d74026930 con 0x7f6d6c039020 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6c64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 93929651804608 notifier 4291 bl.length()=177 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6c64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6c64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6c64ff9640 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6bac002fc0 con 0x7f6d6c039020 2024-09-14T10:44:25.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.140+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(72 notify.3 [notify cookie 93929651989040 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.144+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.144+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== watch-notify(notify_complete (2) cookie 93929651989040 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d74026c40 con 0x7f6d6c039020 2024-09-14T10:44:25.141 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:25.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.144+0000 7f6c337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.144+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93929651815488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38a0f00 con 0x556db386c770 2024-09-14T10:44:25.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.144+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 93929651815488] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.144+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93929651792448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38a0f00 con 0x7f6d6c039020 2024-09-14T10:44:25.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.148+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 93929651792448] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.148+0000 7f6d83e139c0 20 remove_watcher() i=0 2024-09-14T10:44:25.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.148+0000 7f6d83e139c0 2 removed watcher, disabling cache 2024-09-14T10:44:25.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.148+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93929651796880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38a0f00 con 0x556db386c770 2024-09-14T10:44:25.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.148+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 93929651796880] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.148+0000 7f6d83e139c0 20 remove_watcher() i=1 2024-09-14T10:44:25.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.148+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93929651797936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db38a0f00 con 0x556db38729c0 2024-09-14T10:44:25.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d81118640 1 -- 172.21.15.96:0/1160605596 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 93929651797936] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d6c044d70 con 0x556db38729c0 2024-09-14T10:44:25.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d83e139c0 20 remove_watcher() i=2 2024-09-14T10:44:25.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93929651804608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3878040 con 0x7f6d6c039020 2024-09-14T10:44:25.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d8211a640 1 -- 172.21.15.96:0/1160605596 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 93929651804608] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7402f040 con 0x7f6d6c039020 2024-09-14T10:44:25.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d83e139c0 20 remove_watcher() i=3 2024-09-14T10:44:25.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93929651808864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3878040 con 0x556db386c770 2024-09-14T10:44:25.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 93929651808864] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x556db386c770 2024-09-14T10:44:25.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d83e139c0 20 remove_watcher() i=4 2024-09-14T10:44:25.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.152+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93929651800720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3878040 con 0x7f6d74019040 2024-09-14T10:44:25.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.156+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 93929651800720] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.156+0000 7f6d83e139c0 20 remove_watcher() i=5 2024-09-14T10:44:25.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.156+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93929651811568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3878040 con 0x7f6d74019040 2024-09-14T10:44:25.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.156+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 93929651811568] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.156+0000 7f6d83e139c0 20 remove_watcher() i=6 2024-09-14T10:44:25.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.156+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93929651812896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556db3876a40 con 0x7f6d74019040 2024-09-14T10:44:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 93929651812896] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d7c0d0070 con 0x7f6d74019040 2024-09-14T10:44:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 20 remove_watcher() i=7 2024-09-14T10:44:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6d74019040 msgr2=0x7f6d74019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6d74019040 0x7f6d74019930 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db386c770 msgr2=0x556db386ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db386c770 0x556db386ec30 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6d6c039020 msgr2=0x7f6d6c054000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6d6c039020 0x7f6d6c054000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556db38729c0 msgr2=0x556db3874db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556db38729c0 0x556db3874db0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c4c03a150 msgr2=0x7f6c4c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c4c03a150 0x7f6c4c03c610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400f010 tx=0x7f6d7401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 msgr2=0x556db38613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d81919640 1 -- 172.21.15.96:0/1160605596 reap_dead start 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db38613f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c023850 tx=0x7f6d6c0517b0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 shutdown_connections 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/1160605596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db3859e60 0x556db38613f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 >> 172.21.15.96:0/1160605596 conn(0x556db3856290 msgr2=0x556db38544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 shutdown_connections 2024-09-14T10:44:25.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/1160605596 wait complete. 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3153715206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c5c03a140 msgr2=0x7f6c5c03c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3153715206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c5c03a140 0x7f6c5c03c600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400e3f0 tx=0x7f6d74003070 comp rx=0 tx=0).stop 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3153715206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db384d500 msgr2=0x556db384d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3153715206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db384d500 0x556db384d920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00d660 tx=0x7f6d6c00da60 comp rx=0 tx=0).stop 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3153715206 shutdown_connections 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3153715206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c5c03a140 0x7f6c5c03c600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3153715206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db384d500 0x556db384d920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3153715206 >> 172.21.15.96:0/3153715206 conn(0x556db3842eb0 msgr2=0x556db3843290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3153715206 shutdown_connections 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3153715206 wait complete. 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db36b55d0 msgr2=0x556db383cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db36b55d0 0x556db383cf00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c6803a1f0 msgr2=0x7f6c6803c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c6803a1f0 0x7f6c6803c6b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c004180 tx=0x7f6d6c001340 comp rx=0 tx=0).stop 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 msgr2=0x556db3835d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3835d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c019680 tx=0x7f6d7c017d70 comp rx=0 tx=0).stop 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 shutdown_connections 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556db36b55d0 0x556db383cf00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6c6803a1f0 0x7f6c6803c6b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 --2- 172.21.15.96:0/3593147489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db36b51f0 0x556db3835d90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 >> 172.21.15.96:0/3593147489 conn(0x556db373b910 msgr2=0x556db382fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 shutdown_connections 2024-09-14T10:44:25.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.160+0000 7f6d83e139c0 1 -- 172.21.15.96:0/3593147489 wait complete. 2024-09-14T10:44:25.169 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:25.169 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-14T10:44:25.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-14T10:44:25.170 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-14T10:44:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c5add9c0 1 Processor -- start 2024-09-14T10:44:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c5add9c0 1 -- start start 2024-09-14T10:44:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c5add9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f13d7631f0 0x55f13d7f4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c5add9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f13d6977a0 con 0x55f13d7635d0 2024-09-14T10:44:25.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c5add9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55f13d6f31b0 con 0x55f13d7631f0 2024-09-14T10:44:25.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c35e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f13d7631f0 0x55f13d7f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c35e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f13d7631f0 0x55f13d7f4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38522/0 (socket says 172.21.15.96:38522) 2024-09-14T10:44:25.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2216527428 learned_addr learned my addr 172.21.15.96:0/2216527428 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c2de2640 1 --1- 172.21.15.96:0/2216527428 >> v1:172.21.15.70:6789/0 conn(0x55f13d7635d0 0x55f13d7f6570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34224/0 (socket says 172.21.15.96:34224) 2024-09-14T10:44:25.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2216527428 >> v1:172.21.15.70:6789/0 conn(0x55f13d7635d0 legacy=0x55f13d7f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.208+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2216527428 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13d671da0 con 0x55f13d7631f0 2024-09-14T10:44:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c35e3640 1 --2- 172.21.15.96:0/2216527428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d7f4020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00a5c0 tx=0x7ff0ac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7e0ca99cedc7be server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c25e1640 1 -- 172.21.15.96:0/2216527428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac0a6070 con 0x55f13d7631f0 2024-09-14T10:44:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c25e1640 1 -- 172.21.15.96:0/2216527428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0af070 con 0x55f13d7631f0 2024-09-14T10:44:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c25e1640 1 -- 172.21.15.96:0/2216527428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac0aa5c0 con 0x55f13d7631f0 2024-09-14T10:44:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2216527428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 msgr2=0x55f13d7f4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2216527428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d7f4020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00a5c0 tx=0x7ff0ac01b340 comp rx=0 tx=0).stop 2024-09-14T10:44:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2216527428 shutdown_connections 2024-09-14T10:44:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2216527428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d7f4020 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2216527428 >> 172.21.15.96:0/2216527428 conn(0x55f13d7e9910 msgr2=0x55f13d7ebd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2216527428 shutdown_connections 2024-09-14T10:44:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.212+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2216527428 wait complete. 2024-09-14T10:44:25.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c5add9c0 1 Processor -- start 2024-09-14T10:44:25.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c5add9c0 1 -- start start 2024-09-14T10:44:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c5add9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d8dc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c5add9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f13d6f6fc0 con 0x55f13d7631f0 2024-09-14T10:44:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c35e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d8dc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c35e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d8dc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38524/0 (socket says 172.21.15.96:38524) 2024-09-14T10:44:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c35e3640 1 -- 172.21.15.96:0/212238095 learned_addr learned my addr 172.21.15.96:0/212238095 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c35e3640 1 -- 172.21.15.96:0/212238095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13d8dcbd0 con 0x55f13d7631f0 2024-09-14T10:44:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7ff0c35e3640 1 --2- 172.21.15.96:0/212238095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d8dc5e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0ac040 tx=0x7ff0ac003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82407820a4571d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7fefb160a640 1 -- 172.21.15.96:0/212238095 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac0aa970 con 0x55f13d7631f0 2024-09-14T10:44:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7fefb160a640 1 -- 172.21.15.96:0/212238095 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0aab10 con 0x55f13d7631f0 2024-09-14T10:44:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.228+0000 7fefb160a640 1 -- 172.21.15.96:0/212238095 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac0aae30 con 0x55f13d7631f0 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/212238095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 msgr2=0x55f13d8dc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/212238095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d8dc5e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0ac040 tx=0x7ff0ac003030 comp rx=0 tx=0).stop 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/212238095 shutdown_connections 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/212238095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7631f0 0x55f13d8dc5e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/212238095 >> 172.21.15.96:0/212238095 conn(0x55f13d7e9910 msgr2=0x55f13d8d81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/212238095 shutdown_connections 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/212238095 wait complete. 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 Processor -- start 2024-09-14T10:44:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- start start 2024-09-14T10:44:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7635d0 0x55f13d8e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f13d698a50 con 0x55f13d7635d0 2024-09-14T10:44:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c35e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7635d0 0x55f13d8e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c35e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7635d0 0x55f13d8e40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38540/0 (socket says 172.21.15.96:38540) 2024-09-14T10:44:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c35e3640 1 -- 172.21.15.96:0/3384564293 learned_addr learned my addr 172.21.15.96:0/3384564293 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c35e3640 1 -- 172.21.15.96:0/3384564293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13d8e4650 con 0x55f13d7635d0 2024-09-14T10:44:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c35e3640 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7635d0 0x55f13d8e40f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac096f40 tx=0x7ff0ac0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7fefafe07640 1 -- 172.21.15.96:0/3384564293 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac0cb020 con 0x55f13d7635d0 2024-09-14T10:44:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f13d8e48e0 con 0x55f13d7635d0 2024-09-14T10:44:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7fefafe07640 1 -- 172.21.15.96:0/3384564293 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0abe80 con 0x55f13d7635d0 2024-09-14T10:44:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7fefafe07640 1 -- 172.21.15.96:0/3384564293 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0ac0c67a0 con 0x55f13d7635d0 2024-09-14T10:44:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f13d8e5150 con 0x55f13d7635d0 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.232+0000 7fefafe07640 1 -- 172.21.15.96:0/3384564293 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ff0ac0ce020 con 0x55f13d7635d0 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7fefafe07640 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fefa803a1a0 0x7fefa803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7fefafe07640 1 -- 172.21.15.96:0/3384564293 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff0ac0ec320 con 0x55f13d7635d0 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c2de2640 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fefa803a1a0 0x7fefa803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d8e9110 0x55f13d8eb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d8eba40 con 0x55f13d8e9110 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d8e9110 0x55f13d8eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c2de2640 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fefa803a1a0 0x7fefa803c660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4001e90 tx=0x7ff0b40013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d8e9110 0x55f13d8eb500 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c3de4640 1 -- 172.21.15.96:0/3384564293 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0bc00a4d0 con 0x55f13d8e9110 2024-09-14T10:44:25.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d8e54d0 con 0x55f13d8e9110 2024-09-14T10:44:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c3de4640 1 -- 172.21.15.96:0/3384564293 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0bc00a4d0 con 0x55f13d8e9110 2024-09-14T10:44:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d8ed840 con 0x55f13d8e9110 2024-09-14T10:44:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c3de4640 1 -- 172.21.15.96:0/3384564293 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0bc00a4d0 con 0x55f13d8e9110 2024-09-14T10:44:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d8ecaa0 con 0x55f13d8e9110 2024-09-14T10:44:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c3de4640 1 -- 172.21.15.96:0/3384564293 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0bc00a4d0 con 0x55f13d8e9110 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d8ecef0 con 0x55f13d8e9110 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c3de4640 1 -- 172.21.15.96:0/3384564293 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0bc00a4d0 con 0x55f13d8e9110 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 Processor -- start 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 -- start start 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d8fbba0 0x55f13d8fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c5add9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f13d703d80 con 0x55f13d8fbba0 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c2de2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d8fbba0 0x55f13d8fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c2de2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d8fbba0 0x55f13d8fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38544/0 (socket says 172.21.15.96:38544) 2024-09-14T10:44:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.236+0000 7ff0c2de2640 1 -- 172.21.15.96:0/3271896075 learned_addr learned my addr 172.21.15.96:0/3271896075 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c2de2640 1 -- 172.21.15.96:0/3271896075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13d8fc600 con 0x55f13d8fbba0 2024-09-14T10:44:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c2de2640 1 --2- 172.21.15.96:0/3271896075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d8fbba0 0x55f13d8fbfc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400e670 tx=0x7ff0b400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7fefad602640 1 -- 172.21.15.96:0/3271896075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b4022070 con 0x55f13d8fbba0 2024-09-14T10:44:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7fefad602640 1 -- 172.21.15.96:0/3271896075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b400d660 con 0x55f13d8fbba0 2024-09-14T10:44:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3271896075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f13d8fce60 con 0x55f13d8fbba0 2024-09-14T10:44:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7fefad602640 1 -- 172.21.15.96:0/3271896075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b4006070 con 0x55f13d8fbba0 2024-09-14T10:44:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3271896075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f13d8fd3d0 con 0x55f13d8fbba0 2024-09-14T10:44:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7fefad602640 1 -- 172.21.15.96:0/3271896075 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ff0b4025070 con 0x55f13d8fbba0 2024-09-14T10:44:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7fefad602640 1 --2- 172.21.15.96:0/3271896075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef9c03a1a0 0x7fef9c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7fefad602640 1 -- 172.21.15.96:0/3271896075 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff0b40525e0 con 0x55f13d8fbba0 2024-09-14T10:44:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/3271896075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef9c03a1a0 0x7fef9c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c5add9c0 1 Processor -- start 2024-09-14T10:44:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c5add9c0 1 -- start start 2024-09-14T10:44:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c5add9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d9088a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c5add9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f13d8dcf40 con 0x55f13d9084c0 2024-09-14T10:44:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/3271896075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef9c03a1a0 0x7fef9c03c660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55f13d8ec5c0 tx=0x7ff0bc005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c2de2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d9088a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c2de2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d9088a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38546/0 (socket says 172.21.15.96:38546) 2024-09-14T10:44:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c2de2640 1 -- 172.21.15.96:0/1299141209 learned_addr learned my addr 172.21.15.96:0/1299141209 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c2de2640 1 -- 172.21.15.96:0/1299141209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13d908e70 con 0x55f13d9084c0 2024-09-14T10:44:25.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.240+0000 7ff0c2de2640 1 --2- 172.21.15.96:0/1299141209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d9088a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4050940 tx=0x7ff0b400df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b497f467f60bee server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7fefa6ffd640 1 -- 172.21.15.96:0/1299141209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b404e070 con 0x55f13d9084c0 2024-09-14T10:44:25.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7fefa6ffd640 1 -- 172.21.15.96:0/1299141209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b401a320 con 0x55f13d9084c0 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7fefa6ffd640 1 -- 172.21.15.96:0/1299141209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b40268d0 con 0x55f13d9084c0 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/1299141209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 msgr2=0x55f13d9088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/1299141209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d9088a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4050940 tx=0x7ff0b400df30 comp rx=0 tx=0).stop 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/1299141209 shutdown_connections 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/1299141209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d9088a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/1299141209 >> 172.21.15.96:0/1299141209 conn(0x55f13d9048f0 msgr2=0x55f13d902b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/1299141209 shutdown_connections 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/1299141209 wait complete. 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 Processor -- start 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- start start 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d90fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f13d9094d0 con 0x55f13d9084c0 2024-09-14T10:44:25.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c2de2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d90fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c2de2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d90fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38562/0 (socket says 172.21.15.96:38562) 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 learned_addr learned my addr 172.21.15.96:0/2249885718 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13d90ffd0 con 0x55f13d9084c0 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c2de2640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d90fa70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0b404f830 tx=0x7ff0b40508a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7fefa57fa640 1 -- 172.21.15.96:0/2249885718 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b404e030 con 0x55f13d9084c0 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f13d910260 con 0x55f13d9084c0 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7fefa57fa640 1 -- 172.21.15.96:0/2249885718 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b401a320 con 0x55f13d9084c0 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7fefa57fa640 1 -- 172.21.15.96:0/2249885718 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b4026500 con 0x55f13d9084c0 2024-09-14T10:44:25.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.244+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f13d910260 con 0x55f13d9084c0 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7fefa57fa640 1 -- 172.21.15.96:0/2249885718 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ff0b404f270 con 0x55f13d9084c0 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7fefa57fa640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef8c03a150 0x7fef8c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7fefa57fa640 1 -- 172.21.15.96:0/2249885718 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff0b404f070 con 0x55f13d9084c0 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef8c03a150 0x7fef8c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d91ade0 0x55f13d91d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d91d9c0 con 0x55f13d91ade0 2024-09-14T10:44:25.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c35e3640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d91ade0 0x55f13d91d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef8c03a150 0x7fef8c03c610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55f13d8e53d0 tx=0x7ff0bc01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c35e3640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d91ade0 0x55f13d91d270 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 realm 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d91ddd0 con 0x55f13d91ade0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d91e6a0 con 0x55f13d91ade0 2024-09-14T10:44:25.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d91ea40 con 0x55f13d91ade0 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d91f290 con 0x55f13d91ade0 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 20 searching for the correct realm 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f13d921000 0x55f13d9233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c2de2640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f13d921000 0x55f13d9233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c2de2640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f13d921000 0x55f13d9233f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c2de2640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff0b4027060 0x7ff0b4027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0b4027060 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff0b4027060 0x7ff0b4027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.248+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff0b4027060 0x7ff0b4027440 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc01f070 con 0x7ff0b4027060 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c3de4640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff0bc031040 0x7ff0bc032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff0bc031040 0x7ff0bc032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff0bc031040 0x7ff0bc032430 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d91ade0 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d91ade0 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.252+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0b4027060 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc01f070 con 0x7ff0b4027060 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d91ade0 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d91ade0 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0b4027060 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0bc01f070 con 0x7ff0b4027060 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d91ade0 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.256+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d91ade0 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0b4027060 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc01f070 con 0x7ff0b4027060 2024-09-14T10:44:25.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d91ade0 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0b4027060 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc01f070 con 0x7ff0b4027060 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d921000 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.260+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0bc031040 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x55f13d91ade0 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923980 con 0x7ff0b4027060 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0bc01f070 con 0x7ff0b4027060 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:25.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d91fc10 con 0x55f13d91ade0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d9204b0 con 0x55f13d91ade0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d9204b0 con 0x55f13d91ade0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:25.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 zone default found 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 4 Realm: () 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 zonegroup default 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d923de0 con 0x7ff0bc031040 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d9258d0 con 0x55f13d921000 2024-09-14T10:44:25.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d925d70 con 0x55f13d921000 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 started sync module instance, tier type = 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.264+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d924c70 con 0x7ff0b4027060 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.268+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc040040 con 0x7ff0b4027060 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.268+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94494608478304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d9248d0 con 0x7ff0b4027060 2024-09-14T10:44:25.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.268+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d926b90 con 0x55f13d91ade0 2024-09-14T10:44:25.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.268+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94494608478304] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc040040 con 0x7ff0b4027060 2024-09-14T10:44:25.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.268+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.268+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94494608482768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d926fb0 con 0x55f13d91ade0 2024-09-14T10:44:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.268+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d927970 con 0x55f13d921000 2024-09-14T10:44:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.272+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94494608482768] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.272+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.272+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94494608487616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d927d10 con 0x55f13d921000 2024-09-14T10:44:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.272+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d9286d0 con 0x7ff0b4027060 2024-09-14T10:44:25.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.272+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc040040 con 0x7ff0b4027060 2024-09-14T10:44:25.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.272+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94494608491344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d928f70 con 0x7ff0b4027060 2024-09-14T10:44:25.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.272+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d929970 con 0x55f13d91ade0 2024-09-14T10:44:25.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.272+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94494608487616] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.276+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94494608491344] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc040040 con 0x7ff0b4027060 2024-09-14T10:44:25.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.276+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.276+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94494608483824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d928ac0 con 0x55f13d91ade0 2024-09-14T10:44:25.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.276+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d92a210 con 0x7ff0bc031040 2024-09-14T10:44:25.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.276+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94494608483824] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.276+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.276+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94494608495744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d928ac0 con 0x7ff0bc031040 2024-09-14T10:44:25.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.276+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d92a6c0 con 0x7ff0bc031040 2024-09-14T10:44:25.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.280+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94494608495744] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.280+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.280+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94494608499120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d92a680 con 0x7ff0bc031040 2024-09-14T10:44:25.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.280+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d92b100 con 0x7ff0bc031040 2024-09-14T10:44:25.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.280+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94494608499120] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94494608497376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d92b100 con 0x7ff0bc031040 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 add_watcher() i=0 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 add_watcher() i=1 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 add_watcher() i=2 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 add_watcher() i=3 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 add_watcher() i=4 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 add_watcher() i=5 2024-09-14T10:44:25.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 add_watcher() i=6 2024-09-14T10:44:25.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94494608497376] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 add_watcher() i=7 2024-09-14T10:44:25.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:25.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d92e4a0 con 0x55f13d91ade0 2024-09-14T10:44:25.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94494608514656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d92b270 con 0x55f13d91ade0 2024-09-14T10:44:25.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94494608514656] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7fef79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:25.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.284+0000 7ff0c5add9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:25.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 5 note: GC not initialized 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7fef78fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 Filter name: none 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7feef27fc640 20 reqs_thread_entry: start 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d951d50 con 0x7ff0bc031040 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-14T10:44:25.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d950290 con 0x55f13d91ade0 2024-09-14T10:44:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 rados_obj.operate() r=0 bl.length=7 2024-09-14T10:44:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-14T10:44:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-14T10:44:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f13d950680 con 0x55f13d91ade0 2024-09-14T10:44:25.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 20 get_user_info_from_index found 0 xattrs 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7fef79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.288+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94494608514656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d915090 con 0x55f13d91ade0 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.292+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94494608514656] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.292+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94494608478304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d94f920 con 0x7ff0b4027060 2024-09-14T10:44:25.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.292+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94494608478304] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc040040 con 0x7ff0b4027060 2024-09-14T10:44:25.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.292+0000 7ff0c5add9c0 20 remove_watcher() i=0 2024-09-14T10:44:25.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.292+0000 7ff0c5add9c0 2 removed watcher, disabling cache 2024-09-14T10:44:25.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.292+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94494608482768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d94f920 con 0x55f13d91ade0 2024-09-14T10:44:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94494608482768] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c5add9c0 20 remove_watcher() i=1 2024-09-14T10:44:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94494608487616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d94f920 con 0x55f13d921000 2024-09-14T10:44:25.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c2de2640 1 -- 172.21.15.96:0/2249885718 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94494608487616] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b4036020 con 0x55f13d921000 2024-09-14T10:44:25.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c5add9c0 20 remove_watcher() i=2 2024-09-14T10:44:25.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94494608491344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d9274c0 con 0x7ff0b4027060 2024-09-14T10:44:25.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c3de4640 1 -- 172.21.15.96:0/2249885718 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94494608491344] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0bc040040 con 0x7ff0b4027060 2024-09-14T10:44:25.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c5add9c0 20 remove_watcher() i=3 2024-09-14T10:44:25.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.296+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94494608483824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d9261d0 con 0x55f13d91ade0 2024-09-14T10:44:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.300+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94494608483824] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x55f13d91ade0 2024-09-14T10:44:25.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.300+0000 7ff0c5add9c0 20 remove_watcher() i=4 2024-09-14T10:44:25.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.300+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94494608495744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d9274c0 con 0x7ff0bc031040 2024-09-14T10:44:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.300+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94494608495744] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.300+0000 7ff0c5add9c0 20 remove_watcher() i=5 2024-09-14T10:44:25.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.300+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94494608499120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d929480 con 0x7ff0bc031040 2024-09-14T10:44:25.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94494608499120] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 20 remove_watcher() i=6 2024-09-14T10:44:25.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94494608497376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f13d929480 con 0x7ff0bc031040 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94494608497376] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0ac0bd770 con 0x7ff0bc031040 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 20 remove_watcher() i=7 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff0bc031040 msgr2=0x7ff0bc032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff0bc031040 0x7ff0bc032430 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d91ade0 msgr2=0x55f13d91d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d91ade0 0x55f13d91d270 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff0b4027060 msgr2=0x7ff0b4027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff0b4027060 0x7ff0b4027440 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f13d921000 msgr2=0x55f13d9233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f13d921000 0x55f13d9233f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef8c03a150 msgr2=0x7fef8c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.304+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef8c03a150 0x7fef8c03c610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55f13d8e53d0 tx=0x7ff0bc01f000 comp rx=0 tx=0).stop 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c35e3640 1 -- 172.21.15.96:0/2249885718 reap_dead start 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 msgr2=0x55f13d90fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d90fa70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0b404f830 tx=0x7ff0b40508a0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 shutdown_connections 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/2249885718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d9084c0 0x55f13d90fa70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 >> 172.21.15.96:0/2249885718 conn(0x55f13d9048f0 msgr2=0x55f13d902b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 shutdown_connections 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/2249885718 wait complete. 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3271896075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef9c03a1a0 msgr2=0x7fef9c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3271896075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef9c03a1a0 0x7fef9c03c660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55f13d8ec5c0 tx=0x7ff0bc005850 comp rx=0 tx=0).stop 2024-09-14T10:44:25.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3271896075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d8fbba0 msgr2=0x55f13d8fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3271896075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d8fbba0 0x55f13d8fbfc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400e670 tx=0x7ff0b400ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3271896075 shutdown_connections 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3271896075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fef9c03a1a0 0x7fef9c03c660 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3271896075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d8fbba0 0x55f13d8fbfc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3271896075 >> 172.21.15.96:0/3271896075 conn(0x55f13d8f1550 msgr2=0x55f13d8f1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3271896075 shutdown_connections 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3271896075 wait complete. 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d8e9110 msgr2=0x55f13d8eb500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d8e9110 0x55f13d8eb500 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fefa803a1a0 msgr2=0x7fefa803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fefa803a1a0 0x7fefa803c660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4001e90 tx=0x7ff0b40013f0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7635d0 msgr2=0x55f13d8e40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7635d0 0x55f13d8e40f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac096f40 tx=0x7ff0ac0180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 shutdown_connections 2024-09-14T10:44:25.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f13d8e9110 0x55f13d8eb500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fefa803a1a0 0x7fefa803c660 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 --2- 172.21.15.96:0/3384564293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f13d7635d0 0x55f13d8e40f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 >> 172.21.15.96:0/3384564293 conn(0x55f13d7e9910 msgr2=0x55f13d8dda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 shutdown_connections 2024-09-14T10:44:25.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.308+0000 7ff0c5add9c0 1 -- 172.21.15.96:0/3384564293 wait complete. 2024-09-14T10:44:25.317 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-14T10:44:25.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:44:25.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:44:25.317 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:44:25.393 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:25.393 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:25.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.396+0000 7f3052bcc9c0 1 Processor -- start 2024-09-14T10:44:25.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.396+0000 7f3052bcc9c0 1 -- start start 2024-09-14T10:44:25.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.396+0000 7f3052bcc9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5590babdde50 0x5590babde230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.396+0000 7f3052bcc9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5590baa877a0 con 0x5590babe1030 2024-09-14T10:44:25.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.396+0000 7f3052bcc9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5590baae31b0 con 0x5590babdde50 2024-09-14T10:44:25.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.396+0000 7f30506d2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5590babdde50 0x5590babde230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.396+0000 7f304fed1640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5590babe1030 0x5590babe3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34234/0 (socket says 172.21.15.96:34234) 2024-09-14T10:44:25.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.396+0000 7f304fed1640 1 -- 172.21.15.96:0/1998369831 learned_addr learned my addr 172.21.15.96:0/1998369831 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:25.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.400+0000 7f30506d2640 1 -- 172.21.15.96:0/1998369831 >> v1:172.21.15.70:6789/0 conn(0x5590babe1030 legacy=0x5590babe3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.400+0000 7f30506d2640 1 -- 172.21.15.96:0/1998369831 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590baa61da0 con 0x5590babdde50 2024-09-14T10:44:25.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.400+0000 7f30506d2640 1 --2- 172.21.15.96:0/1998369831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590babde230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f304000a480 tx=0x7f304001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81da606c48a0b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f304f6d0640 1 -- 172.21.15.96:0/1998369831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30400b0070 con 0x5590babdde50 2024-09-14T10:44:25.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f304f6d0640 1 -- 172.21.15.96:0/1998369831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30400ab540 con 0x5590babdde50 2024-09-14T10:44:25.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f304f6d0640 1 -- 172.21.15.96:0/1998369831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30400ab840 con 0x5590babdde50 2024-09-14T10:44:25.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1998369831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 msgr2=0x5590babde230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1998369831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590babde230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f304000a480 tx=0x7f304001b280 comp rx=0 tx=0).stop 2024-09-14T10:44:25.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1998369831 shutdown_connections 2024-09-14T10:44:25.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1998369831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590babde230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1998369831 >> 172.21.15.96:0/1998369831 conn(0x5590babd9970 msgr2=0x5590babdbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1998369831 shutdown_connections 2024-09-14T10:44:25.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.404+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1998369831 wait complete. 2024-09-14T10:44:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f3052bcc9c0 1 Processor -- start 2024-09-14T10:44:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f3052bcc9c0 1 -- start start 2024-09-14T10:44:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f3052bcc9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f3052bcc9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5590baae6fc0 con 0x5590babdde50 2024-09-14T10:44:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f30506d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f30506d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38572/0 (socket says 172.21.15.96:38572) 2024-09-14T10:44:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f30506d2640 1 -- 172.21.15.96:0/3711607325 learned_addr learned my addr 172.21.15.96:0/3711607325 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f30506d2640 1 -- 172.21.15.96:0/3711607325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590baccaa20 con 0x5590babdde50 2024-09-14T10:44:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f30506d2640 1 --2- 172.21.15.96:0/3711607325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacca430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f30400ae040 tx=0x7f3040003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c65aa2a9b8fdc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f2f3e60c640 1 -- 172.21.15.96:0/3711607325 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30400b0040 con 0x5590babdde50 2024-09-14T10:44:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f2f3e60c640 1 -- 172.21.15.96:0/3711607325 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304000a300 con 0x5590babdde50 2024-09-14T10:44:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.420+0000 7f2f3e60c640 1 -- 172.21.15.96:0/3711607325 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30400ab820 con 0x5590babdde50 2024-09-14T10:44:25.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/3711607325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 msgr2=0x5590bacca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/3711607325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacca430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f30400ae040 tx=0x7f3040003030 comp rx=0 tx=0).stop 2024-09-14T10:44:25.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/3711607325 shutdown_connections 2024-09-14T10:44:25.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/3711607325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacca430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/3711607325 >> 172.21.15.96:0/3711607325 conn(0x5590babd9970 msgr2=0x5590bacc6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/3711607325 shutdown_connections 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/3711607325 wait complete. 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 Processor -- start 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- start start 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacd1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5590baa88a50 con 0x5590babdde50 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f30506d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacd1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f30506d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacd1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38574/0 (socket says 172.21.15.96:38574) 2024-09-14T10:44:25.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f30506d2640 1 -- 172.21.15.96:0/1386520920 learned_addr learned my addr 172.21.15.96:0/1386520920 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f30506d2640 1 -- 172.21.15.96:0/1386520920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590bacd2110 con 0x5590babdde50 2024-09-14T10:44:25.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f30506d2640 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacd1bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f30400ab510 tx=0x7f3040018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f2f3ce09640 1 -- 172.21.15.96:0/1386520920 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30400b0040 con 0x5590babdde50 2024-09-14T10:44:25.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f2f3ce09640 1 -- 172.21.15.96:0/1386520920 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30400c0680 con 0x5590babdde50 2024-09-14T10:44:25.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590bacd23a0 con 0x5590babdde50 2024-09-14T10:44:25.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f2f3ce09640 1 -- 172.21.15.96:0/1386520920 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30400c0960 con 0x5590babdde50 2024-09-14T10:44:25.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.424+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590bacd2d50 con 0x5590babdde50 2024-09-14T10:44:25.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f2f3ce09640 1 -- 172.21.15.96:0/1386520920 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f30400c0bd0 con 0x5590babdde50 2024-09-14T10:44:25.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f2f3ce09640 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f3803a150 0x7f2f3803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f2f3ce09640 1 -- 172.21.15.96:0/1386520920 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f30400bb070 con 0x5590babdde50 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f304fed1640 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f3803a150 0x7f2f3803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590babe1030 0x5590bacd8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bacd9260 con 0x5590babe1030 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3050ed3640 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590babe1030 0x5590bacd8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f304fed1640 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f3803a150 0x7f2f3803c610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3044001d80 tx=0x7f30440012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3050ed3640 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590babe1030 0x5590bacd8d20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3050ed3640 1 -- 172.21.15.96:0/1386520920 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f304800a4d0 con 0x5590babe1030 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bacd9600 con 0x5590babe1030 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3050ed3640 1 -- 172.21.15.96:0/1386520920 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f304800a4d0 con 0x5590babe1030 2024-09-14T10:44:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bacdaee0 con 0x5590babe1030 2024-09-14T10:44:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3050ed3640 1 -- 172.21.15.96:0/1386520920 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f304800a4d0 con 0x5590babe1030 2024-09-14T10:44:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bacda110 con 0x5590babe1030 2024-09-14T10:44:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3050ed3640 1 -- 172.21.15.96:0/1386520920 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f304800a4d0 con 0x5590babe1030 2024-09-14T10:44:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bacda530 con 0x5590babe1030 2024-09-14T10:44:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3050ed3640 1 -- 172.21.15.96:0/1386520920 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f304800a4d0 con 0x5590babe1030 2024-09-14T10:44:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 Processor -- start 2024-09-14T10:44:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 -- start start 2024-09-14T10:44:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bace92d0 0x5590bace96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.428+0000 7f3052bcc9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5590baaf3d80 con 0x5590bace92d0 2024-09-14T10:44:25.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f304fed1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bace92d0 0x5590bace96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f304fed1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bace92d0 0x5590bace96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38576/0 (socket says 172.21.15.96:38576) 2024-09-14T10:44:25.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f304fed1640 1 -- 172.21.15.96:0/4242446817 learned_addr learned my addr 172.21.15.96:0/4242446817 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f304fed1640 1 -- 172.21.15.96:0/4242446817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590bace9d30 con 0x5590bace92d0 2024-09-14T10:44:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f304fed1640 1 --2- 172.21.15.96:0/4242446817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bace92d0 0x5590bace96f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f304400d660 tx=0x7f304400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f2f35ffb640 1 -- 172.21.15.96:0/4242446817 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f304400c6b0 con 0x5590bace92d0 2024-09-14T10:44:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f2f35ffb640 1 -- 172.21.15.96:0/4242446817 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304400c850 con 0x5590bace92d0 2024-09-14T10:44:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/4242446817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590bacea590 con 0x5590bace92d0 2024-09-14T10:44:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f2f35ffb640 1 -- 172.21.15.96:0/4242446817 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f304400cb30 con 0x5590bace92d0 2024-09-14T10:44:25.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/4242446817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590baceab00 con 0x5590bace92d0 2024-09-14T10:44:25.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f2f35ffb640 1 -- 172.21.15.96:0/4242446817 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3044023020 con 0x5590bace92d0 2024-09-14T10:44:25.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f2f35ffb640 1 --2- 172.21.15.96:0/4242446817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2803a150 0x7f2f2803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f2f35ffb640 1 -- 172.21.15.96:0/4242446817 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3044021020 con 0x5590bace92d0 2024-09-14T10:44:25.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f3050ed3640 1 --2- 172.21.15.96:0/4242446817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2803a150 0x7f2f2803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f3052bcc9c0 1 Processor -- start 2024-09-14T10:44:25.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f3050ed3640 1 --2- 172.21.15.96:0/4242446817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2803a150 0x7f2f2803c610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5590bacda4b0 tx=0x7f3048005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f3052bcc9c0 1 -- start start 2024-09-14T10:44:25.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f3052bcc9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacf7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.432+0000 7f3052bcc9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5590baccad90 con 0x5590bacf6c40 2024-09-14T10:44:25.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacf7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacf7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38586/0 (socket says 172.21.15.96:38586) 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 -- 172.21.15.96:0/69056386 learned_addr learned my addr 172.21.15.96:0/69056386 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 -- 172.21.15.96:0/69056386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590bacf7630 con 0x5590bacf6c40 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 --2- 172.21.15.96:0/69056386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacf7040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f30440517d0 tx=0x7f3044044710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7051fa5c6e4521 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f2f2f7fe640 1 -- 172.21.15.96:0/69056386 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f304400cd20 con 0x5590bacf6c40 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f2f2f7fe640 1 -- 172.21.15.96:0/69056386 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304401bcc0 con 0x5590bacf6c40 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f2f2f7fe640 1 -- 172.21.15.96:0/69056386 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044050270 con 0x5590bacf6c40 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/69056386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 msgr2=0x5590bacf7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/69056386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacf7040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f30440517d0 tx=0x7f3044044710 comp rx=0 tx=0).stop 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/69056386 shutdown_connections 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/69056386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacf7040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/69056386 >> 172.21.15.96:0/69056386 conn(0x5590bacf2060 msgr2=0x5590bacf02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/69056386 shutdown_connections 2024-09-14T10:44:25.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/69056386 wait complete. 2024-09-14T10:44:25.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 Processor -- start 2024-09-14T10:44:25.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 -- start start 2024-09-14T10:44:25.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacfd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5590bacf5b90 con 0x5590bacf6c40 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacfd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacfd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38602/0 (socket says 172.21.15.96:38602) 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 learned_addr learned my addr 172.21.15.96:0/1151367085 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590bacfd6c0 con 0x5590bacf6c40 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f304fed1640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacfd160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3044023850 tx=0x7f3044051760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f2f2dffb640 1 -- 172.21.15.96:0/1151367085 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044034020 con 0x5590bacf6c40 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f2f2dffb640 1 -- 172.21.15.96:0/1151367085 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3044050270 con 0x5590bacf6c40 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590bacfd950 con 0x5590bacf6c40 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.436+0000 7f2f2dffb640 1 -- 172.21.15.96:0/1151367085 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044043170 con 0x5590bacf6c40 2024-09-14T10:44:25.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590bacfd950 con 0x5590bacf6c40 2024-09-14T10:44:25.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f2f2dffb640 1 -- 172.21.15.96:0/1151367085 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3044037020 con 0x5590bacf6c40 2024-09-14T10:44:25.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f2f2dffb640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2003a150 0x7f2f2003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f2f2dffb640 1 -- 172.21.15.96:0/1151367085 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f304404a040 con 0x5590bacf6c40 2024-09-14T10:44:25.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3050ed3640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2003a150 0x7f2f2003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590bad08520 0x5590bad0a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0b100 con 0x5590bad08520 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f30506d2640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590bad08520 0x5590bad0a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3050ed3640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2003a150 0x7f2f2003c610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5590bacd9c30 tx=0x7f304801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f30506d2640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590bad08520 0x5590bad0a9b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 realm 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0b510 con 0x5590bad08520 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0bde0 con 0x5590bad08520 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0c180 con 0x5590bad08520 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0c620 con 0x5590bad08520 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 20 searching for the correct realm 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5590bad0e620 0x5590bad10a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5590bad11100 con 0x5590bad0e620 2024-09-14T10:44:25.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.440+0000 7f304fed1640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5590bad0e620 0x5590bad10a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f304fed1640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5590bad0e620 0x5590bad10a30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f304fed1640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3044039020 0x7f30440247a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5590bad11100 con 0x7f3044039020 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f3050ed3640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3044039020 0x7f30440247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f3050ed3640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3044039020 0x7f30440247a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f304801f070 con 0x7f3044039020 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f3050ed3640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3048031040 0x7f3048032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5590bad11100 con 0x7f3048031040 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f30506d2640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3048031040 0x7f3048032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f30506d2640 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3048031040 0x7f3048032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5590bad11100 con 0x5590bad08520 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5590bad11100 con 0x5590bad08520 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.444+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5590bad11100 con 0x7f3048031040 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5590bad11100 con 0x7f3048031040 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3044039020 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f304801f070 con 0x7f3044039020 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad0e620 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad08520 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3048031040 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad08520 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3044039020 2024-09-14T10:44:25.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f304801f070 con 0x7f3044039020 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad0e620 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad0e620 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3048031040 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad0e620 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.448+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad0e620 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad08520 2024-09-14T10:44:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad08520 2024-09-14T10:44:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3048031040 2024-09-14T10:44:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad0e620 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3044039020 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f304801f070 con 0x7f3044039020 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad08520 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3048031040 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad0e620 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3048031040 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.452+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3044039020 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f304801f070 con 0x7f3044039020 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad0e620 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3048031040 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x5590bad08520 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f30400dd040 con 0x7f3044039020 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f304801f070 con 0x7f3044039020 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:25.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0cf90 con 0x5590bad08520 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0d380 con 0x5590bad08520 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0d380 con 0x5590bad08520 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 zone default found 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 4 Realm: () 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 zonegroup default 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0d7a0 con 0x7f3048031040 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad0dbc0 con 0x5590bad0e620 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.456+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad12f70 con 0x5590bad0e620 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3052bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3052bcc9c0 20 started sync module instance, tier type = 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3052bcc9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:25.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad12410 con 0x7f3044039020 2024-09-14T10:44:25.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3048040040 con 0x7f3044039020 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94080097921072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad12070 con 0x7f3044039020 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad13e50 con 0x5590bad08520 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94080097921072] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3048040040 con 0x7f3044039020 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.460+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94080097923968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad13e50 con 0x5590bad08520 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.464+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad14860 con 0x5590bad0e620 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.464+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94080097923968] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.464+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.464+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94080097925536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad13dc0 con 0x5590bad0e620 2024-09-14T10:44:25.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.464+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad15560 con 0x7f3044039020 2024-09-14T10:44:25.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.468+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3048040040 con 0x7f3044039020 2024-09-14T10:44:25.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.468+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94080097931744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad15e00 con 0x7f3044039020 2024-09-14T10:44:25.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.468+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad16820 con 0x5590bad08520 2024-09-14T10:44:25.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.468+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94080097925536] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.468+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94080097931744] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3048040040 con 0x7f3044039020 2024-09-14T10:44:25.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.468+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.468+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94080097936144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad15950 con 0x5590bad08520 2024-09-14T10:44:25.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.468+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad170c0 con 0x7f3048031040 2024-09-14T10:44:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.472+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.472+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94080097937712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad17200 con 0x7f3048031040 2024-09-14T10:44:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.472+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad17ab0 con 0x7f3048031040 2024-09-14T10:44:25.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.472+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94080097936144] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.472+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94080097937712] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.472+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.472+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94080097930240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad17200 con 0x7f3048031040 2024-09-14T10:44:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.472+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad18140 con 0x7f3048031040 2024-09-14T10:44:25.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94080097930240] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94080097938768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad18140 con 0x7f3048031040 2024-09-14T10:44:25.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 20 add_watcher() i=0 2024-09-14T10:44:25.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 20 add_watcher() i=1 2024-09-14T10:44:25.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 20 add_watcher() i=2 2024-09-14T10:44:25.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 20 add_watcher() i=3 2024-09-14T10:44:25.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 20 add_watcher() i=4 2024-09-14T10:44:25.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 20 add_watcher() i=5 2024-09-14T10:44:25.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 20 add_watcher() i=6 2024-09-14T10:44:25.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94080097938768] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 20 add_watcher() i=7 2024-09-14T10:44:25.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:25.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad1b2e0 con 0x5590bad08520 2024-09-14T10:44:25.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.476+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94080097955056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad18140 con 0x5590bad08520 2024-09-14T10:44:25.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94080097955056] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f2f067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 5 note: GC not initialized 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f2f057e2640 20 reqs_thread_entry: start 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 20 Filter name: none 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f2e76ffd640 20 reqs_thread_entry: start 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590bad3e6c0 con 0x5590bad08520 2024-09-14T10:44:25.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:25.479 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:25.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f2f067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.480+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94080097955056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad3d3b0 con 0x5590bad08520 2024-09-14T10:44:25.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94080097955056] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94080097921072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad1acf0 con 0x7f3044039020 2024-09-14T10:44:25.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94080097921072] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3048040040 con 0x7f3044039020 2024-09-14T10:44:25.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f3052bcc9c0 20 remove_watcher() i=0 2024-09-14T10:44:25.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f3052bcc9c0 2 removed watcher, disabling cache 2024-09-14T10:44:25.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94080097923968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad12830 con 0x5590bad08520 2024-09-14T10:44:25.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94080097923968] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f3052bcc9c0 20 remove_watcher() i=1 2024-09-14T10:44:25.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.484+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94080097925536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad13380 con 0x5590bad0e620 2024-09-14T10:44:25.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.488+0000 7f304fed1640 1 -- 172.21.15.96:0/1151367085 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94080097925536] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3044044d50 con 0x5590bad0e620 2024-09-14T10:44:25.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.488+0000 7f3052bcc9c0 20 remove_watcher() i=2 2024-09-14T10:44:25.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.488+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94080097931744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad139a0 con 0x7f3044039020 2024-09-14T10:44:25.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.492+0000 7f3050ed3640 1 -- 172.21.15.96:0/1151367085 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94080097931744] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3048040040 con 0x7f3044039020 2024-09-14T10:44:25.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.492+0000 7f3052bcc9c0 20 remove_watcher() i=3 2024-09-14T10:44:25.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.492+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94080097936144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad139a0 con 0x5590bad08520 2024-09-14T10:44:25.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.492+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94080097936144] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x5590bad08520 2024-09-14T10:44:25.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.496+0000 7f3052bcc9c0 20 remove_watcher() i=4 2024-09-14T10:44:25.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.496+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94080097937712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad139a0 con 0x7f3048031040 2024-09-14T10:44:25.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.496+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94080097937712] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.496+0000 7f3052bcc9c0 20 remove_watcher() i=5 2024-09-14T10:44:25.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.496+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94080097930240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad139a0 con 0x7f3048031040 2024-09-14T10:44:25.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.496+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94080097930240] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.496+0000 7f3052bcc9c0 20 remove_watcher() i=6 2024-09-14T10:44:25.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.496+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94080097938768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590bad14c00 con 0x7f3048031040 2024-09-14T10:44:25.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94080097938768] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30400b3040 con 0x7f3048031040 2024-09-14T10:44:25.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 20 remove_watcher() i=7 2024-09-14T10:44:25.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3048031040 msgr2=0x7f3048032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3048031040 0x7f3048032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590bad08520 msgr2=0x5590bad0a9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590bad08520 0x5590bad0a9b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3044039020 msgr2=0x7f30440247a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3044039020 0x7f30440247a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5590bad0e620 msgr2=0x5590bad10a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5590bad0e620 0x5590bad10a30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2003a150 msgr2=0x7f2f2003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2003a150 0x7f2f2003c610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5590bacd9c30 tx=0x7f304801f000 comp rx=0 tx=0).stop 2024-09-14T10:44:25.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f30506d2640 1 -- 172.21.15.96:0/1151367085 reap_dead start 2024-09-14T10:44:25.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 msgr2=0x5590bacfd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacfd160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3044023850 tx=0x7f3044051760 comp rx=0 tx=0).stop 2024-09-14T10:44:25.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 shutdown_connections 2024-09-14T10:44:25.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1151367085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bacf6c40 0x5590bacfd160 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 >> 172.21.15.96:0/1151367085 conn(0x5590bacf2060 msgr2=0x5590bacf0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 shutdown_connections 2024-09-14T10:44:25.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1151367085 wait complete. 2024-09-14T10:44:25.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/4242446817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2803a150 msgr2=0x7f2f2803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/4242446817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2803a150 0x7f2f2803c610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5590bacda4b0 tx=0x7f3048005850 comp rx=0 tx=0).stop 2024-09-14T10:44:25.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/4242446817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bace92d0 msgr2=0x5590bace96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/4242446817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bace92d0 0x5590bace96f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f304400d660 tx=0x7f304400da60 comp rx=0 tx=0).stop 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/4242446817 shutdown_connections 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/4242446817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f2803a150 0x7f2f2803c610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/4242446817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590bace92d0 0x5590bace96f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/4242446817 >> 172.21.15.96:0/4242446817 conn(0x5590bacdec80 msgr2=0x5590bacdf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/4242446817 shutdown_connections 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/4242446817 wait complete. 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590babe1030 msgr2=0x5590bacd8d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590babe1030 0x5590bacd8d20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f3803a150 msgr2=0x7f2f3803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f3803a150 0x7f2f3803c610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3044001d80 tx=0x7f30440012e0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 msgr2=0x5590bacd1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacd1bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f30400ab510 tx=0x7f3040018020 comp rx=0 tx=0).stop 2024-09-14T10:44:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 shutdown_connections 2024-09-14T10:44:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5590babe1030 0x5590bacd8d20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f3803a150 0x7f2f3803c610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 --2- 172.21.15.96:0/1386520920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5590babdde50 0x5590bacd1bb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 >> 172.21.15.96:0/1386520920 conn(0x5590babd9970 msgr2=0x5590baccb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 shutdown_connections 2024-09-14T10:44:25.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.500+0000 7f3052bcc9c0 1 -- 172.21.15.96:0/1386520920 wait complete. 2024-09-14T10:44:25.509 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:25.510 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-14T10:44:25.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-14T10:44:25.510 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-14T10:44:25.582 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:25.582 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:25.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.584+0000 7fd53db239c0 1 Processor -- start 2024-09-14T10:44:25.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.584+0000 7fd53db239c0 1 -- start start 2024-09-14T10:44:25.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.584+0000 7fd53db239c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5635aa310a70 0x5635aa3a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.584+0000 7fd53db239c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635aa2447a0 con 0x5635aa310e50 2024-09-14T10:44:25.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.584+0000 7fd53db239c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5635aa2a01b0 con 0x5635aa310a70 2024-09-14T10:44:25.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53b629640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5635aa310a70 0x5635aa3a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53ae28640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5635aa310e50 0x5635aa3a3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34250/0 (socket says 172.21.15.96:34250) 2024-09-14T10:44:25.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53ae28640 1 -- 172.21.15.96:0/2177178658 learned_addr learned my addr 172.21.15.96:0/2177178658 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:25.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53b629640 1 -- 172.21.15.96:0/2177178658 >> v1:172.21.15.70:6789/0 conn(0x5635aa310e50 legacy=0x5635aa3a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53b629640 1 -- 172.21.15.96:0/2177178658 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635aa21eda0 con 0x5635aa310a70 2024-09-14T10:44:25.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53b629640 1 --2- 172.21.15.96:0/2177178658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa3a10d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd53400a420 tx=0x7fd53401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3d65ccb2d91f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53a627640 1 -- 172.21.15.96:0/2177178658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5340af070 con 0x5635aa310a70 2024-09-14T10:44:25.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53a627640 1 -- 172.21.15.96:0/2177178658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5340aa530 con 0x5635aa310a70 2024-09-14T10:44:25.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53a627640 1 -- 172.21.15.96:0/2177178658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5340aa850 con 0x5635aa310a70 2024-09-14T10:44:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53db239c0 1 -- 172.21.15.96:0/2177178658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 msgr2=0x5635aa3a10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53db239c0 1 --2- 172.21.15.96:0/2177178658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa3a10d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd53400a420 tx=0x7fd53401afd0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53db239c0 1 -- 172.21.15.96:0/2177178658 shutdown_connections 2024-09-14T10:44:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53db239c0 1 --2- 172.21.15.96:0/2177178658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa3a10d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.588+0000 7fd53db239c0 1 -- 172.21.15.96:0/2177178658 >> 172.21.15.96:0/2177178658 conn(0x5635aa3969c0 msgr2=0x5635aa398de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.592+0000 7fd53db239c0 1 -- 172.21.15.96:0/2177178658 shutdown_connections 2024-09-14T10:44:25.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.592+0000 7fd53db239c0 1 -- 172.21.15.96:0/2177178658 wait complete. 2024-09-14T10:44:25.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53db239c0 1 Processor -- start 2024-09-14T10:44:25.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53db239c0 1 -- start start 2024-09-14T10:44:25.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53db239c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa4895c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53db239c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5635aa2a3fc0 con 0x5635aa310a70 2024-09-14T10:44:25.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53b629640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa4895c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53b629640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa4895c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38616/0 (socket says 172.21.15.96:38616) 2024-09-14T10:44:25.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53b629640 1 -- 172.21.15.96:0/1665943832 learned_addr learned my addr 172.21.15.96:0/1665943832 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53b629640 1 -- 172.21.15.96:0/1665943832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635aa489bb0 con 0x5635aa310a70 2024-09-14T10:44:25.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd53b629640 1 --2- 172.21.15.96:0/1665943832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa4895c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd5340ad040 tx=0x7fd5340033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1637bb88f13df91 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd42960a640 1 -- 172.21.15.96:0/1665943832 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5340af050 con 0x5635aa310a70 2024-09-14T10:44:25.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd42960a640 1 -- 172.21.15.96:0/1665943832 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5340b0040 con 0x5635aa310a70 2024-09-14T10:44:25.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.604+0000 7fd42960a640 1 -- 172.21.15.96:0/1665943832 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5340aaad0 con 0x5635aa310a70 2024-09-14T10:44:25.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- 172.21.15.96:0/1665943832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 msgr2=0x5635aa4895c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 --2- 172.21.15.96:0/1665943832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa4895c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd5340ad040 tx=0x7fd5340033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- 172.21.15.96:0/1665943832 shutdown_connections 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 --2- 172.21.15.96:0/1665943832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa4895c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- 172.21.15.96:0/1665943832 >> 172.21.15.96:0/1665943832 conn(0x5635aa3969c0 msgr2=0x5635aa485200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- 172.21.15.96:0/1665943832 shutdown_connections 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- 172.21.15.96:0/1665943832 wait complete. 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 Processor -- start 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- start start 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa490d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5635aa245a50 con 0x5635aa310a70 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53b629640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa490d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53b629640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa490d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38618/0 (socket says 172.21.15.96:38618) 2024-09-14T10:44:25.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53b629640 1 -- 172.21.15.96:0/818481370 learned_addr learned my addr 172.21.15.96:0/818481370 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53b629640 1 -- 172.21.15.96:0/818481370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635aa491290 con 0x5635aa310a70 2024-09-14T10:44:25.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53b629640 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa490d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd5340aa500 tx=0x7fd534017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd427e07640 1 -- 172.21.15.96:0/818481370 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5340b6c40 con 0x5635aa310a70 2024-09-14T10:44:25.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd427e07640 1 -- 172.21.15.96:0/818481370 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5340b6de0 con 0x5635aa310a70 2024-09-14T10:44:25.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635aa491520 con 0x5635aa310a70 2024-09-14T10:44:25.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd427e07640 1 -- 172.21.15.96:0/818481370 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5340bf590 con 0x5635aa310a70 2024-09-14T10:44:25.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635aa491e80 con 0x5635aa310a70 2024-09-14T10:44:25.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.608+0000 7fd427e07640 1 -- 172.21.15.96:0/818481370 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd5340bf800 con 0x5635aa310a70 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd427e07640 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd42003a150 0x7fd42003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd427e07640 1 -- 172.21.15.96:0/818481370 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd5340bb070 con 0x5635aa310a70 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53ae28640 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd42003a150 0x7fd42003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa310e50 0x5635aa497e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa498390 con 0x5635aa310e50 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53be2a640 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa310e50 0x5635aa497e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53ae28640 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd42003a150 0x7fd42003c610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd524001d80 tx=0x7fd5240012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53be2a640 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa310e50 0x5635aa497e50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53be2a640 1 -- 172.21.15.96:0/818481370 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd52c0083f0 con 0x5635aa310e50 2024-09-14T10:44:25.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa498770 con 0x5635aa310e50 2024-09-14T10:44:25.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53be2a640 1 -- 172.21.15.96:0/818481370 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd52c0083f0 con 0x5635aa310e50 2024-09-14T10:44:25.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa49a070 con 0x5635aa310e50 2024-09-14T10:44:25.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53be2a640 1 -- 172.21.15.96:0/818481370 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd52c0083f0 con 0x5635aa310e50 2024-09-14T10:44:25.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4992a0 con 0x5635aa310e50 2024-09-14T10:44:25.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53be2a640 1 -- 172.21.15.96:0/818481370 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd52c0083f0 con 0x5635aa310e50 2024-09-14T10:44:25.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4996c0 con 0x5635aa310e50 2024-09-14T10:44:25.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53be2a640 1 -- 172.21.15.96:0/818481370 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd52c0083f0 con 0x5635aa310e50 2024-09-14T10:44:25.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 Processor -- start 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 -- start start 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4a8450 0x5635aa4a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53db239c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5635aa2b0d80 con 0x5635aa4a8450 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53ae28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4a8450 0x5635aa4a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53ae28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4a8450 0x5635aa4a8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38630/0 (socket says 172.21.15.96:38630) 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53ae28640 1 -- 172.21.15.96:0/1575026746 learned_addr learned my addr 172.21.15.96:0/1575026746 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.612+0000 7fd53ae28640 1 -- 172.21.15.96:0/1575026746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635aa4a8eb0 con 0x5635aa4a8450 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53ae28640 1 --2- 172.21.15.96:0/1575026746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4a8450 0x5635aa4a8870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd52400d660 tx=0x7fd52400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd425602640 1 -- 172.21.15.96:0/1575026746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd52400c6b0 con 0x5635aa4a8450 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd425602640 1 -- 172.21.15.96:0/1575026746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52400c850 con 0x5635aa4a8450 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53db239c0 1 -- 172.21.15.96:0/1575026746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635aa4a9710 con 0x5635aa4a8450 2024-09-14T10:44:25.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd425602640 1 -- 172.21.15.96:0/1575026746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd52400cb30 con 0x5635aa4a8450 2024-09-14T10:44:25.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53db239c0 1 -- 172.21.15.96:0/1575026746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635aa4a9c80 con 0x5635aa4a8450 2024-09-14T10:44:25.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd425602640 1 -- 172.21.15.96:0/1575026746 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd524023020 con 0x5635aa4a8450 2024-09-14T10:44:25.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd425602640 1 --2- 172.21.15.96:0/1575026746 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd41403a1f0 0x7fd41403c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd425602640 1 -- 172.21.15.96:0/1575026746 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd524021020 con 0x5635aa4a8450 2024-09-14T10:44:25.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53be2a640 1 --2- 172.21.15.96:0/1575026746 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd41403a1f0 0x7fd41403c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53db239c0 1 Processor -- start 2024-09-14T10:44:25.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53db239c0 1 -- start start 2024-09-14T10:44:25.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53be2a640 1 --2- 172.21.15.96:0/1575026746 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd41403a1f0 0x7fd41403c6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5635aa499640 tx=0x7fd52c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53db239c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53db239c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5635aa489f20 con 0x5635aa4b4db0 2024-09-14T10:44:25.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53ae28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53ae28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38636/0 (socket says 172.21.15.96:38636) 2024-09-14T10:44:25.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53ae28640 1 -- 172.21.15.96:0/3458111806 learned_addr learned my addr 172.21.15.96:0/3458111806 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53ae28640 1 -- 172.21.15.96:0/3458111806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635aa4b5760 con 0x5635aa4b4db0 2024-09-14T10:44:25.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd53ae28640 1 --2- 172.21.15.96:0/3458111806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4b5190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd524051790 tx=0x7fd5240193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff094c60fac98ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.616+0000 7fd41effd640 1 -- 172.21.15.96:0/3458111806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524050270 con 0x5635aa4b4db0 2024-09-14T10:44:25.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd41effd640 1 -- 172.21.15.96:0/3458111806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5240530d0 con 0x5635aa4b4db0 2024-09-14T10:44:25.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd41effd640 1 -- 172.21.15.96:0/3458111806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd52401bcc0 con 0x5635aa4b4db0 2024-09-14T10:44:25.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- 172.21.15.96:0/3458111806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 msgr2=0x5635aa4b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 --2- 172.21.15.96:0/3458111806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4b5190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd524051790 tx=0x7fd5240193e0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- 172.21.15.96:0/3458111806 shutdown_connections 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 --2- 172.21.15.96:0/3458111806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4b5190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- 172.21.15.96:0/3458111806 >> 172.21.15.96:0/3458111806 conn(0x5635aa4b11e0 msgr2=0x5635aa4af420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- 172.21.15.96:0/3458111806 shutdown_connections 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- 172.21.15.96:0/3458111806 wait complete. 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 Processor -- start 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- start start 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4bc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5635aa4b5dc0 con 0x5635aa4b4db0 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53ae28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4bc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53ae28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4bc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38638/0 (socket says 172.21.15.96:38638) 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 learned_addr learned my addr 172.21.15.96:0/198131720 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635aa4bc8a0 con 0x5635aa4b4db0 2024-09-14T10:44:25.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53ae28640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4bc340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd524023850 tx=0x7fd524051720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd41d7fa640 1 -- 172.21.15.96:0/198131720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524034020 con 0x5635aa4b4db0 2024-09-14T10:44:25.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635aa4bcb30 con 0x5635aa4b4db0 2024-09-14T10:44:25.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd41d7fa640 1 -- 172.21.15.96:0/198131720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd524019a70 con 0x5635aa4b4db0 2024-09-14T10:44:25.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd41d7fa640 1 -- 172.21.15.96:0/198131720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd524019c80 con 0x5635aa4b4db0 2024-09-14T10:44:25.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635aa4bcb30 con 0x5635aa4b4db0 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.620+0000 7fd41d7fa640 1 -- 172.21.15.96:0/198131720 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd524037020 con 0x5635aa4b4db0 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd41d7fa640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40403a150 0x7fd40403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd41d7fa640 1 -- 172.21.15.96:0/198131720 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd52404a040 con 0x5635aa4b4db0 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53be2a640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40403a150 0x7fd40403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa4c76e0 0x5635aa4c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4ca2c0 con 0x5635aa4c76e0 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53b629640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa4c76e0 0x5635aa4c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53be2a640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40403a150 0x7fd40403c610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00f010 tx=0x7fd52c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53b629640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa4c76e0 0x5635aa4c9b70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 realm 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4ca6d0 con 0x5635aa4c76e0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4cafa0 con 0x5635aa4c76e0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4cb340 con 0x5635aa4c76e0 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4cbb90 con 0x5635aa4c76e0 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 20 searching for the correct realm 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5635aa4cd900 0x5635aa4cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4cd900 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53ae28640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5635aa4cd900 0x5635aa4cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53ae28640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5635aa4cd900 0x5635aa4cfcf0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53ae28640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd524039020 0x7fd52403f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd524039020 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53be2a640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd524039020 0x7fd52403f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53be2a640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd524039020 0x7fd52403f7c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53be2a640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd52c019040 0x7fd52c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.624+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd52c019040 2024-09-14T10:44:25.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd52c019040 0x7fd52c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd52c019040 0x7fd52c019930 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4c76e0 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4c76e0 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd52c019040 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd52c019040 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd524039020 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4cd900 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4c76e0 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.628+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd52c019040 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4c76e0 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd524039020 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4cd900 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4cd900 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd52c019040 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4cd900 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4cd900 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4c76e0 2024-09-14T10:44:25.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4c76e0 2024-09-14T10:44:25.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd52c019040 2024-09-14T10:44:25.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.632+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4cd900 2024-09-14T10:44:25.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd524039020 2024-09-14T10:44:25.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4c76e0 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd52c019040 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x5635aa4cd900 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d0280 con 0x7fd52c019040 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd5340fd040 con 0x7fd524039020 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd5340fd040 con 0x5635aa4cd900 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd5340fd040 con 0x7fd52c019040 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd5340fd040 con 0x5635aa4c76e0 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd5340fd040 con 0x7fd524039020 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53db239c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53db239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53db239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53db239c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53db239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53db239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.636+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4cc4e0 con 0x5635aa4c76e0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4ccd80 con 0x5635aa4c76e0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4ccd80 con 0x5635aa4c76e0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 zone default found 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 4 Realm: () 2024-09-14T10:44:25.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 zonegroup default 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d06e0 con 0x7fd52c019040 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d21d0 con 0x5635aa4cd900 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d2650 con 0x5635aa4cd900 2024-09-14T10:44:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 started sync module instance, tier type = 2024-09-14T10:44:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d1570 con 0x7fd524039020 2024-09-14T10:44:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94788490434912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d11d0 con 0x7fd524039020 2024-09-14T10:44:25.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.640+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d3580 con 0x5635aa4c76e0 2024-09-14T10:44:25.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.644+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.644+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94788490440912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d34f0 con 0x5635aa4c76e0 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.644+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d44a0 con 0x5635aa4cd900 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.644+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94788490434912] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.644+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94788490440912] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.648+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.648+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94788490443120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d2ab0 con 0x5635aa4cd900 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.648+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d4d40 con 0x7fd524039020 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.648+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.648+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94788490447264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d5470 con 0x7fd524039020 2024-09-14T10:44:25.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.648+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d5f90 con 0x5635aa4c76e0 2024-09-14T10:44:25.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.648+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94788490443120] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.652+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.652+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94788490451552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d5f50 con 0x5635aa4c76e0 2024-09-14T10:44:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.652+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d69a0 con 0x7fd52c019040 2024-09-14T10:44:25.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.652+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94788490447264] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.652+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94788490451552] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.652+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.652+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94788490444688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d64f0 con 0x7fd52c019040 2024-09-14T10:44:25.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.652+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d6d40 con 0x7fd52c019040 2024-09-14T10:44:25.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.656+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.656+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94788490454736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d7120 con 0x7fd52c019040 2024-09-14T10:44:25.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.656+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d7c40 con 0x7fd52c019040 2024-09-14T10:44:25.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.656+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94788490444688] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94788490454736] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94788490458896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d6b70 con 0x7fd52c019040 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 20 add_watcher() i=0 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 20 add_watcher() i=1 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 20 add_watcher() i=2 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 20 add_watcher() i=3 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 20 add_watcher() i=4 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 20 add_watcher() i=5 2024-09-14T10:44:25.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 20 add_watcher() i=6 2024-09-14T10:44:25.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94788490458896] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 20 add_watcher() i=7 2024-09-14T10:44:25.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:25.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4dac30 con 0x5635aa4c76e0 2024-09-14T10:44:25.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.660+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94788490448576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4d80b0 con 0x5635aa4c76e0 2024-09-14T10:44:25.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94788490448576] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd3f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:25.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:25.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 5 note: GC not initialized 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd3f0fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 20 Filter name: none 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd36a7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4fe2d0 con 0x5635aa4c76e0 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:25.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:25.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa500d60 con 0x7fd524039020 2024-09-14T10:44:25.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa504980 con 0x5635aa4c76e0 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.664+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94788490642416 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635aa5034d0 con 0x5635aa4c76e0 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94788490451552 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5635aa491e80 con 0x5635aa4c76e0 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd41effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94788490451552 notifier 4312 bl.length()=567 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd41effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:25.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd41effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:25.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(65 notify.4 [notify cookie 94788490642416 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd41effd640 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd400003eb0 con 0x5635aa4c76e0 2024-09-14T10:44:25.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94788490642416 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635aa491520 con 0x5635aa4c76e0 2024-09-14T10:44:25.666 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:25.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd3f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94788490448576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa5034d0 con 0x5635aa4c76e0 2024-09-14T10:44:25.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94788490448576] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.668+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94788490434912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa5034d0 con 0x7fd524039020 2024-09-14T10:44:25.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.672+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94788490434912] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.672+0000 7fd53db239c0 20 remove_watcher() i=0 2024-09-14T10:44:25.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.672+0000 7fd53db239c0 2 removed watcher, disabling cache 2024-09-14T10:44:25.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.672+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94788490440912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa5034d0 con 0x5635aa4c76e0 2024-09-14T10:44:25.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.672+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94788490440912] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.672+0000 7fd53db239c0 20 remove_watcher() i=1 2024-09-14T10:44:25.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.672+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94788490443120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa5034d0 con 0x5635aa4cd900 2024-09-14T10:44:25.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.676+0000 7fd53ae28640 1 -- 172.21.15.96:0/198131720 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94788490443120] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd524015b90 con 0x5635aa4cd900 2024-09-14T10:44:25.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.676+0000 7fd53db239c0 20 remove_watcher() i=2 2024-09-14T10:44:25.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.676+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94788490447264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4fbed0 con 0x7fd524039020 2024-09-14T10:44:25.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.676+0000 7fd53be2a640 1 -- 172.21.15.96:0/198131720 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94788490447264] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd52c02f040 con 0x7fd524039020 2024-09-14T10:44:25.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.676+0000 7fd53db239c0 20 remove_watcher() i=3 2024-09-14T10:44:25.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.676+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94788490451552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4fbed0 con 0x5635aa4c76e0 2024-09-14T10:44:25.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.680+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94788490451552] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x5635aa4c76e0 2024-09-14T10:44:25.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.680+0000 7fd53db239c0 20 remove_watcher() i=4 2024-09-14T10:44:25.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.680+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94788490444688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4fbed0 con 0x7fd52c019040 2024-09-14T10:44:25.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.680+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94788490444688] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.680+0000 7fd53db239c0 20 remove_watcher() i=5 2024-09-14T10:44:25.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.680+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94788490454736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4fbed0 con 0x7fd52c019040 2024-09-14T10:44:25.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94788490454736] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 20 remove_watcher() i=6 2024-09-14T10:44:25.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94788490458896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635aa4fbed0 con 0x7fd52c019040 2024-09-14T10:44:25.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94788490458896] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5340cf070 con 0x7fd52c019040 2024-09-14T10:44:25.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 20 remove_watcher() i=7 2024-09-14T10:44:25.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd52c019040 msgr2=0x7fd52c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd52c019040 0x7fd52c019930 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa4c76e0 msgr2=0x5635aa4c9b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa4c76e0 0x5635aa4c9b70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd524039020 msgr2=0x7fd52403f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd524039020 0x7fd52403f7c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5635aa4cd900 msgr2=0x5635aa4cfcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5635aa4cd900 0x5635aa4cfcf0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40403a150 msgr2=0x7fd40403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd40403a150 0x7fd40403c610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00f010 tx=0x7fd52c01b070 comp rx=0 tx=0).stop 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 msgr2=0x5635aa4bc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/198131720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4b4db0 0x5635aa4bc340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd524023850 tx=0x7fd524051720 comp rx=0 tx=0).stop 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53b629640 1 -- 172.21.15.96:0/198131720 reap_dead start 2024-09-14T10:44:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 shutdown_connections 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 >> 172.21.15.96:0/198131720 conn(0x5635aa4b11e0 msgr2=0x5635aa4af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 shutdown_connections 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/198131720 wait complete. 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/1575026746 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd41403a1f0 msgr2=0x7fd41403c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/1575026746 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd41403a1f0 0x7fd41403c6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5635aa499640 tx=0x7fd52c003070 comp rx=0 tx=0).stop 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/1575026746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4a8450 msgr2=0x5635aa4a8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/1575026746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4a8450 0x5635aa4a8870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd52400d660 tx=0x7fd52400da60 comp rx=0 tx=0).stop 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/1575026746 shutdown_connections 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/1575026746 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd41403a1f0 0x7fd41403c6b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/1575026746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa4a8450 0x5635aa4a8870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/1575026746 >> 172.21.15.96:0/1575026746 conn(0x5635aa49de00 msgr2=0x5635aa49e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/1575026746 shutdown_connections 2024-09-14T10:44:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/1575026746 wait complete. 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa310e50 msgr2=0x5635aa497e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa310e50 0x5635aa497e50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd42003a150 msgr2=0x7fd42003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd42003a150 0x7fd42003c610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd524001d80 tx=0x7fd5240012e0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 msgr2=0x5635aa490d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa490d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd5340aa500 tx=0x7fd534017d70 comp rx=0 tx=0).stop 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 shutdown_connections 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5635aa310e50 0x5635aa497e50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd42003a150 0x7fd42003c610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 --2- 172.21.15.96:0/818481370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5635aa310a70 0x5635aa490d30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.684+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 >> 172.21.15.96:0/818481370 conn(0x5635aa3969c0 msgr2=0x5635aa48a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.688+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 shutdown_connections 2024-09-14T10:44:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.688+0000 7fd53db239c0 1 -- 172.21.15.96:0/818481370 wait complete. 2024-09-14T10:44:25.693 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:25.693 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:44:25.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:44:25.693 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:44:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe41489c0 1 Processor -- start 2024-09-14T10:44:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe41489c0 1 -- start start 2024-09-14T10:44:25.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe41489c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5649581adfd0 0x5649581ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe41489c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649580567a0 con 0x5649581b1110 2024-09-14T10:44:25.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe41489c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5649580b21b0 con 0x5649581adfd0 2024-09-14T10:44:25.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe1c4e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5649581adfd0 0x5649581ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe144d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5649581b1110 0x5649581b3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34256/0 (socket says 172.21.15.96:34256) 2024-09-14T10:44:25.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe1c4e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5649581adfd0 0x5649581ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38650/0 (socket says 172.21.15.96:38650) 2024-09-14T10:44:25.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe144d640 1 -- 172.21.15.96:0/381122183 learned_addr learned my addr 172.21.15.96:0/381122183 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:25.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe1c4e640 1 -- 172.21.15.96:0/381122183 >> v1:172.21.15.70:6789/0 conn(0x5649581b1110 legacy=0x5649581b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.772+0000 7fefe1c4e640 1 -- 172.21.15.96:0/381122183 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564958030da0 con 0x5649581adfd0 2024-09-14T10:44:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe1c4e640 1 --2- 172.21.15.96:0/381122183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649581ae3b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00a420 tx=0x7fefdc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4cf2b0a270217e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe0c4c640 1 -- 172.21.15.96:0/381122183 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0af070 con 0x5649581adfd0 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe0c4c640 1 -- 172.21.15.96:0/381122183 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefdc0aa530 con 0x5649581adfd0 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe0c4c640 1 -- 172.21.15.96:0/381122183 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0aa850 con 0x5649581adfd0 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe41489c0 1 -- 172.21.15.96:0/381122183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 msgr2=0x5649581ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe41489c0 1 --2- 172.21.15.96:0/381122183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649581ae3b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00a420 tx=0x7fefdc01afd0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe41489c0 1 -- 172.21.15.96:0/381122183 shutdown_connections 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe41489c0 1 --2- 172.21.15.96:0/381122183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649581ae3b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe41489c0 1 -- 172.21.15.96:0/381122183 >> 172.21.15.96:0/381122183 conn(0x5649581a9af0 msgr2=0x5649581abf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe41489c0 1 -- 172.21.15.96:0/381122183 shutdown_connections 2024-09-14T10:44:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.776+0000 7fefe41489c0 1 -- 172.21.15.96:0/381122183 wait complete. 2024-09-14T10:44:25.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe41489c0 1 Processor -- start 2024-09-14T10:44:25.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe41489c0 1 -- start start 2024-09-14T10:44:25.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe41489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x564958299330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe41489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5649580b5fc0 con 0x5649581adfd0 2024-09-14T10:44:25.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe1c4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x564958299330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe1c4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x564958299330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38664/0 (socket says 172.21.15.96:38664) 2024-09-14T10:44:25.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe1c4e640 1 -- 172.21.15.96:0/270119284 learned_addr learned my addr 172.21.15.96:0/270119284 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe1c4e640 1 -- 172.21.15.96:0/270119284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564958299920 con 0x5649581adfd0 2024-09-14T10:44:25.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7fefe1c4e640 1 --2- 172.21.15.96:0/270119284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x564958299330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fefdc018c00 tx=0x7fefdc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba1ebb6b86dda6e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7feecfe07640 1 -- 172.21.15.96:0/270119284 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0af040 con 0x5649581adfd0 2024-09-14T10:44:25.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7feecfe07640 1 -- 172.21.15.96:0/270119284 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefdc0aaa00 con 0x5649581adfd0 2024-09-14T10:44:25.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.788+0000 7feecfe07640 1 -- 172.21.15.96:0/270119284 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0aace0 con 0x5649581adfd0 2024-09-14T10:44:25.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- 172.21.15.96:0/270119284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 msgr2=0x564958299330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 --2- 172.21.15.96:0/270119284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x564958299330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fefdc018c00 tx=0x7fefdc0033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- 172.21.15.96:0/270119284 shutdown_connections 2024-09-14T10:44:25.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 --2- 172.21.15.96:0/270119284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x564958299330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- 172.21.15.96:0/270119284 >> 172.21.15.96:0/270119284 conn(0x5649581a9af0 msgr2=0x564958294f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- 172.21.15.96:0/270119284 shutdown_connections 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- 172.21.15.96:0/270119284 wait complete. 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 Processor -- start 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- start start 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649582a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564958057a50 con 0x5649581adfd0 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe1c4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649582a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe1c4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649582a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38668/0 (socket says 172.21.15.96:38668) 2024-09-14T10:44:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe1c4e640 1 -- 172.21.15.96:0/2524723360 learned_addr learned my addr 172.21.15.96:0/2524723360 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe1c4e640 1 -- 172.21.15.96:0/2524723360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649582a1020 con 0x5649581adfd0 2024-09-14T10:44:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe1c4e640 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649582a0ac0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fefdc018c00 tx=0x7fefdc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7feece604640 1 -- 172.21.15.96:0/2524723360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0c5070 con 0x5649581adfd0 2024-09-14T10:44:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649582a12b0 con 0x5649581adfd0 2024-09-14T10:44:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7feece604640 1 -- 172.21.15.96:0/2524723360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefdc0c1690 con 0x5649581adfd0 2024-09-14T10:44:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7feece604640 1 -- 172.21.15.96:0/2524723360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefdc0c19b0 con 0x5649581adfd0 2024-09-14T10:44:25.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649582a1ce0 con 0x5649581adfd0 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7feece604640 1 -- 172.21.15.96:0/2524723360 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fefdc0b5470 con 0x5649581adfd0 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7feece604640 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feec803a150 0x7feec803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.792+0000 7feece604640 1 -- 172.21.15.96:0/2524723360 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fefdc0bb070 con 0x5649581adfd0 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe144d640 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feec803a150 0x7feec803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649581b1110 0x5649582a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582a8170 con 0x5649581b1110 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe244f640 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649581b1110 0x5649582a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe144d640 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feec803a150 0x7feec803c610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefd8004180 tx=0x7fefd8001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe244f640 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649581b1110 0x5649582a7c30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe244f640 1 -- 172.21.15.96:0/2524723360 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefd40083f0 con 0x5649581b1110 2024-09-14T10:44:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582a8570 con 0x5649581b1110 2024-09-14T10:44:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe244f640 1 -- 172.21.15.96:0/2524723360 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefd40083f0 con 0x5649581b1110 2024-09-14T10:44:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582a9e70 con 0x5649581b1110 2024-09-14T10:44:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe244f640 1 -- 172.21.15.96:0/2524723360 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefd40083f0 con 0x5649581b1110 2024-09-14T10:44:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582a90a0 con 0x5649581b1110 2024-09-14T10:44:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe244f640 1 -- 172.21.15.96:0/2524723360 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefd40083f0 con 0x5649581b1110 2024-09-14T10:44:25.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582a94c0 con 0x5649581b1110 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe244f640 1 -- 172.21.15.96:0/2524723360 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fefd40083f0 con 0x5649581b1110 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 Processor -- start 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 -- start start 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581244a0 0x564958122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe41489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5649580c2d80 con 0x5649581244a0 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe144d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581244a0 0x564958122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe144d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581244a0 0x564958122d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38676/0 (socket says 172.21.15.96:38676) 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe144d640 1 -- 172.21.15.96:0/3381144986 learned_addr learned my addr 172.21.15.96:0/3381144986 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe144d640 1 -- 172.21.15.96:0/3381144986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649581249c0 con 0x5649581244a0 2024-09-14T10:44:25.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.796+0000 7fefe144d640 1 --2- 172.21.15.96:0/3381144986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581244a0 0x564958122d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fefd800d660 tx=0x7fefd800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec77fe640 1 -- 172.21.15.96:0/3381144986 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd800c6b0 con 0x5649581244a0 2024-09-14T10:44:25.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec77fe640 1 -- 172.21.15.96:0/3381144986 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd800c850 con 0x5649581244a0 2024-09-14T10:44:25.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 -- 172.21.15.96:0/3381144986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564958123280 con 0x5649581244a0 2024-09-14T10:44:25.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec77fe640 1 -- 172.21.15.96:0/3381144986 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd800cb30 con 0x5649581244a0 2024-09-14T10:44:25.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 -- 172.21.15.96:0/3381144986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649581237f0 con 0x5649581244a0 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec77fe640 1 -- 172.21.15.96:0/3381144986 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fefd8023020 con 0x5649581244a0 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec77fe640 1 --2- 172.21.15.96:0/3381144986 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feebc03a150 0x7feebc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec77fe640 1 -- 172.21.15.96:0/3381144986 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fefd8021020 con 0x5649581244a0 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe244f640 1 --2- 172.21.15.96:0/3381144986 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feebc03a150 0x7feebc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 Processor -- start 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 -- start start 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe244f640 1 --2- 172.21.15.96:0/3381144986 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feebc03a150 0x7feebc03c610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5649582a9440 tx=0x7fefd4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564958299c90 con 0x5649582c7dd0 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe144d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe144d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38692/0 (socket says 172.21.15.96:38692) 2024-09-14T10:44:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe144d640 1 -- 172.21.15.96:0/2578207187 learned_addr learned my addr 172.21.15.96:0/2578207187 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe144d640 1 -- 172.21.15.96:0/2578207187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649582c87c0 con 0x5649582c7dd0 2024-09-14T10:44:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe144d640 1 --2- 172.21.15.96:0/2578207187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582c81d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fefd8051820 tx=0x7fefd8044760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d5eb48f53fd537 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec57fa640 1 -- 172.21.15.96:0/2578207187 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd80530d0 con 0x5649582c7dd0 2024-09-14T10:44:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec57fa640 1 -- 172.21.15.96:0/2578207187 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd804ae50 con 0x5649582c7dd0 2024-09-14T10:44:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7feec57fa640 1 -- 172.21.15.96:0/2578207187 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd801bcc0 con 0x5649582c7dd0 2024-09-14T10:44:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 -- 172.21.15.96:0/2578207187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 msgr2=0x5649582c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2578207187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582c81d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fefd8051820 tx=0x7fefd8044760 comp rx=0 tx=0).stop 2024-09-14T10:44:25.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 -- 172.21.15.96:0/2578207187 shutdown_connections 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2578207187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582c81d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.800+0000 7fefe41489c0 1 -- 172.21.15.96:0/2578207187 >> 172.21.15.96:0/2578207187 conn(0x5649582c31f0 msgr2=0x5649582c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 -- 172.21.15.96:0/2578207187 shutdown_connections 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 -- 172.21.15.96:0/2578207187 wait complete. 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 Processor -- start 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 -- start start 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5649582c6d20 con 0x5649582c7dd0 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe144d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe144d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38696/0 (socket says 172.21.15.96:38696) 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 learned_addr learned my addr 172.21.15.96:0/1519290225 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649582ce830 con 0x5649582c7dd0 2024-09-14T10:44:25.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe144d640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582ce2d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fefd8023fd0 tx=0x7fefd80517b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7feeb37fe640 1 -- 172.21.15.96:0/1519290225 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd8034020 con 0x5649582c7dd0 2024-09-14T10:44:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649582ceac0 con 0x5649582c7dd0 2024-09-14T10:44:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7feeb37fe640 1 -- 172.21.15.96:0/1519290225 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd8043380 con 0x5649582c7dd0 2024-09-14T10:44:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7feeb37fe640 1 -- 172.21.15.96:0/1519290225 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefd8019ba0 con 0x5649582c7dd0 2024-09-14T10:44:25.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649582ceac0 con 0x5649582c7dd0 2024-09-14T10:44:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7feeb37fe640 1 -- 172.21.15.96:0/1519290225 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fefd8037020 con 0x5649582c7dd0 2024-09-14T10:44:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7feeb37fe640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feeac03a100 0x7feeac03c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7feeb37fe640 1 -- 172.21.15.96:0/1519290225 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fefd8050070 con 0x5649582c7dd0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe244f640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feeac03a100 0x7feeac03c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649582d96d0 0x5649582dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582dc2b0 con 0x5649582d96d0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe1c4e640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649582d96d0 0x5649582dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe244f640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feeac03a100 0x7feeac03c5c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefd400f010 tx=0x7fefd401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.804+0000 7fefe1c4e640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649582d96d0 0x5649582dbb60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 realm 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582dc6c0 con 0x5649582d96d0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582dcf90 con 0x5649582d96d0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd330 con 0x5649582d96d0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 20 searching for the correct realm 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649582df7e0 0x5649582e1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582e2280 con 0x5649582df7e0 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe144d640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649582df7e0 0x5649582e1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe144d640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649582df7e0 0x5649582e1bd0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe144d640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fefd8039020 0x7fefd8015740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582e2280 con 0x7fefd8039020 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe244f640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fefd8039020 0x7fefd8015740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe244f640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fefd8039020 0x7fefd8015740 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe244f640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fefd4019040 0x7fefd4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582e2280 con 0x7fefd4019040 2024-09-14T10:44:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fefd4019040 0x7fefd4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fefd4019040 0x7fefd4019930 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.808+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd4019040 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd4019040 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd8039020 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582df7e0 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd4019040 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd8039020 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582df7e0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582df7e0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.812+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd4019040 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582df7e0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582df7e0 2024-09-14T10:44:25.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd4019040 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582df7e0 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd8039020 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd4019040 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582df7e0 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd4019040 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd8039020 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.816+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582df7e0 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd4019040 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x5649582d96d0 2024-09-14T10:44:25.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649582dd790 con 0x7fefd8039020 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582de100 con 0x5649582d96d0 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582de100 con 0x5649582d96d0 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582de100 con 0x5649582d96d0 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 zone default found 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 4 Realm: () 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:25.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 zonegroup default 2024-09-14T10:44:25.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582de540 con 0x7fefd4019040 2024-09-14T10:44:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582de980 con 0x5649582df7e0 2024-09-14T10:44:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582e40d0 con 0x5649582df7e0 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 started sync module instance, tier type = 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.820+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e3570 con 0x7fefd8039020 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.824+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.824+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94873012023488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e4470 con 0x7fefd8039020 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.824+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e4cc0 con 0x5649582d96d0 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.824+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.824+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94873012028832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e50f0 con 0x5649582d96d0 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.824+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e5be0 con 0x5649582df7e0 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.824+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94873012023488] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.828+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94873012028832] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.828+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.828+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94873012033200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e4ac0 con 0x5649582df7e0 2024-09-14T10:44:25.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.828+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e6480 con 0x7fefd8039020 2024-09-14T10:44:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.828+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.828+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94873012035840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e6d20 con 0x7fefd8039020 2024-09-14T10:44:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.828+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e7720 con 0x5649582d96d0 2024-09-14T10:44:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.828+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94873012033200] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.832+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.832+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94873012025744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e76e0 con 0x5649582d96d0 2024-09-14T10:44:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.832+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e8130 con 0x7fefd4019040 2024-09-14T10:44:25.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.832+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94873012035840] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.832+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94873012025744] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.836+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.836+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94873012040240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e6980 con 0x7fefd4019040 2024-09-14T10:44:25.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.836+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e85e0 con 0x7fefd4019040 2024-09-14T10:44:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.836+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94873012040240] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.836+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.836+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94873012042880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e8550 con 0x7fefd4019040 2024-09-14T10:44:25.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.836+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e8e00 con 0x7fefd4019040 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94873012045136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e8970 con 0x7fefd4019040 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 20 add_watcher() i=0 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 20 add_watcher() i=1 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 20 add_watcher() i=2 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 20 add_watcher() i=3 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 20 add_watcher() i=4 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 20 add_watcher() i=5 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94873012042880] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 20 add_watcher() i=6 2024-09-14T10:44:25.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94873012045136] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 20 add_watcher() i=7 2024-09-14T10:44:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649582e80a0 con 0x5649582d96d0 2024-09-14T10:44:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94873012043936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e97b0 con 0x5649582d96d0 2024-09-14T10:44:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.840+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94873012043936] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fee937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 5 note: GC not initialized 2024-09-14T10:44:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fee927fc640 20 reqs_thread_entry: start 2024-09-14T10:44:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 20 Filter name: none 2024-09-14T10:44:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fee03fff640 20 reqs_thread_entry: start 2024-09-14T10:44:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56495830f5d0 con 0x5649582d96d0 2024-09-14T10:44:25.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:25.842 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fee937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94873012043936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56495830e2c0 con 0x5649582d96d0 2024-09-14T10:44:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94873012043936] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.844+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94873012023488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e80a0 con 0x7fefd8039020 2024-09-14T10:44:25.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.848+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94873012023488] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.848+0000 7fefe41489c0 20 remove_watcher() i=0 2024-09-14T10:44:25.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.848+0000 7fefe41489c0 2 removed watcher, disabling cache 2024-09-14T10:44:25.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.848+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94873012028832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e30c0 con 0x5649582d96d0 2024-09-14T10:44:25.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.848+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94873012028832] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.848+0000 7fefe41489c0 20 remove_watcher() i=1 2024-09-14T10:44:25.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.848+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94873012033200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e80a0 con 0x5649582df7e0 2024-09-14T10:44:25.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe144d640 1 -- 172.21.15.96:0/1519290225 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94873012033200] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd8010d70 con 0x5649582df7e0 2024-09-14T10:44:25.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe41489c0 20 remove_watcher() i=2 2024-09-14T10:44:25.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94873012035840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e56b0 con 0x7fefd8039020 2024-09-14T10:44:25.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe244f640 1 -- 172.21.15.96:0/1519290225 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94873012035840] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefd402f040 con 0x7fefd8039020 2024-09-14T10:44:25.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe41489c0 20 remove_watcher() i=3 2024-09-14T10:44:25.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94873012025744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e6100 con 0x5649582d96d0 2024-09-14T10:44:25.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94873012025744] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x5649582d96d0 2024-09-14T10:44:25.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe41489c0 20 remove_watcher() i=4 2024-09-14T10:44:25.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.852+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94873012040240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e6100 con 0x7fefd4019040 2024-09-14T10:44:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.856+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94873012040240] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.856+0000 7fefe41489c0 20 remove_watcher() i=5 2024-09-14T10:44:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.856+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94873012042880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e6100 con 0x7fefd4019040 2024-09-14T10:44:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.856+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94873012042880] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.856+0000 7fefe41489c0 20 remove_watcher() i=6 2024-09-14T10:44:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.856+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94873012045136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649582e7c80 con 0x7fefd4019040 2024-09-14T10:44:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94873012045136] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefdc0c7070 con 0x7fefd4019040 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 20 remove_watcher() i=7 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fefd4019040 msgr2=0x7fefd4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fefd4019040 0x7fefd4019930 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649582d96d0 msgr2=0x5649582dbb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649582d96d0 0x5649582dbb60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fefd8039020 msgr2=0x7fefd8015740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fefd8039020 0x7fefd8015740 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649582df7e0 msgr2=0x5649582e1bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649582df7e0 0x5649582e1bd0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feeac03a100 msgr2=0x7feeac03c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feeac03a100 0x7feeac03c5c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefd400f010 tx=0x7fefd401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 msgr2=0x5649582ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/1519290225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649582c7dd0 0x5649582ce2d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fefd8023fd0 tx=0x7fefd80517b0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 reap_dead start 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe1c4e640 1 -- 172.21.15.96:0/1519290225 reap_dead start 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 shutdown_connections 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 >> 172.21.15.96:0/1519290225 conn(0x5649582c31f0 msgr2=0x5649582c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 shutdown_connections 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/1519290225 wait complete. 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/3381144986 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feebc03a150 msgr2=0x7feebc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/3381144986 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feebc03a150 0x7feebc03c610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5649582a9440 tx=0x7fefd4003070 comp rx=0 tx=0).stop 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/3381144986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581244a0 msgr2=0x564958122d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/3381144986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581244a0 0x564958122d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fefd800d660 tx=0x7fefd800da60 comp rx=0 tx=0).stop 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/3381144986 shutdown_connections 2024-09-14T10:44:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/3381144986 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feebc03a150 0x7feebc03c610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/3381144986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581244a0 0x564958122d40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/3381144986 >> 172.21.15.96:0/3381144986 conn(0x5649582adc10 msgr2=0x5649582adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/3381144986 shutdown_connections 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/3381144986 wait complete. 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649581b1110 msgr2=0x5649582a7c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649581b1110 0x5649582a7c30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feec803a150 msgr2=0x7feec803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feec803a150 0x7feec803c610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fefd8004180 tx=0x7fefd8001340 comp rx=0 tx=0).stop 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 msgr2=0x5649582a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649582a0ac0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fefdc018c00 tx=0x7fefdc017d70 comp rx=0 tx=0).stop 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 shutdown_connections 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649581b1110 0x5649582a7c30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feec803a150 0x7feec803c610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 --2- 172.21.15.96:0/2524723360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649581adfd0 0x5649582a0ac0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 >> 172.21.15.96:0/2524723360 conn(0x5649581a9af0 msgr2=0x56495829a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 shutdown_connections 2024-09-14T10:44:25.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.860+0000 7fefe41489c0 1 -- 172.21.15.96:0/2524723360 wait complete. 2024-09-14T10:44:25.868 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:25.868 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-14T10:44:25.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-14T10:44:25.869 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-14T10:44:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:25.941 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cdaa49c0 1 Processor -- start 2024-09-14T10:44:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cdaa49c0 1 -- start start 2024-09-14T10:44:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cdaa49c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55bb41225090 0x55bb41227480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cdaa49c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb410ca7a0 con 0x55bb41220ea0 2024-09-14T10:44:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cdaa49c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55bb411261b0 con 0x55bb41225090 2024-09-14T10:44:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cada9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55bb41225090 0x55bb41227480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cb5aa640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55bb41220ea0 0x55bb41221280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34262/0 (socket says 172.21.15.96:34262) 2024-09-14T10:44:25.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/1455199991 learned_addr learned my addr 172.21.15.96:0/1455199991 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:25.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cada9640 1 -- 172.21.15.96:0/1455199991 >> v1:172.21.15.70:6789/0 conn(0x55bb41220ea0 legacy=0x55bb41221280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.944+0000 7fd2cada9640 1 -- 172.21.15.96:0/1455199991 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb410a4da0 con 0x55bb41225090 2024-09-14T10:44:25.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2cada9640 1 --2- 172.21.15.96:0/1455199991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41227480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000a480 tx=0x7fd2c001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e55db2fb4370cc server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2ca5a8640 1 -- 172.21.15.96:0/1455199991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c00aa570 con 0x55bb41225090 2024-09-14T10:44:25.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2ca5a8640 1 -- 172.21.15.96:0/1455199991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c00af070 con 0x55bb41225090 2024-09-14T10:44:25.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2ca5a8640 1 -- 172.21.15.96:0/1455199991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c00aa860 con 0x55bb41225090 2024-09-14T10:44:25.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/1455199991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 msgr2=0x55bb41227480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/1455199991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41227480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000a480 tx=0x7fd2c001b310 comp rx=0 tx=0).stop 2024-09-14T10:44:25.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/1455199991 shutdown_connections 2024-09-14T10:44:25.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/1455199991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41227480 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/1455199991 >> 172.21.15.96:0/1455199991 conn(0x55bb4121c9c0 msgr2=0x55bb4121ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/1455199991 shutdown_connections 2024-09-14T10:44:25.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.948+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/1455199991 wait complete. 2024-09-14T10:44:25.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.960+0000 7fd2cdaa49c0 1 Processor -- start 2024-09-14T10:44:25.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.960+0000 7fd2cdaa49c0 1 -- start start 2024-09-14T10:44:25.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.960+0000 7fd2cdaa49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41220ea0 0x55bb4130b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.960+0000 7fd2cdaa49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bb41129fc0 con 0x55bb41220ea0 2024-09-14T10:44:25.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41220ea0 0x55bb4130b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41220ea0 0x55bb4130b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38720/0 (socket says 172.21.15.96:38720) 2024-09-14T10:44:25.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/3886195866 learned_addr learned my addr 172.21.15.96:0/3886195866 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/3886195866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb4130b7b0 con 0x55bb41220ea0 2024-09-14T10:44:25.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 --2- 172.21.15.96:0/3886195866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41220ea0 0x55bb4130b1c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4001810 tx=0x7fd2c4001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8070d04b5b34e5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd1b960a640 1 -- 172.21.15.96:0/3886195866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c4004530 con 0x55bb41220ea0 2024-09-14T10:44:25.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd1b960a640 1 -- 172.21.15.96:0/3886195866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c40046d0 con 0x55bb41220ea0 2024-09-14T10:44:25.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd1b960a640 1 -- 172.21.15.96:0/3886195866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c40049f0 con 0x55bb41220ea0 2024-09-14T10:44:25.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/3886195866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41220ea0 msgr2=0x55bb4130b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/3886195866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41220ea0 0x55bb4130b1c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4001810 tx=0x7fd2c4001cd0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/3886195866 shutdown_connections 2024-09-14T10:44:25.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/3886195866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41220ea0 0x55bb4130b1c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/3886195866 >> 172.21.15.96:0/3886195866 conn(0x55bb4121c9c0 msgr2=0x55bb41306e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/3886195866 shutdown_connections 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/3886195866 wait complete. 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 Processor -- start 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 -- start start 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41312d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cdaa49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bb410cba50 con 0x55bb41225090 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41312d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41312d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38732/0 (socket says 172.21.15.96:38732) 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/327918434 learned_addr learned my addr 172.21.15.96:0/327918434 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/327918434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb413132d0 con 0x55bb41225090 2024-09-14T10:44:25.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.964+0000 7fd2cb5aa640 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41312d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4000f90 tx=0x7fd2c4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd1b7e07640 1 -- 172.21.15.96:0/327918434 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c4013630 con 0x55bb41225090 2024-09-14T10:44:25.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb41313560 con 0x55bb41225090 2024-09-14T10:44:25.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd1b7e07640 1 -- 172.21.15.96:0/327918434 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c40137d0 con 0x55bb41225090 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd1b7e07640 1 -- 172.21.15.96:0/327918434 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c4013ad0 con 0x55bb41225090 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb41313e20 con 0x55bb41225090 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd1b7e07640 1 -- 172.21.15.96:0/327918434 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd2c4010070 con 0x55bb41225090 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd1b7e07640 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1b003a150 0x7fd1b003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd1b7e07640 1 -- 172.21.15.96:0/327918434 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd2c4018070 con 0x55bb41225090 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cada9640 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1b003a150 0x7fd1b003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb41317de0 0x55bb4131a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb4131a710 con 0x55bb41317de0 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb41317de0 0x55bb4131a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cada9640 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1b003a150 0x7fd1b003c610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00ae000 tx=0x7fd2c00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb41317de0 0x55bb4131a1d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cbdab640 1 -- 172.21.15.96:0/327918434 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2bc0083f0 con 0x55bb41317de0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb4131aad0 con 0x55bb41317de0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cbdab640 1 -- 172.21.15.96:0/327918434 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2bc0083f0 con 0x55bb41317de0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb4131c3d0 con 0x55bb41317de0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cbdab640 1 -- 172.21.15.96:0/327918434 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd2bc0083f0 con 0x55bb41317de0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb4131b600 con 0x55bb41317de0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cbdab640 1 -- 172.21.15.96:0/327918434 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2bc0083f0 con 0x55bb41317de0 2024-09-14T10:44:25.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.968+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb4131ba50 con 0x55bb41317de0 2024-09-14T10:44:25.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cbdab640 1 -- 172.21.15.96:0/327918434 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2bc0083f0 con 0x55bb41317de0 2024-09-14T10:44:25.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cdaa49c0 1 Processor -- start 2024-09-14T10:44:25.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cdaa49c0 1 -- start start 2024-09-14T10:44:25.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cdaa49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4132a770 0x55bb4132ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cdaa49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bb41136d80 con 0x55bb4132a770 2024-09-14T10:44:25.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cada9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4132a770 0x55bb4132ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cada9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4132a770 0x55bb4132ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38736/0 (socket says 172.21.15.96:38736) 2024-09-14T10:44:25.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cada9640 1 -- 172.21.15.96:0/2573188206 learned_addr learned my addr 172.21.15.96:0/2573188206 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cada9640 1 -- 172.21.15.96:0/2573188206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb4132b1d0 con 0x55bb4132a770 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cada9640 1 --2- 172.21.15.96:0/2573188206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4132a770 0x55bb4132ab90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0018f40 tx=0x7fd2c00180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd1b5602640 1 -- 172.21.15.96:0/2573188206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c00c5030 con 0x55bb4132a770 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd1b5602640 1 -- 172.21.15.96:0/2573188206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c00b5950 con 0x55bb4132a770 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2573188206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb4132ba30 con 0x55bb4132a770 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd1b5602640 1 -- 172.21.15.96:0/2573188206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c00b5c30 con 0x55bb4132a770 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2573188206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb4132bfa0 con 0x55bb4132a770 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd1b5602640 1 -- 172.21.15.96:0/2573188206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd2c00c8030 con 0x55bb4132a770 2024-09-14T10:44:25.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd1b5602640 1 --2- 172.21.15.96:0/2573188206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1a403a150 0x7fd1a403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd1b5602640 1 -- 172.21.15.96:0/2573188206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd2c00c6070 con 0x55bb4132a770 2024-09-14T10:44:25.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/2573188206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1a403a150 0x7fd1a403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cdaa49c0 1 Processor -- start 2024-09-14T10:44:25.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.972+0000 7fd2cdaa49c0 1 -- start start 2024-09-14T10:44:25.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/2573188206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1a403a150 0x7fd1a403c610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55bb4131b120 tx=0x7fd2bc003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb4133c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bb4130bbe0 con 0x55bb4133c450 2024-09-14T10:44:25.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb4133c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb4133c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38748/0 (socket says 172.21.15.96:38748) 2024-09-14T10:44:25.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 -- 172.21.15.96:0/2997512794 learned_addr learned my addr 172.21.15.96:0/2997512794 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 -- 172.21.15.96:0/2997512794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb4133ce40 con 0x55bb4133c450 2024-09-14T10:44:25.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 --2- 172.21.15.96:0/2997512794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb4133c850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00ccfd0 tx=0x7fd2c00b5dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6340618c22888485 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd1aeffd640 1 -- 172.21.15.96:0/2997512794 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c00e9030 con 0x55bb4133c450 2024-09-14T10:44:25.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd1aeffd640 1 -- 172.21.15.96:0/2997512794 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0006390 con 0x55bb4133c450 2024-09-14T10:44:25.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd1aeffd640 1 -- 172.21.15.96:0/2997512794 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c0006710 con 0x55bb4133c450 2024-09-14T10:44:25.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2997512794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 msgr2=0x55bb4133c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:25.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2997512794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb4133c850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00ccfd0 tx=0x7fd2c00b5dd0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2997512794 shutdown_connections 2024-09-14T10:44:25.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2997512794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb4133c850 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:25.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2997512794 >> 172.21.15.96:0/2997512794 conn(0x55bb413333c0 msgr2=0x55bb41331600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:25.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2997512794 shutdown_connections 2024-09-14T10:44:25.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2997512794 wait complete. 2024-09-14T10:44:25.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 Processor -- start 2024-09-14T10:44:25.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- start start 2024-09-14T10:44:25.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb413429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bb4133b3b0 con 0x55bb4133c450 2024-09-14T10:44:25.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb413429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb413429b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38758/0 (socket says 172.21.15.96:38758) 2024-09-14T10:44:25.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 learned_addr learned my addr 172.21.15.96:0/2635581550 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:25.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb41342f10 con 0x55bb4133c450 2024-09-14T10:44:25.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cada9640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb413429b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00ccfd0 tx=0x7fd2c00ec020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd1ad7fa640 1 -- 172.21.15.96:0/2635581550 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c00f2070 con 0x55bb4133c450 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb413431a0 con 0x55bb4133c450 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd1ad7fa640 1 -- 172.21.15.96:0/2635581550 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c00b46b0 con 0x55bb4133c450 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb41343b50 con 0x55bb4133c450 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.976+0000 7fd1ad7fa640 1 -- 172.21.15.96:0/2635581550 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2c00b4990 con 0x55bb4133c450 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd1ad7fa640 1 -- 172.21.15.96:0/2635581550 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd2c00f5070 con 0x55bb4133c450 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd1ad7fa640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd19403a150 0x7fd19403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd1ad7fa640 1 -- 172.21.15.96:0/2635581550 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd2c00f8ca0 con 0x55bb4133c450 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd19403a150 0x7fd19403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb4134df90 0x55bb41350420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41350b70 con 0x55bb4134df90 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cb5aa640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb4134df90 0x55bb41350420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd19403a150 0x7fd19403c610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00f010 tx=0x7fd2bc01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cb5aa640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb4134df90 0x55bb41350420 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 realm 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41350f80 con 0x55bb4134df90 2024-09-14T10:44:25.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351850 con 0x55bb4134df90 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:25.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41352440 con 0x55bb4134df90 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 20 searching for the correct realm 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55bb41353cb0 0x55bb41356150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb413567d0 con 0x55bb41353cb0 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cada9640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55bb41353cb0 0x55bb41356150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cada9640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55bb41353cb0 0x55bb41356150 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cada9640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd2c00f7060 0x7fd2c00ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.980+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb413567d0 con 0x7fd2c00f7060 2024-09-14T10:44:26.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd2c00f7060 0x7fd2c00ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd2c00f7060 0x7fd2c00ca410 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cbdab640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd2bc019040 0x7fd2bc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb413567d0 con 0x7fd2bc019040 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd2bc019040 0x7fd2bc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd2bc019040 0x7fd2bc019930 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x7fd2bc019040 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:26.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2bc019040 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x7fd2bc019040 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2bc019040 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x7fd2bc019040 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2c00f7060 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb41353cb0 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.984+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2bc019040 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x7fd2bc019040 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2c00f7060 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb41353cb0 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb41353cb0 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2bc019040 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x7fd2bc019040 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb41353cb0 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb41353cb0 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.988+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2bc019040 2024-09-14T10:44:26.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c401b030 con 0x7fd2bc019040 2024-09-14T10:44:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb41353cb0 2024-09-14T10:44:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2c00f7060 2024-09-14T10:44:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd2c401b030 con 0x55bb4134df90 2024-09-14T10:44:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2bc019040 2024-09-14T10:44:26.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb41353cb0 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2bc019040 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2c00f7060 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb41353cb0 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2bc019040 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x55bb4134df90 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb41351bf0 con 0x7fd2c00f7060 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:26.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41352140 con 0x55bb4134df90 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.992+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41352530 con 0x55bb4134df90 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41352530 con 0x55bb4134df90 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 zone default found 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 4 Realm: () 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 zonegroup default 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41352a10 con 0x7fd2bc019040 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41358640 con 0x55bb41353cb0 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb413589e0 con 0x55bb41353cb0 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 started sync module instance, tier type = 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:26.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41357ae0 con 0x7fd2c00f7060 2024-09-14T10:44:26.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94262741270272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41359230 con 0x7fd2c00f7060 2024-09-14T10:44:26.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41359a80 con 0x55bb4134df90 2024-09-14T10:44:26.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:25.996+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94262741270272] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.000+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.000+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94262741273984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41359650 con 0x55bb4134df90 2024-09-14T10:44:26.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.000+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135a160 con 0x55bb41353cb0 2024-09-14T10:44:26.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.000+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94262741273984] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.000+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.000+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94262741275040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb413595c0 con 0x55bb41353cb0 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.000+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135af10 con 0x7fd2c00f7060 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.004+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.004+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94262741281280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135b7b0 con 0x7fd2c00f7060 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.004+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135c1f0 con 0x55bb4134df90 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.004+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94262741275040] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.004+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.004+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94262741286080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135c1b0 con 0x55bb4134df90 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.004+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135cc00 con 0x7fd2bc019040 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.008+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.008+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94262741288784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135d020 con 0x7fd2bc019040 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.008+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135da20 con 0x7fd2bc019040 2024-09-14T10:44:26.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.008+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94262741281280] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.008+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94262741288784] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.008+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.008+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94262741283584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135cb70 con 0x7fd2bc019040 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.008+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135e0b0 con 0x7fd2bc019040 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94262741286080] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94262741280080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135e0b0 con 0x7fd2bc019040 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 20 add_watcher() i=0 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 20 add_watcher() i=1 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 20 add_watcher() i=2 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 20 add_watcher() i=3 2024-09-14T10:44:26.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 20 add_watcher() i=4 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 20 add_watcher() i=5 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94262741283584] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 20 add_watcher() i=6 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94262741280080] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 20 add_watcher() i=7 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41360d10 con 0x55bb4134df90 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.012+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94262741292336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135e0b0 con 0x55bb4134df90 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94262741292336] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd181fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 5 note: GC not initialized 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd180fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 20 Filter name: none 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd0fa7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41384540 con 0x55bb4134df90 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:26.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb41383f60 con 0x7fd2c00f7060 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4138abf0 con 0x55bb4134df90 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94262741476960 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb413863e0 con 0x55bb4134df90 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94262741286080 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fd2c4057080 con 0x55bb4134df90 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd1aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94262741286080 notifier 4326 bl.length()=567 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd1aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd1aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:26.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(65 notify.4 [notify cookie 94262741476960 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd1aeffd640 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd190003eb0 con 0x55bb4134df90 2024-09-14T10:44:26.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.016+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94262741476960 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd2c403b040 con 0x55bb4134df90 2024-09-14T10:44:26.024 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.020+0000 7fd181fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.020+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94262741292336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41382110 con 0x55bb4134df90 2024-09-14T10:44:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.020+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94262741292336] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.020+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94262741270272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41382110 con 0x7fd2c00f7060 2024-09-14T10:44:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.024+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94262741270272] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.024+0000 7fd2cdaa49c0 20 remove_watcher() i=0 2024-09-14T10:44:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.024+0000 7fd2cdaa49c0 2 removed watcher, disabling cache 2024-09-14T10:44:26.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.024+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94262741273984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41382110 con 0x55bb4134df90 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.024+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94262741273984] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.024+0000 7fd2cdaa49c0 20 remove_watcher() i=1 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.024+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94262741275040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41358d80 con 0x55bb41353cb0 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cada9640 1 -- 172.21.15.96:0/2635581550 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94262741275040] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c00f4030 con 0x55bb41353cb0 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cdaa49c0 20 remove_watcher() i=2 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94262741281280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41382110 con 0x7fd2c00f7060 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cbdab640 1 -- 172.21.15.96:0/2635581550 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94262741281280] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2bc02f040 con 0x7fd2c00f7060 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cdaa49c0 20 remove_watcher() i=3 2024-09-14T10:44:26.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94262741286080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41382110 con 0x55bb4134df90 2024-09-14T10:44:26.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94262741286080] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x55bb4134df90 2024-09-14T10:44:26.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cdaa49c0 20 remove_watcher() i=4 2024-09-14T10:44:26.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.028+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94262741288784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135bcc0 con 0x7fd2bc019040 2024-09-14T10:44:26.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.032+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94262741288784] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.032+0000 7fd2cdaa49c0 20 remove_watcher() i=5 2024-09-14T10:44:26.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.032+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94262741283584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb41382110 con 0x7fd2bc019040 2024-09-14T10:44:26.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.032+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94262741283584] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.032+0000 7fd2cdaa49c0 20 remove_watcher() i=6 2024-09-14T10:44:26.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.032+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94262741280080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb4135b300 con 0x7fd2bc019040 2024-09-14T10:44:26.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94262741280080] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2c4059040 con 0x7fd2bc019040 2024-09-14T10:44:26.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 20 remove_watcher() i=7 2024-09-14T10:44:26.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd2bc019040 msgr2=0x7fd2bc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd2bc019040 0x7fd2bc019930 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb4134df90 msgr2=0x55bb41350420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb4134df90 0x55bb41350420 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd2c00f7060 msgr2=0x7fd2c00ca410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd2c00f7060 0x7fd2c00ca410 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55bb41353cb0 msgr2=0x55bb41356150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55bb41353cb0 0x55bb41356150 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd19403a150 msgr2=0x7fd19403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd19403a150 0x7fd19403c610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00f010 tx=0x7fd2bc01b070 comp rx=0 tx=0).stop 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 msgr2=0x55bb413429b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cb5aa640 1 -- 172.21.15.96:0/2635581550 reap_dead start 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb413429b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00ccfd0 tx=0x7fd2c00ec020 comp rx=0 tx=0).stop 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 shutdown_connections 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2635581550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4133c450 0x55bb413429b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 >> 172.21.15.96:0/2635581550 conn(0x55bb413333c0 msgr2=0x55bb413315d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 shutdown_connections 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2635581550 wait complete. 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2573188206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1a403a150 msgr2=0x7fd1a403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2573188206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1a403a150 0x7fd1a403c610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55bb4131b120 tx=0x7fd2bc003070 comp rx=0 tx=0).stop 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2573188206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4132a770 msgr2=0x55bb4132ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2573188206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4132a770 0x55bb4132ab90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0018f40 tx=0x7fd2c00180b0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2573188206 shutdown_connections 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2573188206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1a403a150 0x7fd1a403c610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/2573188206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb4132a770 0x55bb4132ab90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2573188206 >> 172.21.15.96:0/2573188206 conn(0x55bb41320120 msgr2=0x55bb41320500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2573188206 shutdown_connections 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/2573188206 wait complete. 2024-09-14T10:44:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb41317de0 msgr2=0x55bb4131a1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb41317de0 0x55bb4131a1d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1b003a150 msgr2=0x7fd1b003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1b003a150 0x7fd1b003c610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00ae000 tx=0x7fd2c00a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 msgr2=0x55bb41312d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41312d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4000f90 tx=0x7fd2c4001260 comp rx=0 tx=0).stop 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 shutdown_connections 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55bb41317de0 0x55bb4131a1d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd1b003a150 0x7fd1b003c610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 --2- 172.21.15.96:0/327918434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb41225090 0x55bb41312d70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 >> 172.21.15.96:0/327918434 conn(0x55bb4121c9c0 msgr2=0x55bb4130c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 shutdown_connections 2024-09-14T10:44:26.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.036+0000 7fd2cdaa49c0 1 -- 172.21.15.96:0/327918434 wait complete. 2024-09-14T10:44:26.044 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:26.044 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:44:26.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:44:26.045 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:44:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:26.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b6ae89c0 1 Processor -- start 2024-09-14T10:44:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b6ae89c0 1 -- start start 2024-09-14T10:44:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b6ae89c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d116de8070 0x55d116de6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b6ae89c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d116d197a0 con 0x55d116de7b40 2024-09-14T10:44:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b6ae89c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55d116d751b0 con 0x55d116de8070 2024-09-14T10:44:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b3ded640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d116de8070 0x55d116de6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b45ee640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55d116de7b40 0x55d116de64e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34272/0 (socket says 172.21.15.96:34272) 2024-09-14T10:44:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b3ded640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d116de8070 0x55d116de6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38762/0 (socket says 172.21.15.96:38762) 2024-09-14T10:44:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2059874018 learned_addr learned my addr 172.21.15.96:0/2059874018 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2059874018 >> v1:172.21.15.70:6789/0 conn(0x55d116de7b40 legacy=0x55d116de64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.120+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2059874018 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d116cf3da0 con 0x55d116de8070 2024-09-14T10:44:26.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/2059874018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de8070 0x55d116de6bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00a480 tx=0x7fb79c01b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b791d1cfae86df9d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b35ec640 1 -- 172.21.15.96:0/2059874018 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79c0af070 con 0x55d116de8070 2024-09-14T10:44:26.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b35ec640 1 -- 172.21.15.96:0/2059874018 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c0aa570 con 0x55d116de8070 2024-09-14T10:44:26.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b35ec640 1 -- 172.21.15.96:0/2059874018 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79c0aa8b0 con 0x55d116de8070 2024-09-14T10:44:26.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2059874018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de8070 msgr2=0x55d116de6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2059874018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de8070 0x55d116de6bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00a480 tx=0x7fb79c01b220 comp rx=0 tx=0).stop 2024-09-14T10:44:26.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2059874018 shutdown_connections 2024-09-14T10:44:26.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2059874018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de8070 0x55d116de6bf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2059874018 >> 172.21.15.96:0/2059874018 conn(0x55d116e6cb20 msgr2=0x55d116e6ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2059874018 shutdown_connections 2024-09-14T10:44:26.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.124+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2059874018 wait complete. 2024-09-14T10:44:26.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.136+0000 7fb7b6ae89c0 1 Processor -- start 2024-09-14T10:44:26.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.136+0000 7fb7b6ae89c0 1 -- start start 2024-09-14T10:44:26.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.136+0000 7fb7b6ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f5e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.136+0000 7fb7b6ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d116d78fc0 con 0x55d116de7b40 2024-09-14T10:44:26.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.136+0000 7fb7b45ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f5e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.136+0000 7fb7b45ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f5e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38764/0 (socket says 172.21.15.96:38764) 2024-09-14T10:44:26.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.136+0000 7fb7b45ee640 1 -- 172.21.15.96:0/1541867153 learned_addr learned my addr 172.21.15.96:0/1541867153 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b45ee640 1 -- 172.21.15.96:0/1541867153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d116f5ee00 con 0x55d116de7b40 2024-09-14T10:44:26.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b45ee640 1 --2- 172.21.15.96:0/1541867153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f5e810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac001810 tx=0x7fb7ac001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50956916bff87ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb6a260c640 1 -- 172.21.15.96:0/1541867153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ac004530 con 0x55d116de7b40 2024-09-14T10:44:26.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb6a260c640 1 -- 172.21.15.96:0/1541867153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0046d0 con 0x55d116de7b40 2024-09-14T10:44:26.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb6a260c640 1 -- 172.21.15.96:0/1541867153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ac0049f0 con 0x55d116de7b40 2024-09-14T10:44:26.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1541867153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 msgr2=0x55d116f5e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/1541867153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f5e810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac001810 tx=0x7fb7ac001cd0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1541867153 shutdown_connections 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/1541867153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f5e810 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1541867153 >> 172.21.15.96:0/1541867153 conn(0x55d116e6cb20 msgr2=0x55d116f5a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1541867153 shutdown_connections 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1541867153 wait complete. 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 Processor -- start 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- start start 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f66080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d116d1aa50 con 0x55d116de7b40 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b45ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f66080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b45ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f66080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38774/0 (socket says 172.21.15.96:38774) 2024-09-14T10:44:26.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b45ee640 1 -- 172.21.15.96:0/3511707720 learned_addr learned my addr 172.21.15.96:0/3511707720 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b45ee640 1 -- 172.21.15.96:0/3511707720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d116f665e0 con 0x55d116de7b40 2024-09-14T10:44:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b45ee640 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f66080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac000f90 tx=0x7fb7ac001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb6a0e09640 1 -- 172.21.15.96:0/3511707720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ac013820 con 0x55d116de7b40 2024-09-14T10:44:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d116f66870 con 0x55d116de7b40 2024-09-14T10:44:26.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb6a0e09640 1 -- 172.21.15.96:0/3511707720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0139c0 con 0x55d116de7b40 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d116f67220 con 0x55d116de7b40 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.140+0000 7fb6a0e09640 1 -- 172.21.15.96:0/3511707720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ac013ca0 con 0x55d116de7b40 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb6a0e09640 1 -- 172.21.15.96:0/3511707720 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb7ac010070 con 0x55d116de7b40 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb6a0e09640 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb69c03a150 0x7fb69c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb6a0e09640 1 -- 172.21.15.96:0/3511707720 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb7ac018070 con 0x55d116de7b40 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb69c03a150 0x7fb69c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116de8070 0x55d116f6d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116f6d730 con 0x55d116de8070 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b4def640 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116de8070 0x55d116f6d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb69c03a150 0x7fb69c03c610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0ac000 tx=0x7fb79c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b4def640 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116de8070 0x55d116f6d1f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b4def640 1 -- 172.21.15.96:0/3511707720 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7a40083f0 con 0x55d116de8070 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116f6db60 con 0x55d116de8070 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b4def640 1 -- 172.21.15.96:0/3511707720 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7a40083f0 con 0x55d116de8070 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116f6f460 con 0x55d116de8070 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b4def640 1 -- 172.21.15.96:0/3511707720 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7a40083f0 con 0x55d116de8070 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116f6e690 con 0x55d116de8070 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b4def640 1 -- 172.21.15.96:0/3511707720 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7a40083f0 con 0x55d116de8070 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116f6eae0 con 0x55d116de8070 2024-09-14T10:44:26.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b4def640 1 -- 172.21.15.96:0/3511707720 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb7a40083f0 con 0x55d116de8070 2024-09-14T10:44:26.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 Processor -- start 2024-09-14T10:44:26.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 -- start start 2024-09-14T10:44:26.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f7d820 0x55d116f7dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.144+0000 7fb7b6ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d116d85d80 con 0x55d116f7d820 2024-09-14T10:44:26.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b3ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f7d820 0x55d116f7dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b3ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f7d820 0x55d116f7dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38784/0 (socket says 172.21.15.96:38784) 2024-09-14T10:44:26.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b3ded640 1 -- 172.21.15.96:0/3681162549 learned_addr learned my addr 172.21.15.96:0/3681162549 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b3ded640 1 -- 172.21.15.96:0/3681162549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d116f7e280 con 0x55d116f7d820 2024-09-14T10:44:26.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/3681162549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f7d820 0x55d116f7dc40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb79c018eb0 tx=0x7fb79c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb699ffb640 1 -- 172.21.15.96:0/3681162549 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79c0c7070 con 0x55d116f7d820 2024-09-14T10:44:26.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3681162549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d116f7eae0 con 0x55d116f7d820 2024-09-14T10:44:26.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3681162549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d116f7eff0 con 0x55d116f7d820 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb699ffb640 1 -- 172.21.15.96:0/3681162549 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c0b0040 con 0x55d116f7d820 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb699ffb640 1 -- 172.21.15.96:0/3681162549 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79c0af050 con 0x55d116f7d820 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb699ffb640 1 -- 172.21.15.96:0/3681162549 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb79c0ca070 con 0x55d116f7d820 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb699ffb640 1 --2- 172.21.15.96:0/3681162549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68c03a140 0x7fb68c03c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb699ffb640 1 -- 172.21.15.96:0/3681162549 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb79c0ece70 con 0x55d116f7d820 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b4def640 1 --2- 172.21.15.96:0/3681162549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68c03a140 0x7fb68c03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b6ae89c0 1 Processor -- start 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b6ae89c0 1 -- start start 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b4def640 1 --2- 172.21.15.96:0/3681162549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68c03a140 0x7fb68c03c600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55d116f6e1b0 tx=0x7fb7a4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b6ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f8b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b6ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d116f5f230 con 0x55d116f8b110 2024-09-14T10:44:26.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b3ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f8b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b3ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f8b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38794/0 (socket says 172.21.15.96:38794) 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.148+0000 7fb7b3ded640 1 -- 172.21.15.96:0/1512602555 learned_addr learned my addr 172.21.15.96:0/1512602555 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b3ded640 1 -- 172.21.15.96:0/1512602555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d116f8bb00 con 0x55d116f8b110 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/1512602555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f8b510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0eb260 tx=0x7fb79c0cbdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19e920bfc962572 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb6937fe640 1 -- 172.21.15.96:0/1512602555 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79c0dd070 con 0x55d116f8b110 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb6937fe640 1 -- 172.21.15.96:0/1512602555 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c009e20 con 0x55d116f8b110 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb6937fe640 1 -- 172.21.15.96:0/1512602555 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79c009730 con 0x55d116f8b110 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1512602555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 msgr2=0x55d116f8b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/1512602555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f8b510 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0eb260 tx=0x7fb79c0cbdf0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1512602555 shutdown_connections 2024-09-14T10:44:26.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/1512602555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f8b510 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1512602555 >> 172.21.15.96:0/1512602555 conn(0x55d116f86530 msgr2=0x55d116f84770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1512602555 shutdown_connections 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/1512602555 wait complete. 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 Processor -- start 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- start start 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f91650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d116f8a060 con 0x55d116f8b110 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b3ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f91650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b3ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f91650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38806/0 (socket says 172.21.15.96:38806) 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 learned_addr learned my addr 172.21.15.96:0/2985374943 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d116f91bb0 con 0x55d116f8b110 2024-09-14T10:44:26.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f91650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0db040 tx=0x7fb79c0eb1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb691ffb640 1 -- 172.21.15.96:0/2985374943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79c0e8020 con 0x55d116f8b110 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb691ffb640 1 -- 172.21.15.96:0/2985374943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c0de040 con 0x55d116f8b110 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d116f91e40 con 0x55d116f8b110 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb691ffb640 1 -- 172.21.15.96:0/2985374943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79c0dd070 con 0x55d116f8b110 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.152+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d116f927f0 con 0x55d116f8b110 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb691ffb640 1 -- 172.21.15.96:0/2985374943 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb79c0ce070 con 0x55d116f8b110 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb691ffb640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68403a150 0x7fb68403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb691ffb640 1 -- 172.21.15.96:0/2985374943 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb79c002030 con 0x55d116f8b110 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b4def640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68403a150 0x7fb68403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116f9cbb0 0x55d116f9f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116f9f790 con 0x55d116f9cbb0 2024-09-14T10:44:26.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b45ee640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116f9cbb0 0x55d116f9f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b45ee640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116f9cbb0 0x55d116f9f040 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b4def640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68403a150 0x7fb68403c610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400f010 tx=0x7fb7a401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 realm 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116f9fba0 con 0x55d116f9cbb0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:26.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0470 con 0x55d116f9cbb0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0810 con 0x55d116f9cbb0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 20 searching for the correct realm 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d116fa2cb0 0x55d116fa50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa5770 con 0x55d116fa2cb0 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d116fa2cb0 0x55d116fa50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d116fa2cb0 0x55d116fa50a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b3ded640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb79c0f2070 0x7fb79c0d8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa5770 con 0x7fb79c0f2070 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b4def640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb79c0f2070 0x7fb79c0d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b4def640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb79c0f2070 0x7fb79c0d8a70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b4def640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb7a4019040 0x7fb7a4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.156+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa5770 con 0x7fb7a4019040 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb7a4019040 0x7fb7a4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb7a4019040 0x7fb7a4019930 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb7a4019040 2024-09-14T10:44:26.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb7a4019040 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb79c0f2070 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116fa2cb0 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.160+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb7a4019040 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb79c0f2070 2024-09-14T10:44:26.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116fa2cb0 2024-09-14T10:44:26.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116fa2cb0 2024-09-14T10:44:26.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb7a4019040 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116fa2cb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116fa2cb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb7a4019040 2024-09-14T10:44:26.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116fa2cb0 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.164+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb79c0f2070 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb7a4019040 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116fa2cb0 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb7a4019040 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb79c0f2070 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116fa2cb0 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb7a4019040 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa0cb0 con 0x7fb79c0f2070 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:26.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa1620 con 0x55d116f9cbb0 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.168+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa1a10 con 0x55d116f9cbb0 2024-09-14T10:44:26.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa1a10 con 0x55d116f9cbb0 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 zone default found 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 4 Realm: () 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:26.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 zonegroup default 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa1e30 con 0x7fb7a4019040 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa1e30 con 0x55d116fa2cb0 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa75e0 con 0x55d116fa2cb0 2024-09-14T10:44:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 started sync module instance, tier type = 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa6a80 con 0x7fb79c0f2070 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94356522036848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa66e0 con 0x7fb79c0f2070 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.172+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa84c0 con 0x55d116f9cbb0 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.176+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94356522036848] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.176+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.176+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94356522039792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa84c0 con 0x55d116f9cbb0 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.176+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa8e80 con 0x55d116fa2cb0 2024-09-14T10:44:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.176+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94356522039792] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.176+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.176+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94356522041360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa8430 con 0x55d116fa2cb0 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.176+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa9bc0 con 0x7fb79c0f2070 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.180+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.180+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94356522047184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116faa460 con 0x7fb79c0f2070 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.180+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116faae80 con 0x55d116f9cbb0 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.180+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94356522041360] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.180+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94356522047184] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.180+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.180+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94356522051952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa9fb0 con 0x55d116f9cbb0 2024-09-14T10:44:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.180+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fab720 con 0x7fb7a4019040 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.184+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94356522051952] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.184+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.184+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94356522045984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa9fb0 con 0x7fb7a4019040 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.184+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fabb50 con 0x7fb7a4019040 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.184+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.184+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94356522055328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fabf70 con 0x7fb7a4019040 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.184+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116faca90 con 0x7fb7a4019040 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.184+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94356522045984] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94356522059104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116faca50 con 0x7fb7a4019040 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 20 add_watcher() i=0 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 20 add_watcher() i=1 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 20 add_watcher() i=2 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 20 add_watcher() i=3 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 20 add_watcher() i=4 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 20 add_watcher() i=5 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94356522055328] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 20 add_watcher() i=6 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94356522059104] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 20 add_watcher() i=7 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fabac0 con 0x55d116f9cbb0 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94356522056384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fab0e0 con 0x55d116f9cbb0 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.188+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94356522056384] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb66a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 5 note: GC not initialized 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb6697e2640 20 reqs_thread_entry: start 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 20 Filter name: none 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb5daffd640 20 reqs_thread_entry: start 2024-09-14T10:44:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d116fd2c30 con 0x55d116f9cbb0 2024-09-14T10:44:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb66a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94356522056384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fd1920 con 0x55d116f9cbb0 2024-09-14T10:44:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94356522056384] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94356522036848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fabac0 con 0x7fb79c0f2070 2024-09-14T10:44:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94356522036848] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 20 remove_watcher() i=0 2024-09-14T10:44:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.192+0000 7fb7b6ae89c0 2 removed watcher, disabling cache 2024-09-14T10:44:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.196+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94356522039792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa6e70 con 0x55d116f9cbb0 2024-09-14T10:44:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.196+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94356522039792] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.196+0000 7fb7b6ae89c0 20 remove_watcher() i=1 2024-09-14T10:44:26.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.196+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94356522041360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa6e70 con 0x55d116fa2cb0 2024-09-14T10:44:26.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b3ded640 1 -- 172.21.15.96:0/2985374943 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94356522041360] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb79c0ef070 con 0x55d116fa2cb0 2024-09-14T10:44:26.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b6ae89c0 20 remove_watcher() i=2 2024-09-14T10:44:26.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94356522047184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa8010 con 0x7fb79c0f2070 2024-09-14T10:44:26.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b4def640 1 -- 172.21.15.96:0/2985374943 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94356522047184] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a402f040 con 0x7fb79c0f2070 2024-09-14T10:44:26.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b6ae89c0 20 remove_watcher() i=3 2024-09-14T10:44:26.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94356522051952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa8010 con 0x55d116f9cbb0 2024-09-14T10:44:26.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94356522051952] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x55d116f9cbb0 2024-09-14T10:44:26.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b6ae89c0 20 remove_watcher() i=4 2024-09-14T10:44:26.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.200+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94356522045984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa8010 con 0x7fb7a4019040 2024-09-14T10:44:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.204+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94356522045984] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.204+0000 7fb7b6ae89c0 20 remove_watcher() i=5 2024-09-14T10:44:26.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.204+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94356522055328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fa8010 con 0x7fb7a4019040 2024-09-14T10:44:26.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.204+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94356522055328] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.204+0000 7fb7b6ae89c0 20 remove_watcher() i=6 2024-09-14T10:44:26.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.204+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94356522059104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d116fabb50 con 0x7fb7a4019040 2024-09-14T10:44:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94356522059104] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ac01b030 con 0x7fb7a4019040 2024-09-14T10:44:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 20 remove_watcher() i=7 2024-09-14T10:44:26.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb7a4019040 msgr2=0x7fb7a4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb7a4019040 0x7fb7a4019930 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116f9cbb0 msgr2=0x55d116f9f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116f9cbb0 0x55d116f9f040 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb79c0f2070 msgr2=0x7fb79c0d8a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb79c0f2070 0x7fb79c0d8a70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d116fa2cb0 msgr2=0x55d116fa50a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d116fa2cb0 0x55d116fa50a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68403a150 msgr2=0x7fb68403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68403a150 0x7fb68403c610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400f010 tx=0x7fb7a401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b45ee640 1 -- 172.21.15.96:0/2985374943 reap_dead start 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 msgr2=0x55d116f91650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f91650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0db040 tx=0x7fb79c0eb1f0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 shutdown_connections 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/2985374943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f8b110 0x55d116f91650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 >> 172.21.15.96:0/2985374943 conn(0x55d116f86530 msgr2=0x55d116f84740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 shutdown_connections 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/2985374943 wait complete. 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3681162549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68c03a140 msgr2=0x7fb68c03c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3681162549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68c03a140 0x7fb68c03c600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55d116f6e1b0 tx=0x7fb7a4003070 comp rx=0 tx=0).stop 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3681162549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f7d820 msgr2=0x55d116f7dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3681162549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f7d820 0x55d116f7dc40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb79c018eb0 tx=0x7fb79c018020 comp rx=0 tx=0).stop 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3681162549 shutdown_connections 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3681162549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb68c03a140 0x7fb68c03c600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3681162549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116f7d820 0x55d116f7dc40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3681162549 >> 172.21.15.96:0/3681162549 conn(0x55d116f731d0 msgr2=0x55d116f735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3681162549 shutdown_connections 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3681162549 wait complete. 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116de8070 msgr2=0x55d116f6d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116de8070 0x55d116f6d1f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb69c03a150 msgr2=0x7fb69c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb69c03a150 0x7fb69c03c610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0ac000 tx=0x7fb79c0a5000 comp rx=0 tx=0).stop 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 msgr2=0x55d116f66080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f66080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac000f90 tx=0x7fb7ac001260 comp rx=0 tx=0).stop 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 shutdown_connections 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d116de8070 0x55d116f6d1f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb69c03a150 0x7fb69c03c610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 --2- 172.21.15.96:0/3511707720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d116de7b40 0x55d116f66080 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 >> 172.21.15.96:0/3511707720 conn(0x55d116e6cb20 msgr2=0x55d116f5fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 shutdown_connections 2024-09-14T10:44:26.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.208+0000 7fb7b6ae89c0 1 -- 172.21.15.96:0/3511707720 wait complete. 2024-09-14T10:44:26.215 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:26.215 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-14T10:44:26.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-14T10:44:26.216 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-14T10:44:26.288 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:26.288 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:26.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041f1fa9c0 1 Processor -- start 2024-09-14T10:44:26.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041f1fa9c0 1 -- start start 2024-09-14T10:44:26.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041f1fa9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56279700bfa0 0x56279700c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041f1fa9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562796eb47a0 con 0x56279700f130 2024-09-14T10:44:26.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041f1fa9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x562796f101b0 con 0x56279700bfa0 2024-09-14T10:44:26.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041cd00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56279700bfa0 0x56279700c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041cd00640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56279700bfa0 0x56279700c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38822/0 (socket says 172.21.15.96:38822) 2024-09-14T10:44:26.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041cd00640 1 -- 172.21.15.96:0/1339580371 learned_addr learned my addr 172.21.15.96:0/1339580371 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041c4ff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x56279700f130 0x562797011520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34288/0 (socket says 172.21.15.96:34288) 2024-09-14T10:44:26.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041cd00640 1 -- 172.21.15.96:0/1339580371 >> v1:172.21.15.70:6789/0 conn(0x56279700f130 legacy=0x562797011520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.292+0000 7f041cd00640 1 -- 172.21.15.96:0/1339580371 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562796e8eda0 con 0x56279700bfa0 2024-09-14T10:44:26.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041cd00640 1 --2- 172.21.15.96:0/1339580371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x56279700c380 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f040c00a5c0 tx=0x7f040c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d167cb2624f89245 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041bcfe640 1 -- 172.21.15.96:0/1339580371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0a6070 con 0x56279700bfa0 2024-09-14T10:44:26.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041bcfe640 1 -- 172.21.15.96:0/1339580371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c0af070 con 0x56279700bfa0 2024-09-14T10:44:26.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041bcfe640 1 -- 172.21.15.96:0/1339580371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0aa5c0 con 0x56279700bfa0 2024-09-14T10:44:26.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1339580371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 msgr2=0x56279700c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/1339580371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x56279700c380 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f040c00a5c0 tx=0x7f040c01b340 comp rx=0 tx=0).stop 2024-09-14T10:44:26.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1339580371 shutdown_connections 2024-09-14T10:44:26.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/1339580371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x56279700c380 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1339580371 >> 172.21.15.96:0/1339580371 conn(0x562797007ac0 msgr2=0x562797009ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1339580371 shutdown_connections 2024-09-14T10:44:26.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.296+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1339580371 wait complete. 2024-09-14T10:44:26.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.308+0000 7f041f1fa9c0 1 Processor -- start 2024-09-14T10:44:26.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.308+0000 7f041f1fa9c0 1 -- start start 2024-09-14T10:44:26.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.308+0000 7f041f1fa9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562796f82a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.308+0000 7f041f1fa9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562796f13fc0 con 0x56279700bfa0 2024-09-14T10:44:26.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.308+0000 7f041cd00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562796f82a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.308+0000 7f041cd00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562796f82a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38832/0 (socket says 172.21.15.96:38832) 2024-09-14T10:44:26.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.308+0000 7f041cd00640 1 -- 172.21.15.96:0/1173298930 learned_addr learned my addr 172.21.15.96:0/1173298930 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041cd00640 1 -- 172.21.15.96:0/1173298930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562796f83070 con 0x56279700bfa0 2024-09-14T10:44:26.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041cd00640 1 --2- 172.21.15.96:0/1173298930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562796f82a80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f040c0ac040 tx=0x7f040c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f542d208176bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f030ae0d640 1 -- 172.21.15.96:0/1173298930 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0aa970 con 0x56279700bfa0 2024-09-14T10:44:26.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f030ae0d640 1 -- 172.21.15.96:0/1173298930 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c0aab10 con 0x56279700bfa0 2024-09-14T10:44:26.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f030ae0d640 1 -- 172.21.15.96:0/1173298930 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0aae30 con 0x56279700bfa0 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1173298930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 msgr2=0x562796f82a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/1173298930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562796f82a80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f040c0ac040 tx=0x7f040c003030 comp rx=0 tx=0).stop 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1173298930 shutdown_connections 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/1173298930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562796f82a80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1173298930 >> 172.21.15.96:0/1173298930 conn(0x562797007ac0 msgr2=0x5627970f3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1173298930 shutdown_connections 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1173298930 wait complete. 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 Processor -- start 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- start start 2024-09-14T10:44:26.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562797100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562796eb5a50 con 0x56279700bfa0 2024-09-14T10:44:26.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041cd00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562797100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041cd00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562797100d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38840/0 (socket says 172.21.15.96:38840) 2024-09-14T10:44:26.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041cd00640 1 -- 172.21.15.96:0/3269602045 learned_addr learned my addr 172.21.15.96:0/3269602045 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041cd00640 1 -- 172.21.15.96:0/3269602045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562797101260 con 0x56279700bfa0 2024-09-14T10:44:26.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041cd00640 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562797100d00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f040c01b170 tx=0x7f040c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f030960a640 1 -- 172.21.15.96:0/3269602045 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0c6690 con 0x56279700bfa0 2024-09-14T10:44:26.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627971014f0 con 0x56279700bfa0 2024-09-14T10:44:26.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f030960a640 1 -- 172.21.15.96:0/3269602045 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c0cc070 con 0x56279700bfa0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f030960a640 1 -- 172.21.15.96:0/3269602045 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040c0c6960 con 0x56279700bfa0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.312+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562797101ea0 con 0x56279700bfa0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f030960a640 1 -- 172.21.15.96:0/3269602045 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f040c0c6c10 con 0x56279700bfa0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f030960a640 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030403a1a0 0x7f030403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f030960a640 1 -- 172.21.15.96:0/3269602045 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f040c0ec600 con 0x56279700bfa0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041c4ff640 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030403a1a0 0x7f030403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56279700f130 0x562797107e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627971083b0 con 0x56279700f130 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041d501640 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56279700f130 0x562797107e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041c4ff640 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030403a1a0 0x7f030403c660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0410001e90 tx=0x7f04100013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041d501640 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56279700f130 0x562797107e70 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041d501640 1 -- 172.21.15.96:0/3269602045 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f041400a4d0 con 0x56279700f130 2024-09-14T10:44:26.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562797108820 con 0x56279700f130 2024-09-14T10:44:26.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041d501640 1 -- 172.21.15.96:0/3269602045 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f041400a4d0 con 0x56279700f130 2024-09-14T10:44:26.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279710a120 con 0x56279700f130 2024-09-14T10:44:26.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041d501640 1 -- 172.21.15.96:0/3269602045 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f041400a4d0 con 0x56279700f130 2024-09-14T10:44:26.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562797109260 con 0x56279700f130 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041d501640 1 -- 172.21.15.96:0/3269602045 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f041400a4d0 con 0x56279700f130 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627971096c0 con 0x56279700f130 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041d501640 1 -- 172.21.15.96:0/3269602045 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f041400a4d0 con 0x56279700f130 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 Processor -- start 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 -- start start 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627971184f0 0x562797118910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.316+0000 7f041f1fa9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562796f20d80 con 0x5627971184f0 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041c4ff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627971184f0 0x562797118910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041c4ff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627971184f0 0x562797118910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38844/0 (socket says 172.21.15.96:38844) 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041c4ff640 1 -- 172.21.15.96:0/1199631926 learned_addr learned my addr 172.21.15.96:0/1199631926 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041c4ff640 1 -- 172.21.15.96:0/1199631926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562797118f50 con 0x5627971184f0 2024-09-14T10:44:26.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041c4ff640 1 --2- 172.21.15.96:0/1199631926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627971184f0 0x562797118910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f041000e670 tx=0x7f041000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f03027fc640 1 -- 172.21.15.96:0/1199631926 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0410022070 con 0x5627971184f0 2024-09-14T10:44:26.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1199631926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627971197b0 con 0x5627971184f0 2024-09-14T10:44:26.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1199631926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562797119d20 con 0x5627971184f0 2024-09-14T10:44:26.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f03027fc640 1 -- 172.21.15.96:0/1199631926 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041000d660 con 0x5627971184f0 2024-09-14T10:44:26.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f03027fc640 1 -- 172.21.15.96:0/1199631926 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041002c060 con 0x5627971184f0 2024-09-14T10:44:26.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f03027fc640 1 -- 172.21.15.96:0/1199631926 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0410025070 con 0x5627971184f0 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f03027fc640 1 --2- 172.21.15.96:0/1199631926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f03027fc640 1 -- 172.21.15.96:0/1199631926 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0410052560 con 0x5627971184f0 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041d501640 1 --2- 172.21.15.96:0/1199631926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041f1fa9c0 1 Processor -- start 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041f1fa9c0 1 -- start start 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041d501640 1 --2- 172.21.15.96:0/1199631926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x562797109600 tx=0x7f0414005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041f1fa9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x562797126220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.320+0000 7f041f1fa9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562796f813a0 con 0x562797125e20 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x562797126220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x562797126220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38852/0 (socket says 172.21.15.96:38852) 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 -- 172.21.15.96:0/3016409309 learned_addr learned my addr 172.21.15.96:0/3016409309 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 -- 172.21.15.96:0/3016409309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562797126810 con 0x562797125e20 2024-09-14T10:44:26.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 --2- 172.21.15.96:0/3016409309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x562797126220 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0410050890 tx=0x7f0410050b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64899e71fbddd253 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f02f3fff640 1 -- 172.21.15.96:0/3016409309 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041000dcc0 con 0x562797125e20 2024-09-14T10:44:26.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f02f3fff640 1 -- 172.21.15.96:0/3016409309 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041004d020 con 0x562797125e20 2024-09-14T10:44:26.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f02f3fff640 1 -- 172.21.15.96:0/3016409309 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041001bca0 con 0x562797125e20 2024-09-14T10:44:26.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3016409309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 msgr2=0x562797126220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3016409309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x562797126220 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0410050890 tx=0x7f0410050b60 comp rx=0 tx=0).stop 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3016409309 shutdown_connections 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3016409309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x562797126220 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3016409309 >> 172.21.15.96:0/3016409309 conn(0x562797121240 msgr2=0x56279711f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3016409309 shutdown_connections 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3016409309 wait complete. 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 Processor -- start 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- start start 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x56279712c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562797124d70 con 0x562797125e20 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x56279712c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x56279712c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38868/0 (socket says 172.21.15.96:38868) 2024-09-14T10:44:26.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 learned_addr learned my addr 172.21.15.96:0/2621149886 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56279712c8e0 con 0x562797125e20 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041c4ff640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x56279712c380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f041000ef00 tx=0x7f0410050820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f02f27fc640 1 -- 172.21.15.96:0/2621149886 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04100520d0 con 0x562797125e20 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56279712cb70 con 0x562797125e20 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f02f27fc640 1 -- 172.21.15.96:0/2621149886 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0410052270 con 0x562797125e20 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56279712cb70 con 0x562797125e20 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.324+0000 7f02f27fc640 1 -- 172.21.15.96:0/2621149886 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0410025ba0 con 0x562797125e20 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f02f27fc640 1 -- 172.21.15.96:0/2621149886 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f041003e9d0 con 0x562797125e20 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f02f27fc640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e803a150 0x7f02e803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f02f27fc640 1 -- 172.21.15.96:0/2621149886 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f041004e070 con 0x562797125e20 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041d501640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e803a150 0x7f02e803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562797137720 0x562797139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279713a330 con 0x562797137720 2024-09-14T10:44:26.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041cd00640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562797137720 0x562797139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041d501640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e803a150 0x7f02e803c610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x562797108d80 tx=0x7f041401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041cd00640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562797137720 0x562797139be0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 realm 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562797136a50 con 0x562797137720 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279713adc0 con 0x562797137720 2024-09-14T10:44:26.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279713b660 con 0x562797137720 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279713ba00 con 0x562797137720 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 20 searching for the correct realm 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56279713d930 0x56279713fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x56279713d930 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041c4ff640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56279713d930 0x56279713fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041c4ff640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56279713d930 0x56279713fd20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041c4ff640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0410031070 0x7f04100030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x7f0410031070 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.328+0000 7f041d501640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0410031070 0x7f04100030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041d501640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0410031070 0x7f04100030e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041d501640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0414031040 0x7f0414032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x7f0414031040 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0414031040 0x7f0414032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0414031040 0x7f0414032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x562797137720 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x562797137720 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x7f0414031040 2024-09-14T10:44:26.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x7f0414031040 2024-09-14T10:44:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x7f0410031070 2024-09-14T10:44:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.332+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x56279713d930 2024-09-14T10:44:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x562797137720 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x7f0414031040 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x562797137720 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x7f0410031070 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x56279713d930 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627971402e0 con 0x56279713d930 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x7f0414031040 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x56279713d930 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x56279713d930 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x562797137720 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x562797137720 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.336+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x7f0414031040 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x56279713d930 2024-09-14T10:44:26.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x7f0410031070 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x562797137720 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x7f0414031040 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x56279713d930 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x7f0414031040 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x7f0410031070 2024-09-14T10:44:26.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x56279713d930 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x7f0414031040 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.340+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x562797137720 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0410060040 con 0x7f0410031070 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:26.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279713c400 con 0x562797137720 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279713cca0 con 0x562797137720 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279713cca0 con 0x562797137720 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:26.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 zone default found 2024-09-14T10:44:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 4 Realm: () 2024-09-14T10:44:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 zonegroup default 2024-09-14T10:44:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562797140760 con 0x7f0414031040 2024-09-14T10:44:26.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627971422b0 con 0x56279713d930 2024-09-14T10:44:26.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627971427c0 con 0x56279713d930 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 started sync module instance, tier type = 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627971415f0 con 0x7f0410031070 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728038390240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797141250 con 0x7f0410031070 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.344+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627971436f0 con 0x562797137720 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.348+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728038390240] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.348+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.348+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728038394912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627971436f0 con 0x562797137720 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.348+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627971440b0 con 0x56279713d930 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.348+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728038394912] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728038396480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797143660 con 0x56279713d930 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797144db0 con 0x7f0410031070 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728038402576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627971454c0 con 0x7f0410031070 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797145fe0 con 0x562797137720 2024-09-14T10:44:26.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728038396480] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728038406832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797145fa0 con 0x562797137720 2024-09-14T10:44:26.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728038402576] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.352+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627971469f0 con 0x7f0414031040 2024-09-14T10:44:26.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.356+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728038406832] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.356+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.356+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728038401104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797146540 con 0x7f0414031040 2024-09-14T10:44:26.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.356+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797146d90 con 0x7f0414031040 2024-09-14T10:44:26.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.356+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728038401104] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.356+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.356+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728038409536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797146e10 con 0x7f0414031040 2024-09-14T10:44:26.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.356+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627971477d0 con 0x7f0414031040 2024-09-14T10:44:26.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728038409536] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728038410864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627971477d0 con 0x7f0414031040 2024-09-14T10:44:26.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041f1fa9c0 20 add_watcher() i=0 2024-09-14T10:44:26.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041f1fa9c0 20 add_watcher() i=1 2024-09-14T10:44:26.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041f1fa9c0 20 add_watcher() i=2 2024-09-14T10:44:26.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041f1fa9c0 20 add_watcher() i=3 2024-09-14T10:44:26.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041f1fa9c0 20 add_watcher() i=4 2024-09-14T10:44:26.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041f1fa9c0 20 add_watcher() i=5 2024-09-14T10:44:26.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.360+0000 7f041f1fa9c0 20 add_watcher() i=6 2024-09-14T10:44:26.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728038410864] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 20 add_watcher() i=7 2024-09-14T10:44:26.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:26.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279714aab0 con 0x562797137720 2024-09-14T10:44:26.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728038413456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797147d60 con 0x562797137720 2024-09-14T10:44:26.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728038413456] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f02d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 5 note: GC not initialized 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f02d1fe3640 20 reqs_thread_entry: start 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 20 Filter name: none 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f02437fe640 20 reqs_thread_entry: start 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279716e3e0 con 0x562797137720 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:26.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:26.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:26.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:26.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-14T10:44:26.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.364+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279716ee50 con 0x7f0414031040 2024-09-14T10:44:26.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797174c20 con 0x562797137720 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94728038598288 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562797170310 con 0x562797137720 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94728038406832 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x562797101ea0 con 0x562797137720 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f02f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94728038406832 notifier 4340 bl.length()=678 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f02f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:26.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f02f3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:26.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f02f3fff640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f02e0003eb0 con 0x562797137720 2024-09-14T10:44:26.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(65 notify.4 [notify cookie 94728038598288 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94728038598288 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5627971014f0 con 0x562797137720 2024-09-14T10:44:26.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.368+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797174690 con 0x7f0414031040 2024-09-14T10:44:26.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041f1fa9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:44:26.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041f1fa9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041f1fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94728038598288 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56279716fe60 con 0x56279713d930 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== watch-notify(notify (1) cookie 94728038396480 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56279712c8e0 con 0x56279713d930 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f02f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94728038396480 notifier 4340 bl.length()=177 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f02f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f02f37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f02f37fe640 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0250003410 con 0x56279713d930 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(68 notify.2 [notify cookie 94728038598288 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== watch-notify(notify_complete (2) cookie 94728038598288 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562797126810 con 0x56279713d930 2024-09-14T10:44:26.372 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:44:26.369390Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:26.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f02d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:26.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.372+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728038413456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562797170740 con 0x562797137720 2024-09-14T10:44:26.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94728038413456] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728038390240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56279716bf50 con 0x7f0410031070 2024-09-14T10:44:26.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94728038390240] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041f1fa9c0 20 remove_watcher() i=0 2024-09-14T10:44:26.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041f1fa9c0 2 removed watcher, disabling cache 2024-09-14T10:44:26.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728038394912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56279716bf50 con 0x562797137720 2024-09-14T10:44:26.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94728038394912] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041f1fa9c0 20 remove_watcher() i=1 2024-09-14T10:44:26.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.376+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728038396480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56279716bf50 con 0x56279713d930 2024-09-14T10:44:26.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.380+0000 7f041c4ff640 1 -- 172.21.15.96:0/2621149886 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94728038396480] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041002e070 con 0x56279713d930 2024-09-14T10:44:26.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.380+0000 7f041f1fa9c0 20 remove_watcher() i=2 2024-09-14T10:44:26.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.380+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728038402576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56279716bf50 con 0x7f0410031070 2024-09-14T10:44:26.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.380+0000 7f041d501640 1 -- 172.21.15.96:0/2621149886 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94728038402576] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041401f070 con 0x7f0410031070 2024-09-14T10:44:26.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.380+0000 7f041f1fa9c0 20 remove_watcher() i=3 2024-09-14T10:44:26.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.380+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728038406832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56279716bf50 con 0x562797137720 2024-09-14T10:44:26.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.384+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94728038406832] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x562797137720 2024-09-14T10:44:26.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.384+0000 7f041f1fa9c0 20 remove_watcher() i=4 2024-09-14T10:44:26.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.384+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728038401104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56279716bf50 con 0x7f0414031040 2024-09-14T10:44:26.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.384+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94728038401104] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.384+0000 7f041f1fa9c0 20 remove_watcher() i=5 2024-09-14T10:44:26.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.384+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728038409536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56279716bf50 con 0x7f0414031040 2024-09-14T10:44:26.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94728038409536] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 20 remove_watcher() i=6 2024-09-14T10:44:26.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728038410864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56279716bf50 con 0x7f0414031040 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94728038410864] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c0b3cd0 con 0x7f0414031040 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 20 remove_watcher() i=7 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0414031040 msgr2=0x7f0414032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0414031040 0x7f0414032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562797137720 msgr2=0x562797139be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562797137720 0x562797139be0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0410031070 msgr2=0x7f04100030e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0410031070 0x7f04100030e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56279713d930 msgr2=0x56279713fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.388+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56279713d930 0x56279713fd20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e803a150 msgr2=0x7f02e803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e803a150 0x7f02e803c610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x562797108d80 tx=0x7f041401f000 comp rx=0 tx=0).stop 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 msgr2=0x56279712c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041cd00640 1 -- 172.21.15.96:0/2621149886 reap_dead start 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x56279712c380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f041000ef00 tx=0x7f0410050820 comp rx=0 tx=0).stop 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 shutdown_connections 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/2621149886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562797125e20 0x56279712c380 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 >> 172.21.15.96:0/2621149886 conn(0x562797121240 msgr2=0x56279711f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 shutdown_connections 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/2621149886 wait complete. 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1199631926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 msgr2=0x7f02f403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/1199631926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x562797109600 tx=0x7f0414005850 comp rx=0 tx=0).stop 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1199631926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627971184f0 msgr2=0x562797118910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/1199631926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627971184f0 0x562797118910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f041000e670 tx=0x7f041000ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1199631926 shutdown_connections 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/1199631926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/1199631926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627971184f0 0x562797118910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1199631926 >> 172.21.15.96:0/1199631926 conn(0x56279710dea0 msgr2=0x56279710e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1199631926 shutdown_connections 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/1199631926 wait complete. 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56279700f130 msgr2=0x562797107e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56279700f130 0x562797107e70 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030403a1a0 msgr2=0x7f030403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030403a1a0 0x7f030403c660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0410001e90 tx=0x7f04100013f0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 msgr2=0x562797100d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562797100d00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f040c01b170 tx=0x7f040c0180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 shutdown_connections 2024-09-14T10:44:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56279700f130 0x562797107e70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030403a1a0 0x7f030403c660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 --2- 172.21.15.96:0/3269602045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56279700bfa0 0x562797100d00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 >> 172.21.15.96:0/3269602045 conn(0x562797007ac0 msgr2=0x5627970f2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 shutdown_connections 2024-09-14T10:44:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.392+0000 7f041f1fa9c0 1 -- 172.21.15.96:0/3269602045 wait complete. 2024-09-14T10:44:26.398 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:44:26.369390Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:26.399 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:44:26.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:44:26.399 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:44:26.466 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:26.467 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.468+0000 7f5b932799c0 1 Processor -- start 2024-09-14T10:44:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.468+0000 7f5b932799c0 1 -- start start 2024-09-14T10:44:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.468+0000 7f5b932799c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559dd7e65fd0 0x559dd7e663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.468+0000 7f5b932799c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559dd7d0e7a0 con 0x559dd7e69110 2024-09-14T10:44:26.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.468+0000 7f5b932799c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x559dd7d6a1b0 con 0x559dd7e65fd0 2024-09-14T10:44:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b90d7f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559dd7e65fd0 0x559dd7e663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b8857e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x559dd7e69110 0x559dd7e6b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34302/0 (socket says 172.21.15.96:34302) 2024-09-14T10:44:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b8857e640 1 -- 172.21.15.96:0/2180815639 learned_addr learned my addr 172.21.15.96:0/2180815639 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b90d7f640 1 -- 172.21.15.96:0/2180815639 >> v1:172.21.15.70:6789/0 conn(0x559dd7e69110 legacy=0x559dd7e6b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b90d7f640 1 -- 172.21.15.96:0/2180815639 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd7ce8da0 con 0x559dd7e65fd0 2024-09-14T10:44:26.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b90d7f640 1 --2- 172.21.15.96:0/2180815639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7e663b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800a480 tx=0x7f5b7801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a26949d4d3b18b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b8bfff640 1 -- 172.21.15.96:0/2180815639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b780b0070 con 0x559dd7e65fd0 2024-09-14T10:44:26.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b8bfff640 1 -- 172.21.15.96:0/2180815639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780ab540 con 0x559dd7e65fd0 2024-09-14T10:44:26.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.472+0000 7f5b8bfff640 1 -- 172.21.15.96:0/2180815639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b780ab840 con 0x559dd7e65fd0 2024-09-14T10:44:26.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.476+0000 7f5b932799c0 1 -- 172.21.15.96:0/2180815639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 msgr2=0x559dd7e663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.476+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2180815639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7e663b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800a480 tx=0x7f5b7801b280 comp rx=0 tx=0).stop 2024-09-14T10:44:26.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.476+0000 7f5b932799c0 1 -- 172.21.15.96:0/2180815639 shutdown_connections 2024-09-14T10:44:26.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.476+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2180815639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7e663b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.476+0000 7f5b932799c0 1 -- 172.21.15.96:0/2180815639 >> 172.21.15.96:0/2180815639 conn(0x559dd7e61af0 msgr2=0x559dd7e63f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.476+0000 7f5b932799c0 1 -- 172.21.15.96:0/2180815639 shutdown_connections 2024-09-14T10:44:26.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.476+0000 7f5b932799c0 1 -- 172.21.15.96:0/2180815639 wait complete. 2024-09-14T10:44:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 Processor -- start 2024-09-14T10:44:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- start start 2024-09-14T10:44:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559dd7d6dfc0 con 0x559dd7e65fd0 2024-09-14T10:44:26.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b90d7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b90d7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38894/0 (socket says 172.21.15.96:38894) 2024-09-14T10:44:26.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b90d7f640 1 -- 172.21.15.96:0/569781135 learned_addr learned my addr 172.21.15.96:0/569781135 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b90d7f640 1 -- 172.21.15.96:0/569781135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd7f519c0 con 0x559dd7e65fd0 2024-09-14T10:44:26.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b90d7f640 1 --2- 172.21.15.96:0/569781135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f513d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b78018eb0 tx=0x7f5b78003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a8074ea6535c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5a7ee0d640 1 -- 172.21.15.96:0/569781135 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b780b0070 con 0x559dd7e65fd0 2024-09-14T10:44:26.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5a7ee0d640 1 -- 172.21.15.96:0/569781135 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780b1040 con 0x559dd7e65fd0 2024-09-14T10:44:26.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5a7ee0d640 1 -- 172.21.15.96:0/569781135 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b780ab6f0 con 0x559dd7e65fd0 2024-09-14T10:44:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- 172.21.15.96:0/569781135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 msgr2=0x559dd7f513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 --2- 172.21.15.96:0/569781135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f513d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b78018eb0 tx=0x7f5b78003030 comp rx=0 tx=0).stop 2024-09-14T10:44:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- 172.21.15.96:0/569781135 shutdown_connections 2024-09-14T10:44:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 --2- 172.21.15.96:0/569781135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f513d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- 172.21.15.96:0/569781135 >> 172.21.15.96:0/569781135 conn(0x559dd7e61af0 msgr2=0x559dd7f4cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- 172.21.15.96:0/569781135 shutdown_connections 2024-09-14T10:44:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- 172.21.15.96:0/569781135 wait complete. 2024-09-14T10:44:26.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 Processor -- start 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- start start 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f58ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.488+0000 7f5b932799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559dd7d0fa50 con 0x559dd7e65fd0 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b90d7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f58ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b90d7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f58ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38910/0 (socket says 172.21.15.96:38910) 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b90d7f640 1 -- 172.21.15.96:0/2822438005 learned_addr learned my addr 172.21.15.96:0/2822438005 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b90d7f640 1 -- 172.21.15.96:0/2822438005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd7f59040 con 0x559dd7e65fd0 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b90d7f640 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f58ae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5b78018eb0 tx=0x7f5b78018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5a7d60a640 1 -- 172.21.15.96:0/2822438005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b780c4070 con 0x559dd7e65fd0 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559dd7f592d0 con 0x559dd7e65fd0 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5a7d60a640 1 -- 172.21.15.96:0/2822438005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780b75b0 con 0x559dd7e65fd0 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd7f59c80 con 0x559dd7e65fd0 2024-09-14T10:44:26.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5a7d60a640 1 -- 172.21.15.96:0/2822438005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b780ce060 con 0x559dd7e65fd0 2024-09-14T10:44:26.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5a7d60a640 1 -- 172.21.15.96:0/2822438005 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5b780c7070 con 0x559dd7e65fd0 2024-09-14T10:44:26.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5a7d60a640 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a7803a1a0 0x7f5a7803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5a7d60a640 1 -- 172.21.15.96:0/2822438005 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b780bc070 con 0x559dd7e65fd0 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b8857e640 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a7803a1a0 0x7f5a7803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7e69110 0x559dd7f5fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f60190 con 0x559dd7e69110 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b91580640 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7e69110 0x559dd7f5fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b8857e640 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a7803a1a0 0x7f5a7803c660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b80004180 tx=0x7f5b80001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b91580640 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7e69110 0x559dd7f5fc50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b91580640 1 -- 172.21.15.96:0/2822438005 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b8c00a4d0 con 0x559dd7e69110 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.492+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f605b0 con 0x559dd7e69110 2024-09-14T10:44:26.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b91580640 1 -- 172.21.15.96:0/2822438005 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b8c00a4d0 con 0x559dd7e69110 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f61eb0 con 0x559dd7e69110 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b91580640 1 -- 172.21.15.96:0/2822438005 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b8c00a4d0 con 0x559dd7e69110 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f610e0 con 0x559dd7e69110 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b91580640 1 -- 172.21.15.96:0/2822438005 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b8c00a4d0 con 0x559dd7e69110 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f61530 con 0x559dd7e69110 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b91580640 1 -- 172.21.15.96:0/2822438005 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b8c00a4d0 con 0x559dd7e69110 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 Processor -- start 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 -- start start 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7f70250 0x559dd7f70670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559dd7d7ad80 con 0x559dd7f70250 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b8857e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7f70250 0x559dd7f70670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b8857e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7f70250 0x559dd7f70670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38916/0 (socket says 172.21.15.96:38916) 2024-09-14T10:44:26.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b8857e640 1 -- 172.21.15.96:0/3457233650 learned_addr learned my addr 172.21.15.96:0/3457233650 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b8857e640 1 -- 172.21.15.96:0/3457233650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd7f70cb0 con 0x559dd7f70250 2024-09-14T10:44:26.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b8857e640 1 --2- 172.21.15.96:0/3457233650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7f70250 0x559dd7f70670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000d660 tx=0x7f5b8000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5a767fc640 1 -- 172.21.15.96:0/3457233650 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b8000c6b0 con 0x559dd7f70250 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5a767fc640 1 -- 172.21.15.96:0/3457233650 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8000c850 con 0x559dd7f70250 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 -- 172.21.15.96:0/3457233650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559dd7f71510 con 0x559dd7f70250 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5a767fc640 1 -- 172.21.15.96:0/3457233650 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b8000cb30 con 0x559dd7f70250 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.496+0000 7f5b932799c0 1 -- 172.21.15.96:0/3457233650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd7f71a80 con 0x559dd7f70250 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5a767fc640 1 -- 172.21.15.96:0/3457233650 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5b80023020 con 0x559dd7f70250 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5a767fc640 1 --2- 172.21.15.96:0/3457233650 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6803a1a0 0x7f5a6803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5a767fc640 1 -- 172.21.15.96:0/3457233650 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b80021020 con 0x559dd7f70250 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b91580640 1 --2- 172.21.15.96:0/3457233650 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6803a1a0 0x7f5a6803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 Processor -- start 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- start start 2024-09-14T10:44:26.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b91580640 1 --2- 172.21.15.96:0/3457233650 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6803a1a0 0x7f5a6803c660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x559dd7f60c00 tx=0x7f5b8c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7ddb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559dd7f51d30 con 0x559dd7ddad20 2024-09-14T10:44:26.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b8857e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7ddb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b8857e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7ddb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38932/0 (socket says 172.21.15.96:38932) 2024-09-14T10:44:26.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b8857e640 1 -- 172.21.15.96:0/3699091018 learned_addr learned my addr 172.21.15.96:0/3699091018 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b8857e640 1 -- 172.21.15.96:0/3699091018 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd7ddb660 con 0x559dd7ddad20 2024-09-14T10:44:26.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b8857e640 1 --2- 172.21.15.96:0/3699091018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7ddb120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5b80051820 tx=0x7f5b80044760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dccc155c435842 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5a67fff640 1 -- 172.21.15.96:0/3699091018 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b8001bcc0 con 0x559dd7ddad20 2024-09-14T10:44:26.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5a67fff640 1 -- 172.21.15.96:0/3699091018 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8004ae50 con 0x559dd7ddad20 2024-09-14T10:44:26.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5a67fff640 1 -- 172.21.15.96:0/3699091018 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80050270 con 0x559dd7ddad20 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- 172.21.15.96:0/3699091018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 msgr2=0x559dd7ddb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 --2- 172.21.15.96:0/3699091018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7ddb120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5b80051820 tx=0x7f5b80044760 comp rx=0 tx=0).stop 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- 172.21.15.96:0/3699091018 shutdown_connections 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 --2- 172.21.15.96:0/3699091018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7ddb120 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- 172.21.15.96:0/3699091018 >> 172.21.15.96:0/3699091018 conn(0x559dd7f78fe0 msgr2=0x559dd7f77220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- 172.21.15.96:0/3699091018 shutdown_connections 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- 172.21.15.96:0/3699091018 wait complete. 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 Processor -- start 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- start start 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7f86470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b932799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559dd7ddbb80 con 0x559dd7ddad20 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b8857e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7f86470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.500+0000 7f5b8857e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7f86470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38944/0 (socket says 172.21.15.96:38944) 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 learned_addr learned my addr 172.21.15.96:0/896315855 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd7f869d0 con 0x559dd7ddad20 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b8857e640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7f86470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5b80023fd0 tx=0x7f5b800517b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5a667fc640 1 -- 172.21.15.96:0/896315855 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80034020 con 0x559dd7ddad20 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559dd7f86c60 con 0x559dd7ddad20 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5a667fc640 1 -- 172.21.15.96:0/896315855 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b80043380 con 0x559dd7ddad20 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5a667fc640 1 -- 172.21.15.96:0/896315855 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80019ba0 con 0x559dd7ddad20 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd7f86c60 con 0x559dd7ddad20 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5a667fc640 1 -- 172.21.15.96:0/896315855 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5b80037020 con 0x559dd7ddad20 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5a667fc640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a5c03a150 0x7f5a5c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5a667fc640 1 -- 172.21.15.96:0/896315855 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b80050070 con 0x559dd7ddad20 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b91580640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a5c03a150 0x7f5a5c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7f91800 0x559dd7f93c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f943e0 con 0x559dd7f91800 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b90d7f640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7f91800 0x559dd7f93c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b91580640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a5c03a150 0x7f5a5c03c610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x559dd7f5ac30 tx=0x7f5b8c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b90d7f640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7f91800 0x559dd7f93c90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 realm 2024-09-14T10:44:26.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f947f0 con 0x559dd7f91800 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f950c0 con 0x559dd7f91800 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f95460 con 0x559dd7f91800 2024-09-14T10:44:26.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.504+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f95900 con 0x559dd7f91800 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b932799c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b932799c0 20 searching for the correct realm 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559dd7f97900 0x559dd7f99cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b8857e640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559dd7f97900 0x559dd7f99cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b8857e640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559dd7f97900 0x559dd7f99cf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b8857e640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5b80039020 0x7f5b8003f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b80039020 2024-09-14T10:44:26.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b91580640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5b80039020 0x7f5b8003f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b91580640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5b80039020 0x7f5b8003f850 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c01f070 con 0x7f5b80039020 2024-09-14T10:44:26.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b91580640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5b8c031040 0x7f5b8c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5b8c031040 0x7f5b8c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5b8c031040 0x7f5b8c032940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x7f5b8c031040 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f91800 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f91800 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.508+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x7f5b8c031040 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x7f5b8c031040 2024-09-14T10:44:26.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b80039020 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c01f070 con 0x7f5b80039020 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f91800 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x7f5b8c031040 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f91800 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b80039020 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b8c01f070 con 0x7f5b80039020 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x7f5b8c031040 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.512+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f91800 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f91800 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b780c6030 con 0x7f5b8c031040 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b80039020 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c01f070 con 0x7f5b80039020 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f91800 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5b780c6030 con 0x559dd7f91800 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.516+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b80039020 2024-09-14T10:44:26.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c01f070 con 0x7f5b80039020 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f97900 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b8c031040 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x559dd7f91800 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a3a0 con 0x7f5b80039020 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8c01f070 con 0x7f5b80039020 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:26.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f96330 con 0x559dd7f91800 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f96bd0 con 0x559dd7f91800 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f95f70 con 0x559dd7f91800 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 zone default found 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 4 Realm: () 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 zonegroup default 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9a800 con 0x7f5b8c031040 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9c350 con 0x559dd7f97900 2024-09-14T10:44:26.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9c870 con 0x559dd7f97900 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.520+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b932799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b932799c0 20 started sync module instance, tier type = 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b932799c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9b690 con 0x7f5b80039020 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c040040 con 0x7f5b80039020 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94136421694080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9d180 con 0x7f5b80039020 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9d9d0 con 0x559dd7f91800 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94136421694080] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c040040 con 0x7f5b80039020 2024-09-14T10:44:26.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94136421698768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9d620 con 0x559dd7f91800 2024-09-14T10:44:26.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.524+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9e120 con 0x559dd7f97900 2024-09-14T10:44:26.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.528+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94136421698768] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.528+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.528+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94136421702672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9e4c0 con 0x559dd7f97900 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.528+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9ee80 con 0x7f5b80039020 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.528+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c040040 con 0x7f5b80039020 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.528+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94136421706496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9f720 con 0x7f5b80039020 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.528+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa00e0 con 0x559dd7f91800 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.528+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94136421702672] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.532+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94136421706496] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c040040 con 0x7f5b80039020 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.532+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.532+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94136421710896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9f720 con 0x559dd7f91800 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.532+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa0050 con 0x7f5b8c031040 2024-09-14T10:44:26.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.532+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94136421710896] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.532+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.532+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94136421708672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa0500 con 0x7f5b8c031040 2024-09-14T10:44:26.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.532+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa0ec0 con 0x7f5b8c031040 2024-09-14T10:44:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94136421714448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa12e0 con 0x7f5b8c031040 2024-09-14T10:44:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa1d90 con 0x7f5b8c031040 2024-09-14T10:44:26.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94136421708672] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94136421711952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa1d90 con 0x7f5b8c031040 2024-09-14T10:44:26.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 20 add_watcher() i=0 2024-09-14T10:44:26.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 20 add_watcher() i=1 2024-09-14T10:44:26.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 20 add_watcher() i=2 2024-09-14T10:44:26.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 20 add_watcher() i=3 2024-09-14T10:44:26.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 20 add_watcher() i=4 2024-09-14T10:44:26.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 20 add_watcher() i=5 2024-09-14T10:44:26.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94136421714448] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.536+0000 7f5b932799c0 20 add_watcher() i=6 2024-09-14T10:44:26.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94136421711952] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 20 add_watcher() i=7 2024-09-14T10:44:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa0e30 con 0x559dd7f91800 2024-09-14T10:44:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94136421715504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa2560 con 0x559dd7f91800 2024-09-14T10:44:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94136421715504] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5a477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 5 note: GC not initialized 2024-09-14T10:44:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5a467e4640 20 reqs_thread_entry: start 2024-09-14T10:44:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 20 Filter name: none 2024-09-14T10:44:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5a3f7fe640 20 reqs_thread_entry: start 2024-09-14T10:44:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.540+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fc7fc0 con 0x559dd7f91800 2024-09-14T10:44:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b932799c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-14T10:44:26.541 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:44:26.369390Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:26.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5a477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94136421715504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fc6910 con 0x559dd7f91800 2024-09-14T10:44:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94136421715504] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94136421694080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fc5c40 con 0x7f5b80039020 2024-09-14T10:44:26.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94136421694080] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c040040 con 0x7f5b80039020 2024-09-14T10:44:26.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b932799c0 20 remove_watcher() i=0 2024-09-14T10:44:26.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b932799c0 2 removed watcher, disabling cache 2024-09-14T10:44:26.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.544+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94136421698768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fc5c40 con 0x559dd7f91800 2024-09-14T10:44:26.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.548+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94136421698768] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.548+0000 7f5b932799c0 20 remove_watcher() i=1 2024-09-14T10:44:26.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.548+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94136421702672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fc5c40 con 0x559dd7f97900 2024-09-14T10:44:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.548+0000 7f5b8857e640 1 -- 172.21.15.96:0/896315855 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94136421702672] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8004ed10 con 0x559dd7f97900 2024-09-14T10:44:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.548+0000 7f5b932799c0 20 remove_watcher() i=2 2024-09-14T10:44:26.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.548+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94136421706496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9dc10 con 0x7f5b80039020 2024-09-14T10:44:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.552+0000 7f5b91580640 1 -- 172.21.15.96:0/896315855 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94136421706496] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b8c040040 con 0x7f5b80039020 2024-09-14T10:44:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.552+0000 7f5b932799c0 20 remove_watcher() i=3 2024-09-14T10:44:26.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.552+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94136421710896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9eb00 con 0x559dd7f91800 2024-09-14T10:44:26.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.552+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94136421710896] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x559dd7f91800 2024-09-14T10:44:26.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.552+0000 7f5b932799c0 20 remove_watcher() i=4 2024-09-14T10:44:26.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.552+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94136421708672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9fc30 con 0x7f5b8c031040 2024-09-14T10:44:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.556+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94136421708672] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.556+0000 7f5b932799c0 20 remove_watcher() i=5 2024-09-14T10:44:26.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.556+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94136421714448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7f9eb00 con 0x7f5b8c031040 2024-09-14T10:44:26.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.556+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94136421714448] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.556+0000 7f5b932799c0 20 remove_watcher() i=6 2024-09-14T10:44:26.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.556+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94136421711952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559dd7fa0ec0 con 0x7f5b8c031040 2024-09-14T10:44:26.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94136421711952] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b78104040 con 0x7f5b8c031040 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 20 remove_watcher() i=7 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5b8c031040 msgr2=0x7f5b8c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5b8c031040 0x7f5b8c032940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7f91800 msgr2=0x559dd7f93c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7f91800 0x559dd7f93c90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5b80039020 msgr2=0x7f5b8003f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5b80039020 0x7f5b8003f850 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559dd7f97900 msgr2=0x559dd7f99cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559dd7f97900 0x559dd7f99cf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a5c03a150 msgr2=0x7f5a5c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a5c03a150 0x7f5a5c03c610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x559dd7f5ac30 tx=0x7f5b8c01f000 comp rx=0 tx=0).stop 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 msgr2=0x559dd7f86470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b90d7f640 1 -- 172.21.15.96:0/896315855 reap_dead start 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7f86470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5b80023fd0 tx=0x7f5b800517b0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 shutdown_connections 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/896315855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7ddad20 0x559dd7f86470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 >> 172.21.15.96:0/896315855 conn(0x559dd7f78fe0 msgr2=0x559dd7f771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 shutdown_connections 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/896315855 wait complete. 2024-09-14T10:44:26.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/3457233650 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6803a1a0 msgr2=0x7f5a6803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/3457233650 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6803a1a0 0x7f5a6803c660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x559dd7f60c00 tx=0x7f5b8c005850 comp rx=0 tx=0).stop 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/3457233650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7f70250 msgr2=0x559dd7f70670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/3457233650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7f70250 0x559dd7f70670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000d660 tx=0x7f5b8000da60 comp rx=0 tx=0).stop 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/3457233650 shutdown_connections 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/3457233650 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a6803a1a0 0x7f5a6803c660 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/3457233650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7f70250 0x559dd7f70670 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/3457233650 >> 172.21.15.96:0/3457233650 conn(0x559dd7f65c00 msgr2=0x559dd7f65fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/3457233650 shutdown_connections 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/3457233650 wait complete. 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7e69110 msgr2=0x559dd7f5fc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7e69110 0x559dd7f5fc50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a7803a1a0 msgr2=0x7f5a7803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a7803a1a0 0x7f5a7803c660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b80004180 tx=0x7f5b80001340 comp rx=0 tx=0).stop 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 msgr2=0x559dd7f58ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f58ae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5b78018eb0 tx=0x7f5b78018020 comp rx=0 tx=0).stop 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 shutdown_connections 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559dd7e69110 0x559dd7f5fc50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5a7803a1a0 0x7f5a7803c660 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 --2- 172.21.15.96:0/2822438005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559dd7e65fd0 0x559dd7f58ae0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 >> 172.21.15.96:0/2822438005 conn(0x559dd7e61af0 msgr2=0x559dd7f4ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:26.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 shutdown_connections 2024-09-14T10:44:26.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.560+0000 7f5b932799c0 1 -- 172.21.15.96:0/2822438005 wait complete. 2024-09-14T10:44:26.567 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:44:26.369390Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:26.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-14T10:44:26.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-14T10:44:26.568 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-14T10:44:26.647 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:27.693 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.648+0000 7f7d5baa99c0 1 Processor -- start 2024-09-14T10:44:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.648+0000 7f7d5baa99c0 1 -- start start 2024-09-14T10:44:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.648+0000 7f7d5baa99c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55716bba9010 0x55716bba93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.648+0000 7f7d5baa99c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55716ba517a0 con 0x55716bbac1a0 2024-09-14T10:44:27.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.648+0000 7f7d5baa99c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55716baad1b0 con 0x55716bba9010 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d595af640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55716bba9010 0x55716bba93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d595af640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55716bba9010 0x55716bba93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38948/0 (socket says 172.21.15.96:38948) 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d595af640 1 -- 172.21.15.96:0/1685906094 learned_addr learned my addr 172.21.15.96:0/1685906094 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d58dae640 1 --1- 172.21.15.96:0/1685906094 >> v1:172.21.15.70:6789/0 conn(0x55716bbac1a0 0x55716bbae590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34312/0 (socket says 172.21.15.96:34312) 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d595af640 1 -- 172.21.15.96:0/1685906094 >> v1:172.21.15.70:6789/0 conn(0x55716bbac1a0 legacy=0x55716bbae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d595af640 1 -- 172.21.15.96:0/1685906094 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716ba2bda0 con 0x55716bba9010 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d595af640 1 --2- 172.21.15.96:0/1685906094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bba93f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400a4e0 tx=0x7f7d5401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f75fe7ad988e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d4bfff640 1 -- 172.21.15.96:0/1685906094 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d540aa540 con 0x55716bba9010 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d4bfff640 1 -- 172.21.15.96:0/1685906094 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d540aa6e0 con 0x55716bba9010 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d4bfff640 1 -- 172.21.15.96:0/1685906094 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d540aaa40 con 0x55716bba9010 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1685906094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 msgr2=0x55716bba93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/1685906094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bba93f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400a4e0 tx=0x7f7d5401b090 comp rx=0 tx=0).stop 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1685906094 shutdown_connections 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/1685906094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bba93f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1685906094 >> 172.21.15.96:0/1685906094 conn(0x55716bba4b30 msgr2=0x55716bba6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1685906094 shutdown_connections 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.652+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1685906094 wait complete. 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 Processor -- start 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 -- start start 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc943b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55716bab0fc0 con 0x55716bba9010 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d595af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d595af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc943b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38952/0 (socket says 172.21.15.96:38952) 2024-09-14T10:44:27.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d595af640 1 -- 172.21.15.96:0/3846973759 learned_addr learned my addr 172.21.15.96:0/3846973759 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d595af640 1 -- 172.21.15.96:0/3846973759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716bc949a0 con 0x55716bba9010 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d595af640 1 --2- 172.21.15.96:0/3846973759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc943b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d54019740 tx=0x7f7d540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec10b03cc70ee6a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7c47606640 1 -- 172.21.15.96:0/3846973759 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d540b9070 con 0x55716bba9010 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7c47606640 1 -- 172.21.15.96:0/3846973759 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d540aaa90 con 0x55716bba9010 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7c47606640 1 -- 172.21.15.96:0/3846973759 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d540aad70 con 0x55716bba9010 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3846973759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 msgr2=0x55716bc943b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/3846973759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc943b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d54019740 tx=0x7f7d540033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3846973759 shutdown_connections 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/3846973759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc943b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3846973759 >> 172.21.15.96:0/3846973759 conn(0x55716bba4b30 msgr2=0x55716bc8fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3846973759 shutdown_connections 2024-09-14T10:44:27.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3846973759 wait complete. 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 Processor -- start 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.668+0000 7f7d5baa99c0 1 -- start start 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d5baa99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc9ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d5baa99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55716ba52a50 con 0x55716bba9010 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d595af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc9ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d595af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc9ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38960/0 (socket says 172.21.15.96:38960) 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d595af640 1 -- 172.21.15.96:0/2959698774 learned_addr learned my addr 172.21.15.96:0/2959698774 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d595af640 1 -- 172.21.15.96:0/2959698774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716bc9bfe0 con 0x55716bba9010 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d595af640 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc9ba80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7d54018cc0 tx=0x7f7d54017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7c45e03640 1 -- 172.21.15.96:0/2959698774 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d540b9070 con 0x55716bba9010 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55716bc9c270 con 0x55716bba9010 2024-09-14T10:44:27.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7c45e03640 1 -- 172.21.15.96:0/2959698774 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d540b5b10 con 0x55716bba9010 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55716bc9cc20 con 0x55716bba9010 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7c45e03640 1 -- 172.21.15.96:0/2959698774 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d540b5df0 con 0x55716bba9010 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7c45e03640 1 -- 172.21.15.96:0/2959698774 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7d540b3040 con 0x55716bba9010 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7c45e03640 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c4003a150 0x7f7c4003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7c45e03640 1 -- 172.21.15.96:0/2959698774 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7d540c4070 con 0x55716bba9010 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bbac1a0 0x55716bca2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d58dae640 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c4003a150 0x7f7c4003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bca3130 con 0x55716bbac1a0 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d59db0640 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bbac1a0 0x55716bca2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d58dae640 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c4003a150 0x7f7c4003c610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d50001e40 tx=0x7f7d500013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d59db0640 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bbac1a0 0x55716bca2bf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d59db0640 1 -- 172.21.15.96:0/2959698774 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.672+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bca3540 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d59db0640 1 -- 172.21.15.96:0/2959698774 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d4c0083f0 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bca4e40 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d59db0640 1 -- 172.21.15.96:0/2959698774 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d4c0083f0 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bca4070 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d59db0640 1 -- 172.21.15.96:0/2959698774 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d4c0083f0 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bca44c0 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d59db0640 1 -- 172.21.15.96:0/2959698774 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d4c0083f0 con 0x55716bbac1a0 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 Processor -- start 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 -- start start 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcb31e0 0x55716bcb3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55716babdd80 con 0x55716bcb31e0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d58dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcb31e0 0x55716bcb3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d58dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcb31e0 0x55716bcb3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38970/0 (socket says 172.21.15.96:38970) 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d58dae640 1 -- 172.21.15.96:0/3579411827 learned_addr learned my addr 172.21.15.96:0/3579411827 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d58dae640 1 -- 172.21.15.96:0/3579411827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716bcb3c40 con 0x55716bcb31e0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d58dae640 1 --2- 172.21.15.96:0/3579411827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcb31e0 0x55716bcb3600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000e670 tx=0x7f7d5000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7c3effd640 1 -- 172.21.15.96:0/3579411827 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d50022070 con 0x55716bcb31e0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7c3effd640 1 -- 172.21.15.96:0/3579411827 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5000d660 con 0x55716bcb31e0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3579411827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55716bcb44a0 con 0x55716bcb31e0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7c3effd640 1 -- 172.21.15.96:0/3579411827 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d50006070 con 0x55716bcb31e0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.676+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3579411827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55716bcb4a10 con 0x55716bcb31e0 2024-09-14T10:44:27.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7c3effd640 1 -- 172.21.15.96:0/3579411827 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7d50025070 con 0x55716bcb31e0 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7c3effd640 1 --2- 172.21.15.96:0/3579411827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c3003a150 0x7f7c3003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7c3effd640 1 -- 172.21.15.96:0/3579411827 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7d500523a0 con 0x55716bcb31e0 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d59db0640 1 --2- 172.21.15.96:0/3579411827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c3003a150 0x7f7c3003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 Processor -- start 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- start start 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55716bc94d10 con 0x55716bcc0b70 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d59db0640 1 --2- 172.21.15.96:0/3579411827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c3003a150 0x7f7c3003c610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55716bca3b90 tx=0x7f7d4c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d58dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d58dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38976/0 (socket says 172.21.15.96:38976) 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d58dae640 1 -- 172.21.15.96:0/1373802892 learned_addr learned my addr 172.21.15.96:0/1373802892 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d58dae640 1 -- 172.21.15.96:0/1373802892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716bcc1560 con 0x55716bcc0b70 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d58dae640 1 --2- 172.21.15.96:0/1373802892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc0f70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7d500507c0 tx=0x7f7d50024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d369b1a23276e9d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7c3cff9640 1 -- 172.21.15.96:0/1373802892 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5000dcc0 con 0x55716bcc0b70 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7c3cff9640 1 -- 172.21.15.96:0/1373802892 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5004f220 con 0x55716bcc0b70 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7c3cff9640 1 -- 172.21.15.96:0/1373802892 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5000de60 con 0x55716bcc0b70 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1373802892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 msgr2=0x55716bcc0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/1373802892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc0f70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7d500507c0 tx=0x7f7d50024c90 comp rx=0 tx=0).stop 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1373802892 shutdown_connections 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/1373802892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc0f70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1373802892 >> 172.21.15.96:0/1373802892 conn(0x55716bcbbf90 msgr2=0x55716bcba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1373802892 shutdown_connections 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/1373802892 wait complete. 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 Processor -- start 2024-09-14T10:44:27.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- start start 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.680+0000 7f7d5baa99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55716bcbfac0 con 0x55716bcc0b70 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d58dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d58dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38986/0 (socket says 172.21.15.96:38986) 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 learned_addr learned my addr 172.21.15.96:0/2809974844 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716bcc7600 con 0x55716bcc0b70 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d58dae640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc70a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000ef00 tx=0x7f7d50050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7c2effd640 1 -- 172.21.15.96:0/2809974844 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d50025c80 con 0x55716bcc0b70 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7c2effd640 1 -- 172.21.15.96:0/2809974844 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d50025e20 con 0x55716bcc0b70 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55716bcc7890 con 0x55716bcc0b70 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7c2effd640 1 -- 172.21.15.96:0/2809974844 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5001a320 con 0x55716bcc0b70 2024-09-14T10:44:27.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55716bcc7890 con 0x55716bcc0b70 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7c2effd640 1 -- 172.21.15.96:0/2809974844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7d50033070 con 0x55716bcc0b70 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7c2effd640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c2403a150 0x7f7c2403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7c2effd640 1 -- 172.21.15.96:0/2809974844 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7d50045070 con 0x55716bcc0b70 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d59db0640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c2403a150 0x7f7c2403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bcd2450 0x55716bcd48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd5030 con 0x55716bcd2450 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d595af640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bcd2450 0x55716bcd48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d59db0640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c2403a150 0x7f7c2403c610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00f010 tx=0x7f7d4c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d595af640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bcd2450 0x55716bcd48e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 20 realm 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd5490 con 0x55716bcd2450 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.684+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd5d60 con 0x55716bcd2450 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd6100 con 0x55716bcd2450 2024-09-14T10:44:27.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd6950 con 0x55716bcd2450 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 20 searching for the correct realm 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55716bcd86c0 0x55716bcdaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdb0e0 con 0x55716bcd86c0 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d58dae640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55716bcd86c0 0x55716bcdaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d58dae640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55716bcd86c0 0x55716bcdaab0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d58dae640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7d50035070 0x7f7d500494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdb0e0 con 0x7f7d50035070 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d59db0640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7d50035070 0x7f7d500494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d59db0640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7d50035070 0x7f7d500494d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d59db0640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7d4c019040 0x7f7d4c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdb0e0 con 0x7f7d4c019040 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7d4c019040 0x7f7d4c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7d4c019040 0x7f7d4c019930 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdb0e0 con 0x55716bcd2450 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.688+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdb0e0 con 0x55716bcd2450 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d4c019040 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d4c019040 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d50035070 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd86c0 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd2450 2024-09-14T10:44:27.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d4c019040 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd2450 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d50035070 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd86c0 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd86c0 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.692+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d4c019040 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd86c0 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd86c0 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd2450 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd2450 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d4c019040 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd86c0 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d50035070 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd2450 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d4c019040 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd86c0 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.696+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d4c019040 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d50035070 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd86c0 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d4c019040 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x55716bcd2450 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d540dc040 con 0x7f7d50035070 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:27.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd71a0 con 0x55716bcd2450 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd7590 con 0x55716bcd2450 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd7590 con 0x55716bcd2450 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 zone default found 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 4 Realm: () 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 zonegroup default 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcd6d20 con 0x7f7d4c019040 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdcf30 con 0x55716bcd86c0 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.700+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdd2d0 con 0x55716bcd86c0 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d5baa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d5baa99c0 20 started sync module instance, tier type = 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d5baa99c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdc3d0 con 0x7f7d50035070 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93945628313584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdc030 con 0x7f7d50035070 2024-09-14T10:44:27.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcddfd0 con 0x55716bcd2450 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93945628318496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcde3f0 con 0x55716bcd2450 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.704+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93945628313584] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdeea0 con 0x55716bcd86c0 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93945628317376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdf240 con 0x55716bcd86c0 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdfc00 con 0x7f7d50035070 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93945628318496] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93945628325712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdfb70 con 0x7f7d50035070 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce09d0 con 0x55716bcd2450 2024-09-14T10:44:27.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.708+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93945628317376] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.712+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.712+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93945628329120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce0990 con 0x55716bcd2450 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.712+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce13e0 con 0x7f7d4c019040 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.716+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93945628325712] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.716+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.716+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93945628327920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce13e0 con 0x7f7d4c019040 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.716+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce1c70 con 0x7f7d4c019040 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.716+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93945628329120] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93945628322176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce1e70 con 0x7f7d4c019040 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce26c0 con 0x7f7d4c019040 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93945628327920] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93945628322176] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93945628332304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce2320 con 0x7f7d4c019040 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 20 add_watcher() i=0 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 20 add_watcher() i=1 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 20 add_watcher() i=2 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 20 add_watcher() i=3 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 20 add_watcher() i=4 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 20 add_watcher() i=5 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.720+0000 7f7d5baa99c0 20 add_watcher() i=6 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93945628332304] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 20 add_watcher() i=7 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:27.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bce5470 con 0x55716bcd2450 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93945628335696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bce2720 con 0x55716bcd2450 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93945628335696] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7c0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 5 note: GC not initialized 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7c0e7e4640 20 reqs_thread_entry: start 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 20 Filter name: none 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7b7ffff640 20 reqs_thread_entry: start 2024-09-14T10:44:27.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bd08c70 con 0x55716bcd2450 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bd0f720 con 0x55716bcd2450 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:27.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.724+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93945628520848 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bd0adf0 con 0x55716bcd2450 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 93945628329120 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55716bc9cc20 con 0x55716bcd2450 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7c3cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93945628329120 notifier 4354 bl.length()=567 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7c3cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7c3cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7c3cff9640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7c1c003eb0 con 0x55716bcd2450 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(64 notify.4 [notify cookie 93945628520848 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 93945628520848 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55716bc9c270 con 0x55716bcd2450 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bd0f190 con 0x7f7d4c019040 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d5baa99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:44:27.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93945628520848 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55716bd0a940 con 0x55716bcd86c0 2024-09-14T10:44:27.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== watch-notify(notify (1) cookie 93945628317376 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55716bcc7600 con 0x55716bcd86c0 2024-09-14T10:44:27.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7c2ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 93945628317376 notifier 4354 bl.length()=170 2024-09-14T10:44:27.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7c2ffff640 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7b8c0032d0 con 0x55716bcd86c0 2024-09-14T10:44:27.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 notify.2 [notify cookie 93945628520848 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== watch-notify(notify_complete (2) cookie 93945628520848 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55716bcc1560 con 0x55716bcd86c0 2024-09-14T10:44:27.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.728+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.751 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.732+0000 7f7c0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.732+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93945628335696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bd06860 con 0x55716bcd2450 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.732+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93945628335696] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.732+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93945628313584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bd06860 con 0x7f7d50035070 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.732+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93945628313584] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.732+0000 7f7d5baa99c0 20 remove_watcher() i=0 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.732+0000 7f7d5baa99c0 2 removed watcher, disabling cache 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.732+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93945628318496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bd06860 con 0x55716bcd2450 2024-09-14T10:44:27.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93945628318496] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d5baa99c0 20 remove_watcher() i=1 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93945628317376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bd06860 con 0x55716bcd86c0 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d58dae640 1 -- 172.21.15.96:0/2809974844 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93945628317376] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5003c070 con 0x55716bcd86c0 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d5baa99c0 20 remove_watcher() i=2 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93945628325712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdc7f0 con 0x7f7d50035070 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d59db0640 1 -- 172.21.15.96:0/2809974844 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93945628325712] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c02f040 con 0x7f7d50035070 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d5baa99c0 20 remove_watcher() i=3 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.736+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93945628329120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdc7f0 con 0x55716bcd2450 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.740+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93945628329120] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x55716bcd2450 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.740+0000 7f7d5baa99c0 20 remove_watcher() i=4 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.740+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93945628327920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdc7f0 con 0x7f7d4c019040 2024-09-14T10:44:27.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.740+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93945628327920] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.740+0000 7f7d5baa99c0 20 remove_watcher() i=5 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.740+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93945628322176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcdc7f0 con 0x7f7d4c019040 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93945628322176] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d5baa99c0 20 remove_watcher() i=6 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93945628332304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55716bcde980 con 0x7f7d4c019040 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93945628332304] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d540c7de0 con 0x7f7d4c019040 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d5baa99c0 20 remove_watcher() i=7 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7d4c019040 msgr2=0x7f7d4c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7d4c019040 0x7f7d4c019930 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bcd2450 msgr2=0x55716bcd48e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.744+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bcd2450 0x55716bcd48e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7d50035070 msgr2=0x7f7d500494d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7d50035070 0x7f7d500494d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55716bcd86c0 msgr2=0x55716bcdaab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55716bcd86c0 0x55716bcdaab0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c2403a150 msgr2=0x7f7c2403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c2403a150 0x7f7c2403c610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00f010 tx=0x7f7d4c01b070 comp rx=0 tx=0).stop 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d595af640 1 -- 172.21.15.96:0/2809974844 reap_dead start 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 msgr2=0x55716bcc70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc70a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000ef00 tx=0x7f7d50050720 comp rx=0 tx=0).stop 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 shutdown_connections 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2809974844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcc0b70 0x55716bcc70a0 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000ef00 tx=0x7f7d50050720 comp rx=0 tx=0).stop 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 >> 172.21.15.96:0/2809974844 conn(0x55716bcbbf90 msgr2=0x55716bcba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 shutdown_connections 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2809974844 wait complete. 2024-09-14T10:44:27.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3579411827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c3003a150 msgr2=0x7f7c3003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/3579411827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c3003a150 0x7f7c3003c610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55716bca3b90 tx=0x7f7d4c003070 comp rx=0 tx=0).stop 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3579411827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcb31e0 msgr2=0x55716bcb3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/3579411827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcb31e0 0x55716bcb3600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000e670 tx=0x7f7d5000ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3579411827 shutdown_connections 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/3579411827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c3003a150 0x7f7c3003c610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/3579411827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bcb31e0 0x55716bcb3600 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3579411827 >> 172.21.15.96:0/3579411827 conn(0x55716bca8b90 msgr2=0x55716bca8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3579411827 shutdown_connections 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/3579411827 wait complete. 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bbac1a0 msgr2=0x55716bca2bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bbac1a0 0x55716bca2bf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c4003a150 msgr2=0x7f7c4003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c4003a150 0x7f7c4003c610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7d50001e40 tx=0x7f7d500013a0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 msgr2=0x55716bc9ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc9ba80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7d54018cc0 tx=0x7f7d54017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 shutdown_connections 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55716bbac1a0 0x55716bca2bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7c4003a150 0x7f7c4003c610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 --2- 172.21.15.96:0/2959698774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55716bba9010 0x55716bc9ba80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 >> 172.21.15.96:0/2959698774 conn(0x55716bba4b30 msgr2=0x55716bc956e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 shutdown_connections 2024-09-14T10:44:27.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:26.748+0000 7f7d5baa99c0 1 -- 172.21.15.96:0/2959698774 wait complete. 2024-09-14T10:44:27.762 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:27.763 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-14T10:44:27.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-14T10:44:27.763 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-14T10:44:27.840 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:27.841 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:27.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f27f249c0 1 Processor -- start 2024-09-14T10:44:27.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f27f249c0 1 -- start start 2024-09-14T10:44:27.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f27f249c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5566e0299fe0 0x5566e029a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f27f249c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566e01427a0 con 0x5566e029d120 2024-09-14T10:44:27.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f27f249c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5566e019e1b0 con 0x5566e0299fe0 2024-09-14T10:44:27.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f25a2a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5566e0299fe0 0x5566e029a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f25229640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5566e029d120 0x5566e029f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34322/0 (socket says 172.21.15.96:34322) 2024-09-14T10:44:27.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f25229640 1 -- 172.21.15.96:0/1514776738 learned_addr learned my addr 172.21.15.96:0/1514776738 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:27.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f25a2a640 1 -- 172.21.15.96:0/1514776738 >> v1:172.21.15.70:6789/0 conn(0x5566e029d120 legacy=0x5566e029f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.844+0000 7f6f25a2a640 1 -- 172.21.15.96:0/1514776738 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e011cda0 con 0x5566e0299fe0 2024-09-14T10:44:27.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f25a2a640 1 --2- 172.21.15.96:0/1514776738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e029a3c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800a480 tx=0x7f6f1801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da349b6bfed6af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f24a28640 1 -- 172.21.15.96:0/1514776738 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f180b0070 con 0x5566e0299fe0 2024-09-14T10:44:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f24a28640 1 -- 172.21.15.96:0/1514776738 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f180ab540 con 0x5566e0299fe0 2024-09-14T10:44:27.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f24a28640 1 -- 172.21.15.96:0/1514776738 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f180ab840 con 0x5566e0299fe0 2024-09-14T10:44:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1514776738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 msgr2=0x5566e029a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1514776738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e029a3c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800a480 tx=0x7f6f1801b280 comp rx=0 tx=0).stop 2024-09-14T10:44:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1514776738 shutdown_connections 2024-09-14T10:44:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1514776738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e029a3c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1514776738 >> 172.21.15.96:0/1514776738 conn(0x5566e0295b00 msgr2=0x5566e0297f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1514776738 shutdown_connections 2024-09-14T10:44:27.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.848+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1514776738 wait complete. 2024-09-14T10:44:27.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f27f249c0 1 Processor -- start 2024-09-14T10:44:27.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f27f249c0 1 -- start start 2024-09-14T10:44:27.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f27f249c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e03875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f27f249c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566e01a1fc0 con 0x5566e0299fe0 2024-09-14T10:44:27.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f25a2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e03875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f25a2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e03875e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39012/0 (socket says 172.21.15.96:39012) 2024-09-14T10:44:27.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f25a2a640 1 -- 172.21.15.96:0/3465991816 learned_addr learned my addr 172.21.15.96:0/3465991816 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f25a2a640 1 -- 172.21.15.96:0/3465991816 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e0387bd0 con 0x5566e0299fe0 2024-09-14T10:44:27.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.864+0000 7f6f25a2a640 1 --2- 172.21.15.96:0/3465991816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e03875e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6f18018eb0 tx=0x7f6f18003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8858ac28c9e5dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6e13e07640 1 -- 172.21.15.96:0/3465991816 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f180b0040 con 0x5566e0299fe0 2024-09-14T10:44:27.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6e13e07640 1 -- 172.21.15.96:0/3465991816 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f180bb070 con 0x5566e0299fe0 2024-09-14T10:44:27.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6e13e07640 1 -- 172.21.15.96:0/3465991816 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f180ab6f0 con 0x5566e0299fe0 2024-09-14T10:44:27.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- 172.21.15.96:0/3465991816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 msgr2=0x5566e03875e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/3465991816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e03875e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6f18018eb0 tx=0x7f6f18003030 comp rx=0 tx=0).stop 2024-09-14T10:44:27.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- 172.21.15.96:0/3465991816 shutdown_connections 2024-09-14T10:44:27.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/3465991816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e03875e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- 172.21.15.96:0/3465991816 >> 172.21.15.96:0/3465991816 conn(0x5566e0295b00 msgr2=0x5566e03831b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- 172.21.15.96:0/3465991816 shutdown_connections 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- 172.21.15.96:0/3465991816 wait complete. 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 Processor -- start 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- start start 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e038ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566e0143a50 con 0x5566e0299fe0 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f25a2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e038ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f25a2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e038ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39018/0 (socket says 172.21.15.96:39018) 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f25a2a640 1 -- 172.21.15.96:0/1785862504 learned_addr learned my addr 172.21.15.96:0/1785862504 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f25a2a640 1 -- 172.21.15.96:0/1785862504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e038f2c0 con 0x5566e0299fe0 2024-09-14T10:44:27.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f25a2a640 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e038ed60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f180b8040 tx=0x7f6f18018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6e12604640 1 -- 172.21.15.96:0/1785862504 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f180b0030 con 0x5566e0299fe0 2024-09-14T10:44:27.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566e038f550 con 0x5566e0299fe0 2024-09-14T10:44:27.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6e12604640 1 -- 172.21.15.96:0/1785862504 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f180bb070 con 0x5566e0299fe0 2024-09-14T10:44:27.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6e12604640 1 -- 172.21.15.96:0/1785862504 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f180b68e0 con 0x5566e0299fe0 2024-09-14T10:44:27.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.868+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e038ff00 con 0x5566e0299fe0 2024-09-14T10:44:27.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6e12604640 1 -- 172.21.15.96:0/1785862504 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6f180b6a80 con 0x5566e0299fe0 2024-09-14T10:44:27.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6e12604640 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0c03a150 0x7f6e0c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6e12604640 1 -- 172.21.15.96:0/1785862504 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6f180a8070 con 0x5566e0299fe0 2024-09-14T10:44:27.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f25229640 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0c03a150 0x7f6e0c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e029d120 0x5566e0395ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e0396410 con 0x5566e029d120 2024-09-14T10:44:27.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f2622b640 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e029d120 0x5566e0395ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f25229640 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0c03a150 0x7f6e0c03c610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f10001650 tx=0x7f6f10006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f2622b640 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e029d120 0x5566e0395ed0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f2622b640 1 -- 172.21.15.96:0/1785862504 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f200083f0 con 0x5566e029d120 2024-09-14T10:44:27.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03967f0 con 0x5566e029d120 2024-09-14T10:44:27.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f2622b640 1 -- 172.21.15.96:0/1785862504 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f200083f0 con 0x5566e029d120 2024-09-14T10:44:27.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03980f0 con 0x5566e029d120 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f2622b640 1 -- 172.21.15.96:0/1785862504 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6f200083f0 con 0x5566e029d120 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e0397320 con 0x5566e029d120 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f2622b640 1 -- 172.21.15.96:0/1785862504 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f200083f0 con 0x5566e029d120 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e0397770 con 0x5566e029d120 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f2622b640 1 -- 172.21.15.96:0/1785862504 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6f200083f0 con 0x5566e029d120 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 Processor -- start 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 -- start start 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03a6490 0x5566e03a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.872+0000 7f6f27f249c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566e01aed80 con 0x5566e03a6490 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f25229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03a6490 0x5566e03a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f25229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03a6490 0x5566e03a68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39026/0 (socket says 172.21.15.96:39026) 2024-09-14T10:44:27.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f25229640 1 -- 172.21.15.96:0/2094534213 learned_addr learned my addr 172.21.15.96:0/2094534213 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f25229640 1 -- 172.21.15.96:0/2094534213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e03a6ef0 con 0x5566e03a6490 2024-09-14T10:44:27.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f25229640 1 --2- 172.21.15.96:0/2094534213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03a6490 0x5566e03a68b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f10006960 tx=0x7f6f10015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6e0b7fe640 1 -- 172.21.15.96:0/2094534213 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f10015240 con 0x5566e03a6490 2024-09-14T10:44:27.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2094534213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566e03a7750 con 0x5566e03a6490 2024-09-14T10:44:27.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6e0b7fe640 1 -- 172.21.15.96:0/2094534213 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f10011440 con 0x5566e03a6490 2024-09-14T10:44:27.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2094534213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e03a7cc0 con 0x5566e03a6490 2024-09-14T10:44:27.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6e0b7fe640 1 -- 172.21.15.96:0/2094534213 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f10011720 con 0x5566e03a6490 2024-09-14T10:44:27.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6e0b7fe640 1 -- 172.21.15.96:0/2094534213 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6f100118c0 con 0x5566e03a6490 2024-09-14T10:44:27.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6e0b7fe640 1 --2- 172.21.15.96:0/2094534213 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0003a150 0x7f6e0003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6e0b7fe640 1 -- 172.21.15.96:0/2094534213 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6f1001b030 con 0x5566e03a6490 2024-09-14T10:44:27.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f2622b640 1 --2- 172.21.15.96:0/2094534213 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0003a150 0x7f6e0003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f27f249c0 1 Processor -- start 2024-09-14T10:44:27.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f27f249c0 1 -- start start 2024-09-14T10:44:27.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f2622b640 1 --2- 172.21.15.96:0/2094534213 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0003a150 0x7f6e0003c610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5566e0396e40 tx=0x7f6f20003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f27f249c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03b4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f27f249c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566e0387f40 con 0x5566e03b3e00 2024-09-14T10:44:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.876+0000 7f6f25229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39028/0 (socket says 172.21.15.96:39028) 2024-09-14T10:44:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 -- 172.21.15.96:0/998241469 learned_addr learned my addr 172.21.15.96:0/998241469 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 -- 172.21.15.96:0/998241469 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e03b47f0 con 0x5566e03b3e00 2024-09-14T10:44:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 --2- 172.21.15.96:0/998241469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03b4200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f10006f70 tx=0x7f6f1001e3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd2e54cbe4d21f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6e097fa640 1 -- 172.21.15.96:0/998241469 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f1004d020 con 0x5566e03b3e00 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6e097fa640 1 -- 172.21.15.96:0/998241469 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f10013e10 con 0x5566e03b3e00 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6e097fa640 1 -- 172.21.15.96:0/998241469 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f10013ac0 con 0x5566e03b3e00 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- 172.21.15.96:0/998241469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 msgr2=0x5566e03b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/998241469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03b4200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f10006f70 tx=0x7f6f1001e3f0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- 172.21.15.96:0/998241469 shutdown_connections 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/998241469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03b4200 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- 172.21.15.96:0/998241469 >> 172.21.15.96:0/998241469 conn(0x5566e03af220 msgr2=0x5566e03ad460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- 172.21.15.96:0/998241469 shutdown_connections 2024-09-14T10:44:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- 172.21.15.96:0/998241469 wait complete. 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 Processor -- start 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- start start 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03ba360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566e03b2d50 con 0x5566e03b3e00 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03ba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03ba360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39040/0 (socket says 172.21.15.96:39040) 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 learned_addr learned my addr 172.21.15.96:0/2172695913 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e03ba8c0 con 0x5566e03b3e00 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f25229640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03ba360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f10015d40 tx=0x7f6f100509c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6df77fe640 1 -- 172.21.15.96:0/2172695913 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f10044070 con 0x5566e03b3e00 2024-09-14T10:44:27.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6df77fe640 1 -- 172.21.15.96:0/2172695913 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1003eb70 con 0x5566e03b3e00 2024-09-14T10:44:27.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566e03bab50 con 0x5566e03b3e00 2024-09-14T10:44:27.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6df77fe640 1 -- 172.21.15.96:0/2172695913 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f100520d0 con 0x5566e03b3e00 2024-09-14T10:44:27.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.880+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e03bab50 con 0x5566e03b3e00 2024-09-14T10:44:27.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6df77fe640 1 -- 172.21.15.96:0/2172695913 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6f10052270 con 0x5566e03b3e00 2024-09-14T10:44:27.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6df77fe640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6df003a150 0x7f6df003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6df77fe640 1 -- 172.21.15.96:0/2172695913 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6f10033c50 con 0x5566e03b3e00 2024-09-14T10:44:27.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f2622b640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6df003a150 0x7f6df003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e03c56c0 0x5566e03c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03c82d0 con 0x5566e03c56c0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25a2a640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e03c56c0 0x5566e03c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f2622b640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6df003a150 0x7f6df003c610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000f010 tx=0x7f6f2001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25a2a640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e03c56c0 0x5566e03c7b80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f180b3040 con 0x5566e03c56c0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 realm 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03c86e0 con 0x5566e03c56c0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f180b3040 con 0x5566e03c56c0 2024-09-14T10:44:27.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03c8fb0 con 0x5566e03c56c0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f180b3040 con 0x5566e03c56c0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03c9350 con 0x5566e03c56c0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03c9ba0 con 0x5566e03c56c0 2024-09-14T10:44:27.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 20 searching for the correct realm 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5566e03cb910 0x5566e03cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566e03ce290 con 0x5566e03cb910 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25229640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5566e03cb910 0x5566e03cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.884+0000 7f6f25229640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5566e03cb910 0x5566e03cdd00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25229640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6f10049330 0x7f6f10041a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566e03ce290 con 0x7f6f10049330 2024-09-14T10:44:27.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f2622b640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6f10049330 0x7f6f10041a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f2622b640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6f10049330 0x7f6f10041a30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f2622b640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6f20019040 0x7f6f20019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566e03ce290 con 0x7f6f20019040 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6f20019040 0x7f6f20019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6f20019040 0x7f6f20019930 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5566e03ce290 con 0x5566e03c56c0 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03c56c0 2024-09-14T10:44:27.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f20019040 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.888+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f20019040 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f10049330 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03cb910 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03c56c0 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f20019040 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03c56c0 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f10049330 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03cb910 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03cb910 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f20019040 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03cb910 2024-09-14T10:44:27.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03cb910 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03c56c0 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.892+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03c56c0 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f20019040 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03cb910 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f10049330 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03c56c0 2024-09-14T10:44:27.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f20019040 2024-09-14T10:44:27.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03cb910 2024-09-14T10:44:27.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f20019040 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f10049330 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03cb910 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.896+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f20019040 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x5566e03c56c0 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f180dc040 con 0x7f6f10049330 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:27.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03ca3f0 con 0x5566e03c56c0 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03ca3f0 con 0x5566e03c56c0 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03ca3f0 con 0x5566e03c56c0 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 zone default found 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 4 Realm: () 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 zonegroup default 2024-09-14T10:44:27.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03ca3f0 con 0x7f6f20019040 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03cadc0 con 0x5566e03cb910 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d0100 con 0x5566e03cb910 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 started sync module instance, tier type = 2024-09-14T10:44:27.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.900+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03cf5a0 con 0x7f6f10049330 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.904+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.904+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93900337117584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03cf200 con 0x7f6f10049330 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.904+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d0e00 con 0x5566e03c56c0 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.904+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93900337117584] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.904+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.904+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93900337120416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d0d70 con 0x5566e03c56c0 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.904+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d1810 con 0x5566e03cb910 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93900337124192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d20b0 con 0x5566e03cb910 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d2ab0 con 0x7f6f10049330 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93900337120416] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93900337121472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d2ea0 con 0x7f6f10049330 2024-09-14T10:44:27.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d3860 con 0x5566e03c56c0 2024-09-14T10:44:27.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93900337124192] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.908+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93900337121472] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.912+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.912+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93900337128896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d33b0 con 0x5566e03c56c0 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.912+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d4100 con 0x7f6f20019040 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.912+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93900337128896] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.912+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.912+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93900337126400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d33b0 con 0x7f6f20019040 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.912+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d45c0 con 0x7f6f20019040 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93900337135760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d4a30 con 0x7f6f20019040 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d54f0 con 0x7f6f20019040 2024-09-14T10:44:27.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93900337126400] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93900337135760] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93900337139648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d4580 con 0x7f6f20019040 2024-09-14T10:44:27.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 20 add_watcher() i=0 2024-09-14T10:44:27.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 20 add_watcher() i=1 2024-09-14T10:44:27.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 20 add_watcher() i=2 2024-09-14T10:44:27.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 20 add_watcher() i=3 2024-09-14T10:44:27.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 20 add_watcher() i=4 2024-09-14T10:44:27.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 20 add_watcher() i=5 2024-09-14T10:44:27.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.916+0000 7f6f27f249c0 20 add_watcher() i=6 2024-09-14T10:44:27.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93900337139648] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 20 add_watcher() i=7 2024-09-14T10:44:27.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:27.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d85f0 con 0x5566e03c56c0 2024-09-14T10:44:27.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93900337134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d5a70 con 0x5566e03c56c0 2024-09-14T10:44:27.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93900337134112] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 5 note: GC not initialized 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6dd67fc640 20 reqs_thread_entry: start 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 20 Filter name: none 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6d47fff640 20 reqs_thread_entry: start 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03fbb60 con 0x5566e03c56c0 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.920+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03fc5d0 con 0x5566e03c56c0 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:27.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-14T10:44:27.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-14T10:44:27.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-14T10:44:27.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e04023e0 con 0x5566e03c56c0 2024-09-14T10:44:27.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:27.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:27.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:27.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93900337323600 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03fda00 con 0x5566e03c56c0 2024-09-14T10:44:27.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify (1) cookie 93900337128896 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5566e038ff00 con 0x5566e03c56c0 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6e097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 93900337128896 notifier 4361 bl.length()=732 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6e097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6e097fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(65 notify.4 [notify cookie 93900337323600 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6e097fa640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6de8003eb0 con 0x5566e03c56c0 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== watch-notify(notify_complete (2) cookie 93900337323600 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566e038f550 con 0x5566e03c56c0 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e0401e50 con 0x5566e03c56c0 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-14T10:44:27.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93900337323600 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566e03fd550 con 0x7f6f10049330 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== watch-notify(notify (1) cookie 93900337117584 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f6f20010040 con 0x7f6f10049330 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6e08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93900337117584 notifier 4361 bl.length()=166 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6e08ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6e08ff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(68 notify.0 [notify cookie 93900337323600 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.924+0000 7f6e08ff9640 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6d50003410 con 0x7f6f10049330 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== watch-notify(notify_complete (2) cookie 93900337323600 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6f20026b00 con 0x7f6f10049330 2024-09-14T10:44:27.928 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"dnBMVG0FvP9mpUKHBmDhrwCcjD1moiBuMADMWz42","active":true,"create_date":"2024-09-14T10:44:27.925102Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:27.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:27.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93900337134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03f9730 con 0x5566e03c56c0 2024-09-14T10:44:27.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93900337134112] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93900337117584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03f9730 con 0x7f6f10049330 2024-09-14T10:44:27.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93900337117584] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f27f249c0 20 remove_watcher() i=0 2024-09-14T10:44:27.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f27f249c0 2 removed watcher, disabling cache 2024-09-14T10:44:27.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.928+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93900337120416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03f9730 con 0x5566e03c56c0 2024-09-14T10:44:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.932+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93900337120416] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.932+0000 7f6f27f249c0 20 remove_watcher() i=1 2024-09-14T10:44:27.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.932+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93900337124192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d04a0 con 0x5566e03cb910 2024-09-14T10:44:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.932+0000 7f6f25229640 1 -- 172.21.15.96:0/2172695913 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93900337124192] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f1000f070 con 0x5566e03cb910 2024-09-14T10:44:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.932+0000 7f6f27f249c0 20 remove_watcher() i=2 2024-09-14T10:44:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.932+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93900337121472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03f9730 con 0x7f6f10049330 2024-09-14T10:44:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.936+0000 7f6f2622b640 1 -- 172.21.15.96:0/2172695913 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93900337121472] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f2002f040 con 0x7f6f10049330 2024-09-14T10:44:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.936+0000 7f6f27f249c0 20 remove_watcher() i=3 2024-09-14T10:44:27.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.936+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93900337128896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03f9730 con 0x5566e03c56c0 2024-09-14T10:44:27.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.936+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93900337128896] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x5566e03c56c0 2024-09-14T10:44:27.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.936+0000 7f6f27f249c0 20 remove_watcher() i=4 2024-09-14T10:44:27.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.936+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93900337126400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d25c0 con 0x7f6f20019040 2024-09-14T10:44:27.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.940+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93900337126400] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.940+0000 7f6f27f249c0 20 remove_watcher() i=5 2024-09-14T10:44:27.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.940+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93900337135760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03d1c00 con 0x7f6f20019040 2024-09-14T10:44:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.940+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93900337135760] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.940+0000 7f6f27f249c0 20 remove_watcher() i=6 2024-09-14T10:44:27.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.940+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93900337139648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566e03f9730 con 0x7f6f20019040 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93900337139648] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f180ea040 con 0x7f6f20019040 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 20 remove_watcher() i=7 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6f20019040 msgr2=0x7f6f20019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6f20019040 0x7f6f20019930 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e03c56c0 msgr2=0x5566e03c7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e03c56c0 0x5566e03c7b80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6f10049330 msgr2=0x7f6f10041a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6f10049330 0x7f6f10041a30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5566e03cb910 msgr2=0x5566e03cdd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5566e03cb910 0x5566e03cdd00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6df003a150 msgr2=0x7f6df003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6df003a150 0x7f6df003c610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000f010 tx=0x7f6f2001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 msgr2=0x5566e03ba360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f25a2a640 1 -- 172.21.15.96:0/2172695913 reap_dead start 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03ba360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f10015d40 tx=0x7f6f100509c0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 shutdown_connections 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2172695913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03b3e00 0x5566e03ba360 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 >> 172.21.15.96:0/2172695913 conn(0x5566e03af220 msgr2=0x5566e03ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 shutdown_connections 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2172695913 wait complete. 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2094534213 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0003a150 msgr2=0x7f6e0003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2094534213 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0003a150 0x7f6e0003c610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5566e0396e40 tx=0x7f6f20003070 comp rx=0 tx=0).stop 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2094534213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03a6490 msgr2=0x5566e03a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2094534213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03a6490 0x5566e03a68b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6f10006960 tx=0x7f6f10015820 comp rx=0 tx=0).stop 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2094534213 shutdown_connections 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2094534213 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0003a150 0x7f6e0003c610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/2094534213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e03a6490 0x5566e03a68b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2094534213 >> 172.21.15.96:0/2094534213 conn(0x5566e039be40 msgr2=0x5566e039c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2094534213 shutdown_connections 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/2094534213 wait complete. 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e029d120 msgr2=0x5566e0395ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e029d120 0x5566e0395ed0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0c03a150 msgr2=0x7f6e0c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0c03a150 0x7f6e0c03c610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f10001650 tx=0x7f6f10006720 comp rx=0 tx=0).stop 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 msgr2=0x5566e038ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e038ed60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6f180b8040 tx=0x7f6f18018020 comp rx=0 tx=0).stop 2024-09-14T10:44:27.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 shutdown_connections 2024-09-14T10:44:27.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566e029d120 0x5566e0395ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e0c03a150 0x7f6e0c03c610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 --2- 172.21.15.96:0/1785862504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566e0299fe0 0x5566e038ed60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:27.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 >> 172.21.15.96:0/1785862504 conn(0x5566e0295b00 msgr2=0x5566e0388990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:27.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 shutdown_connections 2024-09-14T10:44:27.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:27.944+0000 7f6f27f249c0 1 -- 172.21.15.96:0/1785862504 wait complete. 2024-09-14T10:44:27.951 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'dnBMVG0FvP9mpUKHBmDhrwCcjD1moiBuMADMWz42', 'active': True, 'create_date': '2024-09-14T10:44:27.925102Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:27.951 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-14T10:44:27.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-14T10:44:27.952 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-14T10:44:28.033 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:28.033 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:28.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e350e9c0 1 Processor -- start 2024-09-14T10:44:28.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e350e9c0 1 -- start start 2024-09-14T10:44:28.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e350e9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557b0d2231f0 0x557b0d2b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e350e9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b0d1577a0 con 0x557b0d2b2160 2024-09-14T10:44:28.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e350e9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x557b0d1b31b0 con 0x557b0d2231f0 2024-09-14T10:44:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e1014640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557b0d2231f0 0x557b0d2b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e1014640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557b0d2231f0 0x557b0d2b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39048/0 (socket says 172.21.15.96:39048) 2024-09-14T10:44:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e0813640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x557b0d2b2160 0x557b0d2b4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34332/0 (socket says 172.21.15.96:34332) 2024-09-14T10:44:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e1014640 1 -- 172.21.15.96:0/1534646105 learned_addr learned my addr 172.21.15.96:0/1534646105 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e1014640 1 -- 172.21.15.96:0/1534646105 >> v1:172.21.15.70:6789/0 conn(0x557b0d2b2160 legacy=0x557b0d2b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.036+0000 7f31e1014640 1 -- 172.21.15.96:0/1534646105 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b0d131da0 con 0x557b0d2231f0 2024-09-14T10:44:28.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31e1014640 1 --2- 172.21.15.96:0/1534646105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2b1c20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00a5c0 tx=0x7f31dc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdffc0534b6c0f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31d3fff640 1 -- 172.21.15.96:0/1534646105 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc0b1070 con 0x557b0d2231f0 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31d3fff640 1 -- 172.21.15.96:0/1534646105 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0a8070 con 0x557b0d2231f0 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31d3fff640 1 -- 172.21.15.96:0/1534646105 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc0ac5b0 con 0x557b0d2231f0 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1534646105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 msgr2=0x557b0d2b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1534646105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2b1c20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00a5c0 tx=0x7f31dc01b340 comp rx=0 tx=0).stop 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1534646105 shutdown_connections 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1534646105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2b1c20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1534646105 >> 172.21.15.96:0/1534646105 conn(0x557b0d2a9910 msgr2=0x557b0d2abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1534646105 shutdown_connections 2024-09-14T10:44:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.040+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1534646105 wait complete. 2024-09-14T10:44:28.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 Processor -- start 2024-09-14T10:44:28.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- start start 2024-09-14T10:44:28.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d39a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b0d1b6fc0 con 0x557b0d2231f0 2024-09-14T10:44:28.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e1014640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d39a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e1014640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d39a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39064/0 (socket says 172.21.15.96:39064) 2024-09-14T10:44:28.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e1014640 1 -- 172.21.15.96:0/3370673918 learned_addr learned my addr 172.21.15.96:0/3370673918 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e1014640 1 -- 172.21.15.96:0/3370673918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b0d39ab60 con 0x557b0d2231f0 2024-09-14T10:44:28.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e1014640 1 --2- 172.21.15.96:0/3370673918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d39a570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0af040 tx=0x7f31dc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1422198f45278c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f30cf606640 1 -- 172.21.15.96:0/3370673918 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc0b1040 con 0x557b0d2231f0 2024-09-14T10:44:28.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f30cf606640 1 -- 172.21.15.96:0/3370673918 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0ac820 con 0x557b0d2231f0 2024-09-14T10:44:28.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f30cf606640 1 -- 172.21.15.96:0/3370673918 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc0acb00 con 0x557b0d2231f0 2024-09-14T10:44:28.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- 172.21.15.96:0/3370673918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 msgr2=0x557b0d39a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/3370673918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d39a570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0af040 tx=0x7f31dc003030 comp rx=0 tx=0).stop 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- 172.21.15.96:0/3370673918 shutdown_connections 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/3370673918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d39a570 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- 172.21.15.96:0/3370673918 >> 172.21.15.96:0/3370673918 conn(0x557b0d2a9910 msgr2=0x557b0d396180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- 172.21.15.96:0/3370673918 shutdown_connections 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- 172.21.15.96:0/3370673918 wait complete. 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 Processor -- start 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- start start 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e350e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b0d158a50 con 0x557b0d2231f0 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e1014640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e1014640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39070/0 (socket says 172.21.15.96:39070) 2024-09-14T10:44:28.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.056+0000 7f31e1014640 1 -- 172.21.15.96:0/1053781350 learned_addr learned my addr 172.21.15.96:0/1053781350 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e1014640 1 -- 172.21.15.96:0/1053781350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b0d2af840 con 0x557b0d2231f0 2024-09-14T10:44:28.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e1014640 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2af2e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31dc01b820 tx=0x7f31dc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f30cde03640 1 -- 172.21.15.96:0/1053781350 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc0b1050 con 0x557b0d2231f0 2024-09-14T10:44:28.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b0d2adc20 con 0x557b0d2231f0 2024-09-14T10:44:28.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f30cde03640 1 -- 172.21.15.96:0/1053781350 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0b7750 con 0x557b0d2231f0 2024-09-14T10:44:28.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f30cde03640 1 -- 172.21.15.96:0/1053781350 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc0b7a50 con 0x557b0d2231f0 2024-09-14T10:44:28.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b0d2ae210 con 0x557b0d2231f0 2024-09-14T10:44:28.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f30cde03640 1 -- 172.21.15.96:0/1053781350 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f31dc0aa070 con 0x557b0d2231f0 2024-09-14T10:44:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f30cde03640 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30c803a150 0x7f30c803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f30cde03640 1 -- 172.21.15.96:0/1053781350 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f31dc0eba40 con 0x557b0d2231f0 2024-09-14T10:44:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e0813640 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30c803a150 0x7f30c803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d2b2160 0x557b0d3ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ab710 con 0x557b0d2b2160 2024-09-14T10:44:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e1815640 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d2b2160 0x557b0d3ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e0813640 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30c803a150 0x7f30c803c610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f31d8001e40 tx=0x7f31d80013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e1815640 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d2b2160 0x557b0d3ab1d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e1815640 1 -- 172.21.15.96:0/1053781350 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31d400a4d0 con 0x557b0d2b2160 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3abab0 con 0x557b0d2b2160 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e1815640 1 -- 172.21.15.96:0/1053781350 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31d400a4d0 con 0x557b0d2b2160 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ad390 con 0x557b0d2b2160 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.060+0000 7f31e1815640 1 -- 172.21.15.96:0/1053781350 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31d400a4d0 con 0x557b0d2b2160 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ac5c0 con 0x557b0d2b2160 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e1815640 1 -- 172.21.15.96:0/1053781350 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31d400a4d0 con 0x557b0d2b2160 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ac9e0 con 0x557b0d2b2160 2024-09-14T10:44:28.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e1815640 1 -- 172.21.15.96:0/1053781350 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31d400a4d0 con 0x557b0d2b2160 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e350e9c0 1 Processor -- start 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e350e9c0 1 -- start start 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e350e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3bb830 0x557b0d3bbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e350e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b0d1c3d80 con 0x557b0d3bb830 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e0813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3bb830 0x557b0d3bbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e0813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3bb830 0x557b0d3bbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39086/0 (socket says 172.21.15.96:39086) 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e0813640 1 -- 172.21.15.96:0/382699921 learned_addr learned my addr 172.21.15.96:0/382699921 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e0813640 1 -- 172.21.15.96:0/382699921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b0d3bc290 con 0x557b0d3bb830 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e0813640 1 --2- 172.21.15.96:0/382699921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3bb830 0x557b0d3bbc50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f31d800e670 tx=0x7f31d800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f30c6ffd640 1 -- 172.21.15.96:0/382699921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31d8022070 con 0x557b0d3bb830 2024-09-14T10:44:28.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f30c6ffd640 1 -- 172.21.15.96:0/382699921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d800d660 con 0x557b0d3bb830 2024-09-14T10:44:28.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e350e9c0 1 -- 172.21.15.96:0/382699921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b0d3bcaf0 con 0x557b0d3bb830 2024-09-14T10:44:28.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f30c6ffd640 1 -- 172.21.15.96:0/382699921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31d8006070 con 0x557b0d3bb830 2024-09-14T10:44:28.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.064+0000 7f31e350e9c0 1 -- 172.21.15.96:0/382699921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b0d3bd060 con 0x557b0d3bb830 2024-09-14T10:44:28.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f30c6ffd640 1 -- 172.21.15.96:0/382699921 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f31d8025070 con 0x557b0d3bb830 2024-09-14T10:44:28.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f30c6ffd640 1 --2- 172.21.15.96:0/382699921 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30b803a150 0x7f30b803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f30c6ffd640 1 -- 172.21.15.96:0/382699921 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f31d80523a0 con 0x557b0d3bb830 2024-09-14T10:44:28.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e1815640 1 --2- 172.21.15.96:0/382699921 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30b803a150 0x7f30b803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 Processor -- start 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- start start 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e1815640 1 --2- 172.21.15.96:0/382699921 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30b803a150 0x7f30b803c610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557b0d3ac960 tx=0x7f31d4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b0d39af30 con 0x557b0d3c9200 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e0813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e0813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39088/0 (socket says 172.21.15.96:39088) 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e0813640 1 -- 172.21.15.96:0/1192208921 learned_addr learned my addr 172.21.15.96:0/1192208921 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e0813640 1 -- 172.21.15.96:0/1192208921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b0d3c9bd0 con 0x557b0d3c9200 2024-09-14T10:44:28.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e0813640 1 --2- 172.21.15.96:0/1192208921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3c95e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f31d80507c0 tx=0x7f31d8024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622f5151984be304 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f30c4ff9640 1 -- 172.21.15.96:0/1192208921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31d800dcc0 con 0x557b0d3c9200 2024-09-14T10:44:28.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f30c4ff9640 1 -- 172.21.15.96:0/1192208921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d804f220 con 0x557b0d3c9200 2024-09-14T10:44:28.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f30c4ff9640 1 -- 172.21.15.96:0/1192208921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31d800de60 con 0x557b0d3c9200 2024-09-14T10:44:28.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1192208921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 msgr2=0x557b0d3c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1192208921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3c95e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f31d80507c0 tx=0x7f31d8024c90 comp rx=0 tx=0).stop 2024-09-14T10:44:28.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1192208921 shutdown_connections 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1192208921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3c95e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1192208921 >> 172.21.15.96:0/1192208921 conn(0x557b0d3c45c0 msgr2=0x557b0d3c2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1192208921 shutdown_connections 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1192208921 wait complete. 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 Processor -- start 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- start start 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e350e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b0d3c80f0 con 0x557b0d3c9200 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e0813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e0813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39104/0 (socket says 172.21.15.96:39104) 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.068+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 learned_addr learned my addr 172.21.15.96:0/258541134 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b0d3cfc80 con 0x557b0d3c9200 2024-09-14T10:44:28.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e0813640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3cf720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f31d800ef00 tx=0x7f31d8050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f30b6ffd640 1 -- 172.21.15.96:0/258541134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31d8025c80 con 0x557b0d3c9200 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f30b6ffd640 1 -- 172.21.15.96:0/258541134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d8025e20 con 0x557b0d3c9200 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b0d3cff10 con 0x557b0d3c9200 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f30b6ffd640 1 -- 172.21.15.96:0/258541134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31d801a320 con 0x557b0d3c9200 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b0d3cff10 con 0x557b0d3c9200 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f30b6ffd640 1 -- 172.21.15.96:0/258541134 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f31d8033070 con 0x557b0d3c9200 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f30b6ffd640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30ac03a150 0x7f30ac03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f30b6ffd640 1 -- 172.21.15.96:0/258541134 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f31d8045070 con 0x557b0d3c9200 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e1815640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30ac03a150 0x7f30ac03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d3daac0 0x557b0d3dcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3dd6a0 con 0x557b0d3daac0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e1014640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d3daac0 0x557b0d3dcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e1815640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30ac03a150 0x7f30ac03c610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557b0d3ac0e0 tx=0x7f31d401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e1014640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d3daac0 0x557b0d3dcf50 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 realm 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ddab0 con 0x557b0d3daac0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:28.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3de380 con 0x557b0d3daac0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3de720 con 0x557b0d3daac0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.072+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3def70 con 0x557b0d3daac0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e350e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e350e9c0 20 searching for the correct realm 2024-09-14T10:44:28.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b0d3e0ce0 0x557b0d3e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e0813640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b0d3e0ce0 0x557b0d3e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e0813640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b0d3e0ce0 0x557b0d3e30d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e0813640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f31d8035070 0x7f31d80494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d8035070 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1815640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f31d8035070 0x7f31d80494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1815640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f31d8035070 0x7f31d80494d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d401f070 con 0x7f31d8035070 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1815640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f31d4031040 0x7f31d4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f31d4031040 0x7f31d4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f31d4031040 0x7f31d4032940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x7f31d4031040 2024-09-14T10:44:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3daac0 2024-09-14T10:44:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3daac0 2024-09-14T10:44:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.076+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x7f31d4031040 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x7f31d4031040 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d8035070 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d401f070 con 0x7f31d8035070 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3daac0 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x7f31d4031040 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3daac0 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d8035070 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31d401f070 con 0x7f31d8035070 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x7f31d4031040 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.080+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3daac0 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3daac0 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0be070 con 0x7f31d4031040 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d8035070 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d401f070 con 0x7f31d8035070 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3daac0 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f31dc0be070 con 0x557b0d3daac0 2024-09-14T10:44:28.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d8035070 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d401f070 con 0x7f31d8035070 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.084+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3e0ce0 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d4031040 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x557b0d3daac0 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3660 con 0x7f31d8035070 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d401f070 con 0x7f31d8035070 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:28.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3df8f0 con 0x557b0d3daac0 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e0190 con 0x557b0d3daac0 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e0190 con 0x557b0d3daac0 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 zone default found 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 4 Realm: () 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 zonegroup default 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e3ac0 con 0x7f31d4031040 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e55b0 con 0x557b0d3e0ce0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e5a90 con 0x557b0d3e0ce0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 started sync module instance, tier type = 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.088+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e4950 con 0x7f31d8035070 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.092+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4040040 con 0x7f31d8035070 2024-09-14T10:44:28.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.092+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93986991525184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e63a0 con 0x7f31d8035070 2024-09-14T10:44:28.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.092+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e6bf0 con 0x557b0d3daac0 2024-09-14T10:44:28.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.092+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93986991525184] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4040040 con 0x7f31d8035070 2024-09-14T10:44:28.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.092+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.092+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93986991529712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e67c0 con 0x557b0d3daac0 2024-09-14T10:44:28.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.092+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e7280 con 0x557b0d3e0ce0 2024-09-14T10:44:28.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93986991529712] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93986991530768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e6730 con 0x557b0d3e0ce0 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e7fd0 con 0x7f31d8035070 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4040040 con 0x7f31d8035070 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93986991537200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e88a0 con 0x7f31d8035070 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e92a0 con 0x557b0d3daac0 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93986991530768] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.096+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93986991537200] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4040040 con 0x7f31d8035070 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.100+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.100+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93986991535728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e83f0 con 0x557b0d3daac0 2024-09-14T10:44:28.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.100+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e9b40 con 0x7f31d4031040 2024-09-14T10:44:28.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.100+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93986991535728] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.100+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.100+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93986991541680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e83f0 con 0x7f31d4031040 2024-09-14T10:44:28.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.100+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e9ff0 con 0x7f31d4031040 2024-09-14T10:44:28.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93986991541680] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93986991545056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e9fb0 con 0x7f31d4031040 2024-09-14T10:44:28.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ea970 con 0x7f31d4031040 2024-09-14T10:44:28.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93986991547584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ead90 con 0x7f31d4031040 2024-09-14T10:44:28.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 20 add_watcher() i=0 2024-09-14T10:44:28.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 20 add_watcher() i=1 2024-09-14T10:44:28.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 20 add_watcher() i=2 2024-09-14T10:44:28.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 20 add_watcher() i=3 2024-09-14T10:44:28.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 20 add_watcher() i=4 2024-09-14T10:44:28.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 20 add_watcher() i=5 2024-09-14T10:44:28.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93986991545056] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.104+0000 7f31e350e9c0 20 add_watcher() i=6 2024-09-14T10:44:28.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93986991547584] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 20 add_watcher() i=7 2024-09-14T10:44:28.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:28.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ead90 con 0x557b0d3daac0 2024-09-14T10:44:28.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93986991548640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ead00 con 0x557b0d3daac0 2024-09-14T10:44:28.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93986991548640] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f30977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 5 note: GC not initialized 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f30967e4640 20 reqs_thread_entry: start 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 20 Filter name: none 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f3007fff640 20 reqs_thread_entry: start 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d411530 con 0x557b0d3daac0 2024-09-14T10:44:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:44:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.108+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d4180f0 con 0x557b0d3daac0 2024-09-14T10:44:28.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e350e9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e350e9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e350e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93986991733600 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b0d413820 con 0x557b0d3daac0 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 93986991535728 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x557b0d2ae210 con 0x557b0d3daac0 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f30c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 93986991535728 notifier 4368 bl.length()=732 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f30c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f30c4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(64 notify.4 [notify cookie 93986991733600 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f30c4ff9640 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f30a4003eb0 con 0x557b0d3daac0 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 93986991733600 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b0d2adc20 con 0x557b0d3daac0 2024-09-14T10:44:28.111 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:28.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f30977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93986991548640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d413370 con 0x557b0d3daac0 2024-09-14T10:44:28.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93986991548640] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93986991525184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d413820 con 0x7f31d8035070 2024-09-14T10:44:28.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93986991525184] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4040040 con 0x7f31d8035070 2024-09-14T10:44:28.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.112+0000 7f31e350e9c0 20 remove_watcher() i=0 2024-09-14T10:44:28.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.116+0000 7f31e350e9c0 2 removed watcher, disabling cache 2024-09-14T10:44:28.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.116+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93986991529712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d413820 con 0x557b0d3daac0 2024-09-14T10:44:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.116+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93986991529712] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.116+0000 7f31e350e9c0 20 remove_watcher() i=1 2024-09-14T10:44:28.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.116+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93986991530768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d413820 con 0x557b0d3e0ce0 2024-09-14T10:44:28.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e0813640 1 -- 172.21.15.96:0/258541134 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93986991530768] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d803c070 con 0x557b0d3e0ce0 2024-09-14T10:44:28.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e350e9c0 20 remove_watcher() i=2 2024-09-14T10:44:28.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93986991537200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ea8e0 con 0x7f31d8035070 2024-09-14T10:44:28.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e1815640 1 -- 172.21.15.96:0/258541134 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93986991537200] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4040040 con 0x7f31d8035070 2024-09-14T10:44:28.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e350e9c0 20 remove_watcher() i=3 2024-09-14T10:44:28.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93986991535728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e4d40 con 0x557b0d3daac0 2024-09-14T10:44:28.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93986991535728] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x557b0d3daac0 2024-09-14T10:44:28.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e350e9c0 20 remove_watcher() i=4 2024-09-14T10:44:28.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.120+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93986991541680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ea8e0 con 0x7f31d4031040 2024-09-14T10:44:28.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.124+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93986991541680] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.124+0000 7f31e350e9c0 20 remove_watcher() i=5 2024-09-14T10:44:28.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.124+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93986991545056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3e4d40 con 0x7f31d4031040 2024-09-14T10:44:28.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.124+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93986991545056] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.124+0000 7f31e350e9c0 20 remove_watcher() i=6 2024-09-14T10:44:28.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.124+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93986991547584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b0d3ea8e0 con 0x7f31d4031040 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93986991547584] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc0fa040 con 0x7f31d4031040 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 20 remove_watcher() i=7 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f31d4031040 msgr2=0x7f31d4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f31d4031040 0x7f31d4032940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d3daac0 msgr2=0x557b0d3dcf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d3daac0 0x557b0d3dcf50 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f31d8035070 msgr2=0x7f31d80494d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f31d8035070 0x7f31d80494d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b0d3e0ce0 msgr2=0x557b0d3e30d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b0d3e0ce0 0x557b0d3e30d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30ac03a150 msgr2=0x7f30ac03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30ac03a150 0x7f30ac03c610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557b0d3ac0e0 tx=0x7f31d401f000 comp rx=0 tx=0).stop 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 msgr2=0x557b0d3cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e1014640 1 -- 172.21.15.96:0/258541134 reap_dead start 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3cf720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f31d800ef00 tx=0x7f31d8050720 comp rx=0 tx=0).stop 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 shutdown_connections 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/258541134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3c9200 0x557b0d3cf720 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 >> 172.21.15.96:0/258541134 conn(0x557b0d3c45c0 msgr2=0x557b0d3c27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 shutdown_connections 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/258541134 wait complete. 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/382699921 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30b803a150 msgr2=0x7f30b803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/382699921 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30b803a150 0x7f30b803c610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x557b0d3ac960 tx=0x7f31d4005850 comp rx=0 tx=0).stop 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/382699921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3bb830 msgr2=0x557b0d3bbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/382699921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3bb830 0x557b0d3bbc50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f31d800e670 tx=0x7f31d800ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/382699921 shutdown_connections 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/382699921 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30b803a150 0x7f30b803c610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/382699921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d3bb830 0x557b0d3bbc50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/382699921 >> 172.21.15.96:0/382699921 conn(0x557b0d3b11e0 msgr2=0x557b0d3b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/382699921 shutdown_connections 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/382699921 wait complete. 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d2b2160 msgr2=0x557b0d3ab1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d2b2160 0x557b0d3ab1d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30c803a150 msgr2=0x7f30c803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30c803a150 0x7f30c803c610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f31d8001e40 tx=0x7f31d80013a0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 msgr2=0x557b0d2af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2af2e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31dc01b820 tx=0x7f31dc0180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 shutdown_connections 2024-09-14T10:44:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b0d2b2160 0x557b0d3ab1d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f30c803a150 0x7f30c803c610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 --2- 172.21.15.96:0/1053781350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b0d2231f0 0x557b0d2af2e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 >> 172.21.15.96:0/1053781350 conn(0x557b0d2a9910 msgr2=0x557b0d39b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 shutdown_connections 2024-09-14T10:44:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.128+0000 7f31e350e9c0 1 -- 172.21.15.96:0/1053781350 wait complete. 2024-09-14T10:44:28.136 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:28.136 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:44:28.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:44:28.136 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:44:28.207 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:28.207 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:28.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1668d3b9c0 1 Processor -- start 2024-09-14T10:44:28.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1668d3b9c0 1 -- start start 2024-09-14T10:44:28.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1668d3b9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55ec6f20a290 0x55ec6f298c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1668d3b9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ec6f13e7a0 con 0x55ec6f299180 2024-09-14T10:44:28.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1668d3b9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55ec6f19a1b0 con 0x55ec6f20a290 2024-09-14T10:44:28.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1666841640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55ec6f20a290 0x55ec6f298c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1666841640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55ec6f20a290 0x55ec6f298c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39116/0 (socket says 172.21.15.96:39116) 2024-09-14T10:44:28.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1666040640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55ec6f299180 0x55ec6f29b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34338/0 (socket says 172.21.15.96:34338) 2024-09-14T10:44:28.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1666841640 1 -- 172.21.15.96:0/3423372066 learned_addr learned my addr 172.21.15.96:0/3423372066 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1666841640 1 -- 172.21.15.96:0/3423372066 >> v1:172.21.15.70:6789/0 conn(0x55ec6f299180 legacy=0x55ec6f29b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1666841640 1 -- 172.21.15.96:0/3423372066 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6f118da0 con 0x55ec6f20a290 2024-09-14T10:44:28.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.212+0000 7f1666841640 1 --2- 172.21.15.96:0/3423372066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f298c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f166000a4e0 tx=0x7f166001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3f392fa48a86ea server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f166583f640 1 -- 172.21.15.96:0/3423372066 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16600aa540 con 0x55ec6f20a290 2024-09-14T10:44:28.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f166583f640 1 -- 172.21.15.96:0/3423372066 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16600aa6e0 con 0x55ec6f20a290 2024-09-14T10:44:28.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f166583f640 1 -- 172.21.15.96:0/3423372066 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16600aaa40 con 0x55ec6f20a290 2024-09-14T10:44:28.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/3423372066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 msgr2=0x55ec6f298c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/3423372066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f298c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f166000a4e0 tx=0x7f166001b090 comp rx=0 tx=0).stop 2024-09-14T10:44:28.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/3423372066 shutdown_connections 2024-09-14T10:44:28.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/3423372066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f298c40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/3423372066 >> 172.21.15.96:0/3423372066 conn(0x55ec6f290970 msgr2=0x55ec6f292d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/3423372066 shutdown_connections 2024-09-14T10:44:28.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.216+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/3423372066 wait complete. 2024-09-14T10:44:28.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1668d3b9c0 1 Processor -- start 2024-09-14T10:44:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1668d3b9c0 1 -- start start 2024-09-14T10:44:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1668d3b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f381510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1668d3b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec6f19dfc0 con 0x55ec6f20a290 2024-09-14T10:44:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1666841640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f381510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1666841640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f381510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39118/0 (socket says 172.21.15.96:39118) 2024-09-14T10:44:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1666841640 1 -- 172.21.15.96:0/1313718854 learned_addr learned my addr 172.21.15.96:0/1313718854 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1666841640 1 -- 172.21.15.96:0/1313718854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6f381b00 con 0x55ec6f20a290 2024-09-14T10:44:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.228+0000 7f1666841640 1 --2- 172.21.15.96:0/1313718854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f381510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1660018cc0 tx=0x7f16600033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56eb2dfb78845cf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1554e09640 1 -- 172.21.15.96:0/1313718854 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16600b9030 con 0x55ec6f20a290 2024-09-14T10:44:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1554e09640 1 -- 172.21.15.96:0/1313718854 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16600aaa80 con 0x55ec6f20a290 2024-09-14T10:44:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1554e09640 1 -- 172.21.15.96:0/1313718854 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16600aada0 con 0x55ec6f20a290 2024-09-14T10:44:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1313718854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 msgr2=0x55ec6f381510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1313718854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f381510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1660018cc0 tx=0x7f16600033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1313718854 shutdown_connections 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1313718854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f381510 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1313718854 >> 172.21.15.96:0/1313718854 conn(0x55ec6f290970 msgr2=0x55ec6f37d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1313718854 shutdown_connections 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1313718854 wait complete. 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 Processor -- start 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- start start 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f388c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec6f13fa50 con 0x55ec6f20a290 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1666841640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f388c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1666841640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f388c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39130/0 (socket says 172.21.15.96:39130) 2024-09-14T10:44:28.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1666841640 1 -- 172.21.15.96:0/1419749902 learned_addr learned my addr 172.21.15.96:0/1419749902 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1666841640 1 -- 172.21.15.96:0/1419749902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6f3891c0 con 0x55ec6f20a290 2024-09-14T10:44:28.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1666841640 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f388c60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f16600033f0 tx=0x7f1660017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1553606640 1 -- 172.21.15.96:0/1419749902 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16600b9070 con 0x55ec6f20a290 2024-09-14T10:44:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec6f389450 con 0x55ec6f20a290 2024-09-14T10:44:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1553606640 1 -- 172.21.15.96:0/1419749902 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16600c3030 con 0x55ec6f20a290 2024-09-14T10:44:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1553606640 1 -- 172.21.15.96:0/1419749902 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16600b5b30 con 0x55ec6f20a290 2024-09-14T10:44:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.232+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6f389e00 con 0x55ec6f20a290 2024-09-14T10:44:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1553606640 1 -- 172.21.15.96:0/1419749902 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f16600b3040 con 0x55ec6f20a290 2024-09-14T10:44:28.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1553606640 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154c03a150 0x7f154c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1553606640 1 -- 172.21.15.96:0/1419749902 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f16600ba070 con 0x55ec6f20a290 2024-09-14T10:44:28.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1666040640 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154c03a150 0x7f154c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f299180 0x55ec6f38fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f390310 con 0x55ec6f299180 2024-09-14T10:44:28.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1667042640 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f299180 0x55ec6f38fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1666040640 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154c03a150 0x7f154c03c610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f165c001e40 tx=0x7f165c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1667042640 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f299180 0x55ec6f38fdd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1667042640 1 -- 172.21.15.96:0/1419749902 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16580083f0 con 0x55ec6f299180 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f390780 con 0x55ec6f299180 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1667042640 1 -- 172.21.15.96:0/1419749902 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16580083f0 con 0x55ec6f299180 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f392080 con 0x55ec6f299180 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1667042640 1 -- 172.21.15.96:0/1419749902 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16580083f0 con 0x55ec6f299180 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3912b0 con 0x55ec6f299180 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1667042640 1 -- 172.21.15.96:0/1419749902 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16580083f0 con 0x55ec6f299180 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f391700 con 0x55ec6f299180 2024-09-14T10:44:28.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1667042640 1 -- 172.21.15.96:0/1419749902 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16580083f0 con 0x55ec6f299180 2024-09-14T10:44:28.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 Processor -- start 2024-09-14T10:44:28.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 -- start start 2024-09-14T10:44:28.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3a0410 0x55ec6f3a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1668d3b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec6f1aad80 con 0x55ec6f3a0410 2024-09-14T10:44:28.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1666040640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3a0410 0x55ec6f3a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1666040640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3a0410 0x55ec6f3a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39132/0 (socket says 172.21.15.96:39132) 2024-09-14T10:44:28.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1666040640 1 -- 172.21.15.96:0/1724422972 learned_addr learned my addr 172.21.15.96:0/1724422972 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.236+0000 7f1666040640 1 -- 172.21.15.96:0/1724422972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6f3a0e70 con 0x55ec6f3a0410 2024-09-14T10:44:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1666040640 1 --2- 172.21.15.96:0/1724422972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3a0410 0x55ec6f3a0830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f165c00e670 tx=0x7f165c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1550e01640 1 -- 172.21.15.96:0/1724422972 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c022070 con 0x55ec6f3a0410 2024-09-14T10:44:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1550e01640 1 -- 172.21.15.96:0/1724422972 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c00d660 con 0x55ec6f3a0410 2024-09-14T10:44:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1550e01640 1 -- 172.21.15.96:0/1724422972 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c006070 con 0x55ec6f3a0410 2024-09-14T10:44:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1724422972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec6f3a16d0 con 0x55ec6f3a0410 2024-09-14T10:44:28.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1724422972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6f3a1c40 con 0x55ec6f3a0410 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1550e01640 1 -- 172.21.15.96:0/1724422972 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f165c025070 con 0x55ec6f3a0410 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1550e01640 1 --2- 172.21.15.96:0/1724422972 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154003a150 0x7f154003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1550e01640 1 -- 172.21.15.96:0/1724422972 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f165c052420 con 0x55ec6f3a0410 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1667042640 1 --2- 172.21.15.96:0/1724422972 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154003a150 0x7f154003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1668d3b9c0 1 Processor -- start 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1667042640 1 --2- 172.21.15.96:0/1724422972 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154003a150 0x7f154003c610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f165800e3f0 tx=0x7f1658003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1668d3b9c0 1 -- start start 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1668d3b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1668d3b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec6f381e70 con 0x55ec6f3add80 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1666040640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1666040640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39146/0 (socket says 172.21.15.96:39146) 2024-09-14T10:44:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1666040640 1 -- 172.21.15.96:0/133321853 learned_addr learned my addr 172.21.15.96:0/133321853 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1666040640 1 -- 172.21.15.96:0/133321853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6f3ae770 con 0x55ec6f3add80 2024-09-14T10:44:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.240+0000 7f1666040640 1 --2- 172.21.15.96:0/133321853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3ae180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f165c0507c0 tx=0x7f165c024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613572b17325661e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f154a7fc640 1 -- 172.21.15.96:0/133321853 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c024770 con 0x55ec6f3add80 2024-09-14T10:44:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f154a7fc640 1 -- 172.21.15.96:0/133321853 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c00dcc0 con 0x55ec6f3add80 2024-09-14T10:44:28.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f154a7fc640 1 -- 172.21.15.96:0/133321853 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c04f220 con 0x55ec6f3add80 2024-09-14T10:44:28.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/133321853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 msgr2=0x55ec6f3ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/133321853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3ae180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f165c0507c0 tx=0x7f165c024c90 comp rx=0 tx=0).stop 2024-09-14T10:44:28.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/133321853 shutdown_connections 2024-09-14T10:44:28.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/133321853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3ae180 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/133321853 >> 172.21.15.96:0/133321853 conn(0x55ec6f3a91a0 msgr2=0x55ec6f3a73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/133321853 shutdown_connections 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/133321853 wait complete. 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 Processor -- start 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- start start 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec6f3accd0 con 0x55ec6f3add80 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1666040640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1666040640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39162/0 (socket says 172.21.15.96:39162) 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 learned_addr learned my addr 172.21.15.96:0/387606229 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6f3b4870 con 0x55ec6f3add80 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1666040640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3b4310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f165c0266c0 tx=0x7f165c050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1548ff9640 1 -- 172.21.15.96:0/387606229 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c024b30 con 0x55ec6f3add80 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec6f3b4b00 con 0x55ec6f3add80 2024-09-14T10:44:28.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1548ff9640 1 -- 172.21.15.96:0/387606229 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c025c80 con 0x55ec6f3add80 2024-09-14T10:44:28.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1548ff9640 1 -- 172.21.15.96:0/387606229 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165c025e30 con 0x55ec6f3add80 2024-09-14T10:44:28.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6f3b4b00 con 0x55ec6f3add80 2024-09-14T10:44:28.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1548ff9640 1 -- 172.21.15.96:0/387606229 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f165c033070 con 0x55ec6f3add80 2024-09-14T10:44:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.244+0000 7f1548ff9640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f153003a0b0 0x7f153003c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1548ff9640 1 -- 172.21.15.96:0/387606229 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f165c045070 con 0x55ec6f3add80 2024-09-14T10:44:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1667042640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f153003a0b0 0x7f153003c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f3bf6c0 0x55ec6f3c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c22a0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f3bf6c0 0x55ec6f3c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1667042640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f153003a0b0 0x7f153003c570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f165800f010 tx=0x7f165801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f3bf6c0 0x55ec6f3c1b50 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 realm 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c26b0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c2f80 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c3320 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c37c0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 20 searching for the correct realm 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ec6f3c57c0 0x55ec6f3c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666040640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ec6f3c57c0 0x55ec6f3c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666040640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ec6f3c57c0 0x55ec6f3c7bb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666040640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f165c035070 0x7f165c01ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f165c035070 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1667042640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f165c035070 0x7f165c01ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1667042640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f165c035070 0x7f165c01ca40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1667042640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1658019040 0x7f1658019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1658019040 0x7f1658019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.248+0000 7f1666841640 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1658019040 0x7f1658019930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f165c035070 2024-09-14T10:44:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f165c035070 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.252+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f165c035070 2024-09-14T10:44:28.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.256+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f165c035070 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x55ec6f3c57c0 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c8260 con 0x7f1658019040 2024-09-14T10:44:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f16600f4040 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f16600f4040 con 0x7f165c035070 2024-09-14T10:44:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:28.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c4130 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c4520 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c4520 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 zone default found 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 4 Realm: () 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 zonegroup default 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c4940 con 0x7f1658019040 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.260+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c4940 con 0x55ec6f3c57c0 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3ca0b0 con 0x55ec6f3c57c0 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 20 started sync module instance, tier type = 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3c9550 con 0x7f165c035070 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94473966885184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3ca950 con 0x7f165c035070 2024-09-14T10:44:28.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cb1a0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94473966885184] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94473966888096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cadf0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.264+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cb910 con 0x55ec6f3c57c0 2024-09-14T10:44:28.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.268+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.268+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94473966892000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cc1b0 con 0x55ec6f3c57c0 2024-09-14T10:44:28.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.268+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3ccb70 con 0x7f165c035070 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.268+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94473966888096] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.268+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.268+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94473966896832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3ccae0 con 0x7f165c035070 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.268+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cd920 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.268+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94473966892000] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.272+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94473966896832] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.272+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.272+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94473966894336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cd8e0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.272+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cdd50 con 0x7f1658019040 2024-09-14T10:44:28.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.272+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94473966894336] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.272+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.272+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94473966902464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cd410 con 0x7f1658019040 2024-09-14T10:44:28.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.272+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3ce760 con 0x7f1658019040 2024-09-14T10:44:28.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.276+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94473966902464] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.276+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.276+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94473966899312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3ce760 con 0x7f1658019040 2024-09-14T10:44:28.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.276+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cf120 con 0x7f1658019040 2024-09-14T10:44:28.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.276+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94473966899312] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94473966904256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cf120 con 0x7f1658019040 2024-09-14T10:44:28.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 20 add_watcher() i=0 2024-09-14T10:44:28.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 20 add_watcher() i=1 2024-09-14T10:44:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 20 add_watcher() i=2 2024-09-14T10:44:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 20 add_watcher() i=3 2024-09-14T10:44:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 20 add_watcher() i=4 2024-09-14T10:44:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 20 add_watcher() i=5 2024-09-14T10:44:28.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 20 add_watcher() i=6 2024-09-14T10:44:28.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94473966904256] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 20 add_watcher() i=7 2024-09-14T10:44:28.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:28.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3d2420 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94473966906848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cf6b0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94473966906848] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.280+0000 7f151d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:28.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 5 note: GC not initialized 2024-09-14T10:44:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1497fff640 20 reqs_thread_entry: start 2024-09-14T10:44:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 20 Filter name: none 2024-09-14T10:44:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1495ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3f57e0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:44:28.282 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:28.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f151d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94473966906848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3f4130 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94473966906848] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.284+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94473966885184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cede0 con 0x7f165c035070 2024-09-14T10:44:28.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.288+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94473966885184] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.288+0000 7f1668d3b9c0 20 remove_watcher() i=0 2024-09-14T10:44:28.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.288+0000 7f1668d3b9c0 2 removed watcher, disabling cache 2024-09-14T10:44:28.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.288+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94473966888096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cede0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.288+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94473966888096] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.288+0000 7f1668d3b9c0 20 remove_watcher() i=1 2024-09-14T10:44:28.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.288+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94473966892000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3ca4a0 con 0x55ec6f3c57c0 2024-09-14T10:44:28.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1666040640 1 -- 172.21.15.96:0/387606229 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94473966892000] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165c03c070 con 0x55ec6f3c57c0 2024-09-14T10:44:28.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1668d3b9c0 20 remove_watcher() i=2 2024-09-14T10:44:28.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94473966896832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cede0 con 0x7f165c035070 2024-09-14T10:44:28.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1667042640 1 -- 172.21.15.96:0/387606229 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94473966896832] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f165802f040 con 0x7f165c035070 2024-09-14T10:44:28.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1668d3b9c0 20 remove_watcher() i=3 2024-09-14T10:44:28.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94473966894336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cc6c0 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94473966894336] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x55ec6f3bf6c0 2024-09-14T10:44:28.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1668d3b9c0 20 remove_watcher() i=4 2024-09-14T10:44:28.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.292+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94473966902464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cede0 con 0x7f1658019040 2024-09-14T10:44:28.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.296+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94473966902464] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.296+0000 7f1668d3b9c0 20 remove_watcher() i=5 2024-09-14T10:44:28.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.296+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94473966899312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cc6c0 con 0x7f1658019040 2024-09-14T10:44:28.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.296+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94473966899312] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.296+0000 7f1668d3b9c0 20 remove_watcher() i=6 2024-09-14T10:44:28.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.296+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94473966904256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ec6f3cede0 con 0x7f1658019040 2024-09-14T10:44:28.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94473966904256] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16600cf070 con 0x7f1658019040 2024-09-14T10:44:28.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 20 remove_watcher() i=7 2024-09-14T10:44:28.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1658019040 msgr2=0x7f1658019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1658019040 0x7f1658019930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f3bf6c0 msgr2=0x55ec6f3c1b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f3bf6c0 0x55ec6f3c1b50 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f165c035070 msgr2=0x7f165c01ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f165c035070 0x7f165c01ca40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ec6f3c57c0 msgr2=0x55ec6f3c7bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ec6f3c57c0 0x55ec6f3c7bb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f153003a0b0 msgr2=0x7f153003c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f153003a0b0 0x7f153003c570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f165800f010 tx=0x7f165801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 msgr2=0x55ec6f3b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1666841640 1 -- 172.21.15.96:0/387606229 reap_dead start 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3b4310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f165c0266c0 tx=0x7f165c050720 comp rx=0 tx=0).stop 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 shutdown_connections 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/387606229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3add80 0x55ec6f3b4310 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 >> 172.21.15.96:0/387606229 conn(0x55ec6f3a91a0 msgr2=0x55ec6f3a73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 shutdown_connections 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/387606229 wait complete. 2024-09-14T10:44:28.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1724422972 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154003a150 msgr2=0x7f154003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1724422972 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154003a150 0x7f154003c610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f165800e3f0 tx=0x7f1658003070 comp rx=0 tx=0).stop 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1724422972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3a0410 msgr2=0x55ec6f3a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1724422972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3a0410 0x55ec6f3a0830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f165c00e670 tx=0x7f165c00ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1724422972 shutdown_connections 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1724422972 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154003a150 0x7f154003c610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1724422972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f3a0410 0x55ec6f3a0830 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1724422972 >> 172.21.15.96:0/1724422972 conn(0x55ec6f395dc0 msgr2=0x55ec6f3961a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1724422972 shutdown_connections 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1724422972 wait complete. 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f299180 msgr2=0x55ec6f38fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f299180 0x55ec6f38fdd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154c03a150 msgr2=0x7f154c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154c03a150 0x7f154c03c610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f165c001e40 tx=0x7f165c0013a0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 msgr2=0x55ec6f388c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f388c60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f16600033f0 tx=0x7f1660017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 shutdown_connections 2024-09-14T10:44:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ec6f299180 0x55ec6f38fdd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f154c03a150 0x7f154c03c610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 --2- 172.21.15.96:0/1419749902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec6f20a290 0x55ec6f388c60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 >> 172.21.15.96:0/1419749902 conn(0x55ec6f290970 msgr2=0x55ec6f3828c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 shutdown_connections 2024-09-14T10:44:28.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.300+0000 7f1668d3b9c0 1 -- 172.21.15.96:0/1419749902 wait complete. 2024-09-14T10:44:28.308 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:28.308 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:44:28.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:44:28.308 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:44:28.386 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:28.387 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.388+0000 7f06ed6df9c0 1 Processor -- start 2024-09-14T10:44:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.388+0000 7f06ed6df9c0 1 -- start start 2024-09-14T10:44:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.388+0000 7f06ed6df9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f4b32f9e50 0x55f4b32fa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.388+0000 7f06ed6df9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4b31a37a0 con 0x55f4b32fd030 2024-09-14T10:44:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.388+0000 7f06ed6df9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55f4b31ff1b0 con 0x55f4b32f9e50 2024-09-14T10:44:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06eb1e5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f4b32f9e50 0x55f4b32fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06eb1e5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f4b32f9e50 0x55f4b32fa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39168/0 (socket says 172.21.15.96:39168) 2024-09-14T10:44:28.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06ea9e4640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55f4b32fd030 0x55f4b32ff420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34344/0 (socket says 172.21.15.96:34344) 2024-09-14T10:44:28.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06eb1e5640 1 -- 172.21.15.96:0/331451371 learned_addr learned my addr 172.21.15.96:0/331451371 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06eb1e5640 1 -- 172.21.15.96:0/331451371 >> v1:172.21.15.70:6789/0 conn(0x55f4b32fd030 legacy=0x55f4b32ff420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06eb1e5640 1 -- 172.21.15.96:0/331451371 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b317dda0 con 0x55f4b32f9e50 2024-09-14T10:44:28.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06eb1e5640 1 --2- 172.21.15.96:0/331451371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b32fa230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00a4e0 tx=0x7f06dc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bc8dd32d180bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06ea1e3640 1 -- 172.21.15.96:0/331451371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc0aa540 con 0x55f4b32f9e50 2024-09-14T10:44:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06ea1e3640 1 -- 172.21.15.96:0/331451371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0aa6e0 con 0x55f4b32f9e50 2024-09-14T10:44:28.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06ea1e3640 1 -- 172.21.15.96:0/331451371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc0aaa40 con 0x55f4b32f9e50 2024-09-14T10:44:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/331451371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 msgr2=0x55f4b32fa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.392+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/331451371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b32fa230 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00a4e0 tx=0x7f06dc01b090 comp rx=0 tx=0).stop 2024-09-14T10:44:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.396+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/331451371 shutdown_connections 2024-09-14T10:44:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.396+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/331451371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b32fa230 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.396+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/331451371 >> 172.21.15.96:0/331451371 conn(0x55f4b32f5970 msgr2=0x55f4b32f7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.396+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/331451371 shutdown_connections 2024-09-14T10:44:28.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.396+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/331451371 wait complete. 2024-09-14T10:44:28.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06ed6df9c0 1 Processor -- start 2024-09-14T10:44:28.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06ed6df9c0 1 -- start start 2024-09-14T10:44:28.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06ed6df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06ed6df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4b3202fc0 con 0x55f4b32f9e50 2024-09-14T10:44:28.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06eb1e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06eb1e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33e52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39172/0 (socket says 172.21.15.96:39172) 2024-09-14T10:44:28.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06eb1e5640 1 -- 172.21.15.96:0/1729593343 learned_addr learned my addr 172.21.15.96:0/1729593343 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06eb1e5640 1 -- 172.21.15.96:0/1729593343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b33e5890 con 0x55f4b32f9e50 2024-09-14T10:44:28.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f06eb1e5640 1 --2- 172.21.15.96:0/1729593343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33e52a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f06dc019740 tx=0x7f06dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1de3a3aa20c8ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f05d960a640 1 -- 172.21.15.96:0/1729593343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc0c1070 con 0x55f4b32f9e50 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f05d960a640 1 -- 172.21.15.96:0/1729593343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0aaa10 con 0x55f4b32f9e50 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.408+0000 7f05d960a640 1 -- 172.21.15.96:0/1729593343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc0aacf0 con 0x55f4b32f9e50 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1729593343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 msgr2=0x55f4b33e52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1729593343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33e52a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f06dc019740 tx=0x7f06dc0033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1729593343 shutdown_connections 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1729593343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33e52a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1729593343 >> 172.21.15.96:0/1729593343 conn(0x55f4b32f5970 msgr2=0x55f4b33e0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1729593343 shutdown_connections 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1729593343 wait complete. 2024-09-14T10:44:28.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 Processor -- start 2024-09-14T10:44:28.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- start start 2024-09-14T10:44:28.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33eb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4b31a4a50 con 0x55f4b32f9e50 2024-09-14T10:44:28.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06eb1e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33eb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06eb1e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33eb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39184/0 (socket says 172.21.15.96:39184) 2024-09-14T10:44:28.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06eb1e5640 1 -- 172.21.15.96:0/1343090202 learned_addr learned my addr 172.21.15.96:0/1343090202 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06eb1e5640 1 -- 172.21.15.96:0/1343090202 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b33ebe80 con 0x55f4b32f9e50 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06eb1e5640 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33eb920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f06dc000f90 tx=0x7f06dc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f05d7e07640 1 -- 172.21.15.96:0/1343090202 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc0ca020 con 0x55f4b32f9e50 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b33ec110 con 0x55f4b32f9e50 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f05d7e07640 1 -- 172.21.15.96:0/1343090202 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0c2040 con 0x55f4b32f9e50 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f05d7e07640 1 -- 172.21.15.96:0/1343090202 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc0c1070 con 0x55f4b32f9e50 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b33ecac0 con 0x55f4b32f9e50 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f05d7e07640 1 -- 172.21.15.96:0/1343090202 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f06dc0c6440 con 0x55f4b32f9e50 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f05d7e07640 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05d003a150 0x7f05d003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f05d7e07640 1 -- 172.21.15.96:0/1343090202 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f06dc0b8030 con 0x55f4b32f9e50 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ea9e4640 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05d003a150 0x7f05d003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.412+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b32fd030 0x55f4b33f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b33f2fd0 con 0x55f4b32fd030 2024-09-14T10:44:28.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b32fd030 0x55f4b33f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ea9e4640 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05d003a150 0x7f05d003c610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06d4001e40 tx=0x7f06d40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b32fd030 0x55f4b33f2a90 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06eb9e6640 1 -- 172.21.15.96:0/1343090202 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e40083f0 con 0x55f4b32fd030 2024-09-14T10:44:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b33f33d0 con 0x55f4b32fd030 2024-09-14T10:44:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06eb9e6640 1 -- 172.21.15.96:0/1343090202 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06e40083f0 con 0x55f4b32fd030 2024-09-14T10:44:28.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b33f4cd0 con 0x55f4b32fd030 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06eb9e6640 1 -- 172.21.15.96:0/1343090202 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06e40083f0 con 0x55f4b32fd030 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b33f3f00 con 0x55f4b32fd030 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06eb9e6640 1 -- 172.21.15.96:0/1343090202 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06e40083f0 con 0x55f4b32fd030 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b33f4350 con 0x55f4b32fd030 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06eb9e6640 1 -- 172.21.15.96:0/1343090202 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06e40083f0 con 0x55f4b32fd030 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 Processor -- start 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 -- start start 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3403090 0x55f4b34034b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ed6df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4b320fd80 con 0x55f4b3403090 2024-09-14T10:44:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ea9e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3403090 0x55f4b34034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ea9e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3403090 0x55f4b34034b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39190/0 (socket says 172.21.15.96:39190) 2024-09-14T10:44:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ea9e4640 1 -- 172.21.15.96:0/4287092638 learned_addr learned my addr 172.21.15.96:0/4287092638 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.416+0000 7f06ea9e4640 1 -- 172.21.15.96:0/4287092638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b3403af0 con 0x55f4b3403090 2024-09-14T10:44:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ea9e4640 1 --2- 172.21.15.96:0/4287092638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3403090 0x55f4b34034b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f06d400e670 tx=0x7f06d400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f05d5602640 1 -- 172.21.15.96:0/4287092638 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d4022070 con 0x55f4b3403090 2024-09-14T10:44:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/4287092638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b3404350 con 0x55f4b3403090 2024-09-14T10:44:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/4287092638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b34048c0 con 0x55f4b3403090 2024-09-14T10:44:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f05d5602640 1 -- 172.21.15.96:0/4287092638 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d400d660 con 0x55f4b3403090 2024-09-14T10:44:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f05d5602640 1 -- 172.21.15.96:0/4287092638 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d4006070 con 0x55f4b3403090 2024-09-14T10:44:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f05d5602640 1 -- 172.21.15.96:0/4287092638 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f06d4025070 con 0x55f4b3403090 2024-09-14T10:44:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f05d5602640 1 --2- 172.21.15.96:0/4287092638 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05c403a140 0x7f05c403c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f05d5602640 1 -- 172.21.15.96:0/4287092638 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f06d40523e0 con 0x55f4b3403090 2024-09-14T10:44:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/4287092638 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05c403a140 0x7f05c403c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ed6df9c0 1 Processor -- start 2024-09-14T10:44:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ed6df9c0 1 -- start start 2024-09-14T10:44:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/4287092638 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05c403a140 0x7f05c403c600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f06e400e3f0 tx=0x7f06e4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ed6df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b3414240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ed6df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4b33e5c00 con 0x55f4b3413e40 2024-09-14T10:44:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ea9e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b3414240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ea9e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b3414240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39198/0 (socket says 172.21.15.96:39198) 2024-09-14T10:44:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2037277116 learned_addr learned my addr 172.21.15.96:0/2037277116 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2037277116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b3414830 con 0x55f4b3413e40 2024-09-14T10:44:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f06ea9e4640 1 --2- 172.21.15.96:0/2037277116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b3414240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f06d4050830 tx=0x7f06d401ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99982c204493cbfd server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.420+0000 7f05ceffd640 1 -- 172.21.15.96:0/2037277116 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d404f2b0 con 0x55f4b3413e40 2024-09-14T10:44:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f05ceffd640 1 -- 172.21.15.96:0/2037277116 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d40263b0 con 0x55f4b3413e40 2024-09-14T10:44:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f05ceffd640 1 -- 172.21.15.96:0/2037277116 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d400dcc0 con 0x55f4b3413e40 2024-09-14T10:44:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2037277116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 msgr2=0x55f4b3414240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2037277116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b3414240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f06d4050830 tx=0x7f06d401ae00 comp rx=0 tx=0).stop 2024-09-14T10:44:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2037277116 shutdown_connections 2024-09-14T10:44:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2037277116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b3414240 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2037277116 >> 172.21.15.96:0/2037277116 conn(0x55f4b340be60 msgr2=0x55f4b340a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2037277116 shutdown_connections 2024-09-14T10:44:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2037277116 wait complete. 2024-09-14T10:44:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 Processor -- start 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- start start 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b341b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4b3414e50 con 0x55f4b3413e40 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ea9e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b341b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ea9e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b341b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39214/0 (socket says 172.21.15.96:39214) 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 learned_addr learned my addr 172.21.15.96:0/2366776422 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b341b920 con 0x55f4b3413e40 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ea9e4640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b341b3c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f06d400cd10 tx=0x7f06d4050760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f05cd7fa640 1 -- 172.21.15.96:0/2366776422 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d404f4c0 con 0x55f4b3413e40 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4b341bbb0 con 0x55f4b3413e40 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f05cd7fa640 1 -- 172.21.15.96:0/2366776422 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d403e910 con 0x55f4b3413e40 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f05cd7fa640 1 -- 172.21.15.96:0/2366776422 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d403eac0 con 0x55f4b3413e40 2024-09-14T10:44:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b341bbb0 con 0x55f4b3413e40 2024-09-14T10:44:28.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f05cd7fa640 1 -- 172.21.15.96:0/2366776422 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f06d4033070 con 0x55f4b3413e40 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.424+0000 7f05cd7fa640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05b403a150 0x7f05b403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f05cd7fa640 1 -- 172.21.15.96:0/2366776422 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f06d4045070 con 0x55f4b3413e40 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05b403a150 0x7f05b403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b3426710 0x55f4b3428ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34292f0 con 0x55f4b3426710 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb1e5640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b3426710 0x55f4b3428ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05b403a150 0x7f05b403c610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f06e400f010 tx=0x7f06e401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb1e5640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b3426710 0x55f4b3428ba0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 realm 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3429700 con 0x55f4b3426710 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3429fd0 con 0x55f4b3426710 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342a370 con 0x55f4b3426710 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342a7d0 con 0x55f4b3426710 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 20 searching for the correct realm 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4b342c820 0x55f4b342ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x55f4b342c820 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ea9e4640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4b342c820 0x55f4b342ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ea9e4640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4b342c820 0x55f4b342ec10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ea9e4640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f06d4035070 0x7f06d4028070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x7f06d4035070 2024-09-14T10:44:28.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f06d4035070 0x7f06d4028070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f06d4035070 0x7f06d4028070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb9e6640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f06e4019040 0x7f06e4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x7f06e4019040 2024-09-14T10:44:28.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.428+0000 7f06eb1e5640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f06e4019040 0x7f06e4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f06e4019040 0x7f06e4019930 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x55f4b3426710 2024-09-14T10:44:28.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x55f4b3426710 2024-09-14T10:44:28.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x7f06e4019040 2024-09-14T10:44:28.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x7f06e4019040 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x7f06d4035070 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x55f4b342c820 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342f2c0 con 0x55f4b3426710 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06e4019040 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.432+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b3426710 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06d4035070 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b342c820 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b342c820 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06e4019040 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b342c820 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b342c820 2024-09-14T10:44:28.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b3426710 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b3426710 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06e4019040 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b342c820 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06d4035070 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b3426710 2024-09-14T10:44:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.436+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06e4019040 2024-09-14T10:44:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b342c820 2024-09-14T10:44:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06e4019040 2024-09-14T10:44:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06d4035070 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b342c820 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06e4019040 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x55f4b3426710 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f06dc0e8040 con 0x7f06d4035070 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342b140 con 0x55f4b3426710 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342b530 con 0x55f4b3426710 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.440+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342b530 con 0x55f4b3426710 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 zone default found 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 4 Realm: () 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 zonegroup default 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342b950 con 0x7f06e4019040 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b342b950 con 0x55f4b342c820 2024-09-14T10:44:28.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3431110 con 0x55f4b342c820 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 started sync module instance, tier type = 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34305b0 con 0x7f06d4035070 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94509467896224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34319f0 con 0x7f06d4035070 2024-09-14T10:44:28.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3432240 con 0x55f4b3426710 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.444+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94509467896224] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.448+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.448+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94509467899200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3431ed0 con 0x55f4b3426710 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.448+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34329f0 con 0x55f4b342c820 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.448+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94509467899200] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.448+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.448+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94509467903168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3432de0 con 0x55f4b342c820 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.448+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34337a0 con 0x7f06d4035070 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.452+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.452+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94509467907104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3434040 con 0x7f06d4035070 2024-09-14T10:44:28.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.452+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3434a60 con 0x55f4b3426710 2024-09-14T10:44:28.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.452+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94509467903168] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.452+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94509467907104] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.452+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.452+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94509467911504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3433b90 con 0x55f4b3426710 2024-09-14T10:44:28.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.452+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3435300 con 0x7f06e4019040 2024-09-14T10:44:28.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.456+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.456+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94509467913072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3435440 con 0x7f06e4019040 2024-09-14T10:44:28.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.456+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3435d10 con 0x7f06e4019040 2024-09-14T10:44:28.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.456+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94509467911504] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.456+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94509467913072] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.456+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.456+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94509467900256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3435440 con 0x7f06e4019040 2024-09-14T10:44:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.456+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34362d0 con 0x7f06e4019040 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94509467900256] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94509467914128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34362d0 con 0x7f06e4019040 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 20 add_watcher() i=0 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 20 add_watcher() i=1 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 20 add_watcher() i=2 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 20 add_watcher() i=3 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 20 add_watcher() i=4 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 20 add_watcher() i=5 2024-09-14T10:44:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 20 add_watcher() i=6 2024-09-14T10:44:28.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94509467914128] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 20 add_watcher() i=7 2024-09-14T10:44:28.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:28.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3439480 con 0x55f4b3426710 2024-09-14T10:44:28.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.460+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94509467917856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34366f0 con 0x55f4b3426710 2024-09-14T10:44:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94509467917856] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f05a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 5 note: GC not initialized 2024-09-14T10:44:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f05a0fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 20 Filter name: none 2024-09-14T10:44:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f051a7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4b345c8a0 con 0x55f4b3426710 2024-09-14T10:44:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:44:28.462 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f05a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94509467917856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b345b1f0 con 0x55f4b3426710 2024-09-14T10:44:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94509467917856] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.464+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94509467896224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3435e20 con 0x7f06d4035070 2024-09-14T10:44:28.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.468+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94509467896224] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.468+0000 7f06ed6df9c0 20 remove_watcher() i=0 2024-09-14T10:44:28.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.468+0000 7f06ed6df9c0 2 removed watcher, disabling cache 2024-09-14T10:44:28.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.468+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94509467899200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34309a0 con 0x55f4b3426710 2024-09-14T10:44:28.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.468+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94509467899200] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.468+0000 7f06ed6df9c0 20 remove_watcher() i=1 2024-09-14T10:44:28.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.468+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94509467903168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34309a0 con 0x55f4b342c820 2024-09-14T10:44:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.472+0000 7f06ea9e4640 1 -- 172.21.15.96:0/2366776422 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94509467903168] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06d403c070 con 0x55f4b342c820 2024-09-14T10:44:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.472+0000 7f06ed6df9c0 20 remove_watcher() i=2 2024-09-14T10:44:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.472+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94509467907104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3431540 con 0x7f06d4035070 2024-09-14T10:44:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.472+0000 7f06eb9e6640 1 -- 172.21.15.96:0/2366776422 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94509467907104] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e402f040 con 0x7f06d4035070 2024-09-14T10:44:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.472+0000 7f06ed6df9c0 20 remove_watcher() i=3 2024-09-14T10:44:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.472+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94509467911504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3431540 con 0x55f4b3426710 2024-09-14T10:44:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.476+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94509467911504] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x55f4b3426710 2024-09-14T10:44:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.476+0000 7f06ed6df9c0 20 remove_watcher() i=4 2024-09-14T10:44:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.476+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94509467913072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3431540 con 0x7f06e4019040 2024-09-14T10:44:28.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.476+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94509467913072] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.476+0000 7f06ed6df9c0 20 remove_watcher() i=5 2024-09-14T10:44:28.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.476+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94509467900256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b3434b70 con 0x7f06e4019040 2024-09-14T10:44:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94509467900256] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 20 remove_watcher() i=6 2024-09-14T10:44:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94509467914128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4b34319f0 con 0x7f06e4019040 2024-09-14T10:44:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94509467914128] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06dc0cc020 con 0x7f06e4019040 2024-09-14T10:44:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 20 remove_watcher() i=7 2024-09-14T10:44:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f06e4019040 msgr2=0x7f06e4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f06e4019040 0x7f06e4019930 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b3426710 msgr2=0x55f4b3428ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b3426710 0x55f4b3428ba0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f06d4035070 msgr2=0x7f06d4028070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f06d4035070 0x7f06d4028070 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4b342c820 msgr2=0x55f4b342ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4b342c820 0x55f4b342ec10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05b403a150 msgr2=0x7f05b403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05b403a150 0x7f05b403c610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f06e400f010 tx=0x7f06e401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 msgr2=0x55f4b341b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06eb1e5640 1 -- 172.21.15.96:0/2366776422 reap_dead start 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b341b3c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f06d400cd10 tx=0x7f06d4050760 comp rx=0 tx=0).stop 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 shutdown_connections 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/2366776422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3413e40 0x55f4b341b3c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 >> 172.21.15.96:0/2366776422 conn(0x55f4b340be60 msgr2=0x55f4b340a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 shutdown_connections 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.480+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/2366776422 wait complete. 2024-09-14T10:44:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/4287092638 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05c403a140 msgr2=0x7f05c403c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/4287092638 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05c403a140 0x7f05c403c600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f06e400e3f0 tx=0x7f06e4003070 comp rx=0 tx=0).stop 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/4287092638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3403090 msgr2=0x55f4b34034b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/4287092638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3403090 0x55f4b34034b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f06d400e670 tx=0x7f06d400ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/4287092638 shutdown_connections 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/4287092638 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05c403a140 0x7f05c403c600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/4287092638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b3403090 0x55f4b34034b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/4287092638 >> 172.21.15.96:0/4287092638 conn(0x55f4b33f8a40 msgr2=0x55f4b33f8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/4287092638 shutdown_connections 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/4287092638 wait complete. 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b32fd030 msgr2=0x55f4b33f2a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b32fd030 0x55f4b33f2a90 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05d003a150 msgr2=0x7f05d003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05d003a150 0x7f05d003c610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06d4001e40 tx=0x7f06d40013a0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 msgr2=0x55f4b33eb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33eb920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f06dc000f90 tx=0x7f06dc017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 shutdown_connections 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4b32fd030 0x55f4b33f2a90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f05d003a150 0x7f05d003c610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 --2- 172.21.15.96:0/1343090202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4b32f9e50 0x55f4b33eb920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 >> 172.21.15.96:0/1343090202 conn(0x55f4b32f5970 msgr2=0x55f4b33e6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 shutdown_connections 2024-09-14T10:44:28.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.484+0000 7f06ed6df9c0 1 -- 172.21.15.96:0/1343090202 wait complete. 2024-09-14T10:44:28.491 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:28.491 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-14T10:44:28.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-14T10:44:28.491 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-14T10:44:28.566 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:28.567 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:28.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.568+0000 7f7ded63f9c0 1 Processor -- start 2024-09-14T10:44:28.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.568+0000 7f7ded63f9c0 1 -- start start 2024-09-14T10:44:28.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7ded63f9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562e2cee5340 0x562e2cee7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7ded63f9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e2cd877a0 con 0x562e2cee11f0 2024-09-14T10:44:28.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7ded63f9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x562e2cde31b0 con 0x562e2cee5340 2024-09-14T10:44:28.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea944640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562e2cee5340 0x562e2cee7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea944640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562e2cee5340 0x562e2cee7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39226/0 (socket says 172.21.15.96:39226) 2024-09-14T10:44:28.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea944640 1 -- 172.21.15.96:0/4124337217 learned_addr learned my addr 172.21.15.96:0/4124337217 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7deb145640 1 --1- 172.21.15.96:0/4124337217 >> v1:172.21.15.70:6789/0 conn(0x562e2cee11f0 0x562e2cee15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34358/0 (socket says 172.21.15.96:34358) 2024-09-14T10:44:28.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea944640 1 -- 172.21.15.96:0/4124337217 >> v1:172.21.15.70:6789/0 conn(0x562e2cee11f0 legacy=0x562e2cee15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea944640 1 -- 172.21.15.96:0/4124337217 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2cd61da0 con 0x562e2cee5340 2024-09-14T10:44:28.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea944640 1 --2- 172.21.15.96:0/4124337217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee5340 0x562e2cee7730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400a5c0 tx=0x7f7dd401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e47eb736e647b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea143640 1 -- 172.21.15.96:0/4124337217 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40a9590 con 0x562e2cee5340 2024-09-14T10:44:28.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea143640 1 -- 172.21.15.96:0/4124337217 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd40ae070 con 0x562e2cee5340 2024-09-14T10:44:28.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.572+0000 7f7dea143640 1 -- 172.21.15.96:0/4124337217 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40a9880 con 0x562e2cee5340 2024-09-14T10:44:28.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.576+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/4124337217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee5340 msgr2=0x562e2cee7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.576+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/4124337217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee5340 0x562e2cee7730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400a5c0 tx=0x7f7dd401b3d0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.576+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/4124337217 shutdown_connections 2024-09-14T10:44:28.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.576+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/4124337217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee5340 0x562e2cee7730 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.576+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/4124337217 >> 172.21.15.96:0/4124337217 conn(0x562e2ce54b00 msgr2=0x562e2ce54f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.576+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/4124337217 shutdown_connections 2024-09-14T10:44:28.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.576+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/4124337217 wait complete. 2024-09-14T10:44:28.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.588+0000 7f7ded63f9c0 1 Processor -- start 2024-09-14T10:44:28.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.588+0000 7f7ded63f9c0 1 -- start start 2024-09-14T10:44:28.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.588+0000 7f7ded63f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfcc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.588+0000 7f7ded63f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e2cde6fc0 con 0x562e2cee11f0 2024-09-14T10:44:28.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.588+0000 7f7deb145640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfcc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.588+0000 7f7deb145640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfcc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39240/0 (socket says 172.21.15.96:39240) 2024-09-14T10:44:28.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.588+0000 7f7deb145640 1 -- 172.21.15.96:0/1294001746 learned_addr learned my addr 172.21.15.96:0/1294001746 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7deb145640 1 -- 172.21.15.96:0/1294001746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2cfccc20 con 0x562e2cee11f0 2024-09-14T10:44:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7deb145640 1 --2- 172.21.15.96:0/1294001746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfcc630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7de4001680 tx=0x7f7de4001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bcecdd69d4274e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7cd960a640 1 -- 172.21.15.96:0/1294001746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7de4013420 con 0x562e2cee11f0 2024-09-14T10:44:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7cd960a640 1 -- 172.21.15.96:0/1294001746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de40135c0 con 0x562e2cee11f0 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7cd960a640 1 -- 172.21.15.96:0/1294001746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7de40138e0 con 0x562e2cee11f0 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1294001746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 msgr2=0x562e2cfcc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/1294001746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfcc630 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7de4001680 tx=0x7f7de4001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1294001746 shutdown_connections 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/1294001746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfcc630 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1294001746 >> 172.21.15.96:0/1294001746 conn(0x562e2ce54b00 msgr2=0x562e2cfc8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1294001746 shutdown_connections 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1294001746 wait complete. 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 Processor -- start 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 -- start start 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfd3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e2cd88a50 con 0x562e2cee11f0 2024-09-14T10:44:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7deb145640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfd3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7deb145640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfd3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39248/0 (socket says 172.21.15.96:39248) 2024-09-14T10:44:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7deb145640 1 -- 172.21.15.96:0/3594100834 learned_addr learned my addr 172.21.15.96:0/3594100834 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7deb145640 1 -- 172.21.15.96:0/3594100834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2cfd4490 con 0x562e2cee11f0 2024-09-14T10:44:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7deb145640 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfd3f30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x562e2cfcd5f0 tx=0x7f7de4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7cd7e07640 1 -- 172.21.15.96:0/3594100834 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7de40037a0 con 0x562e2cee11f0 2024-09-14T10:44:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7cd7e07640 1 -- 172.21.15.96:0/3594100834 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de4023070 con 0x562e2cee11f0 2024-09-14T10:44:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e2cfd4720 con 0x562e2cee11f0 2024-09-14T10:44:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.592+0000 7f7cd7e07640 1 -- 172.21.15.96:0/3594100834 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7de4003ad0 con 0x562e2cee11f0 2024-09-14T10:44:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2cfd50d0 con 0x562e2cee11f0 2024-09-14T10:44:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7cd7e07640 1 -- 172.21.15.96:0/3594100834 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7de4010070 con 0x562e2cee11f0 2024-09-14T10:44:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7cd7e07640 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cd003a1a0 0x7f7cd003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7cd7e07640 1 -- 172.21.15.96:0/3594100834 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7de4050b80 con 0x562e2cee11f0 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7dea944640 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cd003a1a0 0x7f7cd003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2cee5340 0x562e2cfdb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2cfdb5e0 con 0x562e2cee5340 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7deb946640 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2cee5340 0x562e2cfdb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7dea944640 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cd003a1a0 0x7f7cd003c660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ad000 tx=0x7f7dd40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7deb946640 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2cee5340 0x562e2cfdb0a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7deb946640 1 -- 172.21.15.96:0/3594100834 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ddc0083f0 con 0x562e2cee5340 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2cfdba30 con 0x562e2cee5340 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7deb946640 1 -- 172.21.15.96:0/3594100834 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ddc0083f0 con 0x562e2cee5340 2024-09-14T10:44:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2cfdd330 con 0x562e2cee5340 2024-09-14T10:44:28.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7deb946640 1 -- 172.21.15.96:0/3594100834 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ddc0083f0 con 0x562e2cee5340 2024-09-14T10:44:28.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.596+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2cfdc560 con 0x562e2cee5340 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7deb946640 1 -- 172.21.15.96:0/3594100834 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ddc0083f0 con 0x562e2cee5340 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2cfdc980 con 0x562e2cee5340 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7deb946640 1 -- 172.21.15.96:0/3594100834 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7ddc0083f0 con 0x562e2cee5340 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7ded63f9c0 1 Processor -- start 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7ded63f9c0 1 -- start start 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7ded63f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cfeb720 0x562e2cfebb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7ded63f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e2cdf3d80 con 0x562e2cfeb720 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7dea944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cfeb720 0x562e2cfebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7dea944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cfeb720 0x562e2cfebb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39254/0 (socket says 172.21.15.96:39254) 2024-09-14T10:44:28.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7dea944640 1 -- 172.21.15.96:0/209450793 learned_addr learned my addr 172.21.15.96:0/209450793 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7dea944640 1 -- 172.21.15.96:0/209450793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2cfec180 con 0x562e2cfeb720 2024-09-14T10:44:28.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7dea944640 1 --2- 172.21.15.96:0/209450793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cfeb720 0x562e2cfebb40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4017fe0 tx=0x7f7dd4018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7cd5602640 1 -- 172.21.15.96:0/209450793 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40b3ba0 con 0x562e2cfeb720 2024-09-14T10:44:28.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/209450793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e2cfec9e0 con 0x562e2cfeb720 2024-09-14T10:44:28.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7cd5602640 1 -- 172.21.15.96:0/209450793 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd40b3d40 con 0x562e2cfeb720 2024-09-14T10:44:28.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7cd5602640 1 -- 172.21.15.96:0/209450793 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40c8580 con 0x562e2cfeb720 2024-09-14T10:44:28.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/209450793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2cfecef0 con 0x562e2cfeb720 2024-09-14T10:44:28.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7cd5602640 1 -- 172.21.15.96:0/209450793 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7dd40d1440 con 0x562e2cfeb720 2024-09-14T10:44:28.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.600+0000 7f7cd5602640 1 --2- 172.21.15.96:0/209450793 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cc403a150 0x7f7cc403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7cd5602640 1 -- 172.21.15.96:0/209450793 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7dd40ee5f0 con 0x562e2cfeb720 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7deb946640 1 --2- 172.21.15.96:0/209450793 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cc403a150 0x7f7cc403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 Processor -- start 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- start start 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cff8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e2cfcd050 con 0x562e2cff7f60 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7deb946640 1 --2- 172.21.15.96:0/209450793 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cc403a150 0x7f7cc403c610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x562e2cfdc900 tx=0x7f7ddc003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cff8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cff8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39260/0 (socket says 172.21.15.96:39260) 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 -- 172.21.15.96:0/1214386918 learned_addr learned my addr 172.21.15.96:0/1214386918 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 -- 172.21.15.96:0/1214386918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2cff8910 con 0x562e2cff7f60 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 --2- 172.21.15.96:0/1214386918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cff8340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40c7480 tx=0x7f7dd40c7950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e106eabe1622cde1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7cceffd640 1 -- 172.21.15.96:0/1214386918 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40be410 con 0x562e2cff7f60 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7cceffd640 1 -- 172.21.15.96:0/1214386918 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd40bc3b0 con 0x562e2cff7f60 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7cceffd640 1 -- 172.21.15.96:0/1214386918 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40be5b0 con 0x562e2cff7f60 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1214386918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 msgr2=0x562e2cff8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/1214386918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cff8340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40c7480 tx=0x7f7dd40c7950 comp rx=0 tx=0).stop 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1214386918 shutdown_connections 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/1214386918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cff8340 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1214386918 >> 172.21.15.96:0/1214386918 conn(0x562e2cff4390 msgr2=0x562e2cff25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1214386918 shutdown_connections 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/1214386918 wait complete. 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 Processor -- start 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- start start 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cfff500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7ded63f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e2cff8f70 con 0x562e2cff7f60 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cfff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cfff500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39264/0 (socket says 172.21.15.96:39264) 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 learned_addr learned my addr 172.21.15.96:0/2529751692 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.604+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2cfffa60 con 0x562e2cff7f60 2024-09-14T10:44:28.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7dea944640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cfff500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40bcc60 tx=0x7f7dd40ec970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ccd7fa640 1 -- 172.21.15.96:0/2529751692 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40ee2e0 con 0x562e2cff7f60 2024-09-14T10:44:28.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e2cfffcf0 con 0x562e2cff7f60 2024-09-14T10:44:28.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ccd7fa640 1 -- 172.21.15.96:0/2529751692 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd40e4040 con 0x562e2cff7f60 2024-09-14T10:44:28.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ccd7fa640 1 -- 172.21.15.96:0/2529751692 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40ecc50 con 0x562e2cff7f60 2024-09-14T10:44:28.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2d0006a0 con 0x562e2cff7f60 2024-09-14T10:44:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ccd7fa640 1 -- 172.21.15.96:0/2529751692 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7dd40f5060 con 0x562e2cff7f60 2024-09-14T10:44:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ccd7fa640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cb403a150 0x7f7cb403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ccd7fa640 1 -- 172.21.15.96:0/2529751692 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7dd40eac80 con 0x562e2cff7f60 2024-09-14T10:44:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7deb946640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cb403a150 0x7f7cb403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2d00ab10 0x562e2d00cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00d6f0 con 0x562e2d00ab10 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7deb145640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2d00ab10 0x562e2d00cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7deb946640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cb403a150 0x7f7cb403c610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00f010 tx=0x7f7ddc01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7deb145640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2d00ab10 0x562e2d00cfa0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 realm 2024-09-14T10:44:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00db00 con 0x562e2d00ab10 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00e3d0 con 0x562e2d00ab10 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00e770 con 0x562e2d00ab10 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.608+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7ded63f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7ded63f9c0 20 searching for the correct realm 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e2d010d30 0x562e2d013120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d013750 con 0x562e2d010d30 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7dea944640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e2d010d30 0x562e2d013120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7dea944640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e2d010d30 0x562e2d013120 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7dea944640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7dd40f7070 0x7f7dd40ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d013750 con 0x7f7dd40f7070 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb946640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7dd40f7070 0x7f7dd40ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb946640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7dd40f7070 0x7f7dd40ab9d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb946640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7ddc019040 0x7f7ddc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d013750 con 0x7f7ddc019040 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7ddc019040 0x7f7ddc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7ddc019040 0x7f7ddc019930 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.612+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7ddc019040 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7ddc019040 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7dd40f7070 2024-09-14T10:44:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d010d30 2024-09-14T10:44:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7ddc019040 2024-09-14T10:44:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7dd40f7070 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d010d30 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d010d30 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.616+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7ddc019040 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d010d30 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d010d30 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7ddc019040 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d010d30 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7dd40f7070 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7ddc019040 2024-09-14T10:44:28.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d010d30 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.620+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7ddc019040 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7dd40f7070 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d010d30 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7ddc019040 2024-09-14T10:44:28.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x562e2d00ab10 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00efc0 con 0x7f7dd40f7070 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00f810 con 0x562e2d00ab10 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00fc00 con 0x562e2d00ab10 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00fc00 con 0x562e2d00ab10 2024-09-14T10:44:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 zone default found 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 4 Realm: () 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 zonegroup default 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d00f390 con 0x7f7ddc019040 2024-09-14T10:44:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.624+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d0155a0 con 0x562e2d010d30 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d015940 con 0x562e2d010d30 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 20 started sync module instance, tier type = 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d014a40 con 0x7f7dd40f7070 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94756323544672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d0146a0 con 0x7f7dd40f7070 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d0166a0 con 0x562e2d00ab10 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94756323544672] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94756323548384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d016660 con 0x562e2d00ab10 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.628+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d0170b0 con 0x562e2d010d30 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.632+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94756323548384] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.632+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.632+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94756323552256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d017450 con 0x562e2d010d30 2024-09-14T10:44:28.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.632+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d017e10 con 0x7f7dd40f7070 2024-09-14T10:44:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.632+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.632+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94756323555952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d018560 con 0x7f7dd40f7070 2024-09-14T10:44:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.632+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d019080 con 0x562e2d00ab10 2024-09-14T10:44:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.636+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94756323552256] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.636+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94756323555952] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.636+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.636+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94756323560272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d019040 con 0x562e2d00ab10 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.636+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d019920 con 0x7f7ddc019040 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.636+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94756323560272] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.636+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.636+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94756323549440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d0194f0 con 0x7f7ddc019040 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.640+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d019de0 con 0x7f7ddc019040 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.640+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.640+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94756323562736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d01a470 con 0x7f7ddc019040 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.640+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d01ad20 con 0x7f7ddc019040 2024-09-14T10:44:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.640+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94756323549440] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.640+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94756323562736] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94756323561536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d01a470 con 0x7f7ddc019040 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 add_watcher() i=0 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 add_watcher() i=1 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 add_watcher() i=2 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 add_watcher() i=3 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 add_watcher() i=4 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 add_watcher() i=5 2024-09-14T10:44:28.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 add_watcher() i=6 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94756323561536] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 add_watcher() i=7 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d01de20 con 0x562e2d00ab10 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94756323565504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d01b2a0 con 0x562e2d00ab10 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94756323565504] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ca1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ded63f9c0 5 note: GC not initialized 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.644+0000 7f7ca0fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 20 Filter name: none 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7c1a7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d041420 con 0x562e2d00ab10 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d0421b0 con 0x7f7dd40f7070 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d048360 con 0x562e2d00ab10 2024-09-14T10:44:28.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94756323753424 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d043a90 con 0x562e2d00ab10 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94756323560272 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x562e2cfd50d0 con 0x562e2d00ab10 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7cceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94756323560272 notifier 4389 bl.length()=849 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7cceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7cceffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7cceffd640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7cb0003eb0 con 0x562e2d00ab10 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(65 notify.4 [notify cookie 94756323753424 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94756323753424 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e2cfd4720 con 0x562e2d00ab10 2024-09-14T10:44:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.648+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d047dd0 con 0x7f7dd40f7070 2024-09-14T10:44:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7ded63f9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-14T10:44:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7ded63f9c0 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-14T10:44:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7ded63f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-14T10:44:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94756323753424 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2d043a90 con 0x7f7dd40f7070 2024-09-14T10:44:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== watch-notify(notify (1) cookie 94756323544672 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f7ddc010040 con 0x7f7dd40f7070 2024-09-14T10:44:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7cce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94756323544672 notifier 4389 bl.length()=166 2024-09-14T10:44:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7cce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-14T10:44:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7cce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-14T10:44:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(68 notify.0 [notify cookie 94756323753424 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7cce7fc640 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7c20003410 con 0x7f7dd40f7070 2024-09-14T10:44:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== watch-notify(notify_complete (2) cookie 94756323753424 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7ddc026bb0 con 0x7f7dd40f7070 2024-09-14T10:44:28.653 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-14T10:44:28.649818Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7ca1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.652+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94756323565504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d03efb0 con 0x562e2d00ab10 2024-09-14T10:44:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94756323565504] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94756323544672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d03efb0 con 0x7f7dd40f7070 2024-09-14T10:44:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94756323544672] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7ded63f9c0 20 remove_watcher() i=0 2024-09-14T10:44:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7ded63f9c0 2 removed watcher, disabling cache 2024-09-14T10:44:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94756323548384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d014e60 con 0x562e2d00ab10 2024-09-14T10:44:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94756323548384] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7ded63f9c0 20 remove_watcher() i=1 2024-09-14T10:44:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.656+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94756323552256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d03efb0 con 0x562e2d010d30 2024-09-14T10:44:28.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.660+0000 7f7dea944640 1 -- 172.21.15.96:0/2529751692 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94756323552256] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40ce020 con 0x562e2d010d30 2024-09-14T10:44:28.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.660+0000 7f7ded63f9c0 20 remove_watcher() i=2 2024-09-14T10:44:28.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.660+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94756323555952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d015ce0 con 0x7f7dd40f7070 2024-09-14T10:44:28.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.660+0000 7f7deb946640 1 -- 172.21.15.96:0/2529751692 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94756323555952] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc02f040 con 0x7f7dd40f7070 2024-09-14T10:44:28.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.660+0000 7f7ded63f9c0 20 remove_watcher() i=3 2024-09-14T10:44:28.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.660+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94756323560272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d014e60 con 0x562e2d00ab10 2024-09-14T10:44:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.664+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94756323560272] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x562e2d00ab10 2024-09-14T10:44:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.664+0000 7f7ded63f9c0 20 remove_watcher() i=4 2024-09-14T10:44:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.664+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94756323549440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d016c00 con 0x7f7ddc019040 2024-09-14T10:44:28.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.664+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94756323549440] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.664+0000 7f7ded63f9c0 20 remove_watcher() i=5 2024-09-14T10:44:28.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.664+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94756323562736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d017a70 con 0x7f7ddc019040 2024-09-14T10:44:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94756323562736] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 20 remove_watcher() i=6 2024-09-14T10:44:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94756323561536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2d014e60 con 0x7f7ddc019040 2024-09-14T10:44:28.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94756323561536] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7de400f030 con 0x7f7ddc019040 2024-09-14T10:44:28.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 20 remove_watcher() i=7 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7ddc019040 msgr2=0x7f7ddc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7ddc019040 0x7f7ddc019930 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2d00ab10 msgr2=0x562e2d00cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2d00ab10 0x562e2d00cfa0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7dd40f7070 msgr2=0x7f7dd40ab9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7dd40f7070 0x7f7dd40ab9d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e2d010d30 msgr2=0x562e2d013120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e2d010d30 0x562e2d013120 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cb403a150 msgr2=0x7f7cb403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cb403a150 0x7f7cb403c610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00f010 tx=0x7f7ddc01b070 comp rx=0 tx=0).stop 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 msgr2=0x562e2cfff500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7deb145640 1 -- 172.21.15.96:0/2529751692 reap_dead start 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cfff500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40bcc60 tx=0x7f7dd40ec970 comp rx=0 tx=0).stop 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 shutdown_connections 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/2529751692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cff7f60 0x562e2cfff500 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 >> 172.21.15.96:0/2529751692 conn(0x562e2cff4390 msgr2=0x562e2cff25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 shutdown_connections 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.668+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/2529751692 wait complete. 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/209450793 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cc403a150 msgr2=0x7f7cc403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/209450793 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cc403a150 0x7f7cc403c610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x562e2cfdc900 tx=0x7f7ddc003070 comp rx=0 tx=0).stop 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/209450793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cfeb720 msgr2=0x562e2cfebb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/209450793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cfeb720 0x562e2cfebb40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4017fe0 tx=0x7f7dd4018170 comp rx=0 tx=0).stop 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/209450793 shutdown_connections 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/209450793 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cc403a150 0x7f7cc403c610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/209450793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cfeb720 0x562e2cfebb40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/209450793 >> 172.21.15.96:0/209450793 conn(0x562e2cfe10d0 msgr2=0x562e2cfe14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/209450793 shutdown_connections 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/209450793 wait complete. 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2cee5340 msgr2=0x562e2cfdb0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2cee5340 0x562e2cfdb0a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cd003a1a0 msgr2=0x7f7cd003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cd003a1a0 0x7f7cd003c660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ad000 tx=0x7f7dd40a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 msgr2=0x562e2cfd3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfd3f30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x562e2cfcd5f0 tx=0x7f7de4000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 shutdown_connections 2024-09-14T10:44:28.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e2cee5340 0x562e2cfdb0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7cd003a1a0 0x7f7cd003c660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 --2- 172.21.15.96:0/3594100834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2cee11f0 0x562e2cfd3f30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 >> 172.21.15.96:0/3594100834 conn(0x562e2ce54b00 msgr2=0x562e2cfcda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 shutdown_connections 2024-09-14T10:44:28.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.672+0000 7f7ded63f9c0 1 -- 172.21.15.96:0/3594100834 wait complete. 2024-09-14T10:44:28.678 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-14T10:44:28.649818Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:28.678 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:44:28.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:44:28.678 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:44:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:28.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbfc319c0 1 Processor -- start 2024-09-14T10:44:28.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbfc319c0 1 -- start start 2024-09-14T10:44:28.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbfc319c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558535222000 0x5585352223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbfc319c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585350ca7a0 con 0x558535225190 2024-09-14T10:44:28.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbfc319c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5585351261b0 con 0x558535222000 2024-09-14T10:44:28.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbd737640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558535222000 0x5585352223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbd737640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558535222000 0x5585352223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39274/0 (socket says 172.21.15.96:39274) 2024-09-14T10:44:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbd737640 1 -- 172.21.15.96:0/958349065 learned_addr learned my addr 172.21.15.96:0/958349065 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbcf36640 1 --1- 172.21.15.96:0/958349065 >> v1:172.21.15.70:6789/0 conn(0x558535225190 0x558535227580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34368/0 (socket says 172.21.15.96:34368) 2024-09-14T10:44:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbd737640 1 -- 172.21.15.96:0/958349065 >> v1:172.21.15.70:6789/0 conn(0x558535225190 legacy=0x558535227580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.756+0000 7f6fbd737640 1 -- 172.21.15.96:0/958349065 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585350a4da0 con 0x558535222000 2024-09-14T10:44:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fbd737640 1 --2- 172.21.15.96:0/958349065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x5585352223e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800a4e0 tx=0x7f6fb801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5b1ed1b31f7f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fb7fff640 1 -- 172.21.15.96:0/958349065 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb80aa540 con 0x558535222000 2024-09-14T10:44:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fb7fff640 1 -- 172.21.15.96:0/958349065 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb80aa6e0 con 0x558535222000 2024-09-14T10:44:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fb7fff640 1 -- 172.21.15.96:0/958349065 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb80aaa40 con 0x558535222000 2024-09-14T10:44:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/958349065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 msgr2=0x5585352223e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/958349065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x5585352223e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800a4e0 tx=0x7f6fb801b090 comp rx=0 tx=0).stop 2024-09-14T10:44:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/958349065 shutdown_connections 2024-09-14T10:44:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/958349065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x5585352223e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/958349065 >> 172.21.15.96:0/958349065 conn(0x55853521db20 msgr2=0x55853521ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/958349065 shutdown_connections 2024-09-14T10:44:28.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.760+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/958349065 wait complete. 2024-09-14T10:44:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 Processor -- start 2024-09-14T10:44:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- start start 2024-09-14T10:44:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558535129fc0 con 0x558535222000 2024-09-14T10:44:28.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbd737640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbd737640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39282/0 (socket says 172.21.15.96:39282) 2024-09-14T10:44:28.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbd737640 1 -- 172.21.15.96:0/2825228181 learned_addr learned my addr 172.21.15.96:0/2825228181 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbd737640 1 -- 172.21.15.96:0/2825228181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585351990d0 con 0x558535222000 2024-09-14T10:44:28.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbd737640 1 --2- 172.21.15.96:0/2825228181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535198ae0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8019740 tx=0x7f6fb80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61987001378bd91 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6eab606640 1 -- 172.21.15.96:0/2825228181 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb80b9070 con 0x558535222000 2024-09-14T10:44:28.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6eab606640 1 -- 172.21.15.96:0/2825228181 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb80aaa90 con 0x558535222000 2024-09-14T10:44:28.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6eab606640 1 -- 172.21.15.96:0/2825228181 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb80aad70 con 0x558535222000 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/2825228181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 msgr2=0x558535198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/2825228181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535198ae0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8019740 tx=0x7f6fb80033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/2825228181 shutdown_connections 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/2825228181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535198ae0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/2825228181 >> 172.21.15.96:0/2825228181 conn(0x55853521db20 msgr2=0x558535308f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/2825228181 shutdown_connections 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/2825228181 wait complete. 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 Processor -- start 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- start start 2024-09-14T10:44:28.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535316c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbfc319c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5585350cba50 con 0x558535222000 2024-09-14T10:44:28.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbd737640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535316c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbd737640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535316c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39294/0 (socket says 172.21.15.96:39294) 2024-09-14T10:44:28.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.776+0000 7f6fbd737640 1 -- 172.21.15.96:0/3007589812 learned_addr learned my addr 172.21.15.96:0/3007589812 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbd737640 1 -- 172.21.15.96:0/3007589812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585353171f0 con 0x558535222000 2024-09-14T10:44:28.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbd737640 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535316c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8000f90 tx=0x7f6fb8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6ea9e03640 1 -- 172.21.15.96:0/3007589812 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb80b9030 con 0x558535222000 2024-09-14T10:44:28.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558535317480 con 0x558535222000 2024-09-14T10:44:28.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6ea9e03640 1 -- 172.21.15.96:0/3007589812 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb80b5ad0 con 0x558535222000 2024-09-14T10:44:28.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6ea9e03640 1 -- 172.21.15.96:0/3007589812 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fb80b5db0 con 0x558535222000 2024-09-14T10:44:28.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558535317eb0 con 0x558535222000 2024-09-14T10:44:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6ea9e03640 1 -- 172.21.15.96:0/3007589812 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6fb80b3040 con 0x558535222000 2024-09-14T10:44:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6ea9e03640 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ea403a150 0x7f6ea403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6ea9e03640 1 -- 172.21.15.96:0/3007589812 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6fb80c4030 con 0x558535222000 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbcf36640 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ea403a150 0x7f6ea403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558535225190 0x55853531de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55853531e340 con 0x558535225190 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558535225190 0x55853531de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbcf36640 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ea403a150 0x7f6ea403c610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8001e90 tx=0x7f6fa80013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558535225190 0x55853531de00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbdf38640 1 -- 172.21.15.96:0/3007589812 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb00083f0 con 0x558535225190 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55853531e7b0 con 0x558535225190 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbdf38640 1 -- 172.21.15.96:0/3007589812 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fb00083f0 con 0x558535225190 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585353200b0 con 0x558535225190 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbdf38640 1 -- 172.21.15.96:0/3007589812 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6fb00083f0 con 0x558535225190 2024-09-14T10:44:28.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55853531f2e0 con 0x558535225190 2024-09-14T10:44:28.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbdf38640 1 -- 172.21.15.96:0/3007589812 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fb00083f0 con 0x558535225190 2024-09-14T10:44:28.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.780+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55853531f730 con 0x558535225190 2024-09-14T10:44:28.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbdf38640 1 -- 172.21.15.96:0/3007589812 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6fb00083f0 con 0x558535225190 2024-09-14T10:44:28.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbfc319c0 1 Processor -- start 2024-09-14T10:44:28.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbfc319c0 1 -- start start 2024-09-14T10:44:28.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbfc319c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853532e440 0x55853532e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbfc319c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558535136d80 con 0x55853532e440 2024-09-14T10:44:28.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbcf36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853532e440 0x55853532e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbcf36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853532e440 0x55853532e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39302/0 (socket says 172.21.15.96:39302) 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1369068414 learned_addr learned my addr 172.21.15.96:0/1369068414 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1369068414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55853532eea0 con 0x55853532e440 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbcf36640 1 --2- 172.21.15.96:0/1369068414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853532e440 0x55853532e860 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800e670 tx=0x7f6fa800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6ea2ffd640 1 -- 172.21.15.96:0/1369068414 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8022070 con 0x55853532e440 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1369068414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55853532f700 con 0x55853532e440 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1369068414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55853532fc70 con 0x55853532e440 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6ea2ffd640 1 -- 172.21.15.96:0/1369068414 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa800d660 con 0x55853532e440 2024-09-14T10:44:28.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6ea2ffd640 1 -- 172.21.15.96:0/1369068414 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8006070 con 0x55853532e440 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6ea2ffd640 1 -- 172.21.15.96:0/1369068414 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6fa8025070 con 0x55853532e440 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6ea2ffd640 1 --2- 172.21.15.96:0/1369068414 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e9403a150 0x7f6e9403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.784+0000 7f6ea2ffd640 1 -- 172.21.15.96:0/1369068414 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6fa8052580 con 0x55853532e440 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/1369068414 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e9403a150 0x7f6e9403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 Processor -- start 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- start start 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/1369068414 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e9403a150 0x7f6e9403c610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55853531ee00 tx=0x7f6fb0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x55853533b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558535197400 con 0x55853533ae00 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x55853533b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x55853533b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39308/0 (socket says 172.21.15.96:39308) 2024-09-14T10:44:28.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1098351814 learned_addr learned my addr 172.21.15.96:0/1098351814 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1098351814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55853533b7b0 con 0x55853533ae00 2024-09-14T10:44:28.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 --2- 172.21.15.96:0/1098351814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x55853533b1e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8026fd0 tx=0x7f6fa801ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3629daff932ac736 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6ea0ff9640 1 -- 172.21.15.96:0/1098351814 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa80263b0 con 0x55853533ae00 2024-09-14T10:44:28.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6ea0ff9640 1 -- 172.21.15.96:0/1098351814 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa800dcc0 con 0x55853533ae00 2024-09-14T10:44:28.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6ea0ff9640 1 -- 172.21.15.96:0/1098351814 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa8026550 con 0x55853533ae00 2024-09-14T10:44:28.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1098351814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 msgr2=0x55853533b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1098351814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x55853533b1e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8026fd0 tx=0x7f6fa801ae00 comp rx=0 tx=0).stop 2024-09-14T10:44:28.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1098351814 shutdown_connections 2024-09-14T10:44:28.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1098351814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x55853533b1e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1098351814 >> 172.21.15.96:0/1098351814 conn(0x558535337230 msgr2=0x558535335470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1098351814 shutdown_connections 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1098351814 wait complete. 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 Processor -- start 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- start start 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x558535342370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55853533be10 con 0x55853533ae00 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x558535342370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x558535342370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39324/0 (socket says 172.21.15.96:39324) 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 learned_addr learned my addr 172.21.15.96:0/1647844253 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585353428d0 con 0x55853533ae00 2024-09-14T10:44:28.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbcf36640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x558535342370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800cad0 tx=0x7f6fa8050840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6e92ffd640 1 -- 172.21.15.96:0/1647844253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa80520d0 con 0x55853533ae00 2024-09-14T10:44:28.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558535342b60 con 0x55853533ae00 2024-09-14T10:44:28.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6e92ffd640 1 -- 172.21.15.96:0/1647844253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8052270 con 0x55853533ae00 2024-09-14T10:44:28.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6e92ffd640 1 -- 172.21.15.96:0/1647844253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa803a060 con 0x55853533ae00 2024-09-14T10:44:28.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.788+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558535342b60 con 0x55853533ae00 2024-09-14T10:44:28.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6e92ffd640 1 -- 172.21.15.96:0/1647844253 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6fa8033070 con 0x55853533ae00 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6e92ffd640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e8803a100 0x7f6e8803c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6e92ffd640 1 -- 172.21.15.96:0/1647844253 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6fa8045070 con 0x55853533ae00 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e8803a100 0x7f6e8803c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55853534d720 0x55853534fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535350300 con 0x55853534d720 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbd737640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55853534d720 0x55853534fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e8803a100 0x7f6e8803c5c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000f010 tx=0x7f6fb001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbd737640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55853534d720 0x55853534fbb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 realm 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535350710 con 0x55853534d720 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535350fe0 con 0x55853534d720 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535351380 con 0x55853534d720 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535351820 con 0x55853534d720 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 20 searching for the correct realm 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5585353537c0 0x558535355c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbcf36640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5585353537c0 0x558535355c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbcf36640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5585353537c0 0x558535355c10 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbcf36640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6fa8035070 0x7f6fa80278c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fa8035070 2024-09-14T10:44:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.792+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6fa8035070 0x7f6fa80278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6fa8035070 0x7f6fa80278c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbdf38640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6fb0019040 0x7f6fb0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6fb0019040 0x7f6fb0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6fb0019040 0x7f6fb0019930 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x55853534d720 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x55853534d720 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fa8035070 2024-09-14T10:44:28.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.796+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x55853534d720 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x55853534d720 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fa8035070 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x55853534d720 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x55853534d720 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.800+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fa8035070 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x55853534d720 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fa8035070 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x5585353537c0 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fb0019040 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x55853534d720 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.804+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5585353562e0 con 0x7f6fa8035070 2024-09-14T10:44:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535352260 con 0x55853534d720 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535352b00 con 0x55853534d720 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535351ea0 con 0x55853534d720 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 zone default found 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 4 Realm: () 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 zonegroup default 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535356760 con 0x7f6fb0019040 2024-09-14T10:44:28.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5585353582d0 con 0x5585353537c0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535358810 con 0x5585353537c0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 started sync module instance, tier type = 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585353575f0 con 0x7f6fa8035070 2024-09-14T10:44:28.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94030611708384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558535359120 con 0x7f6fa8035070 2024-09-14T10:44:28.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.808+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558535359970 con 0x55853534d720 2024-09-14T10:44:28.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.812+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94030611708384] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.812+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.812+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94030611713136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585353595c0 con 0x55853534d720 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.812+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535a0e0 con 0x5585353537c0 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.812+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94030611713136] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94030611717040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535a4d0 con 0x5585353537c0 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535ae90 con 0x7f6fa8035070 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94030611720944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535b5a0 con 0x7f6fa8035070 2024-09-14T10:44:28.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535c0c0 con 0x55853534d720 2024-09-14T10:44:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94030611717040] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94030611720944] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94030611725200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535c080 con 0x55853534d720 2024-09-14T10:44:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.816+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535c960 con 0x7f6fb0019040 2024-09-14T10:44:28.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.820+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94030611725200] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.820+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.820+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94030611714192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535c530 con 0x7f6fb0019040 2024-09-14T10:44:28.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.820+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535ce00 con 0x7f6fb0019040 2024-09-14T10:44:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94030611714192] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94030611727664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535cfe0 con 0x7f6fb0019040 2024-09-14T10:44:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535d830 con 0x7f6fb0019040 2024-09-14T10:44:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94030611727664] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94030611730400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535d8b0 con 0x7f6fb0019040 2024-09-14T10:44:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 20 add_watcher() i=0 2024-09-14T10:44:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 20 add_watcher() i=1 2024-09-14T10:44:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 20 add_watcher() i=2 2024-09-14T10:44:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 20 add_watcher() i=3 2024-09-14T10:44:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 20 add_watcher() i=4 2024-09-14T10:44:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 20 add_watcher() i=5 2024-09-14T10:44:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.824+0000 7f6fbfc319c0 20 add_watcher() i=6 2024-09-14T10:44:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94030611730400] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 20 add_watcher() i=7 2024-09-14T10:44:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535360b40 con 0x55853534d720 2024-09-14T10:44:28.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94030611731824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535de40 con 0x55853534d720 2024-09-14T10:44:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94030611731824] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6e737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 5 note: GC not initialized 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6e727e4640 20 reqs_thread_entry: start 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 20 Filter name: none 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6de3fff640 20 reqs_thread_entry: start 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558535383eb0 con 0x55853534d720 2024-09-14T10:44:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.828+0000 7f6fbfc319c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-14T10:44:28.829 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-14T10:44:28.649818Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.832+0000 7f6e737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.832+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94030611731824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5585353843f0 con 0x55853534d720 2024-09-14T10:44:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.832+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94030611731824] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.832+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94030611708384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535d570 con 0x7f6fa8035070 2024-09-14T10:44:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.832+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94030611708384] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.832+0000 7f6fbfc319c0 20 remove_watcher() i=0 2024-09-14T10:44:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.832+0000 7f6fbfc319c0 2 removed watcher, disabling cache 2024-09-14T10:44:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.832+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94030611713136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535d570 con 0x55853534d720 2024-09-14T10:44:28.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94030611713136] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbfc319c0 20 remove_watcher() i=1 2024-09-14T10:44:28.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94030611717040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558535358c70 con 0x5585353537c0 2024-09-14T10:44:28.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbcf36640 1 -- 172.21.15.96:0/1647844253 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94030611717040] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fa803c070 con 0x5585353537c0 2024-09-14T10:44:28.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbfc319c0 20 remove_watcher() i=2 2024-09-14T10:44:28.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94030611720944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535d570 con 0x7f6fa8035070 2024-09-14T10:44:28.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbdf38640 1 -- 172.21.15.96:0/1647844253 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94030611720944] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb002f040 con 0x7f6fa8035070 2024-09-14T10:44:28.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbfc319c0 20 remove_watcher() i=3 2024-09-14T10:44:28.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.836+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94030611725200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535d570 con 0x55853534d720 2024-09-14T10:44:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.840+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94030611725200] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x55853534d720 2024-09-14T10:44:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.840+0000 7f6fbfc319c0 20 remove_watcher() i=4 2024-09-14T10:44:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.840+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94030611714192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535bb90 con 0x7f6fb0019040 2024-09-14T10:44:28.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.840+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94030611714192] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.840+0000 7f6fbfc319c0 20 remove_watcher() i=5 2024-09-14T10:44:28.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.840+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94030611727664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535d570 con 0x7f6fb0019040 2024-09-14T10:44:28.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.844+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94030611727664] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.844+0000 7f6fbfc319c0 20 remove_watcher() i=6 2024-09-14T10:44:28.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.844+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94030611730400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55853535c530 con 0x7f6fb0019040 2024-09-14T10:44:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94030611730400] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6fb80cf300 con 0x7f6fb0019040 2024-09-14T10:44:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 20 remove_watcher() i=7 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6fb0019040 msgr2=0x7f6fb0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6fb0019040 0x7f6fb0019930 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55853534d720 msgr2=0x55853534fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55853534d720 0x55853534fbb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6fa8035070 msgr2=0x7f6fa80278c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6fa8035070 0x7f6fa80278c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5585353537c0 msgr2=0x558535355c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5585353537c0 0x558535355c10 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e8803a100 msgr2=0x7f6e8803c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e8803a100 0x7f6e8803c5c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000f010 tx=0x7f6fb001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 msgr2=0x558535342370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbd737640 1 -- 172.21.15.96:0/1647844253 reap_dead start 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x558535342370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800cad0 tx=0x7f6fa8050840 comp rx=0 tx=0).stop 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 shutdown_connections 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1647844253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853533ae00 0x558535342370 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 >> 172.21.15.96:0/1647844253 conn(0x558535337230 msgr2=0x558535335440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 shutdown_connections 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1647844253 wait complete. 2024-09-14T10:44:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1369068414 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e9403a150 msgr2=0x7f6e9403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1369068414 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e9403a150 0x7f6e9403c610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55853531ee00 tx=0x7f6fb0003070 comp rx=0 tx=0).stop 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1369068414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853532e440 msgr2=0x55853532e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1369068414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853532e440 0x55853532e860 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800e670 tx=0x7f6fa800ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1369068414 shutdown_connections 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1369068414 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6e9403a150 0x7f6e9403c610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/1369068414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55853532e440 0x55853532e860 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1369068414 >> 172.21.15.96:0/1369068414 conn(0x558535323df0 msgr2=0x5585353241d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1369068414 shutdown_connections 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/1369068414 wait complete. 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558535225190 msgr2=0x55853531de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558535225190 0x55853531de00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ea403a150 msgr2=0x7f6ea403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ea403a150 0x7f6ea403c610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8001e90 tx=0x7f6fa80013f0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 msgr2=0x558535316c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535316c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8000f90 tx=0x7f6fb8017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 shutdown_connections 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558535225190 0x55853531de00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ea403a150 0x7f6ea403c610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 --2- 172.21.15.96:0/3007589812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558535222000 0x558535316c90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 >> 172.21.15.96:0/3007589812 conn(0x55853521db20 msgr2=0x558535308a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 shutdown_connections 2024-09-14T10:44:28.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.848+0000 7f6fbfc319c0 1 -- 172.21.15.96:0/3007589812 wait complete. 2024-09-14T10:44:28.855 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-14T10:44:28.649818Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:28.855 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-14T10:44:28.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-14T10:44:28.856 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-14T10:44:28.931 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:28.931 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:28.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.932+0000 7f5d294f99c0 1 Processor -- start 2024-09-14T10:44:28.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d294f99c0 1 -- start start 2024-09-14T10:44:28.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d294f99c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x561a8113f810 0x561a8113e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d294f99c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a810717a0 con 0x561a8113f2e0 2024-09-14T10:44:28.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d294f99c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x561a810cd1b0 con 0x561a8113f810 2024-09-14T10:44:28.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d267fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x561a8113f810 0x561a8113e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d267fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x561a8113f810 0x561a8113e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39328/0 (socket says 172.21.15.96:39328) 2024-09-14T10:44:28.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d267fe640 1 -- 172.21.15.96:0/443468709 learned_addr learned my addr 172.21.15.96:0/443468709 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d26fff640 1 --1- 172.21.15.96:0/443468709 >> v1:172.21.15.70:6789/0 conn(0x561a8113f2e0 0x561a8113dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34372/0 (socket says 172.21.15.96:34372) 2024-09-14T10:44:28.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d267fe640 1 -- 172.21.15.96:0/443468709 >> v1:172.21.15.70:6789/0 conn(0x561a8113f2e0 legacy=0x561a8113dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d267fe640 1 -- 172.21.15.96:0/443468709 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8104bda0 con 0x561a8113f810 2024-09-14T10:44:28.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d267fe640 1 --2- 172.21.15.96:0/443468709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f810 0x561a8113e3e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000a5c0 tx=0x7f5d1001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148ebe287c9207f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d25ffd640 1 -- 172.21.15.96:0/443468709 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d100b0070 con 0x561a8113f810 2024-09-14T10:44:28.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d25ffd640 1 -- 172.21.15.96:0/443468709 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d100ab540 con 0x561a8113f810 2024-09-14T10:44:28.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.936+0000 7f5d25ffd640 1 -- 172.21.15.96:0/443468709 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d100ab840 con 0x561a8113f810 2024-09-14T10:44:28.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.940+0000 7f5d294f99c0 1 -- 172.21.15.96:0/443468709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f810 msgr2=0x561a8113e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.940+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/443468709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f810 0x561a8113e3e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000a5c0 tx=0x7f5d1001b280 comp rx=0 tx=0).stop 2024-09-14T10:44:28.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.940+0000 7f5d294f99c0 1 -- 172.21.15.96:0/443468709 shutdown_connections 2024-09-14T10:44:28.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.940+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/443468709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f810 0x561a8113e3e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.940+0000 7f5d294f99c0 1 -- 172.21.15.96:0/443468709 >> 172.21.15.96:0/443468709 conn(0x561a811c4b00 msgr2=0x561a811c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.940+0000 7f5d294f99c0 1 -- 172.21.15.96:0/443468709 shutdown_connections 2024-09-14T10:44:28.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.940+0000 7f5d294f99c0 1 -- 172.21.15.96:0/443468709 wait complete. 2024-09-14T10:44:28.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d294f99c0 1 Processor -- start 2024-09-14T10:44:28.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d294f99c0 1 -- start start 2024-09-14T10:44:28.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d294f99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d294f99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a810d0fc0 con 0x561a8113f2e0 2024-09-14T10:44:28.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d26fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d26fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39336/0 (socket says 172.21.15.96:39336) 2024-09-14T10:44:28.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d26fff640 1 -- 172.21.15.96:0/362679755 learned_addr learned my addr 172.21.15.96:0/362679755 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d26fff640 1 -- 172.21.15.96:0/362679755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a812b6f10 con 0x561a8113f2e0 2024-09-14T10:44:28.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5d26fff640 1 --2- 172.21.15.96:0/362679755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812b6920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5d200016f0 tx=0x7f5d20001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8dd1ab3d4bdba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5c14e09640 1 -- 172.21.15.96:0/362679755 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d20003460 con 0x561a8113f2e0 2024-09-14T10:44:28.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5c14e09640 1 -- 172.21.15.96:0/362679755 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d20003620 con 0x561a8113f2e0 2024-09-14T10:44:28.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.952+0000 7f5c14e09640 1 -- 172.21.15.96:0/362679755 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d20003940 con 0x561a8113f2e0 2024-09-14T10:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- 172.21.15.96:0/362679755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 msgr2=0x561a812b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/362679755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812b6920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5d200016f0 tx=0x7f5d20001bb0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- 172.21.15.96:0/362679755 shutdown_connections 2024-09-14T10:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/362679755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812b6920 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- 172.21.15.96:0/362679755 >> 172.21.15.96:0/362679755 conn(0x561a811c4b00 msgr2=0x561a812b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- 172.21.15.96:0/362679755 shutdown_connections 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- 172.21.15.96:0/362679755 wait complete. 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 Processor -- start 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- start start 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812be180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a81072a50 con 0x561a8113f2e0 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d26fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812be180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d26fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812be180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39346/0 (socket says 172.21.15.96:39346) 2024-09-14T10:44:28.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d26fff640 1 -- 172.21.15.96:0/152767465 learned_addr learned my addr 172.21.15.96:0/152767465 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d26fff640 1 -- 172.21.15.96:0/152767465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a812be6e0 con 0x561a8113f2e0 2024-09-14T10:44:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d26fff640 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812be180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561a812b78e0 tx=0x7f5d20001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5c13606640 1 -- 172.21.15.96:0/152767465 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d20022020 con 0x561a8113f2e0 2024-09-14T10:44:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5c13606640 1 -- 172.21.15.96:0/152767465 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d2001e480 con 0x561a8113f2e0 2024-09-14T10:44:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a812be970 con 0x561a8113f2e0 2024-09-14T10:44:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5c13606640 1 -- 172.21.15.96:0/152767465 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d2001e780 con 0x561a8113f2e0 2024-09-14T10:44:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.956+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a812bf3a0 con 0x561a8113f2e0 2024-09-14T10:44:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5c13606640 1 -- 172.21.15.96:0/152767465 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5d20025020 con 0x561a8113f2e0 2024-09-14T10:44:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5c13606640 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0c03a1a0 0x7f5c0c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5c13606640 1 -- 172.21.15.96:0/152767465 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5d20050ae0 con 0x561a8113f2e0 2024-09-14T10:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d267fe640 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0c03a1a0 0x7f5c0c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a8113f810 0x561a812c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812c5830 con 0x561a8113f810 2024-09-14T10:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d27800640 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a8113f810 0x561a812c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d267fe640 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0c03a1a0 0x7f5c0c03c660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d100ad000 tx=0x7f5d100a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d27800640 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a8113f810 0x561a812c52f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d27800640 1 -- 172.21.15.96:0/152767465 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d180083f0 con 0x561a8113f810 2024-09-14T10:44:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812c5c50 con 0x561a8113f810 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d27800640 1 -- 172.21.15.96:0/152767465 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d180083f0 con 0x561a8113f810 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812c7550 con 0x561a8113f810 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d27800640 1 -- 172.21.15.96:0/152767465 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d180083f0 con 0x561a8113f810 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812c6780 con 0x561a8113f810 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d27800640 1 -- 172.21.15.96:0/152767465 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d180083f0 con 0x561a8113f810 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812c6bd0 con 0x561a8113f810 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d27800640 1 -- 172.21.15.96:0/152767465 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d180083f0 con 0x561a8113f810 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 Processor -- start 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 -- start start 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812d5910 0x561a812d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d294f99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a810ddd80 con 0x561a812d5910 2024-09-14T10:44:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d267fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812d5910 0x561a812d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d267fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812d5910 0x561a812d5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39348/0 (socket says 172.21.15.96:39348) 2024-09-14T10:44:28.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.960+0000 7f5d267fe640 1 -- 172.21.15.96:0/3938950707 learned_addr learned my addr 172.21.15.96:0/3938950707 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d267fe640 1 -- 172.21.15.96:0/3938950707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a812d6370 con 0x561a812d5910 2024-09-14T10:44:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d267fe640 1 --2- 172.21.15.96:0/3938950707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812d5910 0x561a812d5d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d10000c10 tx=0x7f5d10018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5c10e01640 1 -- 172.21.15.96:0/3938950707 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d100b0040 con 0x561a812d5910 2024-09-14T10:44:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5c10e01640 1 -- 172.21.15.96:0/3938950707 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d100c6070 con 0x561a812d5910 2024-09-14T10:44:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3938950707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a812d6bd0 con 0x561a812d5910 2024-09-14T10:44:28.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5c10e01640 1 -- 172.21.15.96:0/3938950707 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d100abdc0 con 0x561a812d5910 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3938950707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a812d70e0 con 0x561a812d5910 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5c10e01640 1 -- 172.21.15.96:0/3938950707 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5d100cb460 con 0x561a812d5910 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5c10e01640 1 --2- 172.21.15.96:0/3938950707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0003a190 0x7f5c0003c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5c10e01640 1 -- 172.21.15.96:0/3938950707 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5d100a8070 con 0x561a812d5910 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d27800640 1 --2- 172.21.15.96:0/3938950707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0003a190 0x7f5c0003c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d294f99c0 1 Processor -- start 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d294f99c0 1 -- start start 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d27800640 1 --2- 172.21.15.96:0/3938950707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0003a190 0x7f5c0003c650 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x561a812c62a0 tx=0x7f5d18003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d294f99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d294f99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a812b72e0 con 0x561a812e3160 2024-09-14T10:44:28.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.964+0000 7f5d267fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39354/0 (socket says 172.21.15.96:39354) 2024-09-14T10:44:28.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 -- 172.21.15.96:0/3734493593 learned_addr learned my addr 172.21.15.96:0/3734493593 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 -- 172.21.15.96:0/3734493593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a812e3b50 con 0x561a812e3160 2024-09-14T10:44:28.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 --2- 172.21.15.96:0/3734493593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e3560 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5d100cd030 tx=0x7f5d100cbb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27690895a3c1a770 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5c0a7fc640 1 -- 172.21.15.96:0/3734493593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d100cbc70 con 0x561a812e3160 2024-09-14T10:44:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5c0a7fc640 1 -- 172.21.15.96:0/3734493593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d100aaac0 con 0x561a812e3160 2024-09-14T10:44:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5c0a7fc640 1 -- 172.21.15.96:0/3734493593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d100cbe10 con 0x561a812e3160 2024-09-14T10:44:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3734493593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 msgr2=0x561a812e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/3734493593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e3560 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5d100cd030 tx=0x7f5d100cbb20 comp rx=0 tx=0).stop 2024-09-14T10:44:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3734493593 shutdown_connections 2024-09-14T10:44:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/3734493593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e3560 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:28.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3734493593 >> 172.21.15.96:0/3734493593 conn(0x561a812de580 msgr2=0x561a812dc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3734493593 shutdown_connections 2024-09-14T10:44:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3734493593 wait complete. 2024-09-14T10:44:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 Processor -- start 2024-09-14T10:44:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- start start 2024-09-14T10:44:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a812e20b0 con 0x561a812e3160 2024-09-14T10:44:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39360/0 (socket says 172.21.15.96:39360) 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 learned_addr learned my addr 172.21.15.96:0/2754897264 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a812e9c30 con 0x561a812e3160 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d267fe640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e96d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5d100b6000 tx=0x7f5d100ebd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5c08ff9640 1 -- 172.21.15.96:0/2754897264 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d100e5070 con 0x561a812e3160 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5c08ff9640 1 -- 172.21.15.96:0/2754897264 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d100c1c00 con 0x561a812e3160 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a812e9ec0 con 0x561a812e3160 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5c08ff9640 1 -- 172.21.15.96:0/2754897264 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d100aa3b0 con 0x561a812e3160 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.968+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a812ea870 con 0x561a812e3160 2024-09-14T10:44:28.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5c08ff9640 1 -- 172.21.15.96:0/2754897264 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5d100aa550 con 0x561a812e3160 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5c08ff9640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5bf003a1f0 0x7f5bf003c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5c08ff9640 1 -- 172.21.15.96:0/2754897264 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5d100db030 con 0x561a812e3160 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d27800640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5bf003a1f0 0x7f5bf003c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a812f4c30 0x561a812f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812f7840 con 0x561a812f4c30 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d26fff640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a812f4c30 0x561a812f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d27800640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5bf003a1f0 0x7f5bf003c6b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800f010 tx=0x7f5d1801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d26fff640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a812f4c30 0x561a812f70f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 realm 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812f7c50 con 0x561a812f4c30 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:28.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812f8520 con 0x561a812f4c30 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812f88c0 con 0x561a812f4c30 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812f9110 con 0x561a812f4c30 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:28.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 20 searching for the correct realm 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a812fae80 0x561a812fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d267fe640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a812fae80 0x561a812fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d267fe640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a812fae80 0x561a812fd270 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d267fe640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5d100ab030 0x7f5d100d58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d100ab030 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.972+0000 7f5d27800640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5d100ab030 0x7f5d100d58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d27800640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5d100ab030 0x7f5d100d58b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:28.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d27800640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5d18019040 0x7f5d18019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:28.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5d18019040 0x7f5d18019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:28.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5d18019040 0x7f5d18019930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:28.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812f4c30 2024-09-14T10:44:28.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812f4c30 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d100ab030 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.976+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812f4c30 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812f4c30 2024-09-14T10:44:28.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d100ab030 2024-09-14T10:44:28.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:28.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812f4c30 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812f4c30 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.980+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d100ab030 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812f4c30 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d100ab030 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812fae80 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.984+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d18019040 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x561a812f4c30 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561a812fd850 con 0x7f5d100ab030 2024-09-14T10:44:28.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:28.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:28.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:28.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:28.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:28.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:28.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:28.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812f9a60 con 0x561a812f4c30 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812fa300 con 0x561a812f4c30 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812fa300 con 0x561a812f4c30 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:28.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 zone default found 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 4 Realm: () 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 zonegroup default 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812fa300 con 0x7f5d18019040 2024-09-14T10:44:28.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812ff740 con 0x561a812fae80 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a812ffb90 con 0x561a812fae80 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 started sync module instance, tier type = 2024-09-14T10:44:28.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:28.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a812febe0 con 0x7f5d100ab030 2024-09-14T10:44:28.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.988+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:28.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.992+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94671836540880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a812fe840 con 0x7f5d100ab030 2024-09-14T10:44:28.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.992+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81300ac0 con 0x561a812f4c30 2024-09-14T10:44:29.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.992+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94671836540880] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:29.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.992+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.992+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94671836545008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81300ac0 con 0x561a812f4c30 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.992+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a813014d0 con 0x561a812fae80 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94671836545008] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94671836546576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81300a30 con 0x561a812fae80 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81302260 con 0x7f5d100ab030 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94671836552560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81302b00 con 0x7f5d100ab030 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81303500 con 0x561a812f4c30 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94671836546576] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:28.996+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94671836552560] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.000+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.000+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94671836551360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81302650 con 0x561a812f4c30 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.000+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81303dd0 con 0x7f5d18019040 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.000+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94671836551360] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.000+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.000+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94671836557328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81302650 con 0x7f5d18019040 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.000+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81304200 con 0x7f5d18019040 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94671836560560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81304670 con 0x7f5d18019040 2024-09-14T10:44:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81305140 con 0x7f5d18019040 2024-09-14T10:44:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94671836557328] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94671836560560] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94671836564528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a813041c0 con 0x7f5d18019040 2024-09-14T10:44:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 20 add_watcher() i=0 2024-09-14T10:44:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 20 add_watcher() i=1 2024-09-14T10:44:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 20 add_watcher() i=2 2024-09-14T10:44:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 20 add_watcher() i=3 2024-09-14T10:44:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 20 add_watcher() i=4 2024-09-14T10:44:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 20 add_watcher() i=5 2024-09-14T10:44:29.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.004+0000 7f5d294f99c0 20 add_watcher() i=6 2024-09-14T10:44:29.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94671836564528] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 20 add_watcher() i=7 2024-09-14T10:44:29.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:29.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a81308240 con 0x561a812f4c30 2024-09-14T10:44:29.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94671836558896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a813056c0 con 0x561a812f4c30 2024-09-14T10:44:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94671836558896] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5bdd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 5 note: GC not initialized 2024-09-14T10:44:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5b57fff640 20 reqs_thread_entry: start 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 20 Filter name: none 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5b55ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a8132b800 con 0x561a812f4c30 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.008+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a813327f0 con 0x561a812f4c30 2024-09-14T10:44:29.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d294f99c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d294f99c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d294f99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94671836750432 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a8132df60 con 0x561a812f4c30 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94671836551360 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x561a812bf3a0 con 0x561a812f4c30 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5c0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94671836551360 notifier 4403 bl.length()=758 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5c0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5c0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5c0a7fc640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5bec003eb0 con 0x561a812f4c30 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(64 notify.4 [notify cookie 94671836750432 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94671836750432 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a812be970 con 0x561a812f4c30 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81332260 con 0x561a812f4c30 2024-09-14T10:44:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d294f99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94671836750432 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561a8132dab0 con 0x7f5d100ab030 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== watch-notify(notify (1) cookie 94671836540880 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f5d18010040 con 0x7f5d100ab030 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5c09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94671836540880 notifier 4403 bl.length()=159 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.0 [notify cookie 94671836750432 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5c09ffb640 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5b5c0032d0 con 0x7f5d100ab030 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.012+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== watch-notify(notify_complete (2) cookie 94671836750432 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5d18026b00 con 0x7f5d100ab030 2024-09-14T10:44:29.014 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-14T10:44:28.649818Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.016+0000 7f5bdd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.016+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94671836558896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a813293d0 con 0x561a812f4c30 2024-09-14T10:44:29.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.016+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94671836558896] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.016+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94671836540880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a813293d0 con 0x7f5d100ab030 2024-09-14T10:44:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.016+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94671836540880] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.016+0000 7f5d294f99c0 20 remove_watcher() i=0 2024-09-14T10:44:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.016+0000 7f5d294f99c0 2 removed watcher, disabling cache 2024-09-14T10:44:29.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.016+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94671836545008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a812fefd0 con 0x561a812f4c30 2024-09-14T10:44:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94671836545008] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d294f99c0 20 remove_watcher() i=1 2024-09-14T10:44:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94671836546576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a813293d0 con 0x561a812fae80 2024-09-14T10:44:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d267fe640 1 -- 172.21.15.96:0/2754897264 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94671836546576] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d100f4070 con 0x561a812fae80 2024-09-14T10:44:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d294f99c0 20 remove_watcher() i=2 2024-09-14T10:44:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94671836552560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a812fefd0 con 0x7f5d100ab030 2024-09-14T10:44:29.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d27800640 1 -- 172.21.15.96:0/2754897264 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94671836552560] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d1802f040 con 0x7f5d100ab030 2024-09-14T10:44:29.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d294f99c0 20 remove_watcher() i=3 2024-09-14T10:44:29.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.020+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94671836551360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81300610 con 0x561a812f4c30 2024-09-14T10:44:29.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.024+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94671836551360] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x561a812f4c30 2024-09-14T10:44:29.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.024+0000 7f5d294f99c0 20 remove_watcher() i=4 2024-09-14T10:44:29.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.024+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94671836557328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a812fefd0 con 0x7f5d18019040 2024-09-14T10:44:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.024+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94671836557328] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.024+0000 7f5d294f99c0 20 remove_watcher() i=5 2024-09-14T10:44:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.024+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94671836560560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a813018c0 con 0x7f5d18019040 2024-09-14T10:44:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.028+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94671836560560] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.028+0000 7f5d294f99c0 20 remove_watcher() i=6 2024-09-14T10:44:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.028+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94671836564528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561a81300610 con 0x7f5d18019040 2024-09-14T10:44:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.028+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94671836564528] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d2001b040 con 0x7f5d18019040 2024-09-14T10:44:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.028+0000 7f5d294f99c0 20 remove_watcher() i=7 2024-09-14T10:44:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5d18019040 msgr2=0x7f5d18019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5d18019040 0x7f5d18019930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a812f4c30 msgr2=0x561a812f70f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a812f4c30 0x561a812f70f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5d100ab030 msgr2=0x7f5d100d58b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5d100ab030 0x7f5d100d58b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a812fae80 msgr2=0x561a812fd270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a812fae80 0x561a812fd270 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5bf003a1f0 msgr2=0x7f5bf003c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5bf003a1f0 0x7f5bf003c6b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800f010 tx=0x7f5d1801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 msgr2=0x561a812e96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/2754897264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812e3160 0x561a812e96d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5d100b6000 tx=0x7f5d100ebd60 comp rx=0 tx=0).stop 2024-09-14T10:44:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 reap_dead start 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d26fff640 1 -- 172.21.15.96:0/2754897264 reap_dead start 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 shutdown_connections 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 >> 172.21.15.96:0/2754897264 conn(0x561a812de580 msgr2=0x561a812dc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 shutdown_connections 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/2754897264 wait complete. 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3938950707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0003a190 msgr2=0x7f5c0003c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/3938950707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0003a190 0x7f5c0003c650 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x561a812c62a0 tx=0x7f5d18003070 comp rx=0 tx=0).stop 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3938950707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812d5910 msgr2=0x561a812d5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/3938950707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812d5910 0x561a812d5d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5d10000c10 tx=0x7f5d10018020 comp rx=0 tx=0).stop 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3938950707 shutdown_connections 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/3938950707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0003a190 0x7f5c0003c650 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/3938950707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a812d5910 0x561a812d5d30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3938950707 >> 172.21.15.96:0/3938950707 conn(0x561a812cb2c0 msgr2=0x561a812cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3938950707 shutdown_connections 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/3938950707 wait complete. 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a8113f810 msgr2=0x561a812c52f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a8113f810 0x561a812c52f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0c03a1a0 msgr2=0x7f5c0c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0c03a1a0 0x7f5c0c03c660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d100ad000 tx=0x7f5d100a5040 comp rx=0 tx=0).stop 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 msgr2=0x561a812be180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812be180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561a812b78e0 tx=0x7f5d20001260 comp rx=0 tx=0).stop 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 shutdown_connections 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a8113f810 0x561a812c52f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5c0c03a1a0 0x7f5c0c03c660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 --2- 172.21.15.96:0/152767465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a8113f2e0 0x561a812be180 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 >> 172.21.15.96:0/152767465 conn(0x561a811c4b00 msgr2=0x561a812b7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 shutdown_connections 2024-09-14T10:44:29.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.032+0000 7f5d294f99c0 1 -- 172.21.15.96:0/152767465 wait complete. 2024-09-14T10:44:29.038 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-14T10:44:28.649818Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:29.038 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-14T10:44:29.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-14T10:44:29.039 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-14T10:44:29.109 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:29.109 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a57e4c9c0 1 Processor -- start 2024-09-14T10:44:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a57e4c9c0 1 -- start start 2024-09-14T10:44:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a57e4c9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f7ac0b83a0 0x55f7ac0ba790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a57e4c9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7abf5a7a0 con 0x55f7ac0b4250 2024-09-14T10:44:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a57e4c9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55f7abfb61b0 con 0x55f7ac0b83a0 2024-09-14T10:44:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a55151640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f7ac0b83a0 0x55f7ac0ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a55151640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f7ac0b83a0 0x55f7ac0ba790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39364/0 (socket says 172.21.15.96:39364) 2024-09-14T10:44:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a55151640 1 -- 172.21.15.96:0/627664275 learned_addr learned my addr 172.21.15.96:0/627664275 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a55151640 1 -- 172.21.15.96:0/627664275 >> v1:172.21.15.70:6789/0 conn(0x55f7ac0b4250 legacy=0x55f7ac0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.112+0000 7f2a55151640 1 -- 172.21.15.96:0/627664275 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7abf34da0 con 0x55f7ac0b83a0 2024-09-14T10:44:29.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a55151640 1 --2- 172.21.15.96:0/627664275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac0ba790 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000a5c0 tx=0x7f2a4001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc76adddd56ea88 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a54950640 1 -- 172.21.15.96:0/627664275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400a9590 con 0x55f7ac0b83a0 2024-09-14T10:44:29.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a54950640 1 -- 172.21.15.96:0/627664275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400ae070 con 0x55f7ac0b83a0 2024-09-14T10:44:29.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a54950640 1 -- 172.21.15.96:0/627664275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400a9880 con 0x55f7ac0b83a0 2024-09-14T10:44:29.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/627664275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 msgr2=0x55f7ac0ba790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/627664275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac0ba790 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000a5c0 tx=0x7f2a4001b3d0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/627664275 shutdown_connections 2024-09-14T10:44:29.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/627664275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac0ba790 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/627664275 >> 172.21.15.96:0/627664275 conn(0x55f7ac027b60 msgr2=0x55f7ac027f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/627664275 shutdown_connections 2024-09-14T10:44:29.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.116+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/627664275 wait complete. 2024-09-14T10:44:29.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.128+0000 7f2a57e4c9c0 1 Processor -- start 2024-09-14T10:44:29.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.128+0000 7f2a57e4c9c0 1 -- start start 2024-09-14T10:44:29.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.128+0000 7f2a57e4c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b4250 0x55f7ac19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.128+0000 7f2a57e4c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7abfb9fc0 con 0x55f7ac0b4250 2024-09-14T10:44:29.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.128+0000 7f2a55952640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b4250 0x55f7ac19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.128+0000 7f2a55952640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b4250 0x55f7ac19f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39374/0 (socket says 172.21.15.96:39374) 2024-09-14T10:44:29.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.128+0000 7f2a55952640 1 -- 172.21.15.96:0/1607450773 learned_addr learned my addr 172.21.15.96:0/1607450773 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a55952640 1 -- 172.21.15.96:0/1607450773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac19fb90 con 0x55f7ac0b4250 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a55952640 1 --2- 172.21.15.96:0/1607450773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b4250 0x55f7ac19f5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001690 tx=0x7f2a50001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ac25af7d0c0809 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2943e07640 1 -- 172.21.15.96:0/1607450773 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a50016070 con 0x55f7ac0b4250 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2943e07640 1 -- 172.21.15.96:0/1607450773 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5000f640 con 0x55f7ac0b4250 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2943e07640 1 -- 172.21.15.96:0/1607450773 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a5000f960 con 0x55f7ac0b4250 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1607450773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b4250 msgr2=0x55f7ac19f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1607450773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b4250 0x55f7ac19f5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001690 tx=0x7f2a50001b50 comp rx=0 tx=0).stop 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1607450773 shutdown_connections 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1607450773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b4250 0x55f7ac19f5a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1607450773 >> 172.21.15.96:0/1607450773 conn(0x55f7ac027b60 msgr2=0x55f7ac19b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1607450773 shutdown_connections 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1607450773 wait complete. 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 Processor -- start 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- start start 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac1a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7abf5ba50 con 0x55f7ac0b83a0 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a55952640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac1a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a55952640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac1a71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39376/0 (socket says 172.21.15.96:39376) 2024-09-14T10:44:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a55952640 1 -- 172.21.15.96:0/4248805532 learned_addr learned my addr 172.21.15.96:0/4248805532 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a55952640 1 -- 172.21.15.96:0/4248805532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac1a7710 con 0x55f7ac0b83a0 2024-09-14T10:44:29.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a55952640 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac1a71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55f7ac1a0560 tx=0x7f2a50001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2942604640 1 -- 172.21.15.96:0/4248805532 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a50020070 con 0x55f7ac0b83a0 2024-09-14T10:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac1a79a0 con 0x55f7ac0b83a0 2024-09-14T10:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2942604640 1 -- 172.21.15.96:0/4248805532 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a50011570 con 0x55f7ac0b83a0 2024-09-14T10:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2942604640 1 -- 172.21.15.96:0/4248805532 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a50016040 con 0x55f7ac0b83a0 2024-09-14T10:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.132+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac1a8260 con 0x55f7ac0b83a0 2024-09-14T10:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2942604640 1 -- 172.21.15.96:0/4248805532 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2a50023070 con 0x55f7ac0b83a0 2024-09-14T10:44:29.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2942604640 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293c03a150 0x7f293c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2942604640 1 -- 172.21.15.96:0/4248805532 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2a50050290 con 0x55f7ac0b83a0 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a55151640 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293c03a150 0x7f293c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ac220 0x55f7ac1ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1aeb50 con 0x55f7ac1ac220 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a56153640 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ac220 0x55f7ac1ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a55151640 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293c03a150 0x7f293c03c610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ad000 tx=0x7f2a400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a56153640 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ac220 0x55f7ac1ae610 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a56153640 1 -- 172.21.15.96:0/4248805532 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a480083f0 con 0x55f7ac1ac220 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1aef80 con 0x55f7ac1ac220 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a56153640 1 -- 172.21.15.96:0/4248805532 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a480083f0 con 0x55f7ac1ac220 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1b0880 con 0x55f7ac1ac220 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a56153640 1 -- 172.21.15.96:0/4248805532 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a480083f0 con 0x55f7ac1ac220 2024-09-14T10:44:29.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1afab0 con 0x55f7ac1ac220 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a56153640 1 -- 172.21.15.96:0/4248805532 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a480083f0 con 0x55f7ac1ac220 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1afed0 con 0x55f7ac1ac220 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a56153640 1 -- 172.21.15.96:0/4248805532 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a480083f0 con 0x55f7ac1ac220 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 Processor -- start 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 -- start start 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1bec70 0x55f7ac1bf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a57e4c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7abfc6d80 con 0x55f7ac1bec70 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.136+0000 7f2a55151640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1bec70 0x55f7ac1bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a55151640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1bec70 0x55f7ac1bf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39384/0 (socket says 172.21.15.96:39384) 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a55151640 1 -- 172.21.15.96:0/1420908985 learned_addr learned my addr 172.21.15.96:0/1420908985 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a55151640 1 -- 172.21.15.96:0/1420908985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac1bf6d0 con 0x55f7ac1bec70 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a55151640 1 --2- 172.21.15.96:0/1420908985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1bec70 0x55f7ac1bf090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ab040 tx=0x7f2a40018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f293b7fe640 1 -- 172.21.15.96:0/1420908985 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400b3ba0 con 0x55f7ac1bec70 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f293b7fe640 1 -- 172.21.15.96:0/1420908985 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400b3d40 con 0x55f7ac1bec70 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f293b7fe640 1 -- 172.21.15.96:0/1420908985 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400c8580 con 0x55f7ac1bec70 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1420908985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac1bff30 con 0x55f7ac1bec70 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1420908985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac1c0440 con 0x55f7ac1bec70 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f293b7fe640 1 -- 172.21.15.96:0/1420908985 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2a400d1440 con 0x55f7ac1bec70 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f293b7fe640 1 --2- 172.21.15.96:0/1420908985 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293003a150 0x7f293003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f293b7fe640 1 -- 172.21.15.96:0/1420908985 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2a400ee6b0 con 0x55f7ac1bec70 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a56153640 1 --2- 172.21.15.96:0/1420908985 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293003a150 0x7f293003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a57e4c9c0 1 Processor -- start 2024-09-14T10:44:29.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a57e4c9c0 1 -- start start 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a56153640 1 --2- 172.21.15.96:0/1420908985 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293003a150 0x7f293003c610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55f7ac1afe50 tx=0x7f2a48003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a57e4c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a57e4c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac19ffc0 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a55151640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a55151640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39388/0 (socket says 172.21.15.96:39388) 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.140+0000 7f2a55151640 1 -- 172.21.15.96:0/1332072806 learned_addr learned my addr 172.21.15.96:0/1332072806 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a55151640 1 -- 172.21.15.96:0/1332072806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac1cceb0 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a55151640 1 --2- 172.21.15.96:0/1332072806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1cc8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ec9e0 tx=0x7f2a400c7a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445cb7cab4db0cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f29397fa640 1 -- 172.21.15.96:0/1332072806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400bccd0 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f29397fa640 1 -- 172.21.15.96:0/1332072806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400be410 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f29397fa640 1 -- 172.21.15.96:0/1332072806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400bc3b0 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1332072806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 msgr2=0x55f7ac1cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1332072806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1cc8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ec9e0 tx=0x7f2a400c7a10 comp rx=0 tx=0).stop 2024-09-14T10:44:29.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1332072806 shutdown_connections 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1332072806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1cc8c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1332072806 >> 172.21.15.96:0/1332072806 conn(0x55f7ac1c78e0 msgr2=0x55f7ac1c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1332072806 shutdown_connections 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1332072806 wait complete. 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 Processor -- start 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- start start 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac1cb410 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a55151640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a55151640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1d2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39392/0 (socket says 172.21.15.96:39392) 2024-09-14T10:44:29.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 learned_addr learned my addr 172.21.15.96:0/1477238991 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac1d2f70 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a55151640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1d2a10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a400c7b40 tx=0x7f2a400ec970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f29277fe640 1 -- 172.21.15.96:0/1477238991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400bc3b0 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac1d3200 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f29277fe640 1 -- 172.21.15.96:0/1477238991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400bc550 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f29277fe640 1 -- 172.21.15.96:0/1477238991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400bc870 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.144+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac1d3bb0 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f29277fe640 1 -- 172.21.15.96:0/1477238991 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2a400e6040 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f29277fe640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f292003a150 0x7f292003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f29277fe640 1 -- 172.21.15.96:0/1477238991 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2a400e3040 con 0x55f7ac1cc4c0 2024-09-14T10:44:29.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a56153640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f292003a150 0x7f292003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ddfe0 0x55f7ac1e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e0bf0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55952640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ddfe0 0x55f7ac1e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a56153640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f292003a150 0x7f292003c610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800f010 tx=0x7f2a4801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55952640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ddfe0 0x55f7ac1e04a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 realm 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e1000 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e18d0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e1c70 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e24c0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 20 searching for the correct realm 2024-09-14T10:44:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f7ac1e4230 0x55f7ac1e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55151640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f7ac1e4230 0x55f7ac1e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55151640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f7ac1e4230 0x55f7ac1e6620 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55151640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2a40009040 0x7f2a400dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a40009040 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.148+0000 7f2a56153640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2a40009040 0x7f2a400dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a56153640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2a40009040 0x7f2a400dfa80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a56153640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2a48019040 0x7f2a48019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2a48019040 0x7f2a48019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2a48019040 0x7f2a48019930 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a40009040 2024-09-14T10:44:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.152+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a40009040 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.156+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a40009040 2024-09-14T10:44:29.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a40009040 2024-09-14T10:44:29.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1e4230 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a48019040 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.160+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e6bb0 con 0x7f2a40009040 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:29.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e2e10 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e36b0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e36b0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 zone default found 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 4 Realm: () 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 zonegroup default 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e7030 con 0x7f2a48019040 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e8b20 con 0x55f7ac1e4230 2024-09-14T10:44:29.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e8f70 con 0x55f7ac1e4230 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 started sync module instance, tier type = 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e7ec0 con 0x7f2a40009040 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522232963760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e7b20 con 0x7f2a40009040 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e9ea0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.164+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522232963760] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.168+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.168+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522232968144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e9ea0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.168+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ea860 con 0x55f7ac1e4230 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.168+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.168+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522232972208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1eb0b0 con 0x55f7ac1e4230 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.168+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1eba70 con 0x7f2a40009040 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.168+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522232968144] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.172+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.172+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522232976832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1eb9e0 con 0x7f2a40009040 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.172+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ec930 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.172+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522232972208] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.172+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522232976832] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.172+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.172+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522232979040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ec480 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.172+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1eccd0 con 0x7f2a48019040 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.176+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522232979040] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.176+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.176+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522232980608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ed0c0 con 0x7f2a48019040 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.176+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ed910 con 0x7f2a48019040 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.176+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.176+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522232983744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1eda30 con 0x7f2a48019040 2024-09-14T10:44:29.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.176+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ee530 con 0x7f2a48019040 2024-09-14T10:44:29.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.176+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522232980608] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522232983744] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522232984800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ec8a0 con 0x7f2a48019040 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 20 add_watcher() i=0 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 20 add_watcher() i=1 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 20 add_watcher() i=2 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 20 add_watcher() i=3 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 20 add_watcher() i=4 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 20 add_watcher() i=5 2024-09-14T10:44:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 20 add_watcher() i=6 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522232984800] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 20 add_watcher() i=7 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1f1520 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.180+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522232987680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ee9a0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522232987680] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f29077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 5 note: GC not initialized 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f29067fc640 20 reqs_thread_entry: start 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 20 Filter name: none 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2877fff640 20 reqs_thread_entry: start 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac214bc0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 20 rados_obj.operate() r=0 bl.length=582 2024-09-14T10:44:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:29.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:29.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac21b620 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94522233172112 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac216fe0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94522232979040 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55f7ac1a8260 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f29397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94522232979040 notifier 4410 bl.length()=732 2024-09-14T10:44:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f29397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f29397fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(64 notify.4 [notify cookie 94522233172112 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f29397fa640 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2918003eb0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.184+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94522233172112 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7ac1a79a0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.186 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-14T10:44:28.649818Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:29.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.188+0000 7f29077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.188+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522232987680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac212790 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.188+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94522232987680] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.188+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522232963760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac212790 con 0x7f2a40009040 2024-09-14T10:44:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.188+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94522232963760] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.188+0000 7f2a57e4c9c0 20 remove_watcher() i=0 2024-09-14T10:44:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.188+0000 7f2a57e4c9c0 2 removed watcher, disabling cache 2024-09-14T10:44:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.188+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522232968144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e82b0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94522232968144] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a57e4c9c0 20 remove_watcher() i=1 2024-09-14T10:44:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522232972208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac212790 con 0x55f7ac1e4230 2024-09-14T10:44:29.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a55151640 1 -- 172.21.15.96:0/1477238991 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94522232972208] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a400ce020 con 0x55f7ac1e4230 2024-09-14T10:44:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a57e4c9c0 20 remove_watcher() i=2 2024-09-14T10:44:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522232976832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e82b0 con 0x7f2a40009040 2024-09-14T10:44:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a56153640 1 -- 172.21.15.96:0/1477238991 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94522232976832] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a4802f040 con 0x7f2a40009040 2024-09-14T10:44:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a57e4c9c0 20 remove_watcher() i=3 2024-09-14T10:44:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.192+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522232979040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ea3b0 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.196+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94522232979040] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x55f7ac1ddfe0 2024-09-14T10:44:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.196+0000 7f2a57e4c9c0 20 remove_watcher() i=4 2024-09-14T10:44:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.196+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522232980608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1eb5c0 con 0x7f2a48019040 2024-09-14T10:44:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.196+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94522232980608] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.196+0000 7f2a57e4c9c0 20 remove_watcher() i=5 2024-09-14T10:44:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.196+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522232983744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1e82b0 con 0x7f2a48019040 2024-09-14T10:44:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.200+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94522232983744] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.200+0000 7f2a57e4c9c0 20 remove_watcher() i=6 2024-09-14T10:44:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.200+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522232984800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac1ea3b0 con 0x7f2a48019040 2024-09-14T10:44:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94522232984800] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002c070 con 0x7f2a48019040 2024-09-14T10:44:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 20 remove_watcher() i=7 2024-09-14T10:44:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2a48019040 msgr2=0x7f2a48019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2a48019040 0x7f2a48019930 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ddfe0 msgr2=0x55f7ac1e04a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ddfe0 0x55f7ac1e04a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2a40009040 msgr2=0x7f2a400dfa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2a40009040 0x7f2a400dfa80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f7ac1e4230 msgr2=0x55f7ac1e6620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f7ac1e4230 0x55f7ac1e6620 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f292003a150 msgr2=0x7f292003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f292003a150 0x7f292003c610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800f010 tx=0x7f2a4801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 msgr2=0x55f7ac1d2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a55952640 1 -- 172.21.15.96:0/1477238991 reap_dead start 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1d2a10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a400c7b40 tx=0x7f2a400ec970 comp rx=0 tx=0).stop 2024-09-14T10:44:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 shutdown_connections 2024-09-14T10:44:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1477238991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1cc4c0 0x55f7ac1d2a10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 >> 172.21.15.96:0/1477238991 conn(0x55f7ac1c78e0 msgr2=0x55f7ac1c5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 shutdown_connections 2024-09-14T10:44:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1477238991 wait complete. 2024-09-14T10:44:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1420908985 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293003a150 msgr2=0x7f293003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1420908985 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293003a150 0x7f293003c610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55f7ac1afe50 tx=0x7f2a48003070 comp rx=0 tx=0).stop 2024-09-14T10:44:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1420908985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1bec70 msgr2=0x55f7ac1bf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1420908985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1bec70 0x55f7ac1bf090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ab040 tx=0x7f2a40018170 comp rx=0 tx=0).stop 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1420908985 shutdown_connections 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1420908985 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293003a150 0x7f293003c610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/1420908985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac1bec70 0x55f7ac1bf090 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1420908985 >> 172.21.15.96:0/1420908985 conn(0x55f7ac1b4620 msgr2=0x55f7ac1b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1420908985 shutdown_connections 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/1420908985 wait complete. 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ac220 msgr2=0x55f7ac1ae610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ac220 0x55f7ac1ae610 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293c03a150 msgr2=0x7f293c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293c03a150 0x7f293c03c610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ad000 tx=0x7f2a400a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 msgr2=0x55f7ac1a71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac1a71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55f7ac1a0560 tx=0x7f2a50001260 comp rx=0 tx=0).stop 2024-09-14T10:44:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 shutdown_connections 2024-09-14T10:44:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f7ac1ac220 0x55f7ac1ae610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f293c03a150 0x7f293c03c610 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 --2- 172.21.15.96:0/4248805532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7ac0b83a0 0x55f7ac1a71b0 secure :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55f7ac1a0560 tx=0x7f2a50001260 comp rx=0 tx=0).stop 2024-09-14T10:44:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 >> 172.21.15.96:0/4248805532 conn(0x55f7ac027b60 msgr2=0x55f7ac1a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 shutdown_connections 2024-09-14T10:44:29.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.204+0000 7f2a57e4c9c0 1 -- 172.21.15.96:0/4248805532 wait complete. 2024-09-14T10:44:29.211 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-14T10:44:28.649818Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:29.212 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-14T10:44:29.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-14T10:44:29.212 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-14T10:44:29.294 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:29.294 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:29.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.296+0000 7f1e14b0d9c0 1 Processor -- start 2024-09-14T10:44:29.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.296+0000 7f1e14b0d9c0 1 -- start start 2024-09-14T10:44:29.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.296+0000 7f1e14b0d9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56388b810fe0 0x56388b8133d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.296+0000 7f1e14b0d9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56388b6b67a0 con 0x56388b80cdf0 2024-09-14T10:44:29.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.296+0000 7f1e14b0d9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x56388b7121b0 con 0x56388b810fe0 2024-09-14T10:44:29.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.296+0000 7f1e11e12640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56388b810fe0 0x56388b8133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.296+0000 7f1e11e12640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56388b810fe0 0x56388b8133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39394/0 (socket says 172.21.15.96:39394) 2024-09-14T10:44:29.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.296+0000 7f1e11e12640 1 -- 172.21.15.96:0/1141308154 learned_addr learned my addr 172.21.15.96:0/1141308154 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e11e12640 1 -- 172.21.15.96:0/1141308154 >> v1:172.21.15.70:6789/0 conn(0x56388b80cdf0 legacy=0x56388b80d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e11e12640 1 -- 172.21.15.96:0/1141308154 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388b690da0 con 0x56388b810fe0 2024-09-14T10:44:29.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e11e12640 1 --2- 172.21.15.96:0/1141308154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b810fe0 0x56388b8133d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800a5c0 tx=0x7f1e0801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99798af98f424197 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e11611640 1 -- 172.21.15.96:0/1141308154 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e080a9590 con 0x56388b810fe0 2024-09-14T10:44:29.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e11611640 1 -- 172.21.15.96:0/1141308154 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e080ae070 con 0x56388b810fe0 2024-09-14T10:44:29.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e11611640 1 -- 172.21.15.96:0/1141308154 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e080a9880 con 0x56388b810fe0 2024-09-14T10:44:29.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1141308154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b810fe0 msgr2=0x56388b8133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/1141308154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b810fe0 0x56388b8133d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800a5c0 tx=0x7f1e0801b3d0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1141308154 shutdown_connections 2024-09-14T10:44:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/1141308154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b810fe0 0x56388b8133d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1141308154 >> 172.21.15.96:0/1141308154 conn(0x56388b808910 msgr2=0x56388b80ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1141308154 shutdown_connections 2024-09-14T10:44:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.300+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1141308154 wait complete. 2024-09-14T10:44:29.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.316+0000 7f1e14b0d9c0 1 Processor -- start 2024-09-14T10:44:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.316+0000 7f1e14b0d9c0 1 -- start start 2024-09-14T10:44:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.316+0000 7f1e14b0d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b8f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.316+0000 7f1e14b0d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56388b715fc0 con 0x56388b80cdf0 2024-09-14T10:44:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.316+0000 7f1e12613640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b8f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.316+0000 7f1e12613640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b8f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39396/0 (socket says 172.21.15.96:39396) 2024-09-14T10:44:29.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.316+0000 7f1e12613640 1 -- 172.21.15.96:0/1242805494 learned_addr learned my addr 172.21.15.96:0/1242805494 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e12613640 1 -- 172.21.15.96:0/1242805494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388b8f5680 con 0x56388b80cdf0 2024-09-14T10:44:29.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e12613640 1 --2- 172.21.15.96:0/1242805494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b8f5090 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00b220 tx=0x7f1e0c00b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52df2f6529c5bdcc server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1d00608640 1 -- 172.21.15.96:0/1242805494 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0c00a040 con 0x56388b80cdf0 2024-09-14T10:44:29.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1d00608640 1 -- 172.21.15.96:0/1242805494 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00f750 con 0x56388b80cdf0 2024-09-14T10:44:29.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1d00608640 1 -- 172.21.15.96:0/1242805494 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0c00fa70 con 0x56388b80cdf0 2024-09-14T10:44:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1242805494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 msgr2=0x56388b8f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/1242805494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b8f5090 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00b220 tx=0x7f1e0c00b6e0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1242805494 shutdown_connections 2024-09-14T10:44:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/1242805494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b8f5090 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1242805494 >> 172.21.15.96:0/1242805494 conn(0x56388b808910 msgr2=0x56388b782020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1242805494 shutdown_connections 2024-09-14T10:44:29.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1242805494 wait complete. 2024-09-14T10:44:29.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 Processor -- start 2024-09-14T10:44:29.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 -- start start 2024-09-14T10:44:29.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b9072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e14b0d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56388b6b7a50 con 0x56388b80cdf0 2024-09-14T10:44:29.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e12613640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b9072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e12613640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b9072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39406/0 (socket says 172.21.15.96:39406) 2024-09-14T10:44:29.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e12613640 1 -- 172.21.15.96:0/3071739533 learned_addr learned my addr 172.21.15.96:0/3071739533 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.320+0000 7f1e12613640 1 -- 172.21.15.96:0/3071739533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388b907820 con 0x56388b80cdf0 2024-09-14T10:44:29.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e12613640 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b9072c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x56388b8f4bf0 tx=0x7f1e0c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1cfee05640 1 -- 172.21.15.96:0/3071739533 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0c01a880 con 0x56388b80cdf0 2024-09-14T10:44:29.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1cfee05640 1 -- 172.21.15.96:0/3071739533 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0c01aa20 con 0x56388b80cdf0 2024-09-14T10:44:29.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1cfee05640 1 -- 172.21.15.96:0/3071739533 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e0c01ad00 con 0x56388b80cdf0 2024-09-14T10:44:29.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56388b907ab0 con 0x56388b80cdf0 2024-09-14T10:44:29.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388b908460 con 0x56388b80cdf0 2024-09-14T10:44:29.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1cfee05640 1 -- 172.21.15.96:0/3071739533 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1e0c017050 con 0x56388b80cdf0 2024-09-14T10:44:29.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1cfee05640 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cf803a1f0 0x7f1cf803c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1cfee05640 1 -- 172.21.15.96:0/3071739533 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1e0c015020 con 0x56388b80cdf0 2024-09-14T10:44:29.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b810fe0 0x56388b90e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b90e970 con 0x56388b810fe0 2024-09-14T10:44:29.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e11e12640 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cf803a1f0 0x7f1cf803c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e12e14640 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b810fe0 0x56388b90e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e12e14640 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b810fe0 0x56388b90e430 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e11e12640 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cf803a1f0 0x7f1cf803c6b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e080ad000 tx=0x7f1e080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e12e14640 1 -- 172.21.15.96:0/3071739533 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0400a4d0 con 0x56388b810fe0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b90ed50 con 0x56388b810fe0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e12e14640 1 -- 172.21.15.96:0/3071739533 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e0400a4d0 con 0x56388b810fe0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b910620 con 0x56388b810fe0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e12e14640 1 -- 172.21.15.96:0/3071739533 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e0400a4d0 con 0x56388b810fe0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b90f850 con 0x56388b810fe0 2024-09-14T10:44:29.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e12e14640 1 -- 172.21.15.96:0/3071739533 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e0400a4d0 con 0x56388b810fe0 2024-09-14T10:44:29.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.324+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b90fbf0 con 0x56388b810fe0 2024-09-14T10:44:29.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e12e14640 1 -- 172.21.15.96:0/3071739533 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e0400a4d0 con 0x56388b810fe0 2024-09-14T10:44:29.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e14b0d9c0 1 Processor -- start 2024-09-14T10:44:29.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e14b0d9c0 1 -- start start 2024-09-14T10:44:29.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e14b0d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b91e9e0 0x56388b91ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e14b0d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56388b722d80 con 0x56388b91e9e0 2024-09-14T10:44:29.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e11e12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b91e9e0 0x56388b91ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e11e12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b91e9e0 0x56388b91ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39422/0 (socket says 172.21.15.96:39422) 2024-09-14T10:44:29.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e11e12640 1 -- 172.21.15.96:0/424355811 learned_addr learned my addr 172.21.15.96:0/424355811 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e11e12640 1 -- 172.21.15.96:0/424355811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388b91f440 con 0x56388b91e9e0 2024-09-14T10:44:29.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e11e12640 1 --2- 172.21.15.96:0/424355811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b91e9e0 0x56388b91ee00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e08017fe0 tx=0x7f1e08018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1cf7fff640 1 -- 172.21.15.96:0/424355811 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e080b3ba0 con 0x56388b91e9e0 2024-09-14T10:44:29.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1cf7fff640 1 -- 172.21.15.96:0/424355811 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e080b3d40 con 0x56388b91e9e0 2024-09-14T10:44:29.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/424355811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56388b91fca0 con 0x56388b91e9e0 2024-09-14T10:44:29.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1cf7fff640 1 -- 172.21.15.96:0/424355811 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e080c8580 con 0x56388b91e9e0 2024-09-14T10:44:29.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.328+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/424355811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388b9201b0 con 0x56388b91e9e0 2024-09-14T10:44:29.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1cf7fff640 1 -- 172.21.15.96:0/424355811 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1e080d1440 con 0x56388b91e9e0 2024-09-14T10:44:29.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1cf7fff640 1 --2- 172.21.15.96:0/424355811 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cec03a0e0 0x7f1cec03c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1cf7fff640 1 -- 172.21.15.96:0/424355811 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1e080ee5a0 con 0x56388b91e9e0 2024-09-14T10:44:29.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e12e14640 1 --2- 172.21.15.96:0/424355811 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cec03a0e0 0x7f1cec03c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 Processor -- start 2024-09-14T10:44:29.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- start start 2024-09-14T10:44:29.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e12e14640 1 --2- 172.21.15.96:0/424355811 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cec03a0e0 0x7f1cec03c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x56388b90f370 tx=0x7f1e04005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b92c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56388b8f3990 con 0x56388b92c230 2024-09-14T10:44:29.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e11e12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b92c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e11e12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b92c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39428/0 (socket says 172.21.15.96:39428) 2024-09-14T10:44:29.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e11e12640 1 -- 172.21.15.96:0/1016018402 learned_addr learned my addr 172.21.15.96:0/1016018402 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e11e12640 1 -- 172.21.15.96:0/1016018402 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388b92cc20 con 0x56388b92c230 2024-09-14T10:44:29.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e11e12640 1 --2- 172.21.15.96:0/1016018402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b92c630 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e080c7660 tx=0x7f1e080c73d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc1201c9948c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1cf5ffb640 1 -- 172.21.15.96:0/1016018402 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e080bc3b0 con 0x56388b92c230 2024-09-14T10:44:29.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1cf5ffb640 1 -- 172.21.15.96:0/1016018402 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e080bcca0 con 0x56388b92c230 2024-09-14T10:44:29.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1cf5ffb640 1 -- 172.21.15.96:0/1016018402 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e080bc550 con 0x56388b92c230 2024-09-14T10:44:29.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1016018402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 msgr2=0x56388b92c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/1016018402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b92c630 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1e080c7660 tx=0x7f1e080c73d0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1016018402 shutdown_connections 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/1016018402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b92c630 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1016018402 >> 172.21.15.96:0/1016018402 conn(0x56388b927650 msgr2=0x56388b925890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1016018402 shutdown_connections 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/1016018402 wait complete. 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 Processor -- start 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- start start 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b932780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e14b0d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56388b92b180 con 0x56388b92c230 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e11e12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b932780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e11e12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b932780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39432/0 (socket says 172.21.15.96:39432) 2024-09-14T10:44:29.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.332+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 learned_addr learned my addr 172.21.15.96:0/2670798505 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388b932ce0 con 0x56388b92c230 2024-09-14T10:44:29.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e11e12640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b932780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1e080c7660 tx=0x7f1e080ec920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1ce3fff640 1 -- 172.21.15.96:0/2670798505 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e080f4070 con 0x56388b92c230 2024-09-14T10:44:29.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56388b932f70 con 0x56388b92c230 2024-09-14T10:44:29.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388b933920 con 0x56388b92c230 2024-09-14T10:44:29.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1ce3fff640 1 -- 172.21.15.96:0/2670798505 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e080ee2e0 con 0x56388b92c230 2024-09-14T10:44:29.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1ce3fff640 1 -- 172.21.15.96:0/2670798505 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e080ecc00 con 0x56388b92c230 2024-09-14T10:44:29.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1ce3fff640 1 -- 172.21.15.96:0/2670798505 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1e080f7070 con 0x56388b92c230 2024-09-14T10:44:29.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1ce3fff640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cdc03a1a0 0x7f1cdc03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1ce3fff640 1 -- 172.21.15.96:0/2670798505 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1e080e3040 con 0x56388b92c230 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e12e14640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cdc03a1a0 0x7f1cdc03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b93dd80 0x56388b940210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b940960 con 0x56388b93dd80 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e12613640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b93dd80 0x56388b940210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e12e14640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cdc03a1a0 0x7f1cdc03c660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x56388b9093e0 tx=0x7f1e0401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e12613640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b93dd80 0x56388b940210 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 20 realm 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.336+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b940d70 con 0x56388b93dd80 2024-09-14T10:44:29.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b941640 con 0x56388b93dd80 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b9419e0 con 0x56388b93dd80 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b942230 con 0x56388b93dd80 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 20 searching for the correct realm 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56388b943fa0 0x56388b946390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e11e12640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56388b943fa0 0x56388b946390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e11e12640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56388b943fa0 0x56388b946390 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e11e12640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1e080f9060 0x7f1e080ee940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e080f9060 2024-09-14T10:44:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12e14640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1e080f9060 0x7f1e080ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12e14640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1e080f9060 0x7f1e080ee940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0401f070 con 0x7f1e080f9060 2024-09-14T10:44:29.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12e14640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1e04031040 0x7f1e04032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12613640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1e04031040 0x7f1e04032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12613640 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1e04031040 0x7f1e04032940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.340+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b93dd80 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b93dd80 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e080f9060 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0401f070 con 0x7f1e080f9060 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b93dd80 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b93dd80 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e080f9060 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e0401f070 con 0x7f1e080f9060 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.344+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b93dd80 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b93dd80 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e080f9060 2024-09-14T10:44:29.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0401f070 con 0x7f1e080f9060 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b93dd80 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.348+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e080f9060 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0401f070 con 0x7f1e080f9060 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b943fa0 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e04031040 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x56388b93dd80 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56388b9468d0 con 0x7f1e080f9060 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e0401f070 con 0x7f1e080f9060 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:29.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b942bb0 con 0x56388b93dd80 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b943450 con 0x56388b93dd80 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b943450 con 0x56388b93dd80 2024-09-14T10:44:29.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 zone default found 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 4 Realm: () 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 zonegroup default 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b946d50 con 0x7f1e04031040 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b948840 con 0x56388b943fa0 2024-09-14T10:44:29.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b948cd0 con 0x56388b943fa0 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 started sync module instance, tier type = 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.352+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b947be0 con 0x7f1e080f9060 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.356+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.356+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94800859922384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b947840 con 0x7f1e080f9060 2024-09-14T10:44:29.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.356+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b949c00 con 0x56388b93dd80 2024-09-14T10:44:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.356+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94800859922384] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.356+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.356+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94800859926832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b949c00 con 0x56388b93dd80 2024-09-14T10:44:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.356+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94a5c0 con 0x56388b943fa0 2024-09-14T10:44:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94800859926832] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94800859928400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b949b70 con 0x56388b943fa0 2024-09-14T10:44:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94b2c0 con 0x7f1e080f9060 2024-09-14T10:44:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94800859934496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94b9f0 con 0x7f1e080f9060 2024-09-14T10:44:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94c510 con 0x56388b93dd80 2024-09-14T10:44:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94800859928400] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.360+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94800859934496] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.364+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.364+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94800859938784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94c4d0 con 0x56388b93dd80 2024-09-14T10:44:29.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.364+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94cdb0 con 0x7f1e04031040 2024-09-14T10:44:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.364+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94800859938784] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.364+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.364+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94800859933024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94c4d0 con 0x7f1e04031040 2024-09-14T10:44:29.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.364+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94d250 con 0x7f1e04031040 2024-09-14T10:44:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.368+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94800859933024] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.368+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.368+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94800859941040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94d180 con 0x7f1e04031040 2024-09-14T10:44:29.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.368+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94dc70 con 0x7f1e04031040 2024-09-14T10:44:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94800859941040] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94800859944768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94de50 con 0x7f1e04031040 2024-09-14T10:44:29.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 add_watcher() i=0 2024-09-14T10:44:29.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 add_watcher() i=1 2024-09-14T10:44:29.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 add_watcher() i=2 2024-09-14T10:44:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 add_watcher() i=3 2024-09-14T10:44:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 add_watcher() i=4 2024-09-14T10:44:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 add_watcher() i=5 2024-09-14T10:44:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 add_watcher() i=6 2024-09-14T10:44:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94800859944768] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 add_watcher() i=7 2024-09-14T10:44:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b951220 con 0x56388b93dd80 2024-09-14T10:44:29.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94800859946304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b94e610 con 0x56388b93dd80 2024-09-14T10:44:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94800859946304] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1cc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.372+0000 7f1e14b0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 5 note: GC not initialized 2024-09-14T10:44:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1c437fe640 20 reqs_thread_entry: start 2024-09-14T10:44:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 20 Filter name: none 2024-09-14T10:44:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1c417fa640 20 reqs_thread_entry: start 2024-09-14T10:44:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b974850 con 0x56388b93dd80 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b97b250 con 0x56388b93dd80 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94800860130560 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b976980 con 0x56388b93dd80 2024-09-14T10:44:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94800859938784 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f1e0c05c040 con 0x56388b93dd80 2024-09-14T10:44:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1cf5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94800859938784 notifier 4417 bl.length()=567 2024-09-14T10:44:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1cf5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1cf5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(64 notify.4 [notify cookie 94800860130560 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1cf5ffb640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1cd8003eb0 con 0x56388b93dd80 2024-09-14T10:44:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94800860130560 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56388b908460 con 0x56388b93dd80 2024-09-14T10:44:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.376+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b97ad00 con 0x7f1e080f9060 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1e14b0d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94800860130560 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56388b9764d0 con 0x7f1e080f9060 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== watch-notify(notify (1) cookie 94800859922384 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f1e040247b0 con 0x7f1e080f9060 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1cf5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94800859922384 notifier 4417 bl.length()=159 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [notify cookie 94800860130560 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1cf5ffb640 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1cd8003eb0 con 0x7f1e080f9060 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== watch-notify(notify_complete (2) cookie 94800860130560 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e04024980 con 0x7f1e080f9060 2024-09-14T10:44:29.378 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:29.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1cc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.380+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94800859946304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b976980 con 0x56388b93dd80 2024-09-14T10:44:29.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94800859946304] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94800859922384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b976980 con 0x7f1e080f9060 2024-09-14T10:44:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94800859922384] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e14b0d9c0 20 remove_watcher() i=0 2024-09-14T10:44:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e14b0d9c0 2 removed watcher, disabling cache 2024-09-14T10:44:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94800859926832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b976980 con 0x56388b93dd80 2024-09-14T10:44:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94800859926832] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e14b0d9c0 20 remove_watcher() i=1 2024-09-14T10:44:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.384+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94800859928400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b976980 con 0x56388b943fa0 2024-09-14T10:44:29.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e11e12640 1 -- 172.21.15.96:0/2670798505 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94800859928400] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e080f6030 con 0x56388b943fa0 2024-09-14T10:44:29.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e14b0d9c0 20 remove_watcher() i=2 2024-09-14T10:44:29.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94800859934496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b947fd0 con 0x7f1e080f9060 2024-09-14T10:44:29.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e12e14640 1 -- 172.21.15.96:0/2670798505 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94800859934496] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e04040040 con 0x7f1e080f9060 2024-09-14T10:44:29.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e14b0d9c0 20 remove_watcher() i=3 2024-09-14T10:44:29.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94800859938784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b949130 con 0x56388b93dd80 2024-09-14T10:44:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94800859938784] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x56388b93dd80 2024-09-14T10:44:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e14b0d9c0 20 remove_watcher() i=4 2024-09-14T10:44:29.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.388+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94800859933024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b949750 con 0x7f1e04031040 2024-09-14T10:44:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.392+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94800859933024] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.392+0000 7f1e14b0d9c0 20 remove_watcher() i=5 2024-09-14T10:44:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.392+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94800859941040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b947fd0 con 0x7f1e04031040 2024-09-14T10:44:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.392+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94800859941040] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.392+0000 7f1e14b0d9c0 20 remove_watcher() i=6 2024-09-14T10:44:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.392+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94800859944768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56388b949130 con 0x7f1e04031040 2024-09-14T10:44:29.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94800859944768] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e0c02e070 con 0x7f1e04031040 2024-09-14T10:44:29.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 20 remove_watcher() i=7 2024-09-14T10:44:29.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1e04031040 msgr2=0x7f1e04032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1e04031040 0x7f1e04032940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b93dd80 msgr2=0x56388b940210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b93dd80 0x56388b940210 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1e080f9060 msgr2=0x7f1e080ee940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1e080f9060 0x7f1e080ee940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56388b943fa0 msgr2=0x56388b946390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56388b943fa0 0x56388b946390 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cdc03a1a0 msgr2=0x7f1cdc03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cdc03a1a0 0x7f1cdc03c660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x56388b9093e0 tx=0x7f1e0401f000 comp rx=0 tx=0).stop 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e12613640 1 -- 172.21.15.96:0/2670798505 reap_dead start 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 msgr2=0x56388b932780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b932780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1e080c7660 tx=0x7f1e080ec920 comp rx=0 tx=0).stop 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 shutdown_connections 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/2670798505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b92c230 0x56388b932780 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 >> 172.21.15.96:0/2670798505 conn(0x56388b927650 msgr2=0x56388b925860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 shutdown_connections 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/2670798505 wait complete. 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/424355811 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cec03a0e0 msgr2=0x7f1cec03c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/424355811 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cec03a0e0 0x7f1cec03c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x56388b90f370 tx=0x7f1e04005850 comp rx=0 tx=0).stop 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/424355811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b91e9e0 msgr2=0x56388b91ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/424355811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b91e9e0 0x56388b91ee00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1e08017fe0 tx=0x7f1e08018170 comp rx=0 tx=0).stop 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/424355811 shutdown_connections 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/424355811 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cec03a0e0 0x7f1cec03c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/424355811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b91e9e0 0x56388b91ee00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/424355811 >> 172.21.15.96:0/424355811 conn(0x56388b914390 msgr2=0x56388b914770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/424355811 shutdown_connections 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/424355811 wait complete. 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b810fe0 msgr2=0x56388b90e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b810fe0 0x56388b90e430 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cf803a1f0 msgr2=0x7f1cf803c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cf803a1f0 0x7f1cf803c6b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e080ad000 tx=0x7f1e080a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 msgr2=0x56388b9072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b9072c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x56388b8f4bf0 tx=0x7f1e0c000bd0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 shutdown_connections 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56388b810fe0 0x56388b90e430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1cf803a1f0 0x7f1cf803c6b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 --2- 172.21.15.96:0/3071739533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56388b80cdf0 0x56388b9072c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 >> 172.21.15.96:0/3071739533 conn(0x56388b808910 msgr2=0x56388b781b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 shutdown_connections 2024-09-14T10:44:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.396+0000 7f1e14b0d9c0 1 -- 172.21.15.96:0/3071739533 wait complete. 2024-09-14T10:44:29.403 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:29.404 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-14T10:44:29.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-14T10:44:29.404 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-14T10:44:29.473 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:29.474 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:29.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f30727b29c0 1 Processor -- start 2024-09-14T10:44:29.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f30727b29c0 1 -- start start 2024-09-14T10:44:29.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f30727b29c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559d7a3e63a0 0x559d7a3e8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f30727b29c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d7a2887a0 con 0x559d7a3e2250 2024-09-14T10:44:29.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f30727b29c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x559d7a2e41b0 con 0x559d7a3e63a0 2024-09-14T10:44:29.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f306fab7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559d7a3e63a0 0x559d7a3e8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f306fab7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559d7a3e63a0 0x559d7a3e8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39446/0 (socket says 172.21.15.96:39446) 2024-09-14T10:44:29.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f30702b8640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x559d7a3e2250 0x559d7a3e2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34400/0 (socket says 172.21.15.96:34400) 2024-09-14T10:44:29.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.476+0000 7f306fab7640 1 -- 172.21.15.96:0/3187039391 learned_addr learned my addr 172.21.15.96:0/3187039391 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f306fab7640 1 -- 172.21.15.96:0/3187039391 >> v1:172.21.15.70:6789/0 conn(0x559d7a3e2250 legacy=0x559d7a3e2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f306fab7640 1 -- 172.21.15.96:0/3187039391 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7a262da0 con 0x559d7a3e63a0 2024-09-14T10:44:29.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f306fab7640 1 --2- 172.21.15.96:0/3187039391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e63a0 0x559d7a3e8790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f305800a4e0 tx=0x7f305801b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb4e713128c44e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f306f2b6640 1 -- 172.21.15.96:0/3187039391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30580aa540 con 0x559d7a3e63a0 2024-09-14T10:44:29.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f306f2b6640 1 -- 172.21.15.96:0/3187039391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30580aa6e0 con 0x559d7a3e63a0 2024-09-14T10:44:29.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f306f2b6640 1 -- 172.21.15.96:0/3187039391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30580aaa40 con 0x559d7a3e63a0 2024-09-14T10:44:29.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f30727b29c0 1 -- 172.21.15.96:0/3187039391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e63a0 msgr2=0x559d7a3e8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f30727b29c0 1 --2- 172.21.15.96:0/3187039391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e63a0 0x559d7a3e8790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f305800a4e0 tx=0x7f305801b120 comp rx=0 tx=0).stop 2024-09-14T10:44:29.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f30727b29c0 1 -- 172.21.15.96:0/3187039391 shutdown_connections 2024-09-14T10:44:29.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f30727b29c0 1 --2- 172.21.15.96:0/3187039391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e63a0 0x559d7a3e8790 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f30727b29c0 1 -- 172.21.15.96:0/3187039391 >> 172.21.15.96:0/3187039391 conn(0x559d7a355b60 msgr2=0x559d7a355f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f30727b29c0 1 -- 172.21.15.96:0/3187039391 shutdown_connections 2024-09-14T10:44:29.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.480+0000 7f30727b29c0 1 -- 172.21.15.96:0/3187039391 wait complete. 2024-09-14T10:44:29.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.492+0000 7f30727b29c0 1 Processor -- start 2024-09-14T10:44:29.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.492+0000 7f30727b29c0 1 -- start start 2024-09-14T10:44:29.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.492+0000 7f30727b29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.492+0000 7f30727b29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d7a2e7fc0 con 0x559d7a3e2250 2024-09-14T10:44:29.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39462/0 (socket says 172.21.15.96:39462) 2024-09-14T10:44:29.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 -- 172.21.15.96:0/1851981728 learned_addr learned my addr 172.21.15.96:0/1851981728 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 -- 172.21.15.96:0/1851981728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7a4cdb90 con 0x559d7a3e2250 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 --2- 172.21.15.96:0/1851981728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4cd5a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3060001ec0 tx=0x7f306000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933b04a7c273b321 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f2f5e60c640 1 -- 172.21.15.96:0/1851981728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306000e5d0 con 0x559d7a3e2250 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f2f5e60c640 1 -- 172.21.15.96:0/1851981728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306000e770 con 0x559d7a3e2250 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f2f5e60c640 1 -- 172.21.15.96:0/1851981728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306000ea70 con 0x559d7a3e2250 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 -- 172.21.15.96:0/1851981728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 msgr2=0x559d7a4cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 --2- 172.21.15.96:0/1851981728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4cd5a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3060001ec0 tx=0x7f306000b6d0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 -- 172.21.15.96:0/1851981728 shutdown_connections 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 --2- 172.21.15.96:0/1851981728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4cd5a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 -- 172.21.15.96:0/1851981728 >> 172.21.15.96:0/1851981728 conn(0x559d7a355b60 msgr2=0x559d7a4c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 -- 172.21.15.96:0/1851981728 shutdown_connections 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 -- 172.21.15.96:0/1851981728 wait complete. 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 Processor -- start 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 -- start start 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30727b29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d7a289a50 con 0x559d7a3e2250 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4d4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39470/0 (socket says 172.21.15.96:39470) 2024-09-14T10:44:29.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 -- 172.21.15.96:0/4237191076 learned_addr learned my addr 172.21.15.96:0/4237191076 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 -- 172.21.15.96:0/4237191076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7a4d5400 con 0x559d7a3e2250 2024-09-14T10:44:29.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.496+0000 7f30702b8640 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4d4ea0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x559d7a4ce560 tx=0x7f3060000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f2f5ce09640 1 -- 172.21.15.96:0/4237191076 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306000f8e0 con 0x559d7a3e2250 2024-09-14T10:44:29.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d7a4d5690 con 0x559d7a3e2250 2024-09-14T10:44:29.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f2f5ce09640 1 -- 172.21.15.96:0/4237191076 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306000fa80 con 0x559d7a3e2250 2024-09-14T10:44:29.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f2f5ce09640 1 -- 172.21.15.96:0/4237191076 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f306000fda0 con 0x559d7a3e2250 2024-09-14T10:44:29.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7a4d6040 con 0x559d7a3e2250 2024-09-14T10:44:29.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f2f5ce09640 1 -- 172.21.15.96:0/4237191076 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3060017070 con 0x559d7a3e2250 2024-09-14T10:44:29.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f2f5ce09640 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f5803a150 0x7f2f5803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f2f5ce09640 1 -- 172.21.15.96:0/4237191076 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3060015020 con 0x559d7a3e2250 2024-09-14T10:44:29.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f306fab7640 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f5803a150 0x7f2f5803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f30727b29c0 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a3e63a0 0x559d7a4dc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a4dc550 con 0x559d7a3e63a0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f3070ab9640 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a3e63a0 0x559d7a4dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f306fab7640 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f5803a150 0x7f2f5803c610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f30580ab000 tx=0x7f30580a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f3070ab9640 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a3e63a0 0x559d7a4dc010 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f3070ab9640 1 -- 172.21.15.96:0/4237191076 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30680083f0 con 0x559d7a3e63a0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a4d6390 con 0x559d7a3e63a0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f3070ab9640 1 -- 172.21.15.96:0/4237191076 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30680083f0 con 0x559d7a3e63a0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a4de330 con 0x559d7a3e63a0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f3070ab9640 1 -- 172.21.15.96:0/4237191076 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f30680083f0 con 0x559d7a3e63a0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a4dd560 con 0x559d7a3e63a0 2024-09-14T10:44:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f3070ab9640 1 -- 172.21.15.96:0/4237191076 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30680083f0 con 0x559d7a3e63a0 2024-09-14T10:44:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.500+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a4dd9b0 con 0x559d7a3e63a0 2024-09-14T10:44:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f3070ab9640 1 -- 172.21.15.96:0/4237191076 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f30680083f0 con 0x559d7a3e63a0 2024-09-14T10:44:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f30727b29c0 1 Processor -- start 2024-09-14T10:44:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f30727b29c0 1 -- start start 2024-09-14T10:44:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f30727b29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4ec6e0 0x559d7a4ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f30727b29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d7a2f4d80 con 0x559d7a4ec6e0 2024-09-14T10:44:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f306fab7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4ec6e0 0x559d7a4ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f306fab7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4ec6e0 0x559d7a4ecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39474/0 (socket says 172.21.15.96:39474) 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f306fab7640 1 -- 172.21.15.96:0/3468104120 learned_addr learned my addr 172.21.15.96:0/3468104120 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f306fab7640 1 -- 172.21.15.96:0/3468104120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7a4ed140 con 0x559d7a4ec6e0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f306fab7640 1 --2- 172.21.15.96:0/3468104120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4ec6e0 0x559d7a4ecb00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f305801b160 tx=0x7f3058017ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f2f55ffb640 1 -- 172.21.15.96:0/3468104120 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30580c2070 con 0x559d7a4ec6e0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f30727b29c0 1 -- 172.21.15.96:0/3468104120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d7a4ed9a0 con 0x559d7a4ec6e0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f30727b29c0 1 -- 172.21.15.96:0/3468104120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7a4edeb0 con 0x559d7a4ec6e0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f2f55ffb640 1 -- 172.21.15.96:0/3468104120 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30580c7450 con 0x559d7a4ec6e0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f2f55ffb640 1 -- 172.21.15.96:0/3468104120 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30580cc060 con 0x559d7a4ec6e0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f2f55ffb640 1 -- 172.21.15.96:0/3468104120 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f30580c5070 con 0x559d7a4ec6e0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f2f55ffb640 1 --2- 172.21.15.96:0/3468104120 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4803a210 0x7f2f4803c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f2f55ffb640 1 -- 172.21.15.96:0/3468104120 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f30580edc10 con 0x559d7a4ec6e0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f3070ab9640 1 --2- 172.21.15.96:0/3468104120 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4803a210 0x7f2f4803c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.504+0000 7f30727b29c0 1 Processor -- start 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- start start 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a4f9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d7a4cdfc0 con 0x559d7a4f8f60 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f3070ab9640 1 --2- 172.21.15.96:0/3468104120 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4803a210 0x7f2f4803c6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f306800e3f0 tx=0x7f3068003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a4f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a4f9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39486/0 (socket says 172.21.15.96:39486) 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 -- 172.21.15.96:0/450375869 learned_addr learned my addr 172.21.15.96:0/450375869 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 -- 172.21.15.96:0/450375869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7a4f9910 con 0x559d7a4f8f60 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 --2- 172.21.15.96:0/450375869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a4f9340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f30580ec000 tx=0x7f30580be4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db5d6b0036e7bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f2f4f7fe640 1 -- 172.21.15.96:0/450375869 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30580c8d60 con 0x559d7a4f8f60 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f2f4f7fe640 1 -- 172.21.15.96:0/450375869 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30580a9ad0 con 0x559d7a4f8f60 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f2f4f7fe640 1 -- 172.21.15.96:0/450375869 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30580a9ca0 con 0x559d7a4f8f60 2024-09-14T10:44:29.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- 172.21.15.96:0/450375869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 msgr2=0x559d7a4f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 --2- 172.21.15.96:0/450375869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a4f9340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f30580ec000 tx=0x7f30580be4d0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- 172.21.15.96:0/450375869 shutdown_connections 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 --2- 172.21.15.96:0/450375869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a4f9340 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- 172.21.15.96:0/450375869 >> 172.21.15.96:0/450375869 conn(0x559d7a4f5390 msgr2=0x559d7a4f35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- 172.21.15.96:0/450375869 shutdown_connections 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- 172.21.15.96:0/450375869 wait complete. 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 Processor -- start 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- start start 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a500500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f30727b29c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d7a4f9f70 con 0x559d7a4f8f60 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a500500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a500500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39496/0 (socket says 172.21.15.96:39496) 2024-09-14T10:44:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 learned_addr learned my addr 172.21.15.96:0/2203615802 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7a500a60 con 0x559d7a4f8f60 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.508+0000 7f306fab7640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a500500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f30580be510 tx=0x7f30580ebf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f2f4dffb640 1 -- 172.21.15.96:0/2203615802 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30580a93c0 con 0x559d7a4f8f60 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f2f4dffb640 1 -- 172.21.15.96:0/2203615802 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30580a9560 con 0x559d7a4f8f60 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d7a500cf0 con 0x559d7a4f8f60 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f2f4dffb640 1 -- 172.21.15.96:0/2203615802 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30580a9860 con 0x559d7a4f8f60 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7a5016a0 con 0x559d7a4f8f60 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f2f4dffb640 1 -- 172.21.15.96:0/2203615802 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f30580b3040 con 0x559d7a4f8f60 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f2f4dffb640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4003a150 0x7f2f4003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f2f4dffb640 1 -- 172.21.15.96:0/2203615802 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f30580e2070 con 0x559d7a4f8f60 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f3070ab9640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4003a150 0x7f2f4003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a50ba20 0x559d7a50deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a50e600 con 0x559d7a50ba20 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30702b8640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a50ba20 0x559d7a50deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f3070ab9640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4003a150 0x7f2f4003c610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f306800f010 tx=0x7f306801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30702b8640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a50ba20 0x559d7a50deb0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f306002e070 con 0x559d7a50ba20 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 realm 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a50ea10 con 0x559d7a50ba20 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f306002e070 con 0x559d7a50ba20 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:29.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a50f2e0 con 0x559d7a50ba20 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f306002e070 con 0x559d7a50ba20 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a50f680 con 0x559d7a50ba20 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f306002e070 con 0x559d7a50ba20 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a50fb20 con 0x559d7a50ba20 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f306002e070 con 0x559d7a50ba20 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 20 searching for the correct realm 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559d7a511b20 0x559d7a513f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f306fab7640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559d7a511b20 0x559d7a513f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.512+0000 7f306fab7640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559d7a511b20 0x559d7a513f10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f306fab7640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f30580c7070 0x7f30580dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f30580c7070 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f3070ab9640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f30580c7070 0x7f30580dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f3070ab9640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f30580c7070 0x7f30580dfa70 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f3070ab9640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3068019040 0x7f3068019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3068019040 0x7f3068019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3068019040 0x7f3068019930 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306002e070 con 0x7f3068019040 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a50ba20 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306002e070 con 0x559d7a50ba20 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a50ba20 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.516+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f30580c7070 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a50ba20 2024-09-14T10:44:29.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a50ba20 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f30580c7070 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a50ba20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.520+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a50ba20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f30580c7070 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a50ba20 2024-09-14T10:44:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f30580c7070 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a511b20 2024-09-14T10:44:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.524+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f3068019040 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x559d7a50ba20 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5145c0 con 0x7f30580c7070 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5105c0 con 0x559d7a50ba20 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a510e60 con 0x559d7a50ba20 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a510200 con 0x559d7a50ba20 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 zone default found 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 4 Realm: () 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 zonegroup default 2024-09-14T10:44:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a510e60 con 0x7f3068019040 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a516410 con 0x559d7a511b20 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5167b0 con 0x559d7a511b20 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 started sync module instance, tier type = 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5158b0 con 0x7f30580c7070 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.528+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.532+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94134850378960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a515510 con 0x7f30580c7070 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.532+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a517690 con 0x559d7a50ba20 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.532+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94134850378960] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.532+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.532+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94134850382784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a517690 con 0x559d7a50ba20 2024-09-14T10:44:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.532+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5180a0 con 0x559d7a511b20 2024-09-14T10:44:29.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.532+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94134850382784] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94134850384352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a517600 con 0x559d7a511b20 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a518df0 con 0x7f30580c7070 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94134850390640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a519690 con 0x7f30580c7070 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51a0b0 con 0x559d7a50ba20 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94134850384352] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94134850390640] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94134850395040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5191e0 con 0x559d7a50ba20 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.536+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51a950 con 0x7f3068019040 2024-09-14T10:44:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.540+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94134850395040] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.540+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.540+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94134850389136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5191e0 con 0x7f3068019040 2024-09-14T10:44:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.540+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51adc0 con 0x7f3068019040 2024-09-14T10:44:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94134850389136] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94134850398384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51ad80 con 0x7f3068019040 2024-09-14T10:44:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51b7c0 con 0x7f3068019040 2024-09-14T10:44:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94134850398384] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94134850400912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51b780 con 0x7f3068019040 2024-09-14T10:44:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 20 add_watcher() i=0 2024-09-14T10:44:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 20 add_watcher() i=1 2024-09-14T10:44:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 20 add_watcher() i=2 2024-09-14T10:44:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 20 add_watcher() i=3 2024-09-14T10:44:29.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 20 add_watcher() i=4 2024-09-14T10:44:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 20 add_watcher() i=5 2024-09-14T10:44:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.544+0000 7f30727b29c0 20 add_watcher() i=6 2024-09-14T10:44:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94134850400912] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 add_watcher() i=7 2024-09-14T10:44:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51ebb0 con 0x559d7a50ba20 2024-09-14T10:44:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94134850396736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51c0d0 con 0x559d7a50ba20 2024-09-14T10:44:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94134850396736] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f2f267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 5 note: GC not initialized 2024-09-14T10:44:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f2f257e2640 20 reqs_thread_entry: start 2024-09-14T10:44:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 Filter name: none 2024-09-14T10:44:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f2e96ffd640 20 reqs_thread_entry: start 2024-09-14T10:44:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a541f10 con 0x559d7a50ba20 2024-09-14T10:44:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a542900 con 0x559d7a50ba20 2024-09-14T10:44:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d7a543910 con 0x7f30580c7070 2024-09-14T10:44:29.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.548+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.552+0000 7f2f267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.552+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94134850396736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a505d40 con 0x559d7a50ba20 2024-09-14T10:44:29.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.552+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94134850396736] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.552+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94134850378960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a51a240 con 0x7f30580c7070 2024-09-14T10:44:29.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.552+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94134850378960] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.552+0000 7f30727b29c0 20 remove_watcher() i=0 2024-09-14T10:44:29.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.552+0000 7f30727b29c0 2 removed watcher, disabling cache 2024-09-14T10:44:29.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.552+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94134850382784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a515cd0 con 0x559d7a50ba20 2024-09-14T10:44:29.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94134850382784] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f30727b29c0 20 remove_watcher() i=1 2024-09-14T10:44:29.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94134850384352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a515cd0 con 0x559d7a511b20 2024-09-14T10:44:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f306fab7640 1 -- 172.21.15.96:0/2203615802 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94134850384352] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30580c4030 con 0x559d7a511b20 2024-09-14T10:44:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f30727b29c0 20 remove_watcher() i=2 2024-09-14T10:44:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94134850390640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5171e0 con 0x7f30580c7070 2024-09-14T10:44:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f3070ab9640 1 -- 172.21.15.96:0/2203615802 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94134850390640] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306802f040 con 0x7f30580c7070 2024-09-14T10:44:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f30727b29c0 20 remove_watcher() i=3 2024-09-14T10:44:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.556+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94134850395040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5171e0 con 0x559d7a50ba20 2024-09-14T10:44:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.560+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94134850395040] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x559d7a50ba20 2024-09-14T10:44:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.560+0000 7f30727b29c0 20 remove_watcher() i=4 2024-09-14T10:44:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.560+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94134850389136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a519ba0 con 0x7f3068019040 2024-09-14T10:44:29.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.560+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94134850389136] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.560+0000 7f30727b29c0 20 remove_watcher() i=5 2024-09-14T10:44:29.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.560+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94134850398384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a5171e0 con 0x7f3068019040 2024-09-14T10:44:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94134850398384] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 20 remove_watcher() i=6 2024-09-14T10:44:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94134850400912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d7a519ba0 con 0x7f3068019040 2024-09-14T10:44:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94134850400912] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f306003f040 con 0x7f3068019040 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 20 remove_watcher() i=7 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3068019040 msgr2=0x7f3068019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3068019040 0x7f3068019930 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a50ba20 msgr2=0x559d7a50deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a50ba20 0x559d7a50deb0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f30580c7070 msgr2=0x7f30580dfa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f30580c7070 0x7f30580dfa70 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559d7a511b20 msgr2=0x559d7a513f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559d7a511b20 0x559d7a513f10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4003a150 msgr2=0x7f2f4003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4003a150 0x7f2f4003c610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f306800f010 tx=0x7f306801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 msgr2=0x559d7a500500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30702b8640 1 -- 172.21.15.96:0/2203615802 reap_dead start 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a500500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f30580be510 tx=0x7f30580ebf90 comp rx=0 tx=0).stop 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 shutdown_connections 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/2203615802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4f8f60 0x559d7a500500 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 >> 172.21.15.96:0/2203615802 conn(0x559d7a4f5390 msgr2=0x559d7a4f35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 shutdown_connections 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/2203615802 wait complete. 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/3468104120 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4803a210 msgr2=0x7f2f4803c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/3468104120 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4803a210 0x7f2f4803c6d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f306800e3f0 tx=0x7f3068003070 comp rx=0 tx=0).stop 2024-09-14T10:44:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/3468104120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4ec6e0 msgr2=0x559d7a4ecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/3468104120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4ec6e0 0x559d7a4ecb00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f305801b160 tx=0x7f3058017ec0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/3468104120 shutdown_connections 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/3468104120 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f4803a210 0x7f2f4803c6d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/3468104120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a4ec6e0 0x559d7a4ecb00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/3468104120 >> 172.21.15.96:0/3468104120 conn(0x559d7a4e2090 msgr2=0x559d7a4e2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/3468104120 shutdown_connections 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/3468104120 wait complete. 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a3e63a0 msgr2=0x559d7a4dc010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a3e63a0 0x559d7a4dc010 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f5803a150 msgr2=0x7f2f5803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f5803a150 0x7f2f5803c610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f30580ab000 tx=0x7f30580a5000 comp rx=0 tx=0).stop 2024-09-14T10:44:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 msgr2=0x559d7a4d4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.564+0000 7f30727b29c0 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4d4ea0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x559d7a4ce560 tx=0x7f3060000bd0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.568+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 shutdown_connections 2024-09-14T10:44:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.568+0000 7f30727b29c0 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559d7a3e63a0 0x559d7a4dc010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.568+0000 7f30727b29c0 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2f5803a150 0x7f2f5803c610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.568+0000 7f30727b29c0 1 --2- 172.21.15.96:0/4237191076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7a3e2250 0x559d7a4d4ea0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.568+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 >> 172.21.15.96:0/4237191076 conn(0x559d7a355b60 msgr2=0x559d7a4ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.568+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 shutdown_connections 2024-09-14T10:44:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.568+0000 7f30727b29c0 1 -- 172.21.15.96:0/4237191076 wait complete. 2024-09-14T10:44:29.573 INFO:teuthology.orchestra.run.smithi096.stdout:[] 2024-09-14T10:44:29.573 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:44:29.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-14T10:44:29.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-14T10:44:29.574 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-14T10:44:29.651 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:29.651 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:29.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5d3f09c0 1 Processor -- start 2024-09-14T10:44:29.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5d3f09c0 1 -- start start 2024-09-14T10:44:29.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5d3f09c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557b4172b630 0x557b417bf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5d3f09c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b4165f7a0 con 0x557b4172b250 2024-09-14T10:44:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5d3f09c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x557b416bb1b0 con 0x557b4172b630 2024-09-14T10:44:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5a6f5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557b4172b630 0x557b417bf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5a6f5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557b4172b630 0x557b417bf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39504/0 (socket says 172.21.15.96:39504) 2024-09-14T10:44:29.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5a6f5640 1 -- 172.21.15.96:0/2564360142 learned_addr learned my addr 172.21.15.96:0/2564360142 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5a6f5640 1 -- 172.21.15.96:0/2564360142 >> v1:172.21.15.70:6789/0 conn(0x557b4172b250 legacy=0x557b417bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5a6f5640 1 -- 172.21.15.96:0/2564360142 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b41639da0 con 0x557b4172b630 2024-09-14T10:44:29.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.656+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/2564360142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b630 0x557b417bf7b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fef4400a5c0 tx=0x7fef4401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdbe40e7d471cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef59ef4640 1 -- 172.21.15.96:0/2564360142 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef440a6070 con 0x557b4172b630 2024-09-14T10:44:29.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef59ef4640 1 -- 172.21.15.96:0/2564360142 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef440af070 con 0x557b4172b630 2024-09-14T10:44:29.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef59ef4640 1 -- 172.21.15.96:0/2564360142 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef440aa5c0 con 0x557b4172b630 2024-09-14T10:44:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2564360142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b630 msgr2=0x557b417bf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2564360142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b630 0x557b417bf7b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fef4400a5c0 tx=0x7fef4401b340 comp rx=0 tx=0).stop 2024-09-14T10:44:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2564360142 shutdown_connections 2024-09-14T10:44:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2564360142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b630 0x557b417bf7b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2564360142 >> 172.21.15.96:0/2564360142 conn(0x557b417b1970 msgr2=0x557b417b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2564360142 shutdown_connections 2024-09-14T10:44:29.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.660+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2564360142 wait complete. 2024-09-14T10:44:29.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5d3f09c0 1 Processor -- start 2024-09-14T10:44:29.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5d3f09c0 1 -- start start 2024-09-14T10:44:29.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5d3f09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5d3f09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b416befc0 con 0x557b4172b250 2024-09-14T10:44:29.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5aef6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5aef6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418a45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39510/0 (socket says 172.21.15.96:39510) 2024-09-14T10:44:29.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5aef6640 1 -- 172.21.15.96:0/2574026231 learned_addr learned my addr 172.21.15.96:0/2574026231 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5aef6640 1 -- 172.21.15.96:0/2574026231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b418a4bc0 con 0x557b4172b250 2024-09-14T10:44:29.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fef5aef6640 1 --2- 172.21.15.96:0/2574026231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418a45d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fef54001680 tx=0x7fef54001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e45c0dfb2018e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fee48e09640 1 -- 172.21.15.96:0/2574026231 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef54016070 con 0x557b4172b250 2024-09-14T10:44:29.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fee48e09640 1 -- 172.21.15.96:0/2574026231 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef5400f660 con 0x557b4172b250 2024-09-14T10:44:29.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.672+0000 7fee48e09640 1 -- 172.21.15.96:0/2574026231 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef5400f980 con 0x557b4172b250 2024-09-14T10:44:29.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2574026231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 msgr2=0x557b418a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2574026231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418a45d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fef54001680 tx=0x7fef54001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:29.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2574026231 shutdown_connections 2024-09-14T10:44:29.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2574026231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418a45d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2574026231 >> 172.21.15.96:0/2574026231 conn(0x557b417b1970 msgr2=0x557b418a01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2574026231 shutdown_connections 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2574026231 wait complete. 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 Processor -- start 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- start start 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b41660a50 con 0x557b4172b250 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5aef6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5aef6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39516/0 (socket says 172.21.15.96:39516) 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5aef6640 1 -- 172.21.15.96:0/2318402077 learned_addr learned my addr 172.21.15.96:0/2318402077 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5aef6640 1 -- 172.21.15.96:0/2318402077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b418ac430 con 0x557b4172b250 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5aef6640 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418abed0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x557b418a5590 tx=0x7fef54000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fee47606640 1 -- 172.21.15.96:0/2318402077 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef54016040 con 0x557b4172b250 2024-09-14T10:44:29.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b418ac6c0 con 0x557b4172b250 2024-09-14T10:44:29.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fee47606640 1 -- 172.21.15.96:0/2318402077 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef54022070 con 0x557b4172b250 2024-09-14T10:44:29.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fee47606640 1 -- 172.21.15.96:0/2318402077 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef54006330 con 0x557b4172b250 2024-09-14T10:44:29.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b418ad070 con 0x557b4172b250 2024-09-14T10:44:29.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.676+0000 7fee47606640 1 -- 172.21.15.96:0/2318402077 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fef54011510 con 0x557b4172b250 2024-09-14T10:44:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fee47606640 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee4003a2f0 0x7fee4003c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fee47606640 1 -- 172.21.15.96:0/2318402077 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fef54050740 con 0x557b4172b250 2024-09-14T10:44:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee4003a2f0 0x7fee4003c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b4172b630 0x557b418b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418b3580 con 0x557b4172b630 2024-09-14T10:44:29.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b4172b630 0x557b418b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee4003a2f0 0x7fee4003c7b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fef440ae000 tx=0x7fef440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b4172b630 0x557b418b3040 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5b6f7640 1 -- 172.21.15.96:0/2318402077 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef4c0083f0 con 0x557b4172b630 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418b39d0 con 0x557b4172b630 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5b6f7640 1 -- 172.21.15.96:0/2318402077 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef4c0083f0 con 0x557b4172b630 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418b52d0 con 0x557b4172b630 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5b6f7640 1 -- 172.21.15.96:0/2318402077 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef4c0083f0 con 0x557b4172b630 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418b4500 con 0x557b4172b630 2024-09-14T10:44:29.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5b6f7640 1 -- 172.21.15.96:0/2318402077 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef4c0083f0 con 0x557b4172b630 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418b4920 con 0x557b4172b630 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5b6f7640 1 -- 172.21.15.96:0/2318402077 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef4c0083f0 con 0x557b4172b630 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 Processor -- start 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 -- start start 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418c36c0 0x557b418c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5d3f09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b416cbd80 con 0x557b418c36c0 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5a6f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418c36c0 0x557b418c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5a6f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418c36c0 0x557b418c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39532/0 (socket says 172.21.15.96:39532) 2024-09-14T10:44:29.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3893744365 learned_addr learned my addr 172.21.15.96:0/3893744365 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.680+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3893744365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b418c4120 con 0x557b418c36c0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/3893744365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418c36c0 0x557b418c3ae0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fef44000c10 tx=0x7fef440180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee44e01640 1 -- 172.21.15.96:0/3893744365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef440b3b90 con 0x557b418c36c0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3893744365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b418c4980 con 0x557b418c36c0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee44e01640 1 -- 172.21.15.96:0/3893744365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef440b3d30 con 0x557b418c36c0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee44e01640 1 -- 172.21.15.96:0/3893744365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef440c8560 con 0x557b418c36c0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3893744365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b418c4e90 con 0x557b418c36c0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee44e01640 1 -- 172.21.15.96:0/3893744365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fef440c8700 con 0x557b418c36c0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee44e01640 1 --2- 172.21.15.96:0/3893744365 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee3403a150 0x7fee3403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee44e01640 1 -- 172.21.15.96:0/3893744365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fef440ee550 con 0x557b418c36c0 2024-09-14T10:44:29.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/3893744365 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee3403a150 0x7fee3403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5d3f09c0 1 Processor -- start 2024-09-14T10:44:29.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5d3f09c0 1 -- start start 2024-09-14T10:44:29.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/3893744365 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee3403a150 0x7fee3403c610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x557b418b48a0 tx=0x7fef4c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5d3f09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5d3f09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b418a4ff0 con 0x557b418d0f70 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5a6f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5a6f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39534/0 (socket says 172.21.15.96:39534) 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5a6f5640 1 -- 172.21.15.96:0/368686016 learned_addr learned my addr 172.21.15.96:0/368686016 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5a6f5640 1 -- 172.21.15.96:0/368686016 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b418d1960 con 0x557b418d0f70 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/368686016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d1370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fef440ec940 tx=0x7fef440ee420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44e1b5d16974605 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee3e7fc640 1 -- 172.21.15.96:0/368686016 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef44006390 con 0x557b418d0f70 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee3e7fc640 1 -- 172.21.15.96:0/368686016 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef440c73d0 con 0x557b418d0f70 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.684+0000 7fee3e7fc640 1 -- 172.21.15.96:0/368686016 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef440bd390 con 0x557b418d0f70 2024-09-14T10:44:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/368686016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 msgr2=0x557b418d1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/368686016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d1370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fef440ec940 tx=0x7fef440ee420 comp rx=0 tx=0).stop 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/368686016 shutdown_connections 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/368686016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d1370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/368686016 >> 172.21.15.96:0/368686016 conn(0x557b418cc390 msgr2=0x557b418ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/368686016 shutdown_connections 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/368686016 wait complete. 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 Processor -- start 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- start start 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b418cfec0 con 0x557b418d0f70 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5a6f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5a6f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39542/0 (socket says 172.21.15.96:39542) 2024-09-14T10:44:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 learned_addr learned my addr 172.21.15.96:0/3000619925 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b418d7a30 con 0x557b418d0f70 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d74d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fef44006760 tx=0x7fef440ec8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fee3cff9640 1 -- 172.21.15.96:0/3000619925 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef440f3070 con 0x557b418d0f70 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b418d7cc0 con 0x557b418d0f70 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b418d8670 con 0x557b418d0f70 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fee3cff9640 1 -- 172.21.15.96:0/3000619925 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef440c73d0 con 0x557b418d0f70 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fee3cff9640 1 -- 172.21.15.96:0/3000619925 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef440ecc90 con 0x557b418d0f70 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.688+0000 7fee3cff9640 1 -- 172.21.15.96:0/3000619925 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fef440f6070 con 0x557b418d0f70 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fee3cff9640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee2403a150 0x7fee2403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fee3cff9640 1 -- 172.21.15.96:0/3000619925 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fef440e1030 con 0x557b418d0f70 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee2403a150 0x7fee2403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b418e2a30 0x557b418e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e5610 con 0x557b418e2a30 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5aef6640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b418e2a30 0x557b418e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee2403a150 0x7fee2403c610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00f010 tx=0x7fef4c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5aef6640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b418e2a30 0x557b418e4ec0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 realm 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e5a20 con 0x557b418e2a30 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:29.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e62f0 con 0x557b418e2a30 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e6690 con 0x557b418e2a30 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e6b30 con 0x557b418e2a30 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 20 searching for the correct realm 2024-09-14T10:44:29.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b418e8b30 0x557b418eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b418e8b30 0x557b418eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b418e8b30 0x557b418eaf20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5a6f5640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fef440f8060 0x7fef440e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef440f8060 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fef440f8060 0x7fef440e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fef440f8060 0x7fef440e69f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5b6f7640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fef4c019040 0x7fef4c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.692+0000 7fef5aef6640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fef4c019040 0x7fef4c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fef4c019040 0x7fef4c019930 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e2a30 2024-09-14T10:44:29.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e2a30 2024-09-14T10:44:29.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef440f8060 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e2a30 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.696+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e2a30 2024-09-14T10:44:29.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef440f8060 2024-09-14T10:44:29.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e2a30 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e2a30 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef440f8060 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e2a30 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.700+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef440f8060 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e8b30 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef4c019040 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x557b418e2a30 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b418eb5f0 con 0x7fef440f8060 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:29.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e75d0 con 0x557b418e2a30 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e7e70 con 0x557b418e2a30 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e7210 con 0x557b418e2a30 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 zone default found 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 4 Realm: () 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 zonegroup default 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.704+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418e7e70 con 0x7fef4c019040 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418ed460 con 0x557b418e8b30 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418ed800 con 0x557b418e8b30 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 20 started sync module instance, tier type = 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418ec900 con 0x7fef440f8060 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93987869215984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418ec560 con 0x7fef440f8060 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418ee6e0 con 0x557b418e2a30 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.708+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93987869215984] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93987869219856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418ee6e0 con 0x557b418e2a30 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418ef0a0 con 0x557b418e8b30 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93987869223920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418ef940 con 0x557b418e8b30 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f0340 con 0x7fef440f8060 2024-09-14T10:44:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93987869219856] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93987869221424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f0730 con 0x7fef440f8060 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.712+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f10f0 con 0x557b418e2a30 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93987869221424] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93987869223920] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93987869226128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f0c40 con 0x557b418e2a30 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f1990 con 0x7fef4c019040 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93987869226128] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93987869228624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f0c40 con 0x7fef4c019040 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.716+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f1e50 con 0x7fef4c019040 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.720+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93987869228624] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.720+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.720+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93987869235488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f1e10 con 0x7fef4c019040 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.720+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f2810 con 0x7fef4c019040 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.720+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93987869235488] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93987869233840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f27d0 con 0x7fef4c019040 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 add_watcher() i=0 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 add_watcher() i=1 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 add_watcher() i=2 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 add_watcher() i=3 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 add_watcher() i=4 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 add_watcher() i=5 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 add_watcher() i=6 2024-09-14T10:44:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93987869233840] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 add_watcher() i=7 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b418f5c30 con 0x557b418e2a30 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93987869238512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418f3150 con 0x557b418e2a30 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93987869238512] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fee117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 5 note: GC not initialized 2024-09-14T10:44:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fed8bfff640 20 reqs_thread_entry: start 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.724+0000 7fef5d3f09c0 20 Filter name: none 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fed89ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b41918f30 con 0x557b418e2a30 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b41919920 con 0x557b418e2a30 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b4191a930 con 0x7fef440f8060 2024-09-14T10:44:29.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fee117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93987869238512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b41916c20 con 0x557b418e2a30 2024-09-14T10:44:29.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93987869238512] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93987869215984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b41916c20 con 0x7fef440f8060 2024-09-14T10:44:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93987869215984] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.728+0000 7fef5d3f09c0 20 remove_watcher() i=0 2024-09-14T10:44:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.732+0000 7fef5d3f09c0 2 removed watcher, disabling cache 2024-09-14T10:44:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.732+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93987869219856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b41916c20 con 0x557b418e2a30 2024-09-14T10:44:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.732+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93987869219856] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.732+0000 7fef5d3f09c0 20 remove_watcher() i=1 2024-09-14T10:44:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.732+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93987869223920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b41916c20 con 0x557b418e8b30 2024-09-14T10:44:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.732+0000 7fef5a6f5640 1 -- 172.21.15.96:0/3000619925 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93987869223920] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef440f5030 con 0x557b418e8b30 2024-09-14T10:44:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.732+0000 7fef5d3f09c0 20 remove_watcher() i=2 2024-09-14T10:44:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.732+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93987869221424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418eccf0 con 0x7fef440f8060 2024-09-14T10:44:29.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.736+0000 7fef5b6f7640 1 -- 172.21.15.96:0/3000619925 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93987869221424] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef4c02f040 con 0x7fef440f8060 2024-09-14T10:44:29.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.736+0000 7fef5d3f09c0 20 remove_watcher() i=3 2024-09-14T10:44:29.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.736+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93987869226128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418eccf0 con 0x557b418e2a30 2024-09-14T10:44:29.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.736+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93987869226128] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x557b418e2a30 2024-09-14T10:44:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.736+0000 7fef5d3f09c0 20 remove_watcher() i=4 2024-09-14T10:44:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.736+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93987869228624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418eccf0 con 0x7fef4c019040 2024-09-14T10:44:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.740+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93987869228624] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.740+0000 7fef5d3f09c0 20 remove_watcher() i=5 2024-09-14T10:44:29.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.740+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93987869235488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418efe50 con 0x7fef4c019040 2024-09-14T10:44:29.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.740+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93987869235488] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.740+0000 7fef5d3f09c0 20 remove_watcher() i=6 2024-09-14T10:44:29.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.740+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93987869233840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b418eccf0 con 0x7fef4c019040 2024-09-14T10:44:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93987869233840] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef5400f070 con 0x7fef4c019040 2024-09-14T10:44:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 20 remove_watcher() i=7 2024-09-14T10:44:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fef4c019040 msgr2=0x7fef4c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fef4c019040 0x7fef4c019930 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b418e2a30 msgr2=0x557b418e4ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b418e2a30 0x557b418e4ec0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fef440f8060 msgr2=0x7fef440e69f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fef440f8060 0x7fef440e69f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b418e8b30 msgr2=0x557b418eaf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557b418e8b30 0x557b418eaf20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee2403a150 msgr2=0x7fee2403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee2403a150 0x7fee2403c610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00f010 tx=0x7fef4c01b070 comp rx=0 tx=0).stop 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 msgr2=0x557b418d74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5aef6640 1 -- 172.21.15.96:0/3000619925 reap_dead start 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d74d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fef44006760 tx=0x7fef440ec8d0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 shutdown_connections 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3000619925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418d0f70 0x557b418d74d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 >> 172.21.15.96:0/3000619925 conn(0x557b418cc390 msgr2=0x557b418ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 shutdown_connections 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3000619925 wait complete. 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3893744365 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee3403a150 msgr2=0x7fee3403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3893744365 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee3403a150 0x7fee3403c610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x557b418b48a0 tx=0x7fef4c003070 comp rx=0 tx=0).stop 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3893744365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418c36c0 msgr2=0x557b418c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3893744365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418c36c0 0x557b418c3ae0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fef44000c10 tx=0x7fef440180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3893744365 shutdown_connections 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3893744365 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee3403a150 0x7fee3403c610 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/3893744365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b418c36c0 0x557b418c3ae0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3893744365 >> 172.21.15.96:0/3893744365 conn(0x557b418b9070 msgr2=0x557b418b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3893744365 shutdown_connections 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/3893744365 wait complete. 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b4172b630 msgr2=0x557b418b3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b4172b630 0x557b418b3040 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee4003a2f0 msgr2=0x7fee4003c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee4003a2f0 0x7fee4003c7b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fef440ae000 tx=0x7fef440a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 msgr2=0x557b418abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418abed0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x557b418a5590 tx=0x7fef54000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 shutdown_connections 2024-09-14T10:44:29.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557b4172b630 0x557b418b3040 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fee4003a2f0 0x7fee4003c7b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 --2- 172.21.15.96:0/2318402077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4172b250 0x557b418abed0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 >> 172.21.15.96:0/2318402077 conn(0x557b417b1970 msgr2=0x557b418a5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 shutdown_connections 2024-09-14T10:44:29.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.744+0000 7fef5d3f09c0 1 -- 172.21.15.96:0/2318402077 wait complete. 2024-09-14T10:44:29.751 INFO:teuthology.orchestra.run.smithi096.stdout:[] 2024-09-14T10:44:29.751 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:44:29.770 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:29.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-14T10:44:29.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-14T10:44:29.770 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-14T10:44:29.818 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:29.818 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:29.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f2835a649c0 1 Processor -- start 2024-09-14T10:44:29.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f2835a649c0 1 -- start start 2024-09-14T10:44:29.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f2835a649c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e5a329a2d0 0x55e5a329a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f2835a649c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5a31cc7a0 con 0x55e5a3298cc0 2024-09-14T10:44:29.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f2835a649c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55e5a32281b0 con 0x55e5a329a2d0 2024-09-14T10:44:29.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f283356a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e5a329a2d0 0x55e5a329a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f283356a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e5a329a2d0 0x55e5a329a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39556/0 (socket says 172.21.15.96:39556) 2024-09-14T10:44:29.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f283356a640 1 -- 172.21.15.96:0/594097515 learned_addr learned my addr 172.21.15.96:0/594097515 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f283356a640 1 -- 172.21.15.96:0/594097515 >> v1:172.21.15.70:6789/0 conn(0x55e5a3298cc0 legacy=0x55e5a32990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.820+0000 7f283356a640 1 -- 172.21.15.96:0/594097515 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a31a6da0 con 0x55e5a329a2d0 2024-09-14T10:44:29.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f283356a640 1 --2- 172.21.15.96:0/594097515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a329a2d0 0x55e5a329a6b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f282400a5c0 tx=0x7f282401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411de9baa14148cd server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2832568640 1 -- 172.21.15.96:0/594097515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28240a6070 con 0x55e5a329a2d0 2024-09-14T10:44:29.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2832568640 1 -- 172.21.15.96:0/594097515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28240af070 con 0x55e5a329a2d0 2024-09-14T10:44:29.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2832568640 1 -- 172.21.15.96:0/594097515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28240aa5c0 con 0x55e5a329a2d0 2024-09-14T10:44:29.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2835a649c0 1 -- 172.21.15.96:0/594097515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a329a2d0 msgr2=0x55e5a329a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2835a649c0 1 --2- 172.21.15.96:0/594097515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a329a2d0 0x55e5a329a6b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f282400a5c0 tx=0x7f282401b340 comp rx=0 tx=0).stop 2024-09-14T10:44:29.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2835a649c0 1 -- 172.21.15.96:0/594097515 shutdown_connections 2024-09-14T10:44:29.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2835a649c0 1 --2- 172.21.15.96:0/594097515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a329a2d0 0x55e5a329a6b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2835a649c0 1 -- 172.21.15.96:0/594097515 >> 172.21.15.96:0/594097515 conn(0x55e5a331faf0 msgr2=0x55e5a3321f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2835a649c0 1 -- 172.21.15.96:0/594097515 shutdown_connections 2024-09-14T10:44:29.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.824+0000 7f2835a649c0 1 -- 172.21.15.96:0/594097515 wait complete. 2024-09-14T10:44:29.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.836+0000 7f2835a649c0 1 Processor -- start 2024-09-14T10:44:29.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.836+0000 7f2835a649c0 1 -- start start 2024-09-14T10:44:29.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.836+0000 7f2835a649c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3411840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.836+0000 7f2835a649c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5a322bfc0 con 0x55e5a3298cc0 2024-09-14T10:44:29.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.836+0000 7f283356a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3411840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3411840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39562/0 (socket says 172.21.15.96:39562) 2024-09-14T10:44:29.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 -- 172.21.15.96:0/3705768534 learned_addr learned my addr 172.21.15.96:0/3705768534 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 -- 172.21.15.96:0/3705768534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a3411e30 con 0x55e5a3298cc0 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 --2- 172.21.15.96:0/3705768534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3411840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2824018f70 tx=0x7f2824003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf16281312ec6156 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f272160a640 1 -- 172.21.15.96:0/3705768534 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28240aa9e0 con 0x55e5a3298cc0 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f272160a640 1 -- 172.21.15.96:0/3705768534 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28240aab80 con 0x55e5a3298cc0 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f272160a640 1 -- 172.21.15.96:0/3705768534 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28240aae60 con 0x55e5a3298cc0 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- 172.21.15.96:0/3705768534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 msgr2=0x55e5a3411840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 --2- 172.21.15.96:0/3705768534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3411840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2824018f70 tx=0x7f2824003030 comp rx=0 tx=0).stop 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- 172.21.15.96:0/3705768534 shutdown_connections 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 --2- 172.21.15.96:0/3705768534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3411840 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- 172.21.15.96:0/3705768534 >> 172.21.15.96:0/3705768534 conn(0x55e5a331faf0 msgr2=0x55e5a340d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- 172.21.15.96:0/3705768534 shutdown_connections 2024-09-14T10:44:29.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- 172.21.15.96:0/3705768534 wait complete. 2024-09-14T10:44:29.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 Processor -- start 2024-09-14T10:44:29.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- start start 2024-09-14T10:44:29.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3418fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5a31cda50 con 0x55e5a3298cc0 2024-09-14T10:44:29.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3418fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3418fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39570/0 (socket says 172.21.15.96:39570) 2024-09-14T10:44:29.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 -- 172.21.15.96:0/98831665 learned_addr learned my addr 172.21.15.96:0/98831665 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 -- 172.21.15.96:0/98831665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a3419520 con 0x55e5a3298cc0 2024-09-14T10:44:29.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f283356a640 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3418fc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2824000c10 tx=0x7f28240180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f271fe07640 1 -- 172.21.15.96:0/98831665 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28240abec0 con 0x55e5a3298cc0 2024-09-14T10:44:29.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5a34197b0 con 0x55e5a3298cc0 2024-09-14T10:44:29.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f271fe07640 1 -- 172.21.15.96:0/98831665 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28240c6690 con 0x55e5a3298cc0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f271fe07640 1 -- 172.21.15.96:0/98831665 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28240c6990 con 0x55e5a3298cc0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.840+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a341a160 con 0x55e5a3298cc0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f271fe07640 1 -- 172.21.15.96:0/98831665 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f28240ce030 con 0x55e5a3298cc0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f271fe07640 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f271803a2f0 0x7f271803c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f271fe07640 1 -- 172.21.15.96:0/98831665 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f28240cc020 con 0x55e5a3298cc0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2832d69640 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f271803a2f0 0x7f271803c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2835a649c0 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a329a2d0 0x55e5a3420130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3420670 con 0x55e5a329a2d0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2833d6b640 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a329a2d0 0x55e5a3420130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2832d69640 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f271803a2f0 0x7f271803c7b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2828001e60 tx=0x7f28280013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2833d6b640 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a329a2d0 0x55e5a3420130 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2833d6b640 1 -- 172.21.15.96:0/98831665 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f282c00a4d0 con 0x55e5a329a2d0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a341a4c0 con 0x55e5a329a2d0 2024-09-14T10:44:29.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2833d6b640 1 -- 172.21.15.96:0/98831665 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f282c00a4d0 con 0x55e5a329a2d0 2024-09-14T10:44:29.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3422400 con 0x55e5a329a2d0 2024-09-14T10:44:29.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2833d6b640 1 -- 172.21.15.96:0/98831665 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f282c00a4d0 con 0x55e5a329a2d0 2024-09-14T10:44:29.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3421630 con 0x55e5a329a2d0 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2833d6b640 1 -- 172.21.15.96:0/98831665 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f282c00a4d0 con 0x55e5a329a2d0 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3421a80 con 0x55e5a329a2d0 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2833d6b640 1 -- 172.21.15.96:0/98831665 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f282c00a4d0 con 0x55e5a329a2d0 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2835a649c0 1 Processor -- start 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.844+0000 7f2835a649c0 1 -- start start 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2835a649c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a34307a0 0x55e5a3430bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2835a649c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5a3238d80 con 0x55e5a34307a0 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2832d69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a34307a0 0x55e5a3430bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2832d69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a34307a0 0x55e5a3430bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39582/0 (socket says 172.21.15.96:39582) 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2832d69640 1 -- 172.21.15.96:0/638597170 learned_addr learned my addr 172.21.15.96:0/638597170 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2832d69640 1 -- 172.21.15.96:0/638597170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a3431200 con 0x55e5a34307a0 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2832d69640 1 --2- 172.21.15.96:0/638597170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a34307a0 0x55e5a3430bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2828010f90 tx=0x7f282800f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f271d602640 1 -- 172.21.15.96:0/638597170 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282800a040 con 0x55e5a34307a0 2024-09-14T10:44:29.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f271d602640 1 -- 172.21.15.96:0/638597170 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2828017050 con 0x55e5a34307a0 2024-09-14T10:44:29.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2835a649c0 1 -- 172.21.15.96:0/638597170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5a3431a60 con 0x55e5a34307a0 2024-09-14T10:44:29.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f271d602640 1 -- 172.21.15.96:0/638597170 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282800e7e0 con 0x55e5a34307a0 2024-09-14T10:44:29.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2835a649c0 1 -- 172.21.15.96:0/638597170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a3431fd0 con 0x55e5a34307a0 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f271d602640 1 -- 172.21.15.96:0/638597170 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f282800e9d0 con 0x55e5a34307a0 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f271d602640 1 --2- 172.21.15.96:0/638597170 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f270c03a140 0x7f270c03c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f271d602640 1 -- 172.21.15.96:0/638597170 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2828052a50 con 0x55e5a34307a0 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2833d6b640 1 --2- 172.21.15.96:0/638597170 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f270c03a140 0x7f270c03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2835a649c0 1 Processor -- start 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2833d6b640 1 --2- 172.21.15.96:0/638597170 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f270c03a140 0x7f270c03c600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55e5a3421150 tx=0x7f282c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2835a649c0 1 -- start start 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2835a649c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a343e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2835a649c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5a34121a0 con 0x55e5a343e130 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.848+0000 7f2832d69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a343e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a343e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39592/0 (socket says 172.21.15.96:39592) 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 -- 172.21.15.96:0/3987994125 learned_addr learned my addr 172.21.15.96:0/3987994125 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 -- 172.21.15.96:0/3987994125 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a343eb20 con 0x55e5a343e130 2024-09-14T10:44:29.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 --2- 172.21.15.96:0/3987994125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a343e530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2828050e40 tx=0x7f282801aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1741b5ef59d229 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2716ffd640 1 -- 172.21.15.96:0/3987994125 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282804a1a0 con 0x55e5a343e130 2024-09-14T10:44:29.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2716ffd640 1 -- 172.21.15.96:0/3987994125 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282801c930 con 0x55e5a343e130 2024-09-14T10:44:29.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2716ffd640 1 -- 172.21.15.96:0/3987994125 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282800ecc0 con 0x55e5a343e130 2024-09-14T10:44:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- 172.21.15.96:0/3987994125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 msgr2=0x55e5a343e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 --2- 172.21.15.96:0/3987994125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a343e530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2828050e40 tx=0x7f282801aa60 comp rx=0 tx=0).stop 2024-09-14T10:44:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- 172.21.15.96:0/3987994125 shutdown_connections 2024-09-14T10:44:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 --2- 172.21.15.96:0/3987994125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a343e530 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- 172.21.15.96:0/3987994125 >> 172.21.15.96:0/3987994125 conn(0x55e5a3439550 msgr2=0x55e5a3437790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- 172.21.15.96:0/3987994125 shutdown_connections 2024-09-14T10:44:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- 172.21.15.96:0/3987994125 wait complete. 2024-09-14T10:44:29.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 Processor -- start 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- start start 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a3444680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5a343d080 con 0x55e5a343e130 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a3444680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a3444680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39594/0 (socket says 172.21.15.96:39594) 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 learned_addr learned my addr 172.21.15.96:0/1199927178 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a3444be0 con 0x55e5a343e130 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2832d69640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a3444680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2828025c20 tx=0x7f2828050dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f27157fa640 1 -- 172.21.15.96:0/1199927178 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282801ccc0 con 0x55e5a343e130 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5a3444e70 con 0x55e5a343e130 2024-09-14T10:44:29.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f27157fa640 1 -- 172.21.15.96:0/1199927178 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282800ecc0 con 0x55e5a343e130 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f27157fa640 1 -- 172.21.15.96:0/1199927178 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282801c410 con 0x55e5a343e130 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.852+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a3445820 con 0x55e5a343e130 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f27157fa640 1 -- 172.21.15.96:0/1199927178 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2828035020 con 0x55e5a343e130 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f27157fa640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26fc03a150 0x7f26fc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f27157fa640 1 -- 172.21.15.96:0/1199927178 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2828033020 con 0x55e5a343e130 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2833d6b640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26fc03a150 0x7f26fc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a344fbe0 0x55e5a3452070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a34527c0 con 0x55e5a344fbe0 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f283356a640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a344fbe0 0x55e5a3452070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f283356a640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a344fbe0 0x55e5a3452070 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2833d6b640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26fc03a150 0x7f26fc03c610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55e5a341a410 tx=0x7f282c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 realm 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3452bd0 con 0x55e5a344fbe0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a34534a0 con 0x55e5a344fbe0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3453840 con 0x55e5a344fbe0 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3453ce0 con 0x55e5a344fbe0 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 20 searching for the correct realm 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e5a3455ce0 0x55e5a34580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a3455ce0 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2832d69640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e5a3455ce0 0x55e5a34580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2832d69640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e5a3455ce0 0x55e5a34580d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2832d69640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f282801c030 0x7f2828052110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282801c030 2024-09-14T10:44:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2833d6b640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f282801c030 0x7f2828052110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.856+0000 7f2833d6b640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f282801c030 0x7f2828052110 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c01f070 con 0x7f282801c030 2024-09-14T10:44:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f2833d6b640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f282c031040 0x7f282c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282c031040 2024-09-14T10:44:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f282c031040 0x7f282c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f282c031040 0x7f282c032430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a344fbe0 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a344fbe0 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282c031040 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282c031040 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282801c030 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c01f070 con 0x7f282801c030 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a3455ce0 2024-09-14T10:44:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a344fbe0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.860+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282c031040 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a344fbe0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282801c030 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f282c01f070 con 0x7f282801c030 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a3455ce0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a3455ce0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282c031040 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a3455ce0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a3455ce0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a344fbe0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a344fbe0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.864+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282c031040 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a3455ce0 2024-09-14T10:44:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282801c030 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c01f070 con 0x7f282801c030 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a344fbe0 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282c031040 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x55e5a3455ce0 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3458780 con 0x7f282c031040 2024-09-14T10:44:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f28240ff040 con 0x7f282801c030 2024-09-14T10:44:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c01f070 con 0x7f282801c030 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f28240ff040 con 0x55e5a3455ce0 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f28240ff040 con 0x7f282c031040 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f28240ff040 con 0x55e5a344fbe0 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.868+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f28240ff040 con 0x7f282801c030 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c01f070 con 0x7f282801c030 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3454780 con 0x55e5a344fbe0 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3455020 con 0x55e5a344fbe0 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a34543c0 con 0x55e5a344fbe0 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 zone default found 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 4 Realm: () 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 zonegroup default 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3455020 con 0x7f282c031040 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345a5d0 con 0x55e5a3455ce0 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345a970 con 0x55e5a3455ce0 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 started sync module instance, tier type = 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3459a70 con 0x7f282801c030 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c040040 con 0x7f282801c030 2024-09-14T10:44:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94444775120528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345b210 con 0x7f282801c030 2024-09-14T10:44:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.872+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345ba60 con 0x55e5a344fbe0 2024-09-14T10:44:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.876+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94444775120528] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c040040 con 0x7f282801c030 2024-09-14T10:44:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.876+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.876+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94444775124320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345b690 con 0x55e5a344fbe0 2024-09-14T10:44:29.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.876+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345c1b0 con 0x55e5a3455ce0 2024-09-14T10:44:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.876+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.876+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94444775128192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345ca50 con 0x55e5a3455ce0 2024-09-14T10:44:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.876+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345d450 con 0x7f282801c030 2024-09-14T10:44:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94444775124320] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c040040 con 0x7f282801c030 2024-09-14T10:44:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94444775125376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345d840 con 0x7f282801c030 2024-09-14T10:44:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345e200 con 0x55e5a344fbe0 2024-09-14T10:44:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94444775128192] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94444775125376] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c040040 con 0x7f282801c030 2024-09-14T10:44:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94444775133024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345dd50 con 0x55e5a344fbe0 2024-09-14T10:44:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.880+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345e5a0 con 0x7f282c031040 2024-09-14T10:44:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.884+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94444775133024] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.884+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.884+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94444775136592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345e990 con 0x7f282c031040 2024-09-14T10:44:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.884+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345f1e0 con 0x7f282c031040 2024-09-14T10:44:29.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.884+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.884+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94444775139728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345f300 con 0x7f282c031040 2024-09-14T10:44:29.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.884+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345fe20 con 0x7f282c031040 2024-09-14T10:44:29.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.884+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94444775136592] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94444775143664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345fde0 con 0x7f282c031040 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 add_watcher() i=0 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 add_watcher() i=1 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 add_watcher() i=2 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 add_watcher() i=3 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 add_watcher() i=4 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 add_watcher() i=5 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94444775139728] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 add_watcher() i=6 2024-09-14T10:44:29.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94444775143664] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 add_watcher() i=7 2024-09-14T10:44:29.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:29.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345edb0 con 0x55e5a344fbe0 2024-09-14T10:44:29.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94444775140784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3460240 con 0x55e5a344fbe0 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94444775140784] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f26e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.888+0000 7f2835a649c0 5 note: GC not initialized 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f26e8fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 20 Filter name: none 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f26627fc640 20 reqs_thread_entry: start 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3486070 con 0x55e5a344fbe0 2024-09-14T10:44:29.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:29.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:29.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3486a60 con 0x55e5a344fbe0 2024-09-14T10:44:29.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:29.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3487a70 con 0x7f282801c030 2024-09-14T10:44:29.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f282c040040 con 0x7f282801c030 2024-09-14T10:44:29.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f26e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:29.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94444775140784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3483d10 con 0x55e5a344fbe0 2024-09-14T10:44:29.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94444775140784] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.892+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94444775120528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3483d10 con 0x7f282801c030 2024-09-14T10:44:29.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94444775120528] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c040040 con 0x7f282801c030 2024-09-14T10:44:29.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2835a649c0 20 remove_watcher() i=0 2024-09-14T10:44:29.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2835a649c0 2 removed watcher, disabling cache 2024-09-14T10:44:29.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94444775124320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3483d10 con 0x55e5a344fbe0 2024-09-14T10:44:29.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94444775124320] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2835a649c0 20 remove_watcher() i=1 2024-09-14T10:44:29.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94444775128192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3483d10 con 0x55e5a3455ce0 2024-09-14T10:44:29.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2832d69640 1 -- 172.21.15.96:0/1199927178 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94444775128192] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282800d040 con 0x55e5a3455ce0 2024-09-14T10:44:29.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2835a649c0 20 remove_watcher() i=2 2024-09-14T10:44:29.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.896+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94444775125376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345ad60 con 0x7f282801c030 2024-09-14T10:44:29.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.900+0000 7f2833d6b640 1 -- 172.21.15.96:0/1199927178 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94444775125376] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c040040 con 0x7f282801c030 2024-09-14T10:44:29.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.900+0000 7f2835a649c0 20 remove_watcher() i=3 2024-09-14T10:44:29.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.900+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94444775133024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3459e90 con 0x55e5a344fbe0 2024-09-14T10:44:29.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.900+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94444775133024] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x55e5a344fbe0 2024-09-14T10:44:29.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.900+0000 7f2835a649c0 20 remove_watcher() i=4 2024-09-14T10:44:29.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.900+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94444775136592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3459e90 con 0x7f282c031040 2024-09-14T10:44:29.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.904+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94444775136592] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.904+0000 7f2835a649c0 20 remove_watcher() i=5 2024-09-14T10:44:29.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.904+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94444775139728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a345dd50 con 0x7f282c031040 2024-09-14T10:44:29.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.904+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94444775139728] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.904+0000 7f2835a649c0 20 remove_watcher() i=6 2024-09-14T10:44:29.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.904+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94444775143664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5a3459e90 con 0x7f282c031040 2024-09-14T10:44:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94444775143664] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28240d0930 con 0x7f282c031040 2024-09-14T10:44:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 20 remove_watcher() i=7 2024-09-14T10:44:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f282c031040 msgr2=0x7f282c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f282c031040 0x7f282c032430 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a344fbe0 msgr2=0x55e5a3452070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a344fbe0 0x55e5a3452070 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f282801c030 msgr2=0x7f2828052110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f282801c030 0x7f2828052110 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e5a3455ce0 msgr2=0x55e5a34580d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e5a3455ce0 0x55e5a34580d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26fc03a150 msgr2=0x7f26fc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f26fc03a150 0x7f26fc03c610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55e5a341a410 tx=0x7f282c01f000 comp rx=0 tx=0).stop 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 msgr2=0x55e5a3444680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f283356a640 1 -- 172.21.15.96:0/1199927178 reap_dead start 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a3444680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2828025c20 tx=0x7f2828050dd0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 shutdown_connections 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/1199927178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a343e130 0x55e5a3444680 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 >> 172.21.15.96:0/1199927178 conn(0x55e5a3439550 msgr2=0x55e5a3437760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 shutdown_connections 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/1199927178 wait complete. 2024-09-14T10:44:29.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/638597170 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f270c03a140 msgr2=0x7f270c03c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/638597170 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f270c03a140 0x7f270c03c600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55e5a3421150 tx=0x7f282c005850 comp rx=0 tx=0).stop 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/638597170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a34307a0 msgr2=0x55e5a3430bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/638597170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a34307a0 0x55e5a3430bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2828010f90 tx=0x7f282800f7a0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/638597170 shutdown_connections 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/638597170 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f270c03a140 0x7f270c03c600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/638597170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a34307a0 0x55e5a3430bc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/638597170 >> 172.21.15.96:0/638597170 conn(0x55e5a3426150 msgr2=0x55e5a3426530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/638597170 shutdown_connections 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/638597170 wait complete. 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a329a2d0 msgr2=0x55e5a3420130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a329a2d0 0x55e5a3420130 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f271803a2f0 msgr2=0x7f271803c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f271803a2f0 0x7f271803c7b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2828001e60 tx=0x7f28280013e0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 msgr2=0x55e5a3418fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3418fc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2824000c10 tx=0x7f28240180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 shutdown_connections 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e5a329a2d0 0x55e5a3420130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f271803a2f0 0x7f271803c7b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 --2- 172.21.15.96:0/98831665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5a3298cc0 0x55e5a3418fc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 >> 172.21.15.96:0/98831665 conn(0x55e5a331faf0 msgr2=0x55e5a3412bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 shutdown_connections 2024-09-14T10:44:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.908+0000 7f2835a649c0 1 -- 172.21.15.96:0/98831665 wait complete. 2024-09-14T10:44:29.914 INFO:teuthology.orchestra.run.smithi096.stdout:["myfoo"] 2024-09-14T10:44:29.915 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-14T10:44:29.918 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:29.918 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-14T10:44:29.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-14T10:44:29.918 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-14T10:44:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe052db9c0 1 Processor -- start 2024-09-14T10:44:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe052db9c0 1 -- start start 2024-09-14T10:44:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe052db9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c05ca0a240 0x55c05ca98c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe052db9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c05c93e7a0 con 0x55c05ca991b0 2024-09-14T10:44:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe052db9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55c05c99a1b0 con 0x55c05ca0a240 2024-09-14T10:44:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe02de1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c05ca0a240 0x55c05ca98c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe02de1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c05ca0a240 0x55c05ca98c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39610/0 (socket says 172.21.15.96:39610) 2024-09-14T10:44:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe025e0640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55c05ca991b0 0x55c05ca9b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34430/0 (socket says 172.21.15.96:34430) 2024-09-14T10:44:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.984+0000 7efe02de1640 1 -- 172.21.15.96:0/3735501097 learned_addr learned my addr 172.21.15.96:0/3735501097 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe02de1640 1 -- 172.21.15.96:0/3735501097 >> v1:172.21.15.70:6789/0 conn(0x55c05ca991b0 legacy=0x55c05ca9b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe02de1640 1 -- 172.21.15.96:0/3735501097 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05c918da0 con 0x55c05ca0a240 2024-09-14T10:44:29.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe02de1640 1 --2- 172.21.15.96:0/3735501097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca98c70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00a4e0 tx=0x7efdfc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c34afed3d42d8be server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:29.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe01ddf640 1 -- 172.21.15.96:0/3735501097 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdfc0aa540 con 0x55c05ca0a240 2024-09-14T10:44:29.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe01ddf640 1 -- 172.21.15.96:0/3735501097 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdfc0aa6e0 con 0x55c05ca0a240 2024-09-14T10:44:29.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe01ddf640 1 -- 172.21.15.96:0/3735501097 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdfc0aaa40 con 0x55c05ca0a240 2024-09-14T10:44:29.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe052db9c0 1 -- 172.21.15.96:0/3735501097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 msgr2=0x55c05ca98c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:29.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3735501097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca98c70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00a4e0 tx=0x7efdfc01b090 comp rx=0 tx=0).stop 2024-09-14T10:44:29.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe052db9c0 1 -- 172.21.15.96:0/3735501097 shutdown_connections 2024-09-14T10:44:29.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3735501097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca98c70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:29.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe052db9c0 1 -- 172.21.15.96:0/3735501097 >> 172.21.15.96:0/3735501097 conn(0x55c05ca90960 msgr2=0x55c05ca92d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:29.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe052db9c0 1 -- 172.21.15.96:0/3735501097 shutdown_connections 2024-09-14T10:44:29.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:29.988+0000 7efe052db9c0 1 -- 172.21.15.96:0/3735501097 wait complete. 2024-09-14T10:44:30.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.000+0000 7efe052db9c0 1 Processor -- start 2024-09-14T10:44:30.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.000+0000 7efe052db9c0 1 -- start start 2024-09-14T10:44:30.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.000+0000 7efe052db9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca96210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.000+0000 7efe052db9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c05c99dfc0 con 0x55c05ca0a240 2024-09-14T10:44:30.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca96210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca96210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39620/0 (socket says 172.21.15.96:39620) 2024-09-14T10:44:30.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 -- 172.21.15.96:0/2010396422 learned_addr learned my addr 172.21.15.96:0/2010396422 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 -- 172.21.15.96:0/2010396422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05ca96800 con 0x55c05ca0a240 2024-09-14T10:44:30.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 --2- 172.21.15.96:0/2010396422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca96210 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efdfc019740 tx=0x7efdfc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9049b7feee790c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efcf0e09640 1 -- 172.21.15.96:0/2010396422 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdfc0b9070 con 0x55c05ca0a240 2024-09-14T10:44:30.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efcf0e09640 1 -- 172.21.15.96:0/2010396422 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdfc0aaa90 con 0x55c05ca0a240 2024-09-14T10:44:30.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efcf0e09640 1 -- 172.21.15.96:0/2010396422 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdfc0aad70 con 0x55c05ca0a240 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 -- 172.21.15.96:0/2010396422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 msgr2=0x55c05ca96210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2010396422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca96210 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efdfc019740 tx=0x7efdfc0033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 -- 172.21.15.96:0/2010396422 shutdown_connections 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2010396422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05ca96210 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 -- 172.21.15.96:0/2010396422 >> 172.21.15.96:0/2010396422 conn(0x55c05ca90960 msgr2=0x55c05cb7d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 -- 172.21.15.96:0/2010396422 shutdown_connections 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 -- 172.21.15.96:0/2010396422 wait complete. 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 Processor -- start 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 -- start start 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05cb8ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe052db9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c05c93fa50 con 0x55c05ca0a240 2024-09-14T10:44:30.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05cb8ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05cb8ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39624/0 (socket says 172.21.15.96:39624) 2024-09-14T10:44:30.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 -- 172.21.15.96:0/3974932446 learned_addr learned my addr 172.21.15.96:0/3974932446 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 -- 172.21.15.96:0/3974932446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05cb8b2c0 con 0x55c05ca0a240 2024-09-14T10:44:30.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.004+0000 7efe02de1640 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05cb8ad60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efdfc018cc0 tx=0x7efdfc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efcef606640 1 -- 172.21.15.96:0/3974932446 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdfc0b9070 con 0x55c05ca0a240 2024-09-14T10:44:30.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c05cb8b550 con 0x55c05ca0a240 2024-09-14T10:44:30.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efcef606640 1 -- 172.21.15.96:0/3974932446 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdfc0b5b10 con 0x55c05ca0a240 2024-09-14T10:44:30.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efcef606640 1 -- 172.21.15.96:0/3974932446 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdfc0b5df0 con 0x55c05ca0a240 2024-09-14T10:44:30.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05cb8bf00 con 0x55c05ca0a240 2024-09-14T10:44:30.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efcef606640 1 -- 172.21.15.96:0/3974932446 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7efdfc0b3040 con 0x55c05ca0a240 2024-09-14T10:44:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efcef606640 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce803a150 0x7efce803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efcef606640 1 -- 172.21.15.96:0/3974932446 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efdfc0c4070 con 0x55c05ca0a240 2024-09-14T10:44:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe025e0640 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce803a150 0x7efce803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05ca991b0 0x55c05cb91ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cb92410 con 0x55c05ca991b0 2024-09-14T10:44:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe035e2640 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05ca991b0 0x55c05cb91ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe025e0640 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce803a150 0x7efce803c610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efdf8001e90 tx=0x7efdf80013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe035e2640 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05ca991b0 0x55c05cb91ed0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe035e2640 1 -- 172.21.15.96:0/3974932446 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdf40083f0 con 0x55c05ca991b0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cb92860 con 0x55c05ca991b0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe035e2640 1 -- 172.21.15.96:0/3974932446 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdf40083f0 con 0x55c05ca991b0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cb94160 con 0x55c05ca991b0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe035e2640 1 -- 172.21.15.96:0/3974932446 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efdf40083f0 con 0x55c05ca991b0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cb93390 con 0x55c05ca991b0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe035e2640 1 -- 172.21.15.96:0/3974932446 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdf40083f0 con 0x55c05ca991b0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cb937e0 con 0x55c05ca991b0 2024-09-14T10:44:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.008+0000 7efe035e2640 1 -- 172.21.15.96:0/3974932446 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efdf40083f0 con 0x55c05ca991b0 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 Processor -- start 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 -- start start 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cba2520 0x55c05cba2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c05c9aad80 con 0x55c05cba2520 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe025e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cba2520 0x55c05cba2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe025e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cba2520 0x55c05cba2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39638/0 (socket says 172.21.15.96:39638) 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe025e0640 1 -- 172.21.15.96:0/3164609999 learned_addr learned my addr 172.21.15.96:0/3164609999 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe025e0640 1 -- 172.21.15.96:0/3164609999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05cba2f80 con 0x55c05cba2520 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe025e0640 1 --2- 172.21.15.96:0/3164609999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cba2520 0x55c05cba2940 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efdf800e670 tx=0x7efdf800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efcece01640 1 -- 172.21.15.96:0/3164609999 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf8022070 con 0x55c05cba2520 2024-09-14T10:44:30.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 -- 172.21.15.96:0/3164609999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c05cba37e0 con 0x55c05cba2520 2024-09-14T10:44:30.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efcece01640 1 -- 172.21.15.96:0/3164609999 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf800d660 con 0x55c05cba2520 2024-09-14T10:44:30.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efcece01640 1 -- 172.21.15.96:0/3164609999 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf8006070 con 0x55c05cba2520 2024-09-14T10:44:30.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 -- 172.21.15.96:0/3164609999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05cba3d50 con 0x55c05cba2520 2024-09-14T10:44:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efcece01640 1 -- 172.21.15.96:0/3164609999 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7efdf8025070 con 0x55c05cba2520 2024-09-14T10:44:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efcece01640 1 --2- 172.21.15.96:0/3164609999 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcdc03a140 0x7efcdc03c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efcece01640 1 -- 172.21.15.96:0/3164609999 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efdf8052550 con 0x55c05cba2520 2024-09-14T10:44:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe035e2640 1 --2- 172.21.15.96:0/3164609999 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcdc03a140 0x7efcdc03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 Processor -- start 2024-09-14T10:44:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 -- start start 2024-09-14T10:44:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe035e2640 1 --2- 172.21.15.96:0/3164609999 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcdc03a140 0x7efcdc03c600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c05cb92eb0 tx=0x7efdf4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.012+0000 7efe052db9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c05ca94af0 con 0x55c05cbafe90 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39644/0 (socket says 172.21.15.96:39644) 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 -- 172.21.15.96:0/3397188029 learned_addr learned my addr 172.21.15.96:0/3397188029 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 -- 172.21.15.96:0/3397188029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05cbb0880 con 0x55c05cbafe90 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 --2- 172.21.15.96:0/3397188029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb0290 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efdf8050970 tx=0x7efdf800df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e4aa202d283664 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efce67fc640 1 -- 172.21.15.96:0/3397188029 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf804e070 con 0x55c05cbafe90 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efce67fc640 1 -- 172.21.15.96:0/3397188029 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf801a320 con 0x55c05cbafe90 2024-09-14T10:44:30.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efce67fc640 1 -- 172.21.15.96:0/3397188029 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf8026a20 con 0x55c05cbafe90 2024-09-14T10:44:30.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- 172.21.15.96:0/3397188029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 msgr2=0x55c05cbb0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3397188029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb0290 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efdf8050970 tx=0x7efdf800df30 comp rx=0 tx=0).stop 2024-09-14T10:44:30.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- 172.21.15.96:0/3397188029 shutdown_connections 2024-09-14T10:44:30.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3397188029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb0290 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- 172.21.15.96:0/3397188029 >> 172.21.15.96:0/3397188029 conn(0x55c05cbab2b0 msgr2=0x55c05cba94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- 172.21.15.96:0/3397188029 shutdown_connections 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- 172.21.15.96:0/3397188029 wait complete. 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 Processor -- start 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- start start 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c05cbaede0 con 0x55c05cbafe90 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39646/0 (socket says 172.21.15.96:39646) 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 learned_addr learned my addr 172.21.15.96:0/2453266040 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05cbb68e0 con 0x55c05cbafe90 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe025e0640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb6380 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efdf801bfd0 tx=0x7efdf80508d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efce4ff9640 1 -- 172.21.15.96:0/2453266040 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf804e030 con 0x55c05cbafe90 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efce4ff9640 1 -- 172.21.15.96:0/2453266040 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf801a320 con 0x55c05cbafe90 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c05cbb68e0 con 0x55c05cbafe90 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efce4ff9640 1 -- 172.21.15.96:0/2453266040 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf80521c0 con 0x55c05cbafe90 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.016+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05cbb68e0 con 0x55c05cbafe90 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efce4ff9640 1 -- 172.21.15.96:0/2453266040 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7efdf804f270 con 0x55c05cbafe90 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efce4ff9640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efccc03a150 0x7efccc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efce4ff9640 1 -- 172.21.15.96:0/2453266040 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efdf804f070 con 0x55c05cbafe90 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe035e2640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efccc03a150 0x7efccc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05cbc1560 0x55c05cbc39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc4140 con 0x55c05cbc1560 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe02de1640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05cbc1560 0x55c05cbc39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe035e2640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efccc03a150 0x7efccc03c610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efdf400f010 tx=0x7efdf401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe02de1640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05cbc1560 0x55c05cbc39f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 realm 2024-09-14T10:44:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc4550 con 0x55c05cbc1560 2024-09-14T10:44:30.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc4e20 con 0x55c05cbc1560 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc51c0 con 0x55c05cbc1560 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc5660 con 0x55c05cbc1560 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 20 searching for the correct realm 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c05cbc7600 0x55c05cbc9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbca140 con 0x55c05cbc7600 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe025e0640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c05cbc7600 0x55c05cbc9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe025e0640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c05cbc7600 0x55c05cbc9a70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe025e0640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efdf8027060 0x7efdf8014070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbca140 con 0x7efdf8027060 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe035e2640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efdf8027060 0x7efdf8014070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.020+0000 7efe035e2640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efdf8027060 0x7efdf8014070 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe035e2640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efdf4019040 0x7efdf4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbca140 con 0x7efdf4019040 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efdf4019040 0x7efdf4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efdf4019040 0x7efdf4019930 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x7efdf4019040 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbca140 con 0x55c05cbc1560 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbca140 con 0x55c05cbc1560 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbca140 con 0x7efdf4019040 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x7efdf4019040 2024-09-14T10:44:30.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbca140 con 0x7efdf4019040 2024-09-14T10:44:30.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x7efdf4019040 2024-09-14T10:44:30.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf8027060 2024-09-14T10:44:30.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc7600 2024-09-14T10:44:30.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.024+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc1560 2024-09-14T10:44:30.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf4019040 2024-09-14T10:44:30.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x7efdf4019040 2024-09-14T10:44:30.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc1560 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf8027060 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc7600 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc7600 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf4019040 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x7efdf4019040 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc7600 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc7600 2024-09-14T10:44:30.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc1560 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc1560 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efdfc0a9ce0 con 0x55c05cbc1560 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.028+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf4019040 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc7600 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf8027060 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc1560 2024-09-14T10:44:30.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf4019040 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc7600 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf4019040 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf8027060 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc7600 2024-09-14T10:44:30.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf4019040 2024-09-14T10:44:30.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.032+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x55c05cbc1560 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7efdfc0e0040 con 0x7efdf8027060 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc5f70 con 0x55c05cbc1560 2024-09-14T10:44:30.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc6360 con 0x55c05cbc1560 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc6360 con 0x55c05cbc1560 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 zone default found 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 4 Realm: () 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:30.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 zonegroup default 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc6780 con 0x7efdf4019040 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc6780 con 0x55c05cbc7600 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcbfb0 con 0x55c05cbc7600 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 started sync module instance, tier type = 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf8027060 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94284677953600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcc850 con 0x7efdf8027060 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.036+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcd0a0 con 0x55c05cbc1560 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.040+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94284677953600] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.040+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.040+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94284677956512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbccc70 con 0x55c05cbc1560 2024-09-14T10:44:30.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.040+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcd790 con 0x55c05cbc7600 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.040+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.040+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94284677960288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbce030 con 0x55c05cbc7600 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.040+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcea30 con 0x7efdf8027060 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.040+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94284677956512] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.044+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.044+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94284677957568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcee20 con 0x7efdf8027060 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.044+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcf7e0 con 0x55c05cbc1560 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.044+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94284677960288] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.044+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94284677957568] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.044+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.044+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94284677965120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcf330 con 0x55c05cbc1560 2024-09-14T10:44:30.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.044+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbd0080 con 0x7efdf4019040 2024-09-14T10:44:30.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.048+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94284677965120] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.048+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.048+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94284677962624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcfda0 con 0x7efdf4019040 2024-09-14T10:44:30.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.048+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbd05f0 con 0x7efdf4019040 2024-09-14T10:44:30.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.048+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94284677962624] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.048+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.048+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94284677970432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbd03f0 con 0x7efdf4019040 2024-09-14T10:44:30.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.048+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbd0f10 con 0x7efdf4019040 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94284677974496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbd1380 con 0x7efdf4019040 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 20 add_watcher() i=0 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 20 add_watcher() i=1 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 20 add_watcher() i=2 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 20 add_watcher() i=3 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 20 add_watcher() i=4 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 20 add_watcher() i=5 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94284677970432] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 20 add_watcher() i=6 2024-09-14T10:44:30.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94284677974496] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 20 add_watcher() i=7 2024-09-14T10:44:30.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:30.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbd1380 con 0x55c05cbc1560 2024-09-14T10:44:30.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94284677975760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbd12f0 con 0x55c05cbc1560 2024-09-14T10:44:30.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94284677975760] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.052+0000 7efcb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:30.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe052db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:30.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe052db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:30.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe052db9c0 5 note: GC not initialized 2024-09-14T10:44:30.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efc33fff640 20 reqs_thread_entry: start 2024-09-14T10:44:30.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe052db9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:30.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe052db9c0 20 Filter name: none 2024-09-14T10:44:30.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efc31ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:30.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbf7050 con 0x55c05cbc7600 2024-09-14T10:44:30.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbf7050 con 0x55c05cbc7600 2024-09-14T10:44:30.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbf7050 con 0x55c05cbc1560 2024-09-14T10:44:30.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc5f70 con 0x55c05cbc1560 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc5f70 con 0x7efdf8027060 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc7600 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc1560 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc7600 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf8027060 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc7600 2024-09-14T10:44:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc1560 2024-09-14T10:44:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.056+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf4019040 2024-09-14T10:44:30.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf4019040 2024-09-14T10:44:30.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc7600 2024-09-14T10:44:30.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf4019040 2024-09-14T10:44:30.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf4019040 2024-09-14T10:44:30.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf4019040 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc7600 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf8027060 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc1560 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc1560 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.060+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc7600 2024-09-14T10:44:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf8027060 2024-09-14T10:44:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf4019040 2024-09-14T10:44:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc1560 2024-09-14T10:44:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf4019040 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc7600 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf8027060 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf4019040 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc1560 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x55c05cbc7600 2024-09-14T10:44:30.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb450 con 0x7efdf8027060 2024-09-14T10:44:30.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe052db9c0 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:30.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.064+0000 7efe052db9c0 20 RGWRados::pool_iterate: got myfoo 2024-09-14T10:44:30.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.068+0000 7efcb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:30.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.068+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94284677975760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbc5f70 con 0x55c05cbc1560 2024-09-14T10:44:30.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.068+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94284677975760] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.068+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94284677953600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbf52d0 con 0x7efdf8027060 2024-09-14T10:44:30.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.068+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94284677953600] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.068+0000 7efe052db9c0 20 remove_watcher() i=0 2024-09-14T10:44:30.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.068+0000 7efe052db9c0 2 removed watcher, disabling cache 2024-09-14T10:44:30.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.068+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94284677956512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb840 con 0x55c05cbc1560 2024-09-14T10:44:30.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94284677956512] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe052db9c0 20 remove_watcher() i=1 2024-09-14T10:44:30.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94284677960288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbf52d0 con 0x55c05cbc7600 2024-09-14T10:44:30.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe025e0640 1 -- 172.21.15.96:0/2453266040 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94284677960288] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf8036020 con 0x55c05cbc7600 2024-09-14T10:44:30.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe052db9c0 20 remove_watcher() i=2 2024-09-14T10:44:30.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94284677957568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcc3a0 con 0x7efdf8027060 2024-09-14T10:44:30.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe035e2640 1 -- 172.21.15.96:0/2453266040 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94284677957568] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf402f040 con 0x7efdf8027060 2024-09-14T10:44:30.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe052db9c0 20 remove_watcher() i=3 2024-09-14T10:44:30.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.072+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94284677965120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb840 con 0x55c05cbc1560 2024-09-14T10:44:30.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.076+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94284677965120] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x55c05cbc1560 2024-09-14T10:44:30.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.076+0000 7efe052db9c0 20 remove_watcher() i=4 2024-09-14T10:44:30.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.076+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94284677962624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbce540 con 0x7efdf4019040 2024-09-14T10:44:30.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.076+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94284677962624] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.076+0000 7efe052db9c0 20 remove_watcher() i=5 2024-09-14T10:44:30.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.076+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94284677970432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbcb840 con 0x7efdf4019040 2024-09-14T10:44:30.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94284677970432] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 20 remove_watcher() i=6 2024-09-14T10:44:30.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94284677974496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c05cbce540 con 0x7efdf4019040 2024-09-14T10:44:30.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94284677974496] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdfc0f1040 con 0x7efdf4019040 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 20 remove_watcher() i=7 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efdf4019040 msgr2=0x7efdf4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7efdf4019040 0x7efdf4019930 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05cbc1560 msgr2=0x55c05cbc39f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05cbc1560 0x55c05cbc39f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efdf8027060 msgr2=0x7efdf8014070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7efdf8027060 0x7efdf8014070 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c05cbc7600 msgr2=0x55c05cbc9a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c05cbc7600 0x55c05cbc9a70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efccc03a150 msgr2=0x7efccc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efccc03a150 0x7efccc03c610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efdf400f010 tx=0x7efdf401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:30.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 msgr2=0x55c05cbb6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/2453266040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cbafe90 0x55c05cbb6380 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efdf801bfd0 tx=0x7efdf80508d0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 reap_dead start 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe02de1640 1 -- 172.21.15.96:0/2453266040 reap_dead start 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 shutdown_connections 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 >> 172.21.15.96:0/2453266040 conn(0x55c05cbab2b0 msgr2=0x55c05cba94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 shutdown_connections 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/2453266040 wait complete. 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/3164609999 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcdc03a140 msgr2=0x7efcdc03c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3164609999 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcdc03a140 0x7efcdc03c600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c05cb92eb0 tx=0x7efdf4003070 comp rx=0 tx=0).stop 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/3164609999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cba2520 msgr2=0x55c05cba2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3164609999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cba2520 0x55c05cba2940 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efdf800e670 tx=0x7efdf800ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/3164609999 shutdown_connections 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3164609999 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efcdc03a140 0x7efcdc03c600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3164609999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05cba2520 0x55c05cba2940 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/3164609999 >> 172.21.15.96:0/3164609999 conn(0x55c05cb97ed0 msgr2=0x55c05cb982b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/3164609999 shutdown_connections 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.080+0000 7efe052db9c0 1 -- 172.21.15.96:0/3164609999 wait complete. 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05ca991b0 msgr2=0x55c05cb91ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05ca991b0 0x55c05cb91ed0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce803a150 msgr2=0x7efce803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce803a150 0x7efce803c610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efdf8001e90 tx=0x7efdf80013f0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 msgr2=0x55c05cb8ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05cb8ad60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efdfc018cc0 tx=0x7efdfc017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 shutdown_connections 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c05ca991b0 0x55c05cb91ed0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efce803a150 0x7efce803c610 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 --2- 172.21.15.96:0/3974932446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c05ca0a240 0x55c05cb8ad60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 >> 172.21.15.96:0/3974932446 conn(0x55c05ca90960 msgr2=0x55c05cb7cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 shutdown_connections 2024-09-14T10:44:30.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.084+0000 7efe052db9c0 1 -- 172.21.15.96:0/3974932446 wait complete. 2024-09-14T10:44:30.089 INFO:teuthology.orchestra.run.smithi096.stdout:["myfoo"] 2024-09-14T10:44:30.089 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-14T10:44:30.105 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:30.121 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:30.135 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:30.181 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-14T10:44:30.251 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:30.323 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:30.396 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:30.397 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:44:30.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:44:30.397 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-14T10:44:30.435 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc83a3f89c0 1 Processor -- start 2024-09-14T10:44:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc83a3f89c0 1 -- start start 2024-09-14T10:44:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc83a3f89c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5605f1ded070 0x5605f1debbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc83a3f89c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5605f1d1e7a0 con 0x5605f1decb40 2024-09-14T10:44:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc83a3f89c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5605f1d7a1b0 con 0x5605f1ded070 2024-09-14T10:44:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc837efe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5605f1decb40 0x5605f1deb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:34446/0 (socket says 172.21.15.96:34446) 2024-09-14T10:44:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc837efe640 1 -- 172.21.15.96:0/1378371427 learned_addr learned my addr 172.21.15.96:0/1378371427 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc8376fd640 1 --2- 172.21.15.96:0/1378371427 >> v2:172.21.15.70:3300/0 conn(0x5605f1ded070 0x5605f1debbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc836efc640 1 -- 172.21.15.96:0/1378371427 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807979279 0 0) 0x5605f1d1e7a0 con 0x5605f1decb40 2024-09-14T10:44:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc836efc640 1 -- 172.21.15.96:0/1378371427 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc820001e20 con 0x5605f1decb40 2024-09-14T10:44:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc8376fd640 1 -- 172.21.15.96:0/1378371427 >> v1:172.21.15.70:6789/0 conn(0x5605f1decb40 legacy=0x5605f1deb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.440+0000 7fc8376fd640 1 -- 172.21.15.96:0/1378371427 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f1cf8da0 con 0x5605f1ded070 2024-09-14T10:44:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc8376fd640 1 --2- 172.21.15.96:0/1378371427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1ded070 0x5605f1debbf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00a480 tx=0x7fc82c01b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb6189231366fed server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc836efc640 1 -- 172.21.15.96:0/1378371427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0af070 con 0x5605f1ded070 2024-09-14T10:44:30.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc836efc640 1 -- 172.21.15.96:0/1378371427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0aa570 con 0x5605f1ded070 2024-09-14T10:44:30.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc836efc640 1 -- 172.21.15.96:0/1378371427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0aa850 con 0x5605f1ded070 2024-09-14T10:44:30.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1378371427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1ded070 msgr2=0x5605f1debbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1378371427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1ded070 0x5605f1debbf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00a480 tx=0x7fc82c01b220 comp rx=0 tx=0).stop 2024-09-14T10:44:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1378371427 shutdown_connections 2024-09-14T10:44:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1378371427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1ded070 0x5605f1debbf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1378371427 >> 172.21.15.96:0/1378371427 conn(0x5605f1e71b20 msgr2=0x5605f1e73f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1378371427 shutdown_connections 2024-09-14T10:44:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.444+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1378371427 wait complete. 2024-09-14T10:44:30.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc83a3f89c0 1 Processor -- start 2024-09-14T10:44:30.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc83a3f89c0 1 -- start start 2024-09-14T10:44:30.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc83a3f89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f63630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc83a3f89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605f1d7dfc0 con 0x5605f1decb40 2024-09-14T10:44:30.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc837efe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f63630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc837efe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f63630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39676/0 (socket says 172.21.15.96:39676) 2024-09-14T10:44:30.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc837efe640 1 -- 172.21.15.96:0/1485096787 learned_addr learned my addr 172.21.15.96:0/1485096787 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc837efe640 1 -- 172.21.15.96:0/1485096787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f1f63c20 con 0x5605f1decb40 2024-09-14T10:44:30.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc837efe640 1 --2- 172.21.15.96:0/1485096787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f63630 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc8300016a0 tx=0x7fc830001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcc365390d5c716 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc725e0b640 1 -- 172.21.15.96:0/1485096787 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc830004530 con 0x5605f1decb40 2024-09-14T10:44:30.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc725e0b640 1 -- 172.21.15.96:0/1485096787 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8300046d0 con 0x5605f1decb40 2024-09-14T10:44:30.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.460+0000 7fc725e0b640 1 -- 172.21.15.96:0/1485096787 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8300049f0 con 0x5605f1decb40 2024-09-14T10:44:30.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1485096787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 msgr2=0x5605f1f63630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1485096787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f63630 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc8300016a0 tx=0x7fc830001b60 comp rx=0 tx=0).stop 2024-09-14T10:44:30.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1485096787 shutdown_connections 2024-09-14T10:44:30.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1485096787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f63630 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1485096787 >> 172.21.15.96:0/1485096787 conn(0x5605f1e71b20 msgr2=0x5605f1f5f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1485096787 shutdown_connections 2024-09-14T10:44:30.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1485096787 wait complete. 2024-09-14T10:44:30.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 Processor -- start 2024-09-14T10:44:30.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- start start 2024-09-14T10:44:30.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f6ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605f1d1fa50 con 0x5605f1decb40 2024-09-14T10:44:30.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc837efe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f6ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc837efe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f6ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39688/0 (socket says 172.21.15.96:39688) 2024-09-14T10:44:30.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc837efe640 1 -- 172.21.15.96:0/369380796 learned_addr learned my addr 172.21.15.96:0/369380796 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc837efe640 1 -- 172.21.15.96:0/369380796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f1f6b3e0 con 0x5605f1decb40 2024-09-14T10:44:30.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc837efe640 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f6ae80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc830001ba0 tx=0x7fc830004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc71ffff640 1 -- 172.21.15.96:0/369380796 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc830013760 con 0x5605f1decb40 2024-09-14T10:44:30.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f1f6b670 con 0x5605f1decb40 2024-09-14T10:44:30.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc71ffff640 1 -- 172.21.15.96:0/369380796 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc830013900 con 0x5605f1decb40 2024-09-14T10:44:30.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc71ffff640 1 -- 172.21.15.96:0/369380796 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc830013c00 con 0x5605f1decb40 2024-09-14T10:44:30.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f1f6c020 con 0x5605f1decb40 2024-09-14T10:44:30.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.464+0000 7fc71ffff640 1 -- 172.21.15.96:0/369380796 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc830010070 con 0x5605f1decb40 2024-09-14T10:44:30.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc71ffff640 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc72003a150 0x7fc72003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc71ffff640 1 -- 172.21.15.96:0/369380796 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc830018070 con 0x5605f1decb40 2024-09-14T10:44:30.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8376fd640 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc72003a150 0x7fc72003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1ded070 0x5605f1f71ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1f72530 con 0x5605f1ded070 2024-09-14T10:44:30.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8386ff640 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1ded070 0x5605f1f71ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8376fd640 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc72003a150 0x7fc72003c610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0ac000 tx=0x7fc82c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8386ff640 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1ded070 0x5605f1f71ff0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8386ff640 1 -- 172.21.15.96:0/369380796 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8280083f0 con 0x5605f1ded070 2024-09-14T10:44:30.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1f6c380 con 0x5605f1ded070 2024-09-14T10:44:30.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8386ff640 1 -- 172.21.15.96:0/369380796 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8280083f0 con 0x5605f1ded070 2024-09-14T10:44:30.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1f742c0 con 0x5605f1ded070 2024-09-14T10:44:30.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8386ff640 1 -- 172.21.15.96:0/369380796 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8280083f0 con 0x5605f1ded070 2024-09-14T10:44:30.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1f734f0 con 0x5605f1ded070 2024-09-14T10:44:30.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8386ff640 1 -- 172.21.15.96:0/369380796 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8280083f0 con 0x5605f1ded070 2024-09-14T10:44:30.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1f73940 con 0x5605f1ded070 2024-09-14T10:44:30.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8386ff640 1 -- 172.21.15.96:0/369380796 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8280083f0 con 0x5605f1ded070 2024-09-14T10:44:30.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 Processor -- start 2024-09-14T10:44:30.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 -- start start 2024-09-14T10:44:30.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f82680 0x5605f1f82aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc83a3f89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605f1d8ad80 con 0x5605f1f82680 2024-09-14T10:44:30.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8376fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f82680 0x5605f1f82aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8376fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f82680 0x5605f1f82aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39704/0 (socket says 172.21.15.96:39704) 2024-09-14T10:44:30.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.468+0000 7fc8376fd640 1 -- 172.21.15.96:0/2233722318 learned_addr learned my addr 172.21.15.96:0/2233722318 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc8376fd640 1 -- 172.21.15.96:0/2233722318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f1f830e0 con 0x5605f1f82680 2024-09-14T10:44:30.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc8376fd640 1 --2- 172.21.15.96:0/2233722318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f82680 0x5605f1f82aa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc82c017e90 tx=0x7fc82c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc71d7fa640 1 -- 172.21.15.96:0/2233722318 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0c7070 con 0x5605f1f82680 2024-09-14T10:44:30.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/2233722318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f1f83940 con 0x5605f1f82680 2024-09-14T10:44:30.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc71d7fa640 1 -- 172.21.15.96:0/2233722318 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0b0040 con 0x5605f1f82680 2024-09-14T10:44:30.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc71d7fa640 1 -- 172.21.15.96:0/2233722318 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0af050 con 0x5605f1f82680 2024-09-14T10:44:30.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/2233722318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f1f83e50 con 0x5605f1f82680 2024-09-14T10:44:30.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc71d7fa640 1 -- 172.21.15.96:0/2233722318 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc82c0ca070 con 0x5605f1f82680 2024-09-14T10:44:30.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc71d7fa640 1 --2- 172.21.15.96:0/2233722318 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71003a140 0x7fc71003c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc71d7fa640 1 -- 172.21.15.96:0/2233722318 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc82c0ecd30 con 0x5605f1f82680 2024-09-14T10:44:30.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc8386ff640 1 --2- 172.21.15.96:0/2233722318 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71003a140 0x7fc71003c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc83a3f89c0 1 Processor -- start 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc83a3f89c0 1 -- start start 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc8386ff640 1 --2- 172.21.15.96:0/2233722318 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71003a140 0x7fc71003c600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e3f0 tx=0x7fc828003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc83a3f89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f902b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc83a3f89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605f1f64050 con 0x5605f1f8feb0 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc8376fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f902b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc8376fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f902b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39712/0 (socket says 172.21.15.96:39712) 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.472+0000 7fc8376fd640 1 -- 172.21.15.96:0/543301636 learned_addr learned my addr 172.21.15.96:0/543301636 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc8376fd640 1 -- 172.21.15.96:0/543301636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f1f908a0 con 0x5605f1f8feb0 2024-09-14T10:44:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc8376fd640 1 --2- 172.21.15.96:0/543301636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f902b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0eb120 tx=0x7fc82c0b5cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778769e6585752fb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc716ffd640 1 -- 172.21.15.96:0/543301636 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0de070 con 0x5605f1f8feb0 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc716ffd640 1 -- 172.21.15.96:0/543301636 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0b5510 con 0x5605f1f8feb0 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc716ffd640 1 -- 172.21.15.96:0/543301636 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0c1dd0 con 0x5605f1f8feb0 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/543301636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 msgr2=0x5605f1f902b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/543301636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f902b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0eb120 tx=0x7fc82c0b5cc0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/543301636 shutdown_connections 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/543301636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f902b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/543301636 >> 172.21.15.96:0/543301636 conn(0x5605f1f8b2d0 msgr2=0x5605f1f89510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/543301636 shutdown_connections 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/543301636 wait complete. 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 Processor -- start 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- start start 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605f1f8ee00 con 0x5605f1f8feb0 2024-09-14T10:44:30.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc8376fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc8376fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:39722/0 (socket says 172.21.15.96:39722) 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 learned_addr learned my addr 172.21.15.96:0/1972293581 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605f1f96950 con 0x5605f1f8feb0 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc8376fd640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f963f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0c2a80 tx=0x7fc82c0eb0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc7157fa640 1 -- 172.21.15.96:0/1972293581 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0ef070 con 0x5605f1f8feb0 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605f1f96be0 con 0x5605f1f8feb0 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc7157fa640 1 -- 172.21.15.96:0/1972293581 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0df040 con 0x5605f1f8feb0 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc7157fa640 1 -- 172.21.15.96:0/1972293581 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82c0ea020 con 0x5605f1f8feb0 2024-09-14T10:44:30.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.476+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605f1f97590 con 0x5605f1f8feb0 2024-09-14T10:44:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc7157fa640 1 -- 172.21.15.96:0/1972293581 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc82c0c13a0 con 0x5605f1f8feb0 2024-09-14T10:44:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc7157fa640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70003a150 0x7fc70003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc7157fa640 1 -- 172.21.15.96:0/1972293581 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc82c0e8570 con 0x5605f1f8feb0 2024-09-14T10:44:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc8386ff640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70003a150 0x7fc70003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1fa1950 0x5605f1fa3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa4530 con 0x5605f1fa1950 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc837efe640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1fa1950 0x5605f1fa3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc8386ff640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70003a150 0x7fc70003c610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5605f1f73010 tx=0x7fc82801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc837efe640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1fa1950 0x5605f1fa3de0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 realm 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa4940 con 0x5605f1fa1950 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5210 con 0x5605f1fa1950 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa55b0 con 0x5605f1fa1950 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 20 searching for the correct realm 2024-09-14T10:44:30.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5605f1fa7a50 0x5605f1fa9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1faa4f0 con 0x5605f1fa7a50 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.480+0000 7fc8376fd640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5605f1fa7a50 0x5605f1fa9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8376fd640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5605f1fa7a50 0x5605f1fa9e40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8376fd640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc82c0f4070 0x7fc82c0e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1faa4f0 con 0x7fc82c0f4070 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8386ff640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc82c0f4070 0x7fc82c0e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8386ff640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc82c0f4070 0x7fc82c0e8890 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8386ff640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc828019040 0x7fc828019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1faa4f0 con 0x7fc828019040 2024-09-14T10:44:30.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc837efe640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc828019040 0x7fc828019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc837efe640 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc828019040 0x7fc828019930 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.484+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc828019040 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc828019040 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc82c0f4070 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa7a50 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc828019040 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc82c0f4070 2024-09-14T10:44:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa7a50 2024-09-14T10:44:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa7a50 2024-09-14T10:44:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.488+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc828019040 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa7a50 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa7a50 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc828019040 2024-09-14T10:44:30.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa7a50 2024-09-14T10:44:30.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc82c0f4070 2024-09-14T10:44:30.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc828019040 2024-09-14T10:44:30.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.492+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa7a50 2024-09-14T10:44:30.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc828019040 2024-09-14T10:44:30.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc82c0f4070 2024-09-14T10:44:30.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa7a50 2024-09-14T10:44:30.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc828019040 2024-09-14T10:44:30.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x5605f1fa1950 2024-09-14T10:44:30.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa5a50 con 0x7fc82c0f4070 2024-09-14T10:44:30.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:30.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa63c0 con 0x5605f1fa1950 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa67b0 con 0x5605f1fa1950 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:30.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa67b0 con 0x5605f1fa1950 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 zone default found 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 4 Realm: () 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 zonegroup default 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.496+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa6bd0 con 0x7fc828019040 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fa6bd0 con 0x5605f1fa7a50 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fac340 con 0x5605f1fa7a50 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 20 started sync module instance, tier type = 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:30.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fab7e0 con 0x7fc82c0f4070 2024-09-14T10:44:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94583534566400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1facc00 con 0x7fc82c0f4070 2024-09-14T10:44:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.500+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fad450 con 0x5605f1fa1950 2024-09-14T10:44:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.504+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94583534566400] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.504+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.504+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94583534569296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fad080 con 0x5605f1fa1950 2024-09-14T10:44:30.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.504+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fadba0 con 0x5605f1fa7a50 2024-09-14T10:44:30.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.504+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.504+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94583534573168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fae440 con 0x5605f1fa7a50 2024-09-14T10:44:30.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.504+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1faee40 con 0x7fc82c0f4070 2024-09-14T10:44:30.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.504+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94583534569296] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94583534570352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1faf230 con 0x7fc82c0f4070 2024-09-14T10:44:30.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fafbf0 con 0x5605f1fa1950 2024-09-14T10:44:30.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94583534573168] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94583534570352] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94583534578000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1faf740 con 0x5605f1fa1950 2024-09-14T10:44:30.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fb0490 con 0x7fc828019040 2024-09-14T10:44:30.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.508+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94583534578000] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.512+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.512+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94583534575504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fb01b0 con 0x7fc828019040 2024-09-14T10:44:30.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.512+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fb0a00 con 0x7fc828019040 2024-09-14T10:44:30.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.512+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.512+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94583534584512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fb0d90 con 0x7fc828019040 2024-09-14T10:44:30.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.512+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fb18b0 con 0x7fc828019040 2024-09-14T10:44:30.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.512+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94583534575504] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94583534588800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fb1870 con 0x7fc828019040 2024-09-14T10:44:30.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 add_watcher() i=0 2024-09-14T10:44:30.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 add_watcher() i=1 2024-09-14T10:44:30.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 add_watcher() i=2 2024-09-14T10:44:30.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 add_watcher() i=3 2024-09-14T10:44:30.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 add_watcher() i=4 2024-09-14T10:44:30.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 add_watcher() i=5 2024-09-14T10:44:30.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94583534584512] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 add_watcher() i=6 2024-09-14T10:44:30.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94583534588800] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 add_watcher() i=7 2024-09-14T10:44:30.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:30.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fb0820 con 0x5605f1fa1950 2024-09-14T10:44:30.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94583534585824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fb1ca0 con 0x5605f1fa1950 2024-09-14T10:44:30.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94583534585824] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc6edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:30.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:30.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.516+0000 7fc83a3f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:30.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 5 note: GC not initialized 2024-09-14T10:44:30.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc6ecfe1640 20 reqs_thread_entry: start 2024-09-14T10:44:30.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:30.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 Filter name: none 2024-09-14T10:44:30.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc6667fc640 20 reqs_thread_entry: start 2024-09-14T10:44:30.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd7e30 con 0x7fc82c0f4070 2024-09-14T10:44:30.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:30.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:63 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd87c0 con 0x5605f1fa7a50 2024-09-14T10:44:30.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(63 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd9e90 con 0x7fc82c0f4070 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd9e90 con 0x5605f1fa7a50 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(65 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 4.2e 4:77aa7d25:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fdb780 con 0x5605f1fa7a50 2024-09-14T10:44:30.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 4.31 4:8c880be2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fde1b0 con 0x5605f1fa1950 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 4.15 4:aa6540a5:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fe0dd0 con 0x5605f1fa7a50 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 4.1c 4:3adf25d2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fe3730 con 0x7fc828019040 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 4.2 4:4285a78a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fe0dd0 con 0x5605f1fa1950 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 4.2c 4:37c95a4c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fe3730 con 0x5605f1fa1950 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 4.2a 4:5661d8ff:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1feb4a0 con 0x5605f1fa1950 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(66 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 4.2d 4:b689318c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fee1d0 con 0x7fc828019040 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:74 4.16 4:68627ddf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1feb4a0 con 0x5605f1fa7a50 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(68 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:75 4.18 4:1a24b59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1ff0a40 con 0x7fc82c0f4070 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 4.4 4:2304044a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5605f1ff1290 con 0x7fc828019040 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(67 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(75 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(74 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(70 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(71 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(72 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.520+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(76 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc6edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:30.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94583534585824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x5605f1fa1950 2024-09-14T10:44:30.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94583534585824] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94583534566400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x7fc82c0f4070 2024-09-14T10:44:30.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94583534566400] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc83a3f89c0 20 remove_watcher() i=0 2024-09-14T10:44:30.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc83a3f89c0 2 removed watcher, disabling cache 2024-09-14T10:44:30.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.524+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94583534569296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x5605f1fa1950 2024-09-14T10:44:30.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.528+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94583534569296] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.528+0000 7fc83a3f89c0 20 remove_watcher() i=1 2024-09-14T10:44:30.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.528+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94583534573168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x5605f1fa7a50 2024-09-14T10:44:30.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.528+0000 7fc8376fd640 1 -- 172.21.15.96:0/1972293581 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94583534573168] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c0f1070 con 0x5605f1fa7a50 2024-09-14T10:44:30.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.528+0000 7fc83a3f89c0 20 remove_watcher() i=2 2024-09-14T10:44:30.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.528+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94583534570352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x7fc82c0f4070 2024-09-14T10:44:30.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.532+0000 7fc8386ff640 1 -- 172.21.15.96:0/1972293581 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94583534570352] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82802f040 con 0x7fc82c0f4070 2024-09-14T10:44:30.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.532+0000 7fc83a3f89c0 20 remove_watcher() i=3 2024-09-14T10:44:30.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.532+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94583534578000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x5605f1fa1950 2024-09-14T10:44:30.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.532+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94583534578000] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x5605f1fa1950 2024-09-14T10:44:30.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.532+0000 7fc83a3f89c0 20 remove_watcher() i=4 2024-09-14T10:44:30.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.532+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94583534575504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x7fc828019040 2024-09-14T10:44:30.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.536+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94583534575504] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.536+0000 7fc83a3f89c0 20 remove_watcher() i=5 2024-09-14T10:44:30.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.536+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94583534584512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x7fc828019040 2024-09-14T10:44:30.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.536+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94583534584512] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.536+0000 7fc83a3f89c0 20 remove_watcher() i=6 2024-09-14T10:44:30.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.536+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94583534588800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5605f1fd56f0 con 0x7fc828019040 2024-09-14T10:44:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94583534588800] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83001b030 con 0x7fc828019040 2024-09-14T10:44:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 20 remove_watcher() i=7 2024-09-14T10:44:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc828019040 msgr2=0x7fc828019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc828019040 0x7fc828019930 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1fa1950 msgr2=0x5605f1fa3de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1fa1950 0x5605f1fa3de0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc82c0f4070 msgr2=0x7fc82c0e8890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc82c0f4070 0x7fc82c0e8890 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5605f1fa7a50 msgr2=0x5605f1fa9e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5605f1fa7a50 0x5605f1fa9e40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70003a150 msgr2=0x7fc70003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70003a150 0x7fc70003c610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5605f1f73010 tx=0x7fc82801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 msgr2=0x5605f1f963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc837efe640 1 -- 172.21.15.96:0/1972293581 reap_dead start 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f963f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0c2a80 tx=0x7fc82c0eb0b0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 shutdown_connections 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/1972293581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f8feb0 0x5605f1f963f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 >> 172.21.15.96:0/1972293581 conn(0x5605f1f8b2d0 msgr2=0x5605f1f894e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 shutdown_connections 2024-09-14T10:44:30.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/1972293581 wait complete. 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/2233722318 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71003a140 msgr2=0x7fc71003c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/2233722318 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71003a140 0x7fc71003c600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e3f0 tx=0x7fc828003070 comp rx=0 tx=0).stop 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/2233722318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f82680 msgr2=0x5605f1f82aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/2233722318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f82680 0x5605f1f82aa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc82c017e90 tx=0x7fc82c018020 comp rx=0 tx=0).stop 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/2233722318 shutdown_connections 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/2233722318 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71003a140 0x7fc71003c600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/2233722318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1f82680 0x5605f1f82aa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/2233722318 >> 172.21.15.96:0/2233722318 conn(0x5605f1f78030 msgr2=0x5605f1f78410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/2233722318 shutdown_connections 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/2233722318 wait complete. 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1ded070 msgr2=0x5605f1f71ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1ded070 0x5605f1f71ff0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc72003a150 msgr2=0x7fc72003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.540+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc72003a150 0x7fc72003c610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0ac000 tx=0x7fc82c0a5000 comp rx=0 tx=0).stop 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 msgr2=0x5605f1f6ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f6ae80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc830001ba0 tx=0x7fc830004470 comp rx=0 tx=0).stop 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 shutdown_connections 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5605f1ded070 0x5605f1f71ff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc72003a150 0x7fc72003c610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 --2- 172.21.15.96:0/369380796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605f1decb40 0x5605f1f6ae80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 >> 172.21.15.96:0/369380796 conn(0x5605f1e71b20 msgr2=0x5605f1f5dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 shutdown_connections 2024-09-14T10:44:30.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.544+0000 7fc83a3f89c0 1 -- 172.21.15.96:0/369380796 wait complete. 2024-09-14T10:44:30.551 INFO:teuthology.orchestra.run.smithi096.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"81c91f69-c086-4f6e-b0d8-6162f65a1a15","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","marker":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-14T10:44:29.767115Z","creation_time":"2024-09-14T10:44:29.762936Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-14T10:44:30.551 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:44:29.767115Z', 'creation_time': '2024-09-14T10:44:29.762936Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-14T10:44:30.551 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-14T10:44:30.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-14T10:44:30.552 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-14T10:44:30.632 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:30.632 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:30.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f326a2ea9c0 1 Processor -- start 2024-09-14T10:44:30.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f326a2ea9c0 1 -- start start 2024-09-14T10:44:30.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f326a2ea9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5595eeee91a0 0x5595eeeeb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f326a2ea9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595eed8d7a0 con 0x5595eeee5000 2024-09-14T10:44:30.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f326a2ea9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5595eede91b0 con 0x5595eeee91a0 2024-09-14T10:44:30.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f32675ef640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5595eeee91a0 0x5595eeeeb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f32675ef640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5595eeee91a0 0x5595eeeeb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:44976/0 (socket says 172.21.15.96:44976) 2024-09-14T10:44:30.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f3267df0640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5595eeee5000 0x5595eeee53e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37132/0 (socket says 172.21.15.96:37132) 2024-09-14T10:44:30.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f32675ef640 1 -- 172.21.15.96:0/262330796 learned_addr learned my addr 172.21.15.96:0/262330796 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f32675ef640 1 -- 172.21.15.96:0/262330796 >> v1:172.21.15.70:6789/0 conn(0x5595eeee5000 legacy=0x5595eeee53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.636+0000 7f32675ef640 1 -- 172.21.15.96:0/262330796 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595eed67da0 con 0x5595eeee91a0 2024-09-14T10:44:30.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f32675ef640 1 --2- 172.21.15.96:0/262330796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee91a0 0x5595eeeeb590 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f325000a5c0 tx=0x7f325001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b88241dfffdd7b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f3266dee640 1 -- 172.21.15.96:0/262330796 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32500a9590 con 0x5595eeee91a0 2024-09-14T10:44:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f3266dee640 1 -- 172.21.15.96:0/262330796 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32500ae070 con 0x5595eeee91a0 2024-09-14T10:44:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f3266dee640 1 -- 172.21.15.96:0/262330796 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32500a9880 con 0x5595eeee91a0 2024-09-14T10:44:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/262330796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee91a0 msgr2=0x5595eeeeb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/262330796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee91a0 0x5595eeeeb590 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f325000a5c0 tx=0x7f325001b3d0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/262330796 shutdown_connections 2024-09-14T10:44:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/262330796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee91a0 0x5595eeeeb590 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/262330796 >> 172.21.15.96:0/262330796 conn(0x5595eeee0b20 msgr2=0x5595eeee2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/262330796 shutdown_connections 2024-09-14T10:44:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.640+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/262330796 wait complete. 2024-09-14T10:44:30.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f326a2ea9c0 1 Processor -- start 2024-09-14T10:44:30.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f326a2ea9c0 1 -- start start 2024-09-14T10:44:30.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f326a2ea9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f326a2ea9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595eedecfc0 con 0x5595eeee5000 2024-09-14T10:44:30.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f3267df0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f3267df0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:44978/0 (socket says 172.21.15.96:44978) 2024-09-14T10:44:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f3267df0640 1 -- 172.21.15.96:0/3887783673 learned_addr learned my addr 172.21.15.96:0/3887783673 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f3267df0640 1 -- 172.21.15.96:0/3887783673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595eefd0980 con 0x5595eeee5000 2024-09-14T10:44:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f3267df0640 1 --2- 172.21.15.96:0/3887783673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd0390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3258001ec0 tx=0x7f325800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28ba85213836209 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f3155e0b640 1 -- 172.21.15.96:0/3887783673 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325800e5d0 con 0x5595eeee5000 2024-09-14T10:44:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f3155e0b640 1 -- 172.21.15.96:0/3887783673 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325800e770 con 0x5595eeee5000 2024-09-14T10:44:30.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.656+0000 7f3155e0b640 1 -- 172.21.15.96:0/3887783673 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325800ea70 con 0x5595eeee5000 2024-09-14T10:44:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3887783673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 msgr2=0x5595eefd0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/3887783673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd0390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3258001ec0 tx=0x7f325800b6d0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3887783673 shutdown_connections 2024-09-14T10:44:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/3887783673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd0390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3887783673 >> 172.21.15.96:0/3887783673 conn(0x5595eeee0b20 msgr2=0x5595eefcbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3887783673 shutdown_connections 2024-09-14T10:44:30.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3887783673 wait complete. 2024-09-14T10:44:30.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 Processor -- start 2024-09-14T10:44:30.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- start start 2024-09-14T10:44:30.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595eed8ea50 con 0x5595eeee5000 2024-09-14T10:44:30.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f3267df0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f3267df0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:44988/0 (socket says 172.21.15.96:44988) 2024-09-14T10:44:30.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f3267df0640 1 -- 172.21.15.96:0/1706156092 learned_addr learned my addr 172.21.15.96:0/1706156092 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f3267df0640 1 -- 172.21.15.96:0/1706156092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595eefd8140 con 0x5595eeee5000 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f3267df0640 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd7be0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x5595eefd1320 tx=0x7f3258000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f314ffff640 1 -- 172.21.15.96:0/1706156092 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325800f8e0 con 0x5595eeee5000 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595eefd83d0 con 0x5595eeee5000 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f314ffff640 1 -- 172.21.15.96:0/1706156092 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325800fa80 con 0x5595eeee5000 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595eefd8d80 con 0x5595eeee5000 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f314ffff640 1 -- 172.21.15.96:0/1706156092 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325802c060 con 0x5595eeee5000 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f314ffff640 1 -- 172.21.15.96:0/1706156092 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3258017070 con 0x5595eeee5000 2024-09-14T10:44:30.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.660+0000 7f314ffff640 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f315003a1a0 0x7f315003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f314ffff640 1 -- 172.21.15.96:0/1706156092 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3258015020 con 0x5595eeee5000 2024-09-14T10:44:30.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32675ef640 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f315003a1a0 0x7f315003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595eeee91a0 0x5595eefded50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595eefdf290 con 0x5595eeee91a0 2024-09-14T10:44:30.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32685f1640 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595eeee91a0 0x5595eefded50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32675ef640 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f315003a1a0 0x7f315003c660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f32500ad000 tx=0x7f32500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32685f1640 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595eeee91a0 0x5595eefded50 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32685f1640 1 -- 172.21.15.96:0/1706156092 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f326000a4d0 con 0x5595eeee91a0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595eefdf6b0 con 0x5595eeee91a0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32685f1640 1 -- 172.21.15.96:0/1706156092 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f326000a4d0 con 0x5595eeee91a0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595eefe0fb0 con 0x5595eeee91a0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32685f1640 1 -- 172.21.15.96:0/1706156092 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f326000a4d0 con 0x5595eeee91a0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595eefe01e0 con 0x5595eeee91a0 2024-09-14T10:44:30.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32685f1640 1 -- 172.21.15.96:0/1706156092 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f326000a4d0 con 0x5595eeee91a0 2024-09-14T10:44:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595eefe0630 con 0x5595eeee91a0 2024-09-14T10:44:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32685f1640 1 -- 172.21.15.96:0/1706156092 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f326000a4d0 con 0x5595eeee91a0 2024-09-14T10:44:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 Processor -- start 2024-09-14T10:44:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 -- start start 2024-09-14T10:44:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eefef340 0x5595eefef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f326a2ea9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595eedf9d80 con 0x5595eefef340 2024-09-14T10:44:30.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32675ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eefef340 0x5595eefef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32675ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eefef340 0x5595eefef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:44990/0 (socket says 172.21.15.96:44990) 2024-09-14T10:44:30.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.664+0000 7f32675ef640 1 -- 172.21.15.96:0/69158085 learned_addr learned my addr 172.21.15.96:0/69158085 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f32675ef640 1 -- 172.21.15.96:0/69158085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595eefefda0 con 0x5595eefef340 2024-09-14T10:44:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f32675ef640 1 --2- 172.21.15.96:0/69158085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eefef340 0x5595eefef760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3250017fe0 tx=0x7f3250018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f314d7fa640 1 -- 172.21.15.96:0/69158085 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32500b3ba0 con 0x5595eefef340 2024-09-14T10:44:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/69158085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595eeff0600 con 0x5595eefef340 2024-09-14T10:44:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f314d7fa640 1 -- 172.21.15.96:0/69158085 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32500b3d40 con 0x5595eefef340 2024-09-14T10:44:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f314d7fa640 1 -- 172.21.15.96:0/69158085 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32500c8580 con 0x5595eefef340 2024-09-14T10:44:30.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/69158085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595eeff0b10 con 0x5595eefef340 2024-09-14T10:44:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f314d7fa640 1 -- 172.21.15.96:0/69158085 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f32500d1440 con 0x5595eefef340 2024-09-14T10:44:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f314d7fa640 1 --2- 172.21.15.96:0/69158085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f314003a150 0x7f314003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f314d7fa640 1 -- 172.21.15.96:0/69158085 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f32500ee5f0 con 0x5595eefef340 2024-09-14T10:44:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f32685f1640 1 --2- 172.21.15.96:0/69158085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f314003a150 0x7f314003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f326a2ea9c0 1 Processor -- start 2024-09-14T10:44:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f326a2ea9c0 1 -- start start 2024-09-14T10:44:30.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f326a2ea9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595eee5a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f326a2ea9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595eefd0db0 con 0x5595eee5a540 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f32685f1640 1 --2- 172.21.15.96:0/69158085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f314003a150 0x7f314003c610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5595eefdfd00 tx=0x7f3260005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f32675ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595eee5a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f32675ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595eee5a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:44992/0 (socket says 172.21.15.96:44992) 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f32675ef640 1 -- 172.21.15.96:0/3409357612 learned_addr learned my addr 172.21.15.96:0/3409357612 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.668+0000 7f32675ef640 1 -- 172.21.15.96:0/3409357612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595eee5ae60 con 0x5595eee5a540 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f32675ef640 1 --2- 172.21.15.96:0/3409357612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595eee5a920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f32500c7480 tx=0x7f32500c7950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78029e7007d6dfb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f3146ffd640 1 -- 172.21.15.96:0/3409357612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32500be410 con 0x5595eee5a540 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f3146ffd640 1 -- 172.21.15.96:0/3409357612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32500bc3b0 con 0x5595eee5a540 2024-09-14T10:44:30.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f3146ffd640 1 -- 172.21.15.96:0/3409357612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32500be5b0 con 0x5595eee5a540 2024-09-14T10:44:30.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3409357612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 msgr2=0x5595eee5a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/3409357612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595eee5a920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f32500c7480 tx=0x7f32500c7950 comp rx=0 tx=0).stop 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3409357612 shutdown_connections 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/3409357612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595eee5a920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3409357612 >> 172.21.15.96:0/3409357612 conn(0x5595eeff7fb0 msgr2=0x5595eeff61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3409357612 shutdown_connections 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/3409357612 wait complete. 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 Processor -- start 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- start start 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595ef005310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595eee5b450 con 0x5595eee5a540 2024-09-14T10:44:30.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f32675ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595ef005310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f32675ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595ef005310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:44996/0 (socket says 172.21.15.96:44996) 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 learned_addr learned my addr 172.21.15.96:0/934049523 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595ef005870 con 0x5595eee5a540 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f32675ef640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595ef005310 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f32500bcc60 tx=0x7f32500ec970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f31457fa640 1 -- 172.21.15.96:0/934049523 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32500ee2e0 con 0x5595eee5a540 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595ef005b00 con 0x5595eee5a540 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f31457fa640 1 -- 172.21.15.96:0/934049523 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32500e4040 con 0x5595eee5a540 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f31457fa640 1 -- 172.21.15.96:0/934049523 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32500ecc50 con 0x5595eee5a540 2024-09-14T10:44:30.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.672+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595ef0064b0 con 0x5595eee5a540 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f31457fa640 1 -- 172.21.15.96:0/934049523 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f32500a8a60 con 0x5595eee5a540 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f31457fa640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f313003a150 0x7f313003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f31457fa640 1 -- 172.21.15.96:0/934049523 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f32500eac80 con 0x5595eee5a540 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f32685f1640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f313003a150 0x7f313003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595ef0108e0 0x5595ef012d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0134c0 con 0x5595ef0108e0 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f3267df0640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595ef0108e0 0x5595ef012d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f32685f1640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f313003a150 0x7f313003c610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5595eefd91e0 tx=0x7f326001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f3267df0640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595ef0108e0 0x5595ef012d70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 realm 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0138d0 con 0x5595ef0108e0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0141a0 con 0x5595ef0108e0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef014540 con 0x5595ef0108e0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0149e0 con 0x5595ef0108e0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 20 searching for the correct realm 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5595ef0169e0 0x5595ef018dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f32675ef640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5595ef0169e0 0x5595ef018dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f32675ef640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5595ef0169e0 0x5595ef018dd0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f32675ef640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3250009040 0x7f32500bf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.676+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3250009040 2024-09-14T10:44:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f32685f1640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3250009040 0x7f32500bf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f32685f1640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3250009040 0x7f32500bf8f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326001f070 con 0x7f3250009040 2024-09-14T10:44:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f32685f1640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3260031040 0x7f3260032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3260031040 0x7f3260032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3260031040 0x7f3260032940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0108e0 2024-09-14T10:44:30.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0108e0 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.680+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3250009040 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326001f070 con 0x7f3250009040 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0108e0 2024-09-14T10:44:30.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0108e0 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3250009040 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f326001f070 con 0x7f3250009040 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.684+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0108e0 2024-09-14T10:44:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0108e0 2024-09-14T10:44:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3250009040 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326001f070 con 0x7f3250009040 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0108e0 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3250009040 2024-09-14T10:44:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326001f070 con 0x7f3250009040 2024-09-14T10:44:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.688+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0169e0 2024-09-14T10:44:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3260031040 2024-09-14T10:44:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x5595ef0108e0 2024-09-14T10:44:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019480 con 0x7f3250009040 2024-09-14T10:44:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f326001f070 con 0x7f3250009040 2024-09-14T10:44:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0154b0 con 0x5595ef0108e0 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef015d50 con 0x5595ef0108e0 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:30.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0150f0 con 0x5595ef0108e0 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 zone default found 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 4 Realm: () 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 zonegroup default 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef019900 con 0x7f3260031040 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01b7a0 con 0x5595ef0169e0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01bb40 con 0x5595ef0169e0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 started sync module instance, tier type = 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.692+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01abe0 con 0x7f3250009040 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.696+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.696+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94102448353280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01c390 con 0x7f3250009040 2024-09-14T10:44:30.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.696+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01cbe0 con 0x5595ef0108e0 2024-09-14T10:44:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.696+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94102448353280] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.696+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.696+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94102448357088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01c7f0 con 0x5595ef0108e0 2024-09-14T10:44:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.696+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01d310 con 0x5595ef0169e0 2024-09-14T10:44:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.700+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94102448357088] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.700+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.700+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94102448360928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01d700 con 0x5595ef0169e0 2024-09-14T10:44:30.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.700+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01e0c0 con 0x7f3250009040 2024-09-14T10:44:30.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.700+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.700+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94102448364832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01e7d0 con 0x7f3250009040 2024-09-14T10:44:30.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.700+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01f2f0 con 0x5595ef0108e0 2024-09-14T10:44:30.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.700+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94102448360928] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.704+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94102448364832] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.704+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.704+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94102448369088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01f2b0 con 0x5595ef0108e0 2024-09-14T10:44:30.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.704+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01fb90 con 0x7f3260031040 2024-09-14T10:44:30.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.704+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94102448369088] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.704+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.704+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94102448358144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01f760 con 0x7f3260031040 2024-09-14T10:44:30.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.704+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01fff0 con 0x7f3260031040 2024-09-14T10:44:30.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94102448371552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef020680 con 0x7f3260031040 2024-09-14T10:44:30.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef020f30 con 0x7f3260031040 2024-09-14T10:44:30.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94102448358144] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94102448371552] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94102448370352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef020680 con 0x7f3260031040 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 20 add_watcher() i=0 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 20 add_watcher() i=1 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 20 add_watcher() i=2 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 20 add_watcher() i=3 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 20 add_watcher() i=4 2024-09-14T10:44:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 20 add_watcher() i=5 2024-09-14T10:44:30.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.708+0000 7f326a2ea9c0 20 add_watcher() i=6 2024-09-14T10:44:30.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94102448370352] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 20 add_watcher() i=7 2024-09-14T10:44:30.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:30.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef024030 con 0x5595ef0108e0 2024-09-14T10:44:30.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94102448374224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0214b0 con 0x5595ef0108e0 2024-09-14T10:44:30.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94102448374224] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f311dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:30.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 5 note: GC not initialized 2024-09-14T10:44:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f311cfe1640 20 reqs_thread_entry: start 2024-09-14T10:44:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 20 Filter name: none 2024-09-14T10:44:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f30967fc640 20 reqs_thread_entry: start 2024-09-14T10:44:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.712+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef047160 con 0x5595ef0108e0 2024-09-14T10:44:30.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:30.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0476a0 con 0x5595ef0108e0 2024-09-14T10:44:30.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0486b0 con 0x7f3250009040 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef045d10 con 0x7f3250009040 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0486b0 con 0x5595ef0169e0 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 4.2e 4:77aa7d25:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef047d50 con 0x5595ef0169e0 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 4.31 4:8c880be2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef04cfd0 con 0x5595ef0108e0 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 4.15 4:aa6540a5:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef04f880 con 0x5595ef0169e0 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 4.1c 4:3adf25d2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0523f0 con 0x7f3260031040 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 4.2 4:4285a78a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef054e00 con 0x5595ef0108e0 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 4.2c 4:37c95a4c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef057790 con 0x5595ef0108e0 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:73 4.2a 4:5661d8ff:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef05a1e0 con 0x5595ef0108e0 2024-09-14T10:44:30.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 4.2d 4:b689318c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef05c7b0 con 0x7f3260031040 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(71 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(69 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(72 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 4.16 4:68627ddf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef047820 con 0x5595ef0169e0 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:76 4.18 4:1a24b59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef052850 con 0x7f3250009040 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(73 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 4.4 4:2304044a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595ef0542a0 con 0x7f3260031040 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(75 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(76 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(70 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(74 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.716+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(77 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.720+0000 7f311dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:30.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.720+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94102448374224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef044d90 con 0x5595ef0108e0 2024-09-14T10:44:30.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.720+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94102448374224] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.720+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94102448353280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef044d90 con 0x7f3250009040 2024-09-14T10:44:30.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.720+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94102448353280] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.720+0000 7f326a2ea9c0 20 remove_watcher() i=0 2024-09-14T10:44:30.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.720+0000 7f326a2ea9c0 2 removed watcher, disabling cache 2024-09-14T10:44:30.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.720+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94102448357088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef044d90 con 0x5595ef0108e0 2024-09-14T10:44:30.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.724+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94102448357088] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.724+0000 7f326a2ea9c0 20 remove_watcher() i=1 2024-09-14T10:44:30.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.724+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94102448360928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01bee0 con 0x5595ef0169e0 2024-09-14T10:44:30.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.724+0000 7f32675ef640 1 -- 172.21.15.96:0/934049523 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94102448360928] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32500f4060 con 0x5595ef0169e0 2024-09-14T10:44:30.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.724+0000 7f326a2ea9c0 20 remove_watcher() i=2 2024-09-14T10:44:30.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.724+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94102448364832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef044d90 con 0x7f3250009040 2024-09-14T10:44:30.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.728+0000 7f32685f1640 1 -- 172.21.15.96:0/934049523 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94102448364832] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260040040 con 0x7f3250009040 2024-09-14T10:44:30.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.728+0000 7f326a2ea9c0 20 remove_watcher() i=3 2024-09-14T10:44:30.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.728+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94102448369088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef01bee0 con 0x5595ef0108e0 2024-09-14T10:44:30.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.728+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94102448369088] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x5595ef0108e0 2024-09-14T10:44:30.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.728+0000 7f326a2ea9c0 20 remove_watcher() i=4 2024-09-14T10:44:30.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.728+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94102448358144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef044d90 con 0x7f3260031040 2024-09-14T10:44:30.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.732+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94102448358144] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.732+0000 7f326a2ea9c0 20 remove_watcher() i=5 2024-09-14T10:44:30.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.732+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94102448371552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef044d90 con 0x7f3260031040 2024-09-14T10:44:30.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.732+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94102448371552] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.732+0000 7f326a2ea9c0 20 remove_watcher() i=6 2024-09-14T10:44:30.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.732+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94102448370352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595ef044d90 con 0x7f3260031040 2024-09-14T10:44:30.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94102448370352] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f325802e070 con 0x7f3260031040 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 20 remove_watcher() i=7 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3260031040 msgr2=0x7f3260032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3260031040 0x7f3260032940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595ef0108e0 msgr2=0x5595ef012d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595ef0108e0 0x5595ef012d70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3250009040 msgr2=0x7f32500bf8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3250009040 0x7f32500bf8f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5595ef0169e0 msgr2=0x5595ef018dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5595ef0169e0 0x5595ef018dd0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f313003a150 msgr2=0x7f313003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f313003a150 0x7f313003c610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5595eefd91e0 tx=0x7f326001f000 comp rx=0 tx=0).stop 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 msgr2=0x5595ef005310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f3267df0640 1 -- 172.21.15.96:0/934049523 reap_dead start 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595ef005310 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f32500bcc60 tx=0x7f32500ec970 comp rx=0 tx=0).stop 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 shutdown_connections 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/934049523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eee5a540 0x5595ef005310 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 >> 172.21.15.96:0/934049523 conn(0x5595eeff7fb0 msgr2=0x5595eeff61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 shutdown_connections 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/934049523 wait complete. 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/69158085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f314003a150 msgr2=0x7f314003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/69158085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f314003a150 0x7f314003c610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5595eefdfd00 tx=0x7f3260005850 comp rx=0 tx=0).stop 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/69158085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eefef340 msgr2=0x5595eefef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/69158085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eefef340 0x5595eefef760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3250017fe0 tx=0x7f3250018170 comp rx=0 tx=0).stop 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/69158085 shutdown_connections 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/69158085 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f314003a150 0x7f314003c610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/69158085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eefef340 0x5595eefef760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/69158085 >> 172.21.15.96:0/69158085 conn(0x5595eefe4cf0 msgr2=0x5595eefe50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/69158085 shutdown_connections 2024-09-14T10:44:30.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/69158085 wait complete. 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595eeee91a0 msgr2=0x5595eefded50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595eeee91a0 0x5595eefded50 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f315003a1a0 msgr2=0x7f315003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f315003a1a0 0x7f315003c660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f32500ad000 tx=0x7f32500a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 msgr2=0x5595eefd7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd7be0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x5595eefd1320 tx=0x7f3258000bd0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 shutdown_connections 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5595eeee91a0 0x5595eefded50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f315003a1a0 0x7f315003c660 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 --2- 172.21.15.96:0/1706156092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595eeee5000 0x5595eefd7be0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 >> 172.21.15.96:0/1706156092 conn(0x5595eeee0b20 msgr2=0x5595eefd17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 shutdown_connections 2024-09-14T10:44:30.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.736+0000 7f326a2ea9c0 1 -- 172.21.15.96:0/1706156092 wait complete. 2024-09-14T10:44:30.745 INFO:teuthology.orchestra.run.smithi096.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"81c91f69-c086-4f6e-b0d8-6162f65a1a15","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","marker":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-14T10:44:29.767115Z","creation_time":"2024-09-14T10:44:29.762936Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-14T10:44:30.745 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:44:29.767115Z', 'creation_time': '2024-09-14T10:44:29.762936Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-14T10:44:30.757 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-14T10:44:30.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:44:30.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:44:30.757 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-14T10:44:30.819 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:30.819 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:30.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c58019c0 1 Processor -- start 2024-09-14T10:44:30.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c58019c0 1 -- start start 2024-09-14T10:44:30.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c58019c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d6881ed250 0x55d6881ed630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c58019c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6880937a0 con 0x55d6881f0390 2024-09-14T10:44:30.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c58019c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55d6880ef1b0 con 0x55d6881ed250 2024-09-14T10:44:30.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c3307640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d6881ed250 0x55d6881ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c3307640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d6881ed250 0x55d6881ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:44998/0 (socket says 172.21.15.96:44998) 2024-09-14T10:44:30.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c2b06640 1 --1- 172.21.15.96:0/4048465171 >> v1:172.21.15.70:6789/0 conn(0x55d6881f0390 0x55d6881f2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37144/0 (socket says 172.21.15.96:37144) 2024-09-14T10:44:30.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c3307640 1 -- 172.21.15.96:0/4048465171 learned_addr learned my addr 172.21.15.96:0/4048465171 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c3307640 1 -- 172.21.15.96:0/4048465171 >> v1:172.21.15.70:6789/0 conn(0x55d6881f0390 legacy=0x55d6881f2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.824+0000 7f72c3307640 1 -- 172.21.15.96:0/4048465171 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d68806dda0 con 0x55d6881ed250 2024-09-14T10:44:30.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c3307640 1 --2- 172.21.15.96:0/4048465171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6881ed630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00a4e0 tx=0x7f72bc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ae6d92e67ff883 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c2305640 1 -- 172.21.15.96:0/4048465171 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc0aa540 con 0x55d6881ed250 2024-09-14T10:44:30.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c2305640 1 -- 172.21.15.96:0/4048465171 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc0aa6e0 con 0x55d6881ed250 2024-09-14T10:44:30.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c2305640 1 -- 172.21.15.96:0/4048465171 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc0aaa40 con 0x55d6881ed250 2024-09-14T10:44:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c58019c0 1 -- 172.21.15.96:0/4048465171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 msgr2=0x55d6881ed630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4048465171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6881ed630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00a4e0 tx=0x7f72bc01b090 comp rx=0 tx=0).stop 2024-09-14T10:44:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c58019c0 1 -- 172.21.15.96:0/4048465171 shutdown_connections 2024-09-14T10:44:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4048465171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6881ed630 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c58019c0 1 -- 172.21.15.96:0/4048465171 >> 172.21.15.96:0/4048465171 conn(0x55d688160b60 msgr2=0x55d688160f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c58019c0 1 -- 172.21.15.96:0/4048465171 shutdown_connections 2024-09-14T10:44:30.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.828+0000 7f72c58019c0 1 -- 172.21.15.96:0/4048465171 wait complete. 2024-09-14T10:44:30.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c58019c0 1 Processor -- start 2024-09-14T10:44:30.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c58019c0 1 -- start start 2024-09-14T10:44:30.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c58019c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882d8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c58019c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d6880f2fc0 con 0x55d6881ed250 2024-09-14T10:44:30.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c3307640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c3307640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882d8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45004/0 (socket says 172.21.15.96:45004) 2024-09-14T10:44:30.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c3307640 1 -- 172.21.15.96:0/4045822067 learned_addr learned my addr 172.21.15.96:0/4045822067 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c3307640 1 -- 172.21.15.96:0/4045822067 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6882d8b10 con 0x55d6881ed250 2024-09-14T10:44:30.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f72c3307640 1 --2- 172.21.15.96:0/4045822067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882d8520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f72bc019740 tx=0x7f72bc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d060a9cdb2d8a422 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f71b160a640 1 -- 172.21.15.96:0/4045822067 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc0b9070 con 0x55d6881ed250 2024-09-14T10:44:30.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f71b160a640 1 -- 172.21.15.96:0/4045822067 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc0aaa90 con 0x55d6881ed250 2024-09-14T10:44:30.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.844+0000 7f71b160a640 1 -- 172.21.15.96:0/4045822067 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc0aad70 con 0x55d6881ed250 2024-09-14T10:44:30.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- 172.21.15.96:0/4045822067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 msgr2=0x55d6882d8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4045822067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882d8520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f72bc019740 tx=0x7f72bc0033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- 172.21.15.96:0/4045822067 shutdown_connections 2024-09-14T10:44:30.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4045822067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882d8520 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- 172.21.15.96:0/4045822067 >> 172.21.15.96:0/4045822067 conn(0x55d688160b60 msgr2=0x55d6882d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- 172.21.15.96:0/4045822067 shutdown_connections 2024-09-14T10:44:30.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- 172.21.15.96:0/4045822067 wait complete. 2024-09-14T10:44:30.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 Processor -- start 2024-09-14T10:44:30.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- start start 2024-09-14T10:44:30.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882dfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d688094a50 con 0x55d6881ed250 2024-09-14T10:44:30.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c3307640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882dfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c3307640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882dfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45016/0 (socket says 172.21.15.96:45016) 2024-09-14T10:44:30.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c3307640 1 -- 172.21.15.96:0/4226461848 learned_addr learned my addr 172.21.15.96:0/4226461848 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c3307640 1 -- 172.21.15.96:0/4226461848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6882e0160 con 0x55d6881ed250 2024-09-14T10:44:30.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c3307640 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882dfc00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f72bc018cc0 tx=0x7f72bc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f71afe07640 1 -- 172.21.15.96:0/4226461848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc0b9070 con 0x55d6881ed250 2024-09-14T10:44:30.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6882e03f0 con 0x55d6881ed250 2024-09-14T10:44:30.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f71afe07640 1 -- 172.21.15.96:0/4226461848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc0b5b10 con 0x55d6881ed250 2024-09-14T10:44:30.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f71afe07640 1 -- 172.21.15.96:0/4226461848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc0b5df0 con 0x55d6881ed250 2024-09-14T10:44:30.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.848+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6882e0da0 con 0x55d6881ed250 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f71afe07640 1 -- 172.21.15.96:0/4226461848 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f72bc0b3040 con 0x55d6881ed250 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f71afe07640 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71a803a150 0x7f71a803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f71afe07640 1 -- 172.21.15.96:0/4226461848 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72bc0c4070 con 0x55d6881ed250 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c2b06640 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71a803a150 0x7f71a803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d6881f0390 0x55d6882e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6882e72b0 con 0x55d6881f0390 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c3b08640 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d6881f0390 0x55d6882e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c2b06640 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71a803a150 0x7f71a803c610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72ac001e90 tx=0x7f72ac0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c3b08640 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d6881f0390 0x55d6882e6d70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c3b08640 1 -- 172.21.15.96:0/4226461848 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72b40083f0 con 0x55d6881f0390 2024-09-14T10:44:30.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6882e7b00 con 0x55d6881f0390 2024-09-14T10:44:30.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c3b08640 1 -- 172.21.15.96:0/4226461848 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72b40083f0 con 0x55d6881f0390 2024-09-14T10:44:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6882e8eb0 con 0x55d6881f0390 2024-09-14T10:44:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c3b08640 1 -- 172.21.15.96:0/4226461848 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72b40083f0 con 0x55d6881f0390 2024-09-14T10:44:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6882e8350 con 0x55d6881f0390 2024-09-14T10:44:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c3b08640 1 -- 172.21.15.96:0/4226461848 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72b40083f0 con 0x55d6881f0390 2024-09-14T10:44:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6882e87a0 con 0x55d6881f0390 2024-09-14T10:44:30.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c3b08640 1 -- 172.21.15.96:0/4226461848 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72b40083f0 con 0x55d6881f0390 2024-09-14T10:44:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 Processor -- start 2024-09-14T10:44:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 -- start start 2024-09-14T10:44:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6882f7440 0x55d6882f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.852+0000 7f72c58019c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d6880ffd80 con 0x55d6882f7440 2024-09-14T10:44:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c2b06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6882f7440 0x55d6882f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c2b06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6882f7440 0x55d6882f7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45030/0 (socket says 172.21.15.96:45030) 2024-09-14T10:44:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c2b06640 1 -- 172.21.15.96:0/2964889502 learned_addr learned my addr 172.21.15.96:0/2964889502 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c2b06640 1 -- 172.21.15.96:0/2964889502 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6882f7ea0 con 0x55d6882f7440 2024-09-14T10:44:30.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c2b06640 1 --2- 172.21.15.96:0/2964889502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6882f7440 0x55d6882f7860 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00e670 tx=0x7f72ac00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f71ad602640 1 -- 172.21.15.96:0/2964889502 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac022070 con 0x55d6882f7440 2024-09-14T10:44:30.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c58019c0 1 -- 172.21.15.96:0/2964889502 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6882f8700 con 0x55d6882f7440 2024-09-14T10:44:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f71ad602640 1 -- 172.21.15.96:0/2964889502 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac00d660 con 0x55d6882f7440 2024-09-14T10:44:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f71ad602640 1 -- 172.21.15.96:0/2964889502 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac006070 con 0x55d6882f7440 2024-09-14T10:44:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c58019c0 1 -- 172.21.15.96:0/2964889502 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6882f8c70 con 0x55d6882f7440 2024-09-14T10:44:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f71ad602640 1 -- 172.21.15.96:0/2964889502 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f72ac025070 con 0x55d6882f7440 2024-09-14T10:44:30.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f71ad602640 1 --2- 172.21.15.96:0/2964889502 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f719c03a150 0x7f719c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f71ad602640 1 -- 172.21.15.96:0/2964889502 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72ac0525a0 con 0x55d6882f7440 2024-09-14T10:44:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c3b08640 1 --2- 172.21.15.96:0/2964889502 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f719c03a150 0x7f719c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c58019c0 1 Processor -- start 2024-09-14T10:44:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c3b08640 1 --2- 172.21.15.96:0/2964889502 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f719c03a150 0x7f719c03c610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72b400e3f0 tx=0x7f72b4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c58019c0 1 -- start start 2024-09-14T10:44:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c58019c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d6883051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c58019c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d6882d8e80 con 0x55d688304db0 2024-09-14T10:44:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c2b06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d6883051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.856+0000 7f72c2b06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d6883051b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45038/0 (socket says 172.21.15.96:45038) 2024-09-14T10:44:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c2b06640 1 -- 172.21.15.96:0/3025719260 learned_addr learned my addr 172.21.15.96:0/3025719260 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c2b06640 1 -- 172.21.15.96:0/3025719260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6883057a0 con 0x55d688304db0 2024-09-14T10:44:30.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c2b06640 1 --2- 172.21.15.96:0/3025719260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d6883051b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0509c0 tx=0x7f72ac024a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cc96398a058e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f71a6ffd640 1 -- 172.21.15.96:0/3025719260 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac04e070 con 0x55d688304db0 2024-09-14T10:44:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f71a6ffd640 1 -- 172.21.15.96:0/3025719260 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac0268d0 con 0x55d688304db0 2024-09-14T10:44:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f71a6ffd640 1 -- 172.21.15.96:0/3025719260 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac0242c0 con 0x55d688304db0 2024-09-14T10:44:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- 172.21.15.96:0/3025719260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 msgr2=0x55d6883051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3025719260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d6883051b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0509c0 tx=0x7f72ac024a10 comp rx=0 tx=0).stop 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- 172.21.15.96:0/3025719260 shutdown_connections 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3025719260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d6883051b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- 172.21.15.96:0/3025719260 >> 172.21.15.96:0/3025719260 conn(0x55d6883001d0 msgr2=0x55d6882fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- 172.21.15.96:0/3025719260 shutdown_connections 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- 172.21.15.96:0/3025719260 wait complete. 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 Processor -- start 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- start start 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d68830b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d688303d00 con 0x55d688304db0 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c2b06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d68830b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c2b06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d68830b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45054/0 (socket says 172.21.15.96:45054) 2024-09-14T10:44:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 learned_addr learned my addr 172.21.15.96:0/3448047652 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d68830b800 con 0x55d688304db0 2024-09-14T10:44:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c2b06640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d68830b2a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f72ac04f8b0 tx=0x7f72ac050920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f71a57fa640 1 -- 172.21.15.96:0/3448047652 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac04e030 con 0x55d688304db0 2024-09-14T10:44:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d68830ba90 con 0x55d688304db0 2024-09-14T10:44:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f71a57fa640 1 -- 172.21.15.96:0/3448047652 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac0520d0 con 0x55d688304db0 2024-09-14T10:44:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f71a57fa640 1 -- 172.21.15.96:0/3448047652 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac050ad0 con 0x55d688304db0 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.860+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d68830c440 con 0x55d688304db0 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f71a57fa640 1 -- 172.21.15.96:0/3448047652 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f72ac050c70 con 0x55d688304db0 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f71a57fa640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f718c03a150 0x7f718c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f71a57fa640 1 -- 172.21.15.96:0/3448047652 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72ac04f070 con 0x55d688304db0 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3b08640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f718c03a150 0x7f718c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d688316650 0x55d688318ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d688319230 con 0x55d688316650 2024-09-14T10:44:30.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3307640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d688316650 0x55d688318ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3b08640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f718c03a150 0x7f718c03c610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72b400f010 tx=0x7f72b401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3307640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d688316650 0x55d688318ae0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 realm 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d688319640 con 0x55d688316650 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d688319f10 con 0x55d688316650 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68831a2b0 con 0x55d688316650 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:30.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68831a750 con 0x55d688316650 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 20 searching for the correct realm 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d68831c6f0 0x55d68831eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x55d68831c6f0 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.864+0000 7f72c2b06640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d68831c6f0 0x55d68831eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c2b06640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d68831c6f0 0x55d68831eb60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c2b06640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f72ac027060 0x7f72ac053950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x7f72ac027060 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3b08640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f72ac027060 0x7f72ac053950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3b08640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f72ac027060 0x7f72ac053950 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3b08640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f72b4019040 0x7f72b4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:30.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x7f72b4019040 2024-09-14T10:44:30.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3307640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f72b4019040 0x7f72b4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3307640 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f72b4019040 0x7f72b4019930 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x55d688316650 2024-09-14T10:44:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x55d688316650 2024-09-14T10:44:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.868+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x7f72b4019040 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x7f72b4019040 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x7f72ac027060 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x55d68831c6f0 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x55d688316650 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x7f72b4019040 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d68831f230 con 0x55d688316650 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72ac027060 2024-09-14T10:44:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d68831c6f0 2024-09-14T10:44:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d68831c6f0 2024-09-14T10:44:30.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.872+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72b4019040 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d68831c6f0 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d68831c6f0 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d688316650 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d688316650 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72b4019040 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d68831c6f0 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72ac027060 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d688316650 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72b4019040 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.876+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d68831c6f0 2024-09-14T10:44:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72b4019040 2024-09-14T10:44:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72ac027060 2024-09-14T10:44:30.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d68831c6f0 2024-09-14T10:44:30.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72b4019040 2024-09-14T10:44:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x55d688316650 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72bc0e3040 con 0x7f72ac027060 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68831b060 con 0x55d688316650 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68831b450 con 0x55d688316650 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68831b450 con 0x55d688316650 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 zone default found 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 4 Realm: () 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:30.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:30.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 zonegroup default 2024-09-14T10:44:30.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.880+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68831b870 con 0x7f72b4019040 2024-09-14T10:44:30.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68831b870 con 0x55d68831c6f0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6883210a0 con 0x55d68831c6f0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 20 started sync module instance, tier type = 2024-09-14T10:44:30.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688320540 con 0x7f72ac027060 2024-09-14T10:44:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94379896342880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6883218f0 con 0x7f72ac027060 2024-09-14T10:44:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688322140 con 0x55d688316650 2024-09-14T10:44:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.884+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94379896342880] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94379896345664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688321d70 con 0x55d688316650 2024-09-14T10:44:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688322890 con 0x55d68831c6f0 2024-09-14T10:44:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94379896349536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688323130 con 0x55d68831c6f0 2024-09-14T10:44:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688323af0 con 0x7f72ac027060 2024-09-14T10:44:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94379896345664] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94379896354368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688323a60 con 0x7f72ac027060 2024-09-14T10:44:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.888+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6883248a0 con 0x55d688316650 2024-09-14T10:44:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.892+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94379896349536] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.892+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94379896354368] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.892+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.892+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94379896351872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688324860 con 0x55d688316650 2024-09-14T10:44:30.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.892+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688324cd0 con 0x7f72b4019040 2024-09-14T10:44:30.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.892+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94379896351872] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.896+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.896+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94379896360000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688324390 con 0x7f72b4019040 2024-09-14T10:44:30.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.896+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6883256e0 con 0x7f72b4019040 2024-09-14T10:44:30.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.896+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.896+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94379896361520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688325b00 con 0x7f72b4019040 2024-09-14T10:44:30.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.896+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688326500 con 0x7f72b4019040 2024-09-14T10:44:30.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.896+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94379896360000] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94379896361520] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94379896356576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688325650 con 0x7f72b4019040 2024-09-14T10:44:30.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 20 add_watcher() i=0 2024-09-14T10:44:30.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 20 add_watcher() i=1 2024-09-14T10:44:30.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 20 add_watcher() i=2 2024-09-14T10:44:30.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 20 add_watcher() i=3 2024-09-14T10:44:30.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 20 add_watcher() i=4 2024-09-14T10:44:30.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 20 add_watcher() i=5 2024-09-14T10:44:30.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 20 add_watcher() i=6 2024-09-14T10:44:30.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94379896356576] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 20 add_watcher() i=7 2024-09-14T10:44:30.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:30.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d688329600 con 0x55d688316650 2024-09-14T10:44:30.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.900+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94379896365072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d688326a80 con 0x55d688316650 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94379896365072] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f7179fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 5 note: GC not initialized 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f7178fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 Filter name: none 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f70f27fc640 20 reqs_thread_entry: start 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68834cb20 con 0x7f72ac027060 2024-09-14T10:44:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:63 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68834d490 con 0x55d68831c6f0 2024-09-14T10:44:30.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(63 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68834eb60 con 0x7f72ac027060 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68834eb60 con 0x55d68831c6f0 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(65 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 4.2e 4:77aa7d25:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68834e3c0 con 0x55d68831c6f0 2024-09-14T10:44:30.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 4.31 4:8c880be2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6883534b0 con 0x55d688316650 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 4.15 4:aa6540a5:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d688355fe0 con 0x55d68831c6f0 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 4.1c 4:3adf25d2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d688358c70 con 0x7f72b4019040 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 4.2 4:4285a78a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68835b610 con 0x55d688316650 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 4.2c 4:37c95a4c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68835de80 con 0x55d688316650 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 4.2a 4:5661d8ff:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d688360a70 con 0x55d688316650 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 4.2d 4:b689318c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6883638e0 con 0x7f72b4019040 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:74 4.16 4:68627ddf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d688366750 con 0x55d68831c6f0 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:75 4.18 4:1a24b59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68835b610 con 0x7f72ac027060 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(66 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(68 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(67 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 4.4 4:2304044a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d68835de80 con 0x7f72b4019040 2024-09-14T10:44:30.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(74 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.904+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(70 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(72 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(71 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(75 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(76 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f7179fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:30.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94379896365072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x55d688316650 2024-09-14T10:44:30.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94379896365072] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.908+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94379896342880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x7f72ac027060 2024-09-14T10:44:30.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.912+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94379896342880] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.912+0000 7f72c58019c0 20 remove_watcher() i=0 2024-09-14T10:44:30.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.912+0000 7f72c58019c0 2 removed watcher, disabling cache 2024-09-14T10:44:30.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.912+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94379896345664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x55d688316650 2024-09-14T10:44:30.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.912+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94379896345664] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.912+0000 7f72c58019c0 20 remove_watcher() i=1 2024-09-14T10:44:30.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.912+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94379896349536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x55d68831c6f0 2024-09-14T10:44:30.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c2b06640 1 -- 172.21.15.96:0/3448047652 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94379896349536] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac024030 con 0x55d68831c6f0 2024-09-14T10:44:30.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c58019c0 20 remove_watcher() i=2 2024-09-14T10:44:30.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94379896354368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x7f72ac027060 2024-09-14T10:44:30.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c3b08640 1 -- 172.21.15.96:0/3448047652 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94379896354368] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b402f040 con 0x7f72ac027060 2024-09-14T10:44:30.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c58019c0 20 remove_watcher() i=3 2024-09-14T10:44:30.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94379896351872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x55d688316650 2024-09-14T10:44:30.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94379896351872] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x55d688316650 2024-09-14T10:44:30.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c58019c0 20 remove_watcher() i=4 2024-09-14T10:44:30.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.916+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94379896360000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x7f72b4019040 2024-09-14T10:44:30.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.920+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94379896360000] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.920+0000 7f72c58019c0 20 remove_watcher() i=5 2024-09-14T10:44:30.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.920+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94379896361520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x7f72b4019040 2024-09-14T10:44:30.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.920+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94379896361520] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.920+0000 7f72c58019c0 20 remove_watcher() i=6 2024-09-14T10:44:30.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.920+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94379896356576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d68834a3c0 con 0x7f72b4019040 2024-09-14T10:44:30.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94379896356576] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc0c7de0 con 0x7f72b4019040 2024-09-14T10:44:30.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 20 remove_watcher() i=7 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f72b4019040 msgr2=0x7f72b4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f72b4019040 0x7f72b4019930 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d688316650 msgr2=0x55d688318ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d688316650 0x55d688318ae0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f72ac027060 msgr2=0x7f72ac053950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f72ac027060 0x7f72ac053950 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d68831c6f0 msgr2=0x55d68831eb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d68831c6f0 0x55d68831eb60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f718c03a150 msgr2=0x7f718c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f718c03a150 0x7f718c03c610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72b400f010 tx=0x7f72b401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 msgr2=0x55d68830b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/3448047652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d688304db0 0x55d68830b2a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f72ac04f8b0 tx=0x7f72ac050920 comp rx=0 tx=0).stop 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c3307640 1 -- 172.21.15.96:0/3448047652 reap_dead start 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 shutdown_connections 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 >> 172.21.15.96:0/3448047652 conn(0x55d6883001d0 msgr2=0x55d6882fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 shutdown_connections 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/3448047652 wait complete. 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/2964889502 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f719c03a150 msgr2=0x7f719c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/2964889502 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f719c03a150 0x7f719c03c610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72b400e3f0 tx=0x7f72b4003070 comp rx=0 tx=0).stop 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/2964889502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6882f7440 msgr2=0x55d6882f7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/2964889502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6882f7440 0x55d6882f7860 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00e670 tx=0x7f72ac00ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/2964889502 shutdown_connections 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/2964889502 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f719c03a150 0x7f719c03c610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/2964889502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6882f7440 0x55d6882f7860 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/2964889502 >> 172.21.15.96:0/2964889502 conn(0x55d6882ecdf0 msgr2=0x55d6882ed1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/2964889502 shutdown_connections 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/2964889502 wait complete. 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d6881f0390 msgr2=0x55d6882e6d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d6881f0390 0x55d6882e6d70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71a803a150 msgr2=0x7f71a803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71a803a150 0x7f71a803c610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72ac001e90 tx=0x7f72ac0013f0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 msgr2=0x55d6882dfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882dfc00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f72bc018cc0 tx=0x7f72bc017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 shutdown_connections 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d6881f0390 0x55d6882e6d70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71a803a150 0x7f71a803c610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 --2- 172.21.15.96:0/4226461848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d6881ed250 0x55d6882dfc00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:30.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 >> 172.21.15.96:0/4226461848 conn(0x55d688160b60 msgr2=0x55d6882d9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:30.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 shutdown_connections 2024-09-14T10:44:30.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:30.924+0000 7f72c58019c0 1 -- 172.21.15.96:0/4226461848 wait complete. 2024-09-14T10:44:30.935 INFO:teuthology.orchestra.run.smithi096.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"81c91f69-c086-4f6e-b0d8-6162f65a1a15","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","marker":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-14T10:44:29.767115Z","creation_time":"2024-09-14T10:44:29.762936Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-14T10:44:30.935 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:44:29.767115Z', 'creation_time': '2024-09-14T10:44:29.762936Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-14T10:44:30.935 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-14T10:44:30.935 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-14T10:44:30.935 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-14T10:44:31.015 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:31.015 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:31.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff794ad9c0 1 Processor -- start 2024-09-14T10:44:31.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff794ad9c0 1 -- start start 2024-09-14T10:44:31.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff794ad9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5613c43bb640 0x5613c444f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff794ad9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613c42ef7a0 con 0x5613c43bb260 2024-09-14T10:44:31.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff794ad9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5613c434b1b0 con 0x5613c43bb640 2024-09-14T10:44:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff767b2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5613c43bb640 0x5613c444f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff767b2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5613c43bb640 0x5613c444f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45056/0 (socket says 172.21.15.96:45056) 2024-09-14T10:44:31.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff767b2640 1 -- 172.21.15.96:0/3501988658 learned_addr learned my addr 172.21.15.96:0/3501988658 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff767b2640 1 -- 172.21.15.96:0/3501988658 >> v1:172.21.15.70:6789/0 conn(0x5613c43bb260 legacy=0x5613c444c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff767b2640 1 -- 172.21.15.96:0/3501988658 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c42c9da0 con 0x5613c43bb640 2024-09-14T10:44:31.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.020+0000 7eff767b2640 1 --2- 172.21.15.96:0/3501988658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb640 0x5613c444f7c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00a5c0 tx=0x7eff6c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef90ddce6167a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff75fb1640 1 -- 172.21.15.96:0/3501988658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6c0a6070 con 0x5613c43bb640 2024-09-14T10:44:31.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff75fb1640 1 -- 172.21.15.96:0/3501988658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c0af070 con 0x5613c43bb640 2024-09-14T10:44:31.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff75fb1640 1 -- 172.21.15.96:0/3501988658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6c0aa5c0 con 0x5613c43bb640 2024-09-14T10:44:31.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3501988658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb640 msgr2=0x5613c444f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3501988658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb640 0x5613c444f7c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00a5c0 tx=0x7eff6c01b340 comp rx=0 tx=0).stop 2024-09-14T10:44:31.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3501988658 shutdown_connections 2024-09-14T10:44:31.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3501988658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb640 0x5613c444f7c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3501988658 >> 172.21.15.96:0/3501988658 conn(0x5613c4441980 msgr2=0x5613c4443da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3501988658 shutdown_connections 2024-09-14T10:44:31.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.024+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3501988658 wait complete. 2024-09-14T10:44:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 Processor -- start 2024-09-14T10:44:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- start start 2024-09-14T10:44:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c45345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613c434efc0 con 0x5613c43bb260 2024-09-14T10:44:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff76fb3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c45345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff76fb3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c45345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45066/0 (socket says 172.21.15.96:45066) 2024-09-14T10:44:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff76fb3640 1 -- 172.21.15.96:0/1541485438 learned_addr learned my addr 172.21.15.96:0/1541485438 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff76fb3640 1 -- 172.21.15.96:0/1541485438 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c4534bd0 con 0x5613c43bb260 2024-09-14T10:44:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff76fb3640 1 --2- 172.21.15.96:0/1541485438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c45345e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7eff70001680 tx=0x7eff70001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942629175a114acd server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7efe64e09640 1 -- 172.21.15.96:0/1541485438 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff70016070 con 0x5613c43bb260 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7efe64e09640 1 -- 172.21.15.96:0/1541485438 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7000f660 con 0x5613c43bb260 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7efe64e09640 1 -- 172.21.15.96:0/1541485438 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7000f980 con 0x5613c43bb260 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1541485438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 msgr2=0x5613c45345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/1541485438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c45345e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7eff70001680 tx=0x7eff70001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1541485438 shutdown_connections 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/1541485438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c45345e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1541485438 >> 172.21.15.96:0/1541485438 conn(0x5613c4441980 msgr2=0x5613c45301d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1541485438 shutdown_connections 2024-09-14T10:44:31.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1541485438 wait complete. 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 Processor -- start 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- start start 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c453bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff794ad9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613c42f0a50 con 0x5613c43bb260 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff76fb3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c453bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff76fb3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c453bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45068/0 (socket says 172.21.15.96:45068) 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.040+0000 7eff76fb3640 1 -- 172.21.15.96:0/3805611508 learned_addr learned my addr 172.21.15.96:0/3805611508 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff76fb3640 1 -- 172.21.15.96:0/3805611508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c453c440 con 0x5613c43bb260 2024-09-14T10:44:31.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff76fb3640 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c453bee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x5613c45355a0 tx=0x7eff70000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7efe63606640 1 -- 172.21.15.96:0/3805611508 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff70016040 con 0x5613c43bb260 2024-09-14T10:44:31.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613c453c6d0 con 0x5613c43bb260 2024-09-14T10:44:31.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7efe63606640 1 -- 172.21.15.96:0/3805611508 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff70022070 con 0x5613c43bb260 2024-09-14T10:44:31.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7efe63606640 1 -- 172.21.15.96:0/3805611508 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff70006330 con 0x5613c43bb260 2024-09-14T10:44:31.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c453d080 con 0x5613c43bb260 2024-09-14T10:44:31.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7efe63606640 1 -- 172.21.15.96:0/3805611508 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7eff70011510 con 0x5613c43bb260 2024-09-14T10:44:31.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7efe63606640 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5c03a2f0 0x7efe5c03c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7efe63606640 1 -- 172.21.15.96:0/3805611508 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff700506b0 con 0x5613c43bb260 2024-09-14T10:44:31.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff767b2640 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5c03a2f0 0x7efe5c03c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c43bb640 0x5613c4543050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4543590 con 0x5613c43bb640 2024-09-14T10:44:31.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff777b4640 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c43bb640 0x5613c4543050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff767b2640 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5c03a2f0 0x7efe5c03c7b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0ae000 tx=0x7eff6c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff777b4640 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c43bb640 0x5613c4543050 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff777b4640 1 -- 172.21.15.96:0/3805611508 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff680083f0 con 0x5613c43bb640 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.044+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c453d4d0 con 0x5613c43bb640 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff777b4640 1 -- 172.21.15.96:0/3805611508 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff680083f0 con 0x5613c43bb640 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4545340 con 0x5613c43bb640 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff777b4640 1 -- 172.21.15.96:0/3805611508 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff680083f0 con 0x5613c43bb640 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4544570 con 0x5613c43bb640 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff777b4640 1 -- 172.21.15.96:0/3805611508 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff680083f0 con 0x5613c43bb640 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45449c0 con 0x5613c43bb640 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff777b4640 1 -- 172.21.15.96:0/3805611508 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff680083f0 con 0x5613c43bb640 2024-09-14T10:44:31.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 Processor -- start 2024-09-14T10:44:31.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 -- start start 2024-09-14T10:44:31.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4553700 0x5613c4553b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613c435bd80 con 0x5613c4553700 2024-09-14T10:44:31.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff767b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4553700 0x5613c4553b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff767b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4553700 0x5613c4553b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45078/0 (socket says 172.21.15.96:45078) 2024-09-14T10:44:31.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff767b2640 1 -- 172.21.15.96:0/1254565119 learned_addr learned my addr 172.21.15.96:0/1254565119 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff767b2640 1 -- 172.21.15.96:0/1254565119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c4554160 con 0x5613c4553700 2024-09-14T10:44:31.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff767b2640 1 --2- 172.21.15.96:0/1254565119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4553700 0x5613c4553b20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff6c000c10 tx=0x7eff6c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7efe60e01640 1 -- 172.21.15.96:0/1254565119 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6c0b3b90 con 0x5613c4553700 2024-09-14T10:44:31.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1254565119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613c45549c0 con 0x5613c4553700 2024-09-14T10:44:31.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7efe60e01640 1 -- 172.21.15.96:0/1254565119 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c0b3d30 con 0x5613c4553700 2024-09-14T10:44:31.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7efe60e01640 1 -- 172.21.15.96:0/1254565119 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6c0c8560 con 0x5613c4553700 2024-09-14T10:44:31.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.048+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1254565119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c4554ed0 con 0x5613c4553700 2024-09-14T10:44:31.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7efe60e01640 1 -- 172.21.15.96:0/1254565119 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7eff6c0d1440 con 0x5613c4553700 2024-09-14T10:44:31.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7efe60e01640 1 --2- 172.21.15.96:0/1254565119 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5003a140 0x7efe5003c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7efe60e01640 1 -- 172.21.15.96:0/1254565119 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff6c0ee410 con 0x5613c4553700 2024-09-14T10:44:31.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff777b4640 1 --2- 172.21.15.96:0/1254565119 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5003a140 0x7efe5003c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 Processor -- start 2024-09-14T10:44:31.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 -- start start 2024-09-14T10:44:31.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff777b4640 1 --2- 172.21.15.96:0/1254565119 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5003a140 0x7efe5003c600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff6800e3f0 tx=0x7eff68003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c4561390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613c4535000 con 0x5613c4560fb0 2024-09-14T10:44:31.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff767b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c4561390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff767b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c4561390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45092/0 (socket says 172.21.15.96:45092) 2024-09-14T10:44:31.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff767b2640 1 -- 172.21.15.96:0/1615812202 learned_addr learned my addr 172.21.15.96:0/1615812202 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff767b2640 1 -- 172.21.15.96:0/1615812202 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c4561980 con 0x5613c4560fb0 2024-09-14T10:44:31.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff767b2640 1 --2- 172.21.15.96:0/1615812202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c4561390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0ec740 tx=0x7eff6c0bd8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc04f903e4dfd535 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7efe5a7fc640 1 -- 172.21.15.96:0/1615812202 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6c0ee0d0 con 0x5613c4560fb0 2024-09-14T10:44:31.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7efe5a7fc640 1 -- 172.21.15.96:0/1615812202 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c0be410 con 0x5613c4560fb0 2024-09-14T10:44:31.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7efe5a7fc640 1 -- 172.21.15.96:0/1615812202 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6c0bcc80 con 0x5613c4560fb0 2024-09-14T10:44:31.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1615812202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 msgr2=0x5613c4561390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/1615812202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c4561390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0ec740 tx=0x7eff6c0bd8a0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1615812202 shutdown_connections 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/1615812202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c4561390 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.052+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1615812202 >> 172.21.15.96:0/1615812202 conn(0x5613c455c370 msgr2=0x5613c455a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1615812202 shutdown_connections 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1615812202 wait complete. 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 1 Processor -- start 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 1 -- start start 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c45674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613c455fea0 con 0x5613c4560fb0 2024-09-14T10:44:31.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff767b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c45674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff767b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c45674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45100/0 (socket says 172.21.15.96:45100) 2024-09-14T10:44:31.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 learned_addr learned my addr 172.21.15.96:0/4124031051 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613c4567a10 con 0x5613c4560fb0 2024-09-14T10:44:31.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff767b2640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c45674b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7eff6c006500 tx=0x7eff6c0ec6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7efe58ff9640 1 -- 172.21.15.96:0/4124031051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6c0bdc40 con 0x5613c4560fb0 2024-09-14T10:44:31.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613c4567ca0 con 0x5613c4560fb0 2024-09-14T10:44:31.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7efe58ff9640 1 -- 172.21.15.96:0/4124031051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6c0bcc80 con 0x5613c4560fb0 2024-09-14T10:44:31.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7efe58ff9640 1 -- 172.21.15.96:0/4124031051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6c0ecb50 con 0x5613c4560fb0 2024-09-14T10:44:31.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613c4568650 con 0x5613c4560fb0 2024-09-14T10:44:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7efe58ff9640 1 -- 172.21.15.96:0/4124031051 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7eff6c0f5060 con 0x5613c4560fb0 2024-09-14T10:44:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7efe58ff9640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe4003a150 0x7efe4003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.056+0000 7efe58ff9640 1 -- 172.21.15.96:0/4124031051 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff6c0e2070 con 0x5613c4560fb0 2024-09-14T10:44:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff777b4640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe4003a150 0x7efe4003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c4572810 0x5613c4574ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45753f0 con 0x5613c4572810 2024-09-14T10:44:31.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff76fb3640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c4572810 0x5613c4574ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff777b4640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe4003a150 0x7efe4003c610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff6800f010 tx=0x7eff6801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff76fb3640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c4572810 0x5613c4574ca0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 realm 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4575800 con 0x5613c4572810 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:31.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45760d0 con 0x5613c4572810 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4576470 con 0x5613c4572810 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4576910 con 0x5613c4572810 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 20 searching for the correct realm 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613c45788b0 0x5613c457ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff767b2640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613c45788b0 0x5613c457ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff767b2640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613c45788b0 0x5613c457ad00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff767b2640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7eff6c009040 0x7eff6c0e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff6c009040 2024-09-14T10:44:31.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff777b4640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7eff6c009040 0x7eff6c0e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff777b4640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7eff6c009040 0x7eff6c0e5aa0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.060+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff777b4640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7eff68019040 0x7eff68019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7eff68019040 0x7eff68019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7eff68019040 0x7eff68019930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c4572810 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c4572810 2024-09-14T10:44:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff6c009040 2024-09-14T10:44:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c4572810 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.064+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c4572810 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff6c009040 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c4572810 2024-09-14T10:44:31.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c4572810 2024-09-14T10:44:31.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.068+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff6c009040 2024-09-14T10:44:31.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c4572810 2024-09-14T10:44:31.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff6c009040 2024-09-14T10:44:31.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c45788b0 2024-09-14T10:44:31.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.072+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff68019040 2024-09-14T10:44:31.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x5613c4572810 2024-09-14T10:44:31.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613c457b3d0 con 0x7eff6c009040 2024-09-14T10:44:31.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4577320 con 0x5613c4572810 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4577bc0 con 0x5613c4572810 2024-09-14T10:44:31.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4576f60 con 0x5613c4572810 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 zone default found 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 4 Realm: () 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 zonegroup default 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4577bc0 con 0x7eff68019040 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c457d240 con 0x5613c45788b0 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c457d5e0 con 0x5613c45788b0 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 started sync module instance, tier type = 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:31.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.076+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457c6e0 con 0x7eff6c009040 2024-09-14T10:44:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.080+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.080+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94642898455296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457dea0 con 0x7eff6c009040 2024-09-14T10:44:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.080+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457e6f0 con 0x5613c4572810 2024-09-14T10:44:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.080+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94642898455296] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.080+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.080+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94642898459120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457e3a0 con 0x5613c4572810 2024-09-14T10:44:31.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.080+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457eec0 con 0x5613c45788b0 2024-09-14T10:44:31.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.084+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94642898459120] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.084+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.084+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94642898463120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457f2b0 con 0x5613c45788b0 2024-09-14T10:44:31.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.084+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457fc70 con 0x7eff6c009040 2024-09-14T10:44:31.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.084+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.084+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94642898467024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4580380 con 0x7eff6c009040 2024-09-14T10:44:31.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.084+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4580ea0 con 0x5613c4572810 2024-09-14T10:44:31.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.084+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94642898463120] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.088+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94642898467024] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.088+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.088+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94642898471280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4580e60 con 0x5613c4572810 2024-09-14T10:44:31.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.088+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4581740 con 0x7eff68019040 2024-09-14T10:44:31.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.088+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94642898471280] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.088+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.088+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94642898460176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4581310 con 0x7eff68019040 2024-09-14T10:44:31.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.088+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4581bc0 con 0x7eff68019040 2024-09-14T10:44:31.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94642898473744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4582270 con 0x7eff68019040 2024-09-14T10:44:31.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4582b20 con 0x7eff68019040 2024-09-14T10:44:31.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94642898460176] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94642898473744] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94642898472544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c4582270 con 0x7eff68019040 2024-09-14T10:44:31.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 20 add_watcher() i=0 2024-09-14T10:44:31.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 20 add_watcher() i=1 2024-09-14T10:44:31.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 20 add_watcher() i=2 2024-09-14T10:44:31.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 20 add_watcher() i=3 2024-09-14T10:44:31.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 20 add_watcher() i=4 2024-09-14T10:44:31.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 20 add_watcher() i=5 2024-09-14T10:44:31.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.092+0000 7eff794ad9c0 20 add_watcher() i=6 2024-09-14T10:44:31.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94642898472544] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 20 add_watcher() i=7 2024-09-14T10:44:31.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:31.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c4585c20 con 0x5613c4572810 2024-09-14T10:44:31.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94642898476480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c45830a0 con 0x5613c4572810 2024-09-14T10:44:31.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94642898476480] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7efe2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 5 note: GC not initialized 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7efda7fff640 20 reqs_thread_entry: start 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.096+0000 7eff794ad9c0 20 Filter name: none 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7efda5ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a8ce0 con 0x5613c4572810 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45aa230 con 0x7eff6c009040 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45aa230 con 0x5613c45788b0 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:44:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 4.2e 4:77aa7d25:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45abe00 con 0x5613c45788b0 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 4.31 4:8c880be2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45aea70 con 0x5613c4572810 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 4.15 4:aa6540a5:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45b1780 con 0x5613c45788b0 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:68 4.1c 4:3adf25d2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45b4470 con 0x7eff68019040 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 4.2 4:4285a78a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45b1780 con 0x5613c4572810 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 4.2c 4:37c95a4c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45b1780 con 0x5613c4572810 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 4.2a 4:5661d8ff:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45bba00 con 0x5613c4572810 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 4.2d 4:b689318c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45be340 con 0x7eff68019040 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(65 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 4.16 4:68627ddf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45be340 con 0x5613c45788b0 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(66 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(67 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 4.18 4:1a24b59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45b1190 con 0x7eff6c009040 2024-09-14T10:44:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(69 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 4.4 4:2304044a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45b6920 con 0x7eff68019040 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(70 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(71 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(68 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(73 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(74 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(75 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.100+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a7a80 con 0x7eff6c009040 2024-09-14T10:44:31.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a7a80 con 0x7eff6c009040 2024-09-14T10:44:31.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff794ad9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a7a80 con 0x5613c4572810 2024-09-14T10:44:31.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff794ad9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:31.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a7a80 con 0x7eff6c009040 2024-09-14T10:44:31.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.104+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.108+0000 7efe2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.108+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94642898476480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a6910 con 0x5613c4572810 2024-09-14T10:44:31.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.108+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94642898476480] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.108+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94642898455296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a6910 con 0x7eff6c009040 2024-09-14T10:44:31.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.108+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94642898455296] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.108+0000 7eff794ad9c0 20 remove_watcher() i=0 2024-09-14T10:44:31.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.108+0000 7eff794ad9c0 2 removed watcher, disabling cache 2024-09-14T10:44:31.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.108+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94642898459120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457cb00 con 0x5613c4572810 2024-09-14T10:44:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.112+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94642898459120] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.112+0000 7eff794ad9c0 20 remove_watcher() i=1 2024-09-14T10:44:31.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.112+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94642898463120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a6910 con 0x5613c45788b0 2024-09-14T10:44:31.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.112+0000 7eff767b2640 1 -- 172.21.15.96:0/4124031051 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94642898463120] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6c0ce020 con 0x5613c45788b0 2024-09-14T10:44:31.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.112+0000 7eff794ad9c0 20 remove_watcher() i=2 2024-09-14T10:44:31.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.112+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94642898467024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457d9f0 con 0x7eff6c009040 2024-09-14T10:44:31.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.116+0000 7eff777b4640 1 -- 172.21.15.96:0/4124031051 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94642898467024] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff6802f040 con 0x7eff6c009040 2024-09-14T10:44:31.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.116+0000 7eff794ad9c0 20 remove_watcher() i=3 2024-09-14T10:44:31.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.116+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94642898471280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457cb00 con 0x5613c4572810 2024-09-14T10:44:31.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.116+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94642898471280] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x5613c4572810 2024-09-14T10:44:31.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.116+0000 7eff794ad9c0 20 remove_watcher() i=4 2024-09-14T10:44:31.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.116+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94642898460176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457e990 con 0x7eff68019040 2024-09-14T10:44:31.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.120+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94642898460176] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.120+0000 7eff794ad9c0 20 remove_watcher() i=5 2024-09-14T10:44:31.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.120+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94642898473744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c45a6910 con 0x7eff68019040 2024-09-14T10:44:31.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.120+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94642898473744] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.120+0000 7eff794ad9c0 20 remove_watcher() i=6 2024-09-14T10:44:31.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.120+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94642898472544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613c457cb00 con 0x7eff68019040 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94642898472544] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7000f070 con 0x7eff68019040 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 20 remove_watcher() i=7 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7eff68019040 msgr2=0x7eff68019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7eff68019040 0x7eff68019930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c4572810 msgr2=0x5613c4574ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c4572810 0x5613c4574ca0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7eff6c009040 msgr2=0x7eff6c0e5aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7eff6c009040 0x7eff6c0e5aa0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613c45788b0 msgr2=0x5613c457ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613c45788b0 0x5613c457ad00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe4003a150 msgr2=0x7efe4003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe4003a150 0x7efe4003c610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff6800f010 tx=0x7eff6801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 msgr2=0x5613c45674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/4124031051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4560fb0 0x5613c45674b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7eff6c006500 tx=0x7eff6c0ec6d0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 reap_dead start 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff76fb3640 1 -- 172.21.15.96:0/4124031051 reap_dead start 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 shutdown_connections 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 >> 172.21.15.96:0/4124031051 conn(0x5613c455c370 msgr2=0x5613c455a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 shutdown_connections 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/4124031051 wait complete. 2024-09-14T10:44:31.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1254565119 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5003a140 msgr2=0x7efe5003c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/1254565119 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5003a140 0x7efe5003c600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff6800e3f0 tx=0x7eff68003070 comp rx=0 tx=0).stop 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1254565119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4553700 msgr2=0x5613c4553b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/1254565119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4553700 0x5613c4553b20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff6c000c10 tx=0x7eff6c0180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1254565119 shutdown_connections 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/1254565119 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5003a140 0x7efe5003c600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/1254565119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c4553700 0x5613c4553b20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1254565119 >> 172.21.15.96:0/1254565119 conn(0x5613c45490b0 msgr2=0x5613c4549490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1254565119 shutdown_connections 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/1254565119 wait complete. 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c43bb640 msgr2=0x5613c4543050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c43bb640 0x5613c4543050 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5c03a2f0 msgr2=0x7efe5c03c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5c03a2f0 0x7efe5c03c7b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0ae000 tx=0x7eff6c0a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:31.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 msgr2=0x5613c453bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c453bee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x5613c45355a0 tx=0x7eff70000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:31.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 shutdown_connections 2024-09-14T10:44:31.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613c43bb640 0x5613c4543050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe5c03a2f0 0x7efe5c03c7b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 --2- 172.21.15.96:0/3805611508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613c43bb260 0x5613c453bee0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 >> 172.21.15.96:0/3805611508 conn(0x5613c4441980 msgr2=0x5613c4535a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 shutdown_connections 2024-09-14T10:44:31.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.124+0000 7eff794ad9c0 1 -- 172.21.15.96:0/3805611508 wait complete. 2024-09-14T10:44:31.134 INFO:teuthology.orchestra.run.smithi096.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-14T10:44:31.106150Z","last_stats_update":"2024-09-14T10:44:31.103808Z"} 2024-09-14T10:44:31.134 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-14T10:44:31.106150Z', 'last_stats_update': '2024-09-14T10:44:31.103808Z'} 2024-09-14T10:44:31.143 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:31.143 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-14T10:44:31.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-14T10:44:31.143 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-14T10:44:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb347cf09c0 1 Processor -- start 2024-09-14T10:44:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb347cf09c0 1 -- start start 2024-09-14T10:44:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb347cf09c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d42d0c2050 0x55d42d0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb347cf09c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d42cf677a0 con 0x55d42d0bde60 2024-09-14T10:44:31.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb347cf09c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55d42cfc31b0 con 0x55d42d0c2050 2024-09-14T10:44:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb344ff5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d42d0c2050 0x55d42d0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb344ff5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d42d0c2050 0x55d42d0c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45110/0 (socket says 172.21.15.96:45110) 2024-09-14T10:44:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb3457f6640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55d42d0bde60 0x55d42d0be240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37158/0 (socket says 172.21.15.96:37158) 2024-09-14T10:44:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb344ff5640 1 -- 172.21.15.96:0/3598996224 learned_addr learned my addr 172.21.15.96:0/3598996224 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb344ff5640 1 -- 172.21.15.96:0/3598996224 >> v1:172.21.15.70:6789/0 conn(0x55d42d0bde60 legacy=0x55d42d0be240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.216+0000 7fb344ff5640 1 -- 172.21.15.96:0/3598996224 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42cf41da0 con 0x55d42d0c2050 2024-09-14T10:44:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb344ff5640 1 --2- 172.21.15.96:0/3598996224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0c2050 0x55d42d0c4440 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00a5c0 tx=0x7fb33c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930fa1d102551bce server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb337fff640 1 -- 172.21.15.96:0/3598996224 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33c0a9590 con 0x55d42d0c2050 2024-09-14T10:44:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb337fff640 1 -- 172.21.15.96:0/3598996224 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c0ae070 con 0x55d42d0c2050 2024-09-14T10:44:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb337fff640 1 -- 172.21.15.96:0/3598996224 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33c0a9880 con 0x55d42d0c2050 2024-09-14T10:44:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3598996224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0c2050 msgr2=0x55d42d0c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3598996224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0c2050 0x55d42d0c4440 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00a5c0 tx=0x7fb33c01b3d0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3598996224 shutdown_connections 2024-09-14T10:44:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3598996224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0c2050 0x55d42d0c4440 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3598996224 >> 172.21.15.96:0/3598996224 conn(0x55d42d0b9980 msgr2=0x55d42d0bbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3598996224 shutdown_connections 2024-09-14T10:44:31.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.220+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3598996224 wait complete. 2024-09-14T10:44:31.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb347cf09c0 1 Processor -- start 2024-09-14T10:44:31.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb347cf09c0 1 -- start start 2024-09-14T10:44:31.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb347cf09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb347cf09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d42cfc6fc0 con 0x55d42d0bde60 2024-09-14T10:44:31.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb3457f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb3457f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1a92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45120/0 (socket says 172.21.15.96:45120) 2024-09-14T10:44:31.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb3457f6640 1 -- 172.21.15.96:0/1891065604 learned_addr learned my addr 172.21.15.96:0/1891065604 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb3457f6640 1 -- 172.21.15.96:0/1891065604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42d1a98d0 con 0x55d42d0bde60 2024-09-14T10:44:31.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb3457f6640 1 --2- 172.21.15.96:0/1891065604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1a92e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb3400016f0 tx=0x7fb340001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171fff718ef744ae server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb233606640 1 -- 172.21.15.96:0/1891065604 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb340003460 con 0x55d42d0bde60 2024-09-14T10:44:31.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb233606640 1 -- 172.21.15.96:0/1891065604 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb340003620 con 0x55d42d0bde60 2024-09-14T10:44:31.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb233606640 1 -- 172.21.15.96:0/1891065604 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb340003940 con 0x55d42d0bde60 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb347cf09c0 1 -- 172.21.15.96:0/1891065604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 msgr2=0x55d42d1a92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.236+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/1891065604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1a92e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb3400016f0 tx=0x7fb340001bb0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 -- 172.21.15.96:0/1891065604 shutdown_connections 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/1891065604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1a92e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 -- 172.21.15.96:0/1891065604 >> 172.21.15.96:0/1891065604 conn(0x55d42d0b9980 msgr2=0x55d42d1a4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 -- 172.21.15.96:0/1891065604 shutdown_connections 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 -- 172.21.15.96:0/1891065604 wait complete. 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 Processor -- start 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 -- start start 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d42cf68a50 con 0x55d42d0bde60 2024-09-14T10:44:31.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb3457f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb3457f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45128/0 (socket says 172.21.15.96:45128) 2024-09-14T10:44:31.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb3457f6640 1 -- 172.21.15.96:0/3202229849 learned_addr learned my addr 172.21.15.96:0/3202229849 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb3457f6640 1 -- 172.21.15.96:0/3202229849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42d1b1110 con 0x55d42d0bde60 2024-09-14T10:44:31.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb3457f6640 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1b0bb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55d42d1aa2a0 tx=0x7fb340001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb231e03640 1 -- 172.21.15.96:0/3202229849 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb340028070 con 0x55d42d0bde60 2024-09-14T10:44:31.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb231e03640 1 -- 172.21.15.96:0/3202229849 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb340019770 con 0x55d42d0bde60 2024-09-14T10:44:31.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d42d1b13a0 con 0x55d42d0bde60 2024-09-14T10:44:31.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb231e03640 1 -- 172.21.15.96:0/3202229849 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb340019a70 con 0x55d42d0bde60 2024-09-14T10:44:31.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42d1b1d80 con 0x55d42d0bde60 2024-09-14T10:44:31.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb231e03640 1 -- 172.21.15.96:0/3202229849 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb34002b070 con 0x55d42d0bde60 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb231e03640 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb22c03a1a0 0x7fb22c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.240+0000 7fb231e03640 1 -- 172.21.15.96:0/3202229849 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb340020070 con 0x55d42d0bde60 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb344ff5640 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb22c03a1a0 0x7fb22c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d0c2050 0x55d42d1b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1b72d0 con 0x55d42d0c2050 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb345ff7640 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d0c2050 0x55d42d1b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb344ff5640 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb22c03a1a0 0x7fb22c03c660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0ad000 tx=0x7fb33c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb345ff7640 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d0c2050 0x55d42d1b6d90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb345ff7640 1 -- 172.21.15.96:0/3202229849 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3380083f0 con 0x55d42d0c2050 2024-09-14T10:44:31.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1b7670 con 0x55d42d0c2050 2024-09-14T10:44:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb345ff7640 1 -- 172.21.15.96:0/3202229849 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3380083f0 con 0x55d42d0c2050 2024-09-14T10:44:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1b8f20 con 0x55d42d0c2050 2024-09-14T10:44:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb345ff7640 1 -- 172.21.15.96:0/3202229849 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb3380083f0 con 0x55d42d0c2050 2024-09-14T10:44:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1b8150 con 0x55d42d0c2050 2024-09-14T10:44:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb345ff7640 1 -- 172.21.15.96:0/3202229849 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3380083f0 con 0x55d42d0c2050 2024-09-14T10:44:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1b85a0 con 0x55d42d0c2050 2024-09-14T10:44:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb345ff7640 1 -- 172.21.15.96:0/3202229849 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb3380083f0 con 0x55d42d0c2050 2024-09-14T10:44:31.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 Processor -- start 2024-09-14T10:44:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 -- start start 2024-09-14T10:44:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1c72a0 0x55d42d1c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb347cf09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d42cfd3d80 con 0x55d42d1c72a0 2024-09-14T10:44:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb344ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1c72a0 0x55d42d1c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb344ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1c72a0 0x55d42d1c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45138/0 (socket says 172.21.15.96:45138) 2024-09-14T10:44:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.244+0000 7fb344ff5640 1 -- 172.21.15.96:0/3180739251 learned_addr learned my addr 172.21.15.96:0/3180739251 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb344ff5640 1 -- 172.21.15.96:0/3180739251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42d1c7d00 con 0x55d42d1c72a0 2024-09-14T10:44:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb344ff5640 1 --2- 172.21.15.96:0/3180739251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1c72a0 0x55d42d1c76c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0ab040 tx=0x7fb33c018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb22affd640 1 -- 172.21.15.96:0/3180739251 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33c0b3ba0 con 0x55d42d1c72a0 2024-09-14T10:44:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3180739251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d42d1c8560 con 0x55d42d1c72a0 2024-09-14T10:44:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb22affd640 1 -- 172.21.15.96:0/3180739251 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c0b3d40 con 0x55d42d1c72a0 2024-09-14T10:44:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb22affd640 1 -- 172.21.15.96:0/3180739251 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33c0c8580 con 0x55d42d1c72a0 2024-09-14T10:44:31.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3180739251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42d1c8a70 con 0x55d42d1c72a0 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb22affd640 1 -- 172.21.15.96:0/3180739251 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb33c0d1440 con 0x55d42d1c72a0 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb22affd640 1 --2- 172.21.15.96:0/3180739251 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21c03a150 0x7fb21c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb22affd640 1 -- 172.21.15.96:0/3180739251 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb33c0ee5f0 con 0x55d42d1c72a0 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb345ff7640 1 --2- 172.21.15.96:0/3180739251 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21c03a150 0x7fb21c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb347cf09c0 1 Processor -- start 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb347cf09c0 1 -- start start 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb347cf09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1d3ae0 0x55d42d1d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb345ff7640 1 --2- 172.21.15.96:0/3180739251 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21c03a150 0x7fb21c03c610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb33800e3f0 tx=0x7fb338003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb347cf09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d42d1a9ca0 con 0x55d42d1d3ae0 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb344ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1d3ae0 0x55d42d1d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb344ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1d3ae0 0x55d42d1d3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45154/0 (socket says 172.21.15.96:45154) 2024-09-14T10:44:31.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb344ff5640 1 -- 172.21.15.96:0/2226106753 learned_addr learned my addr 172.21.15.96:0/2226106753 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb344ff5640 1 -- 172.21.15.96:0/2226106753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42d1d4490 con 0x55d42d1d3ae0 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.248+0000 7fb344ff5640 1 --2- 172.21.15.96:0/2226106753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1d3ae0 0x55d42d1d3ec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0ec9e0 tx=0x7fb33c0c7a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f68c4d17100dd66 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb228ff9640 1 -- 172.21.15.96:0/2226106753 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33c0be540 con 0x55d42d1d3ae0 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb228ff9640 1 -- 172.21.15.96:0/2226106753 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c0bc3b0 con 0x55d42d1d3ae0 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb228ff9640 1 -- 172.21.15.96:0/2226106753 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33c0ee0d0 con 0x55d42d1d3ae0 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2226106753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1d3ae0 msgr2=0x55d42d1d3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2226106753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1d3ae0 0x55d42d1d3ec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0ec9e0 tx=0x7fb33c0c7a10 comp rx=0 tx=0).stop 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2226106753 shutdown_connections 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2226106753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1d3ae0 0x55d42d1d3ec0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2226106753 >> 172.21.15.96:0/2226106753 conn(0x55d42d1cff10 msgr2=0x55d42d1ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2226106753 shutdown_connections 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2226106753 wait complete. 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 Processor -- start 2024-09-14T10:44:31.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- start start 2024-09-14T10:44:31.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1df5e0 0x55d42d1dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d42d1d4af0 con 0x55d42d1df5e0 2024-09-14T10:44:31.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb344ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1df5e0 0x55d42d1dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb344ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1df5e0 0x55d42d1dfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45166/0 (socket says 172.21.15.96:45166) 2024-09-14T10:44:31.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 learned_addr learned my addr 172.21.15.96:0/2162568479 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42d1dff60 con 0x55d42d1df5e0 2024-09-14T10:44:31.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb344ff5640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1df5e0 0x55d42d1dfa00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0b37f0 tx=0x7fb33c0ec970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb21affd640 1 -- 172.21.15.96:0/2162568479 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33c0f4070 con 0x55d42d1df5e0 2024-09-14T10:44:31.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb21affd640 1 -- 172.21.15.96:0/2162568479 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c0ee2e0 con 0x55d42d1df5e0 2024-09-14T10:44:31.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d42d1e01f0 con 0x55d42d1df5e0 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb21affd640 1 -- 172.21.15.96:0/2162568479 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33c0ecc50 con 0x55d42d1df5e0 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.252+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42d1e0b60 con 0x55d42d1df5e0 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb21affd640 1 -- 172.21.15.96:0/2162568479 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb33c0f7070 con 0x55d42d1df5e0 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb21affd640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21003a150 0x7fb21003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb21affd640 1 -- 172.21.15.96:0/2162568479 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb33c0e3040 con 0x55d42d1df5e0 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb345ff7640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21003a150 0x7fb21003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d1eb170 0x55d42d1ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1edd80 con 0x55d42d1eb170 2024-09-14T10:44:31.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb3457f6640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d1eb170 0x55d42d1ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb345ff7640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21003a150 0x7fb21003c610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb33800f010 tx=0x7fb33801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb3457f6640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d1eb170 0x55d42d1ed630 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 realm 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1ee190 con 0x55d42d1eb170 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1eea60 con 0x55d42d1eb170 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1eee00 con 0x55d42d1eb170 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1ef650 con 0x55d42d1eb170 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 20 searching for the correct realm 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d42d1f13c0 0x55d42d1f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x55d42d1f13c0 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb344ff5640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d42d1f13c0 0x55d42d1f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb344ff5640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d42d1f13c0 0x55d42d1f37b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb344ff5640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb33c0f9060 0x7fb33c0eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x7fb33c0f9060 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.256+0000 7fb345ff7640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb33c0f9060 0x7fb33c0eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb345ff7640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb33c0f9060 0x7fb33c0eb170 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb345ff7640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb338019040 0x7fb338019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x7fb338019040 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb338019040 0x7fb338019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb338019040 0x7fb338019930 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x55d42d1eb170 2024-09-14T10:44:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x55d42d1eb170 2024-09-14T10:44:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x7fb338019040 2024-09-14T10:44:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x7fb338019040 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.260+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x7fb33c0f9060 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x55d42d1f13c0 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x55d42d1eb170 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x7fb338019040 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f3de0 con 0x55d42d1eb170 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x7fb33c0f9060 2024-09-14T10:44:31.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1f13c0 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1f13c0 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x7fb338019040 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1f13c0 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1f13c0 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.264+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1eb170 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1eb170 2024-09-14T10:44:31.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x7fb338019040 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1f13c0 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x7fb33c0f9060 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1eb170 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x7fb338019040 2024-09-14T10:44:31.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x55d42d1f13c0 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340036040 con 0x7fb338019040 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.268+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340040040 con 0x7fb33c0f9060 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340040040 con 0x55d42d1f13c0 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340040040 con 0x7fb338019040 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340040040 con 0x55d42d1eb170 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb340040040 con 0x7fb33c0f9060 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1efea0 con 0x55d42d1eb170 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f0290 con 0x55d42d1eb170 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f0290 con 0x55d42d1eb170 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 zone default found 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 4 Realm: () 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 zonegroup default 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f0720 con 0x7fb338019040 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.272+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f5c30 con 0x55d42d1f13c0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f5fd0 con 0x55d42d1f13c0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 20 started sync module instance, tier type = 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:31.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f50d0 con 0x7fb33c0f9060 2024-09-14T10:44:31.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94369778453536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f6370 con 0x7fb33c0f9060 2024-09-14T10:44:31.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f6d30 con 0x55d42d1eb170 2024-09-14T10:44:31.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.276+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94369778460800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f7150 con 0x55d42d1eb170 2024-09-14T10:44:31.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.280+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f7ba0 con 0x55d42d1f13c0 2024-09-14T10:44:31.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.280+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94369778453536] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.280+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94369778460800] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.280+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.280+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94369778455792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f7150 con 0x55d42d1f13c0 2024-09-14T10:44:31.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.280+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f8440 con 0x7fb33c0f9060 2024-09-14T10:44:31.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.280+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.284+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94369778466976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f8b70 con 0x7fb33c0f9060 2024-09-14T10:44:31.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.284+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f9670 con 0x55d42d1eb170 2024-09-14T10:44:31.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.284+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94369778455792] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.284+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94369778466976] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.284+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.284+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94369778471264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f9630 con 0x55d42d1eb170 2024-09-14T10:44:31.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.284+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f9a90 con 0x7fb338019040 2024-09-14T10:44:31.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.284+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94369778471264] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.288+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.288+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94369778461856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1f9a40 con 0x7fb338019040 2024-09-14T10:44:31.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.288+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1fa4a0 con 0x7fb338019040 2024-09-14T10:44:31.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.288+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.288+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94369778474992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1fa8c0 con 0x7fb338019040 2024-09-14T10:44:31.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.288+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1fb300 con 0x7fb338019040 2024-09-14T10:44:31.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.288+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94369778461856] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94369778474992] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94369778478544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1fa410 con 0x7fb338019040 2024-09-14T10:44:31.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 20 add_watcher() i=0 2024-09-14T10:44:31.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 20 add_watcher() i=1 2024-09-14T10:44:31.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 20 add_watcher() i=2 2024-09-14T10:44:31.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 20 add_watcher() i=3 2024-09-14T10:44:31.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 20 add_watcher() i=4 2024-09-14T10:44:31.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 20 add_watcher() i=5 2024-09-14T10:44:31.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 20 add_watcher() i=6 2024-09-14T10:44:31.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94369778478544] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 20 add_watcher() i=7 2024-09-14T10:44:31.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:31.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1fe400 con 0x55d42d1eb170 2024-09-14T10:44:31.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.292+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94369778468288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d1fb880 con 0x55d42d1eb170 2024-09-14T10:44:31.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94369778468288] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb1fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:31.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:31.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 5 note: GC not initialized 2024-09-14T10:44:31.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb1fafe5640 20 reqs_thread_entry: start 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 Filter name: none 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb1f8fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d2218f0 con 0x55d42d1eb170 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:31.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d2239e0 con 0x7fb33c0f9060 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d2251f0 con 0x55d42d1f13c0 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:31.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-14T10:44:31.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.296+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d228910 con 0x7fb33c0f9060 2024-09-14T10:44:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb347cf09c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-14T10:44:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb347cf09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d227960 con 0x7fb33c0f9060 2024-09-14T10:44:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb347cf09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb347cf09c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-14T10:44:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb347cf09c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb347cf09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:31.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.300+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d22c960 con 0x7fb33c0f9060 2024-09-14T10:44:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb347cf09c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-14T10:44:31.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb347cf09c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb347cf09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:44:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94369778680880 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d42d228330 con 0x7fb338019040 2024-09-14T10:44:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== watch-notify(notify (1) cookie 94369778474992 notify 137438953479 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55d42d1b1d80 con 0x7fb338019040 2024-09-14T10:44:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb228ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94369778474992 notifier 4480 bl.length()=338 2024-09-14T10:44:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb228ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-14T10:44:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb228ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb228ff9640 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb208003eb0 con 0x7fb338019040 2024-09-14T10:44:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(68 notify.6 [notify cookie 94369778680880 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== watch-notify(notify_complete (2) cookie 94369778680880 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d42d1b13a0 con 0x7fb338019040 2024-09-14T10:44:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb1fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.304+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94369778468288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d21f530 con 0x55d42d1eb170 2024-09-14T10:44:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.308+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94369778468288] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.308+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94369778453536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d21f530 con 0x7fb33c0f9060 2024-09-14T10:44:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.308+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94369778453536] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.308+0000 7fb347cf09c0 20 remove_watcher() i=0 2024-09-14T10:44:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.308+0000 7fb347cf09c0 2 removed watcher, disabling cache 2024-09-14T10:44:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.308+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94369778460800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d21f530 con 0x55d42d1eb170 2024-09-14T10:44:31.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94369778460800] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb347cf09c0 20 remove_watcher() i=1 2024-09-14T10:44:31.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94369778455792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d22c950 con 0x55d42d1f13c0 2024-09-14T10:44:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb344ff5640 1 -- 172.21.15.96:0/2162568479 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94369778455792] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33c0f6030 con 0x55d42d1f13c0 2024-09-14T10:44:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb347cf09c0 20 remove_watcher() i=2 2024-09-14T10:44:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94369778466976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d21f530 con 0x7fb33c0f9060 2024-09-14T10:44:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb345ff7640 1 -- 172.21.15.96:0/2162568479 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94369778466976] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33802f040 con 0x7fb33c0f9060 2024-09-14T10:44:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb347cf09c0 20 remove_watcher() i=3 2024-09-14T10:44:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.312+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94369778471264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d21f530 con 0x55d42d1eb170 2024-09-14T10:44:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.316+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94369778471264] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x55d42d1eb170 2024-09-14T10:44:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.316+0000 7fb347cf09c0 20 remove_watcher() i=4 2024-09-14T10:44:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.316+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94369778461856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d21f530 con 0x7fb338019040 2024-09-14T10:44:31.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.320+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94369778461856] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.320+0000 7fb347cf09c0 20 remove_watcher() i=5 2024-09-14T10:44:31.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.320+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94369778474992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d21f530 con 0x7fb338019040 2024-09-14T10:44:31.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.320+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94369778474992] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.320+0000 7fb347cf09c0 20 remove_watcher() i=6 2024-09-14T10:44:31.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.320+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94369778478544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d42d21f530 con 0x7fb338019040 2024-09-14T10:44:31.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94369778478544] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34002a030 con 0x7fb338019040 2024-09-14T10:44:31.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 20 remove_watcher() i=7 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb338019040 msgr2=0x7fb338019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fb338019040 0x7fb338019930 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d1eb170 msgr2=0x55d42d1ed630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d1eb170 0x55d42d1ed630 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb33c0f9060 msgr2=0x7fb33c0eb170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fb33c0f9060 0x7fb33c0eb170 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d42d1f13c0 msgr2=0x55d42d1f37b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d42d1f13c0 0x55d42d1f37b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21003a150 msgr2=0x7fb21003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21003a150 0x7fb21003c610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb33800f010 tx=0x7fb33801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb3457f6640 1 -- 172.21.15.96:0/2162568479 reap_dead start 2024-09-14T10:44:31.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1df5e0 msgr2=0x55d42d1dfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1df5e0 0x55d42d1dfa00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0b37f0 tx=0x7fb33c0ec970 comp rx=0 tx=0).stop 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 shutdown_connections 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/2162568479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1df5e0 0x55d42d1dfa00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 >> 172.21.15.96:0/2162568479 conn(0x55d42d1cff10 msgr2=0x55d42d1ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 shutdown_connections 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/2162568479 wait complete. 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3180739251 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21c03a150 msgr2=0x7fb21c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3180739251 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21c03a150 0x7fb21c03c610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb33800e3f0 tx=0x7fb338003070 comp rx=0 tx=0).stop 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3180739251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1c72a0 msgr2=0x55d42d1c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3180739251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1c72a0 0x55d42d1c76c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0ab040 tx=0x7fb33c018170 comp rx=0 tx=0).stop 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3180739251 shutdown_connections 2024-09-14T10:44:31.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3180739251 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb21c03a150 0x7fb21c03c610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3180739251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d1c72a0 0x55d42d1c76c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3180739251 >> 172.21.15.96:0/3180739251 conn(0x55d42d1bcc50 msgr2=0x55d42d1bd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3180739251 shutdown_connections 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3180739251 wait complete. 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d0c2050 msgr2=0x55d42d1b6d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d0c2050 0x55d42d1b6d90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb22c03a1a0 msgr2=0x7fb22c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb22c03a1a0 0x7fb22c03c660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb33c0ad000 tx=0x7fb33c0a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 msgr2=0x55d42d1b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1b0bb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55d42d1aa2a0 tx=0x7fb340001260 comp rx=0 tx=0).stop 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 shutdown_connections 2024-09-14T10:44:31.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d42d0c2050 0x55d42d1b6d90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb22c03a1a0 0x7fb22c03c660 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 --2- 172.21.15.96:0/3202229849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d42d0bde60 0x55d42d1b0bb0 secure :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55d42d1aa2a0 tx=0x7fb340001260 comp rx=0 tx=0).stop 2024-09-14T10:44:31.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 >> 172.21.15.96:0/3202229849 conn(0x55d42d0b9980 msgr2=0x55d42d1aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 shutdown_connections 2024-09-14T10:44:31.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.324+0000 7fb347cf09c0 1 -- 172.21.15.96:0/3202229849 wait complete. 2024-09-14T10:44:31.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-14T10:44:31.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-14T10:44:31.334 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-14T10:44:31.421 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:31.421 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:31.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70afb599c0 1 Processor -- start 2024-09-14T10:44:31.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70afb599c0 1 -- start start 2024-09-14T10:44:31.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70afb599c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56470a351840 0x56470a350410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70afb599c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56470a2837a0 con 0x56470a351310 2024-09-14T10:44:31.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70afb599c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x56470a2df1b0 con 0x56470a351840 2024-09-14T10:44:31.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70ace5e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56470a351840 0x56470a350410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70ace5e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x56470a351840 0x56470a350410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45182/0 (socket says 172.21.15.96:45182) 2024-09-14T10:44:31.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70ad65f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x56470a351310 0x56470a34fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37170/0 (socket says 172.21.15.96:37170) 2024-09-14T10:44:31.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70ace5e640 1 -- 172.21.15.96:0/2527460857 learned_addr learned my addr 172.21.15.96:0/2527460857 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70ace5e640 1 -- 172.21.15.96:0/2527460857 >> v1:172.21.15.70:6789/0 conn(0x56470a351310 legacy=0x56470a34fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.424+0000 7f70ace5e640 1 -- 172.21.15.96:0/2527460857 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a25dda0 con 0x56470a351840 2024-09-14T10:44:31.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f70ace5e640 1 --2- 172.21.15.96:0/2527460857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351840 0x56470a350410 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f70a400a5c0 tx=0x7f70a401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2a3b286c7c98c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f709ffff640 1 -- 172.21.15.96:0/2527460857 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a40b0070 con 0x56470a351840 2024-09-14T10:44:31.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f709ffff640 1 -- 172.21.15.96:0/2527460857 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a40ab540 con 0x56470a351840 2024-09-14T10:44:31.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f709ffff640 1 -- 172.21.15.96:0/2527460857 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a40ab840 con 0x56470a351840 2024-09-14T10:44:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f70afb599c0 1 -- 172.21.15.96:0/2527460857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351840 msgr2=0x56470a350410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2527460857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351840 0x56470a350410 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f70a400a5c0 tx=0x7f70a401b280 comp rx=0 tx=0).stop 2024-09-14T10:44:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f70afb599c0 1 -- 172.21.15.96:0/2527460857 shutdown_connections 2024-09-14T10:44:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2527460857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351840 0x56470a350410 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f70afb599c0 1 -- 172.21.15.96:0/2527460857 >> 172.21.15.96:0/2527460857 conn(0x56470a3d6b30 msgr2=0x56470a3d8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f70afb599c0 1 -- 172.21.15.96:0/2527460857 shutdown_connections 2024-09-14T10:44:31.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.428+0000 7f70afb599c0 1 -- 172.21.15.96:0/2527460857 wait complete. 2024-09-14T10:44:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.444+0000 7f70afb599c0 1 Processor -- start 2024-09-14T10:44:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.444+0000 7f70afb599c0 1 -- start start 2024-09-14T10:44:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.444+0000 7f70afb599c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.444+0000 7f70afb599c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56470a2e2fc0 con 0x56470a351310 2024-09-14T10:44:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.444+0000 7f70ad65f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.444+0000 7f70ad65f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45194/0 (socket says 172.21.15.96:45194) 2024-09-14T10:44:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.444+0000 7f70ad65f640 1 -- 172.21.15.96:0/4127471809 learned_addr learned my addr 172.21.15.96:0/4127471809 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70ad65f640 1 -- 172.21.15.96:0/4127471809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a4c8fc0 con 0x56470a351310 2024-09-14T10:44:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70ad65f640 1 --2- 172.21.15.96:0/4127471809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4c89d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f70a0001ec0 tx=0x7f70a000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdba20e196db9ce server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f6f9b606640 1 -- 172.21.15.96:0/4127471809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a000e5d0 con 0x56470a351310 2024-09-14T10:44:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f6f9b606640 1 -- 172.21.15.96:0/4127471809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a000e770 con 0x56470a351310 2024-09-14T10:44:31.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f6f9b606640 1 -- 172.21.15.96:0/4127471809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a000ea70 con 0x56470a351310 2024-09-14T10:44:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 -- 172.21.15.96:0/4127471809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 msgr2=0x56470a4c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 --2- 172.21.15.96:0/4127471809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4c89d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f70a0001ec0 tx=0x7f70a000b6d0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 -- 172.21.15.96:0/4127471809 shutdown_connections 2024-09-14T10:44:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 --2- 172.21.15.96:0/4127471809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4c89d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 -- 172.21.15.96:0/4127471809 >> 172.21.15.96:0/4127471809 conn(0x56470a3d6b30 msgr2=0x56470a4c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 -- 172.21.15.96:0/4127471809 shutdown_connections 2024-09-14T10:44:31.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 -- 172.21.15.96:0/4127471809 wait complete. 2024-09-14T10:44:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 Processor -- start 2024-09-14T10:44:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 -- start start 2024-09-14T10:44:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70afb599c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56470a284a50 con 0x56470a351310 2024-09-14T10:44:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70ad65f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70ad65f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45198/0 (socket says 172.21.15.96:45198) 2024-09-14T10:44:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70ad65f640 1 -- 172.21.15.96:0/2293384465 learned_addr learned my addr 172.21.15.96:0/2293384465 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70ad65f640 1 -- 172.21.15.96:0/2293384465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a4d07d0 con 0x56470a351310 2024-09-14T10:44:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.448+0000 7f70ad65f640 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4d0270 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x56470a4c9990 tx=0x7f70a0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f6f99e03640 1 -- 172.21.15.96:0/2293384465 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a000f8e0 con 0x56470a351310 2024-09-14T10:44:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f6f99e03640 1 -- 172.21.15.96:0/2293384465 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a000fa80 con 0x56470a351310 2024-09-14T10:44:31.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f6f99e03640 1 -- 172.21.15.96:0/2293384465 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a000fda0 con 0x56470a351310 2024-09-14T10:44:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56470a4d0a60 con 0x56470a351310 2024-09-14T10:44:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56470a4d1410 con 0x56470a351310 2024-09-14T10:44:31.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f6f99e03640 1 -- 172.21.15.96:0/2293384465 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f70a0017070 con 0x56470a351310 2024-09-14T10:44:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f6f99e03640 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f9403a1a0 0x7f6f9403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f6f99e03640 1 -- 172.21.15.96:0/2293384465 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70a0015020 con 0x56470a351310 2024-09-14T10:44:31.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70ace5e640 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f9403a1a0 0x7f6f9403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a351840 0x56470a4d73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a4d7920 con 0x56470a351840 2024-09-14T10:44:31.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70ade60640 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a351840 0x56470a4d73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70ace5e640 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f9403a1a0 0x7f6f9403c660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70a40ad000 tx=0x7f70a40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70ade60640 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a351840 0x56470a4d73e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70ade60640 1 -- 172.21.15.96:0/2293384465 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70a800a4d0 con 0x56470a351840 2024-09-14T10:44:31.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a4d1750 con 0x56470a351840 2024-09-14T10:44:31.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70ade60640 1 -- 172.21.15.96:0/2293384465 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70a800a4d0 con 0x56470a351840 2024-09-14T10:44:31.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.452+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a4d9680 con 0x56470a351840 2024-09-14T10:44:31.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70ade60640 1 -- 172.21.15.96:0/2293384465 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f70a800a4d0 con 0x56470a351840 2024-09-14T10:44:31.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a4d88e0 con 0x56470a351840 2024-09-14T10:44:31.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70ade60640 1 -- 172.21.15.96:0/2293384465 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70a800a4d0 con 0x56470a351840 2024-09-14T10:44:31.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a4d8d30 con 0x56470a351840 2024-09-14T10:44:31.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70ade60640 1 -- 172.21.15.96:0/2293384465 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f70a800a4d0 con 0x56470a351840 2024-09-14T10:44:31.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70afb599c0 1 Processor -- start 2024-09-14T10:44:31.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70afb599c0 1 -- start start 2024-09-14T10:44:31.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70afb599c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4e79e0 0x56470a4e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70afb599c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56470a2efd80 con 0x56470a4e79e0 2024-09-14T10:44:31.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70ace5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4e79e0 0x56470a4e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70ace5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4e79e0 0x56470a4e7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45208/0 (socket says 172.21.15.96:45208) 2024-09-14T10:44:31.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70ace5e640 1 -- 172.21.15.96:0/32071378 learned_addr learned my addr 172.21.15.96:0/32071378 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70ace5e640 1 -- 172.21.15.96:0/32071378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a4e8440 con 0x56470a4e79e0 2024-09-14T10:44:31.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70ace5e640 1 --2- 172.21.15.96:0/32071378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4e79e0 0x56470a4e7e00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f70a401b2c0 tx=0x7f70a4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f6f92ffd640 1 -- 172.21.15.96:0/32071378 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a40b0040 con 0x56470a4e79e0 2024-09-14T10:44:31.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70afb599c0 1 -- 172.21.15.96:0/32071378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56470a4e8ca0 con 0x56470a4e79e0 2024-09-14T10:44:31.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f6f92ffd640 1 -- 172.21.15.96:0/32071378 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a40c6070 con 0x56470a4e79e0 2024-09-14T10:44:31.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f6f92ffd640 1 -- 172.21.15.96:0/32071378 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a40abe30 con 0x56470a4e79e0 2024-09-14T10:44:31.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.456+0000 7f70afb599c0 1 -- 172.21.15.96:0/32071378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56470a4e91b0 con 0x56470a4e79e0 2024-09-14T10:44:31.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f6f92ffd640 1 -- 172.21.15.96:0/32071378 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f70a40cb460 con 0x56470a4e79e0 2024-09-14T10:44:31.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f6f92ffd640 1 --2- 172.21.15.96:0/32071378 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f8803a150 0x7f6f8803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f6f92ffd640 1 -- 172.21.15.96:0/32071378 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70a40a8070 con 0x56470a4e79e0 2024-09-14T10:44:31.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70ade60640 1 --2- 172.21.15.96:0/32071378 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f8803a150 0x7f6f8803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 Processor -- start 2024-09-14T10:44:31.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- start start 2024-09-14T10:44:31.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70ade60640 1 --2- 172.21.15.96:0/32071378 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f8803a150 0x7f6f8803c610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56470a4d8400 tx=0x7f70a8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4f4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56470a4c93f0 con 0x56470a4f4220 2024-09-14T10:44:31.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70ace5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70ace5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45212/0 (socket says 172.21.15.96:45212) 2024-09-14T10:44:31.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70ace5e640 1 -- 172.21.15.96:0/705350010 learned_addr learned my addr 172.21.15.96:0/705350010 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70ace5e640 1 -- 172.21.15.96:0/705350010 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a4f4bd0 con 0x56470a4f4220 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70ace5e640 1 --2- 172.21.15.96:0/705350010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4f4600 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f70a40ebf90 tx=0x7f70a40cbb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2bf3c236736b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f6f90ff9640 1 -- 172.21.15.96:0/705350010 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a4006e50 con 0x56470a4f4220 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f6f90ff9640 1 -- 172.21.15.96:0/705350010 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a40cacc0 con 0x56470a4f4220 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f6f90ff9640 1 -- 172.21.15.96:0/705350010 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a40aaac0 con 0x56470a4f4220 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- 172.21.15.96:0/705350010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 msgr2=0x56470a4f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 --2- 172.21.15.96:0/705350010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4f4600 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f70a40ebf90 tx=0x7f70a40cbb20 comp rx=0 tx=0).stop 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- 172.21.15.96:0/705350010 shutdown_connections 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 --2- 172.21.15.96:0/705350010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4f4600 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- 172.21.15.96:0/705350010 >> 172.21.15.96:0/705350010 conn(0x56470a4f0650 msgr2=0x56470a4ee890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- 172.21.15.96:0/705350010 shutdown_connections 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- 172.21.15.96:0/705350010 wait complete. 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 Processor -- start 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- start start 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4fb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.460+0000 7f70afb599c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56470a4f5230 con 0x56470a4f4220 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ace5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4fb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ace5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4fb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45222/0 (socket says 172.21.15.96:45222) 2024-09-14T10:44:31.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 learned_addr learned my addr 172.21.15.96:0/3792181274 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a4fbcb0 con 0x56470a4f4220 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ace5e640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4fb750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f70a40b5a50 tx=0x7f70a40ebf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f6f7effd640 1 -- 172.21.15.96:0/3792181274 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a40e5020 con 0x56470a4f4220 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56470a4fbf40 con 0x56470a4f4220 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f6f7effd640 1 -- 172.21.15.96:0/3792181274 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a40c1e40 con 0x56470a4f4220 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f6f7effd640 1 -- 172.21.15.96:0/3792181274 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70a4006e50 con 0x56470a4f4220 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56470a4fc8f0 con 0x56470a4f4220 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f6f7effd640 1 -- 172.21.15.96:0/3792181274 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f70a40f4060 con 0x56470a4f4220 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f6f7effd640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f7803a150 0x7f6f7803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f6f7effd640 1 -- 172.21.15.96:0/3792181274 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70a40f7c60 con 0x56470a4f4220 2024-09-14T10:44:31.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ade60640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f7803a150 0x7f6f7803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a506cf0 0x56470a5091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a509900 con 0x56470a506cf0 2024-09-14T10:44:31.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ad65f640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a506cf0 0x56470a5091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ade60640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f7803a150 0x7f6f7803c610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x56470a4d1690 tx=0x7f70a801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ad65f640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a506cf0 0x56470a5091b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.464+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 realm 2024-09-14T10:44:31.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a509d10 con 0x56470a506cf0 2024-09-14T10:44:31.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a50a5e0 con 0x56470a506cf0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a50a980 con 0x56470a506cf0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a50b1d0 con 0x56470a506cf0 2024-09-14T10:44:31.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 20 searching for the correct realm 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56470a50cf40 0x56470a50f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ace5e640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56470a50cf40 0x56470a50f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ace5e640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56470a50cf40 0x56470a50f330 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ace5e640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f70a40ab030 0x7f70a40d8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a40ab030 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ade60640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f70a40ab030 0x7f70a40d8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ade60640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f70a40ab030 0x7f70a40d8ad0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a801f070 con 0x7f70a40ab030 2024-09-14T10:44:31.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ade60640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f70a8031040 0x7f70a8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ad65f640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f70a8031040 0x7f70a8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.468+0000 7f70ad65f640 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f70a8031040 0x7f70a8032940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a506cf0 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a506cf0 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a40ab030 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a801f070 con 0x7f70a40ab030 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a506cf0 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.472+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a506cf0 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a40ab030 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f70a801f070 con 0x7f70a40ab030 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a506cf0 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a506cf0 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.476+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a40ab030 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a801f070 con 0x7f70a40ab030 2024-09-14T10:44:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a506cf0 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a40ab030 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a801f070 con 0x7f70a40ab030 2024-09-14T10:44:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a50cf40 2024-09-14T10:44:31.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.480+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a8031040 2024-09-14T10:44:31.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x56470a506cf0 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56470a50f8c0 con 0x7f70a40ab030 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70a801f070 con 0x7f70a40ab030 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a50bb50 con 0x56470a506cf0 2024-09-14T10:44:31.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a50c3f0 con 0x56470a506cf0 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a50fd40 con 0x56470a506cf0 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 zone default found 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 4 Realm: () 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 zonegroup default 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a50fd60 con 0x7f70a8031040 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a511b90 con 0x56470a50cf40 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a5120a0 con 0x56470a50cf40 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 started sync module instance, tier type = 2024-09-14T10:44:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.484+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a511030 con 0x7f70a40ab030 2024-09-14T10:44:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.488+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a8040040 con 0x7f70a40ab030 2024-09-14T10:44:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.488+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863115752480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a510c90 con 0x7f70a40ab030 2024-09-14T10:44:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.488+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a512fd0 con 0x56470a506cf0 2024-09-14T10:44:31.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.488+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863115752480] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a8040040 con 0x7f70a40ab030 2024-09-14T10:44:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.488+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.488+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863115756800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a512fd0 con 0x56470a506cf0 2024-09-14T10:44:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.488+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a5139e0 con 0x56470a50cf40 2024-09-14T10:44:31.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863115756800] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863115758368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a512f40 con 0x56470a50cf40 2024-09-14T10:44:31.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a5146e0 con 0x7f70a40ab030 2024-09-14T10:44:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a8040040 con 0x7f70a40ab030 2024-09-14T10:44:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863115764576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a514f80 con 0x7f70a40ab030 2024-09-14T10:44:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a5159a0 con 0x56470a506cf0 2024-09-14T10:44:31.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863115758368] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.492+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863115764576] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a8040040 con 0x7f70a40ab030 2024-09-14T10:44:31.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.496+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.496+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863115768976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a514ad0 con 0x56470a506cf0 2024-09-14T10:44:31.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.496+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a516240 con 0x7f70a8031040 2024-09-14T10:44:31.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.496+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863115768976] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.496+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.496+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863115763072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a515f60 con 0x7f70a8031040 2024-09-14T10:44:31.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.496+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a5167b0 con 0x7f70a8031040 2024-09-14T10:44:31.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.500+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863115763072] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.500+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.500+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863115770816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a5165b0 con 0x7f70a8031040 2024-09-14T10:44:31.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.500+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a517070 con 0x7f70a8031040 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.500+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863115770816] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863115774784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a517030 con 0x7f70a8031040 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 add_watcher() i=0 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 add_watcher() i=1 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 add_watcher() i=2 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 add_watcher() i=3 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 add_watcher() i=4 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 add_watcher() i=5 2024-09-14T10:44:31.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 add_watcher() i=6 2024-09-14T10:44:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863115774784] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 add_watcher() i=7 2024-09-14T10:44:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a51a490 con 0x56470a506cf0 2024-09-14T10:44:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863115771936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a5179b0 con 0x56470a506cf0 2024-09-14T10:44:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863115771936] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f6f63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:31.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:31.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.504+0000 7f70afb599c0 5 note: GC not initialized 2024-09-14T10:44:31.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f6f62fe5640 20 reqs_thread_entry: start 2024-09-14T10:44:31.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 20 Filter name: none 2024-09-14T10:44:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f6f60fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:44:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a53dd00 con 0x7f70a8031040 2024-09-14T10:44:31.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a53c240 con 0x7f70a8031040 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:44:31.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.508+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53ce00 con 0x7f70a8031040 2024-09-14T10:44:31.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70afb599c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-14T10:44:31.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70afb599c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:31.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70afb599c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-14T10:44:31.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94863115930352 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a541840 con 0x7f70a8031040 2024-09-14T10:44:31.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== watch-notify(notify (1) cookie 94863115763072 notify 137438953480 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56470a53c660 con 0x7f70a8031040 2024-09-14T10:44:31.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f6f90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94863115763072 notifier 4487 bl.length()=556 2024-09-14T10:44:31.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f6f90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-14T10:44:31.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f6f90ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:31.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(65 notify.5 [notify cookie 94863115930352 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f6f90ff9640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6f70003eb0 con 0x7f70a8031040 2024-09-14T10:44:31.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== watch-notify(notify_complete (2) cookie 94863115930352 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f70a0057020 con 0x7f70a8031040 2024-09-14T10:44:31.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.512+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53cac0 con 0x7f70a8031040 2024-09-14T10:44:31.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70afb599c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:44:31.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70afb599c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:31.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70afb599c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:44:31.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94863115944672 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56470a53cac0 con 0x56470a50cf40 2024-09-14T10:44:31.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== watch-notify(notify (1) cookie 94863115758368 notify 137438953474 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56470a4fbf40 con 0x56470a50cf40 2024-09-14T10:44:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f6f90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94863115758368 notifier 4487 bl.length()=177 2024-09-14T10:44:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f6f90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:44:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f6f90ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f6f90ff9640 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6f70003eb0 con 0x56470a50cf40 2024-09-14T10:44:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(68 notify.2 [notify cookie 94863115944672 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== watch-notify(notify_complete (2) cookie 94863115944672 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56470a4fbcb0 con 0x56470a50cf40 2024-09-14T10:44:31.515 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:44:31.511025Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:31.511011Z","tags":[],"group_ids":[]} 2024-09-14T10:44:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f6f63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.516+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863115771936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x56470a506cf0 2024-09-14T10:44:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.520+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94863115771936] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.520+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863115752480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x7f70a40ab030 2024-09-14T10:44:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.520+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94863115752480] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a8040040 con 0x7f70a40ab030 2024-09-14T10:44:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.520+0000 7f70afb599c0 20 remove_watcher() i=0 2024-09-14T10:44:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.520+0000 7f70afb599c0 2 removed watcher, disabling cache 2024-09-14T10:44:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.520+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863115756800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x56470a506cf0 2024-09-14T10:44:31.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94863115756800] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70afb599c0 20 remove_watcher() i=1 2024-09-14T10:44:31.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863115758368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x56470a50cf40 2024-09-14T10:44:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70ace5e640 1 -- 172.21.15.96:0/3792181274 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94863115758368] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a40b3040 con 0x56470a50cf40 2024-09-14T10:44:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70afb599c0 20 remove_watcher() i=2 2024-09-14T10:44:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863115764576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x7f70a40ab030 2024-09-14T10:44:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70ade60640 1 -- 172.21.15.96:0/3792181274 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94863115764576] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a8040040 con 0x7f70a40ab030 2024-09-14T10:44:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70afb599c0 20 remove_watcher() i=3 2024-09-14T10:44:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.524+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863115768976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x56470a506cf0 2024-09-14T10:44:31.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.528+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94863115768976] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x56470a506cf0 2024-09-14T10:44:31.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.528+0000 7f70afb599c0 20 remove_watcher() i=4 2024-09-14T10:44:31.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.528+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863115763072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x7f70a8031040 2024-09-14T10:44:31.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.528+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94863115763072] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.532+0000 7f70afb599c0 20 remove_watcher() i=5 2024-09-14T10:44:31.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.532+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863115770816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x7f70a8031040 2024-09-14T10:44:31.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.532+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94863115770816] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.532+0000 7f70afb599c0 20 remove_watcher() i=6 2024-09-14T10:44:31.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.532+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863115774784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56470a53b870 con 0x7f70a8031040 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.532+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94863115774784] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70a002e070 con 0x7f70a8031040 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.532+0000 7f70afb599c0 20 remove_watcher() i=7 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f70a8031040 msgr2=0x7f70a8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f70a8031040 0x7f70a8032940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a506cf0 msgr2=0x56470a5091b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a506cf0 0x56470a5091b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f70a40ab030 msgr2=0x7f70a40d8ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f70a40ab030 0x7f70a40d8ad0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56470a50cf40 msgr2=0x56470a50f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x56470a50cf40 0x56470a50f330 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f7803a150 msgr2=0x7f6f7803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f7803a150 0x7f6f7803c610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x56470a4d1690 tx=0x7f70a801f000 comp rx=0 tx=0).stop 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70ad65f640 1 -- 172.21.15.96:0/3792181274 reap_dead start 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 msgr2=0x56470a4fb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4fb750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f70a40b5a50 tx=0x7f70a40ebf20 comp rx=0 tx=0).stop 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 shutdown_connections 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/3792181274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4f4220 0x56470a4fb750 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 >> 172.21.15.96:0/3792181274 conn(0x56470a4f0650 msgr2=0x56470a4ee860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 shutdown_connections 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/3792181274 wait complete. 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/32071378 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f8803a150 msgr2=0x7f6f8803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/32071378 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f8803a150 0x7f6f8803c610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56470a4d8400 tx=0x7f70a8005850 comp rx=0 tx=0).stop 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/32071378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4e79e0 msgr2=0x56470a4e7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/32071378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4e79e0 0x56470a4e7e00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f70a401b2c0 tx=0x7f70a4018020 comp rx=0 tx=0).stop 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/32071378 shutdown_connections 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/32071378 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f8803a150 0x7f6f8803c610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/32071378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a4e79e0 0x56470a4e7e00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/32071378 >> 172.21.15.96:0/32071378 conn(0x56470a4dd390 msgr2=0x56470a4dd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/32071378 shutdown_connections 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/32071378 wait complete. 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a351840 msgr2=0x56470a4d73e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a351840 0x56470a4d73e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f9403a1a0 msgr2=0x7f6f9403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f9403a1a0 0x7f6f9403c660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70a40ad000 tx=0x7f70a40a5040 comp rx=0 tx=0).stop 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 msgr2=0x56470a4d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4d0270 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x56470a4c9990 tx=0x7f70a0000bd0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 shutdown_connections 2024-09-14T10:44:31.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56470a351840 0x56470a4d73e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6f9403a1a0 0x7f6f9403c660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 --2- 172.21.15.96:0/2293384465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56470a351310 0x56470a4d0270 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 >> 172.21.15.96:0/2293384465 conn(0x56470a3d6b30 msgr2=0x56470a4c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 shutdown_connections 2024-09-14T10:44:31.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.536+0000 7f70afb599c0 1 -- 172.21.15.96:0/2293384465 wait complete. 2024-09-14T10:44:31.545 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:44:31.511025Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:31.511011Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:31.553 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-14T10:44:31.559 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:31.559 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-14T10:44:31.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-14T10:44:31.560 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-14T10:44:31.590 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:31.590 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f9ff59c0 1 Processor -- start 2024-09-14T10:44:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f9ff59c0 1 -- start start 2024-09-14T10:44:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f9ff59c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5623525a8e50 0x56235263c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f9ff59c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5623524dc7a0 con 0x5623525a8a70 2024-09-14T10:44:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f9ff59c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5623525381b0 con 0x5623525a8e50 2024-09-14T10:44:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f72fa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5623525a8e50 0x56235263c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f7afb640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5623525a8a70 0x5623526390d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37172/0 (socket says 172.21.15.96:37172) 2024-09-14T10:44:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f72fa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5623525a8e50 0x56235263c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45224/0 (socket says 172.21.15.96:45224) 2024-09-14T10:44:31.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.592+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3775373007 learned_addr learned my addr 172.21.15.96:0/3775373007 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:31.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3775373007 >> v1:172.21.15.70:6789/0 conn(0x5623525a8a70 legacy=0x5623526390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3775373007 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623524b6da0 con 0x5623525a8e50 2024-09-14T10:44:31.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/3775373007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8e50 0x56235263c800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00a480 tx=0x7fc3ec01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624a5e58f7c87dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f6af9640 1 -- 172.21.15.96:0/3775373007 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0b0070 con 0x5623525a8e50 2024-09-14T10:44:31.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f6af9640 1 -- 172.21.15.96:0/3775373007 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0ab540 con 0x5623525a8e50 2024-09-14T10:44:31.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f6af9640 1 -- 172.21.15.96:0/3775373007 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0ab840 con 0x5623525a8e50 2024-09-14T10:44:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3775373007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8e50 msgr2=0x56235263c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3775373007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8e50 0x56235263c800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00a480 tx=0x7fc3ec01b280 comp rx=0 tx=0).stop 2024-09-14T10:44:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3775373007 shutdown_connections 2024-09-14T10:44:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3775373007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8e50 0x56235263c800 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3775373007 >> 172.21.15.96:0/3775373007 conn(0x56235262e9c0 msgr2=0x562352630de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3775373007 shutdown_connections 2024-09-14T10:44:31.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.596+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3775373007 wait complete. 2024-09-14T10:44:31.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.612+0000 7fc3f9ff59c0 1 Processor -- start 2024-09-14T10:44:31.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.612+0000 7fc3f9ff59c0 1 -- start start 2024-09-14T10:44:31.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.612+0000 7fc3f9ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x5623527215d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.612+0000 7fc3f9ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56235253bfc0 con 0x5623525a8a70 2024-09-14T10:44:31.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.612+0000 7fc3f7afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x5623527215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.612+0000 7fc3f7afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x5623527215d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45228/0 (socket says 172.21.15.96:45228) 2024-09-14T10:44:31.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.612+0000 7fc3f7afb640 1 -- 172.21.15.96:0/726375922 learned_addr learned my addr 172.21.15.96:0/726375922 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f7afb640 1 -- 172.21.15.96:0/726375922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562352721bc0 con 0x5623525a8a70 2024-09-14T10:44:31.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f7afb640 1 --2- 172.21.15.96:0/726375922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x5623527215d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8001e00 tx=0x7fc3e800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee0ae3aa61d5f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc2e5e0b640 1 -- 172.21.15.96:0/726375922 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e8012020 con 0x5623525a8a70 2024-09-14T10:44:31.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc2e5e0b640 1 -- 172.21.15.96:0/726375922 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e800e690 con 0x5623525a8a70 2024-09-14T10:44:31.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc2e5e0b640 1 -- 172.21.15.96:0/726375922 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e800ea10 con 0x5623525a8a70 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/726375922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 msgr2=0x5623527215d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/726375922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x5623527215d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8001e00 tx=0x7fc3e800b6d0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/726375922 shutdown_connections 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/726375922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x5623527215d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/726375922 >> 172.21.15.96:0/726375922 conn(0x56235262e9c0 msgr2=0x56235271d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/726375922 shutdown_connections 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/726375922 wait complete. 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 Processor -- start 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- start start 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x562352728e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5623524dda50 con 0x5623525a8a70 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f7afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x562352728e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f7afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x562352728e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45234/0 (socket says 172.21.15.96:45234) 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f7afb640 1 -- 172.21.15.96:0/1765057630 learned_addr learned my addr 172.21.15.96:0/1765057630 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f7afb640 1 -- 172.21.15.96:0/1765057630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623527293a0 con 0x5623525a8a70 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f7afb640 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x562352728e40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x562352722560 tx=0x7fc3e8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc2dffff640 1 -- 172.21.15.96:0/1765057630 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e8012030 con 0x5623525a8a70 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562352729630 con 0x5623525a8a70 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc2dffff640 1 -- 172.21.15.96:0/1765057630 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e801a750 con 0x5623525a8a70 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc2dffff640 1 -- 172.21.15.96:0/1765057630 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e801aa50 con 0x5623525a8a70 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.616+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562352729fe0 con 0x5623525a8a70 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc2dffff640 1 -- 172.21.15.96:0/1765057630 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc3e8015020 con 0x5623525a8a70 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc2dffff640 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2e003a150 0x7fc2e003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc2dffff640 1 -- 172.21.15.96:0/1765057630 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc3e8020030 con 0x5623525a8a70 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2e003a150 0x7fc2e003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5623525a8e50 0x56235272ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623527304f0 con 0x5623525a8e50 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5623525a8e50 0x56235272ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2e003a150 0x7fc2e003c610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0ad000 tx=0x7fc3ec0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5623525a8e50 0x56235272ffb0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f82fc640 1 -- 172.21.15.96:0/1765057630 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f000a4d0 con 0x5623525a8e50 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56235272a3e0 con 0x5623525a8e50 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f82fc640 1 -- 172.21.15.96:0/1765057630 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3f000a4d0 con 0x5623525a8e50 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352732250 con 0x5623525a8e50 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f82fc640 1 -- 172.21.15.96:0/1765057630 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc3f000a4d0 con 0x5623525a8e50 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352731480 con 0x5623525a8e50 2024-09-14T10:44:31.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f82fc640 1 -- 172.21.15.96:0/1765057630 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3f000a4d0 con 0x5623525a8e50 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623527318d0 con 0x5623525a8e50 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.620+0000 7fc3f82fc640 1 -- 172.21.15.96:0/1765057630 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc3f000a4d0 con 0x5623525a8e50 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f9ff59c0 1 Processor -- start 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f9ff59c0 1 -- start start 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f9ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562352740610 0x562352740a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f9ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562352548d80 con 0x562352740610 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f72fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562352740610 0x562352740a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f72fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562352740610 0x562352740a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45244/0 (socket says 172.21.15.96:45244) 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3501423206 learned_addr learned my addr 172.21.15.96:0/3501423206 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3501423206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562352741070 con 0x562352740610 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/3501423206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562352740610 0x562352740a30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec01b2c0 tx=0x7fc3ec018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc2dd7fa640 1 -- 172.21.15.96:0/3501423206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0c7070 con 0x562352740610 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3501423206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623527418d0 con 0x562352740610 2024-09-14T10:44:31.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc2dd7fa640 1 -- 172.21.15.96:0/3501423206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0c2400 con 0x562352740610 2024-09-14T10:44:31.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc2dd7fa640 1 -- 172.21.15.96:0/3501423206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0b0040 con 0x562352740610 2024-09-14T10:44:31.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3501423206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562352741de0 con 0x562352740610 2024-09-14T10:44:31.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc2dd7fa640 1 -- 172.21.15.96:0/3501423206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc3ec0c26e0 con 0x562352740610 2024-09-14T10:44:31.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc2dd7fa640 1 --2- 172.21.15.96:0/3501423206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2d003a140 0x7fc2d003c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc2dd7fa640 1 -- 172.21.15.96:0/3501423206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc3ec0a8070 con 0x562352740610 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/3501423206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2d003a140 0x7fc2d003c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f9ff59c0 1 Processor -- start 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.624+0000 7fc3f9ff59c0 1 -- start start 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/3501423206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2d003a140 0x7fc2d003c600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x562352730fa0 tx=0x7fc3f0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x56235274e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562352721ff0 con 0x56235274de60 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x56235274e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x56235274e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45258/0 (socket says 172.21.15.96:45258) 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 -- 172.21.15.96:0/905290952 learned_addr learned my addr 172.21.15.96:0/905290952 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 -- 172.21.15.96:0/905290952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56235274e850 con 0x56235274de60 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/905290952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x56235274e260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0c2000 tx=0x7fc3ec0b6530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3168b350dc06fe65 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc2d6ffd640 1 -- 172.21.15.96:0/905290952 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0ca360 con 0x56235274de60 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc2d6ffd640 1 -- 172.21.15.96:0/905290952 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0dc070 con 0x56235274de60 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc2d6ffd640 1 -- 172.21.15.96:0/905290952 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0b5cd0 con 0x56235274de60 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/905290952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 msgr2=0x56235274e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/905290952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x56235274e260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0c2000 tx=0x7fc3ec0b6530 comp rx=0 tx=0).stop 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/905290952 shutdown_connections 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/905290952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x56235274e260 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/905290952 >> 172.21.15.96:0/905290952 conn(0x562352749280 msgr2=0x5623527474c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/905290952 shutdown_connections 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/905290952 wait complete. 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 Processor -- start 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 -- start start 2024-09-14T10:44:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x5623527543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f9ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56235274cdb0 con 0x56235274de60 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x5623527543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x5623527543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45264/0 (socket says 172.21.15.96:45264) 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 learned_addr learned my addr 172.21.15.96:0/3490302187 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562352754950 con 0x56235274de60 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x5623527543f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0abfd0 tx=0x7fc3ec0eb630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.628+0000 7fc2d57fa640 1 -- 172.21.15.96:0/3490302187 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0eb460 con 0x56235274de60 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562352754be0 con 0x56235274de60 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc2d57fa640 1 -- 172.21.15.96:0/3490302187 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0e6070 con 0x56235274de60 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc2d57fa640 1 -- 172.21.15.96:0/3490302187 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0c2d70 con 0x56235274de60 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562352755590 con 0x56235274de60 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc2d57fa640 1 -- 172.21.15.96:0/3490302187 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc3ec0eb7e0 con 0x56235274de60 2024-09-14T10:44:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc2d57fa640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2c003a150 0x7fc2c003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc2d57fa640 1 -- 172.21.15.96:0/3490302187 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc3ec0eecb0 con 0x56235274de60 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2c003a150 0x7fc2c003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56235275f8c0 0x562352761d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623527624d0 con 0x56235275f8c0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f7afb640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56235275f8c0 0x562352761d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2c003a150 0x7fc2c003c610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x56235272a320 tx=0x7fc3f001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f7afb640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56235275f8c0 0x562352761d80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 realm 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623527628e0 con 0x56235275f8c0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623527631b0 con 0x56235275f8c0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352763550 con 0x56235275f8c0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623527639b0 con 0x56235275f8c0 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 20 searching for the correct realm 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562352765a00 0x562352767df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.632+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562352765a00 0x562352767df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562352765a00 0x562352767df0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f72fa640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc3ec0ab030 0x7fc3ec0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3ec0ab030 2024-09-14T10:44:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc3ec0ab030 0x7fc3ec0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc3ec0ab030 0x7fc3ec0c1880 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f001f070 con 0x7fc3ec0ab030 2024-09-14T10:44:31.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f82fc640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc3f0031040 0x7fc3f0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f7afb640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc3f0031040 0x7fc3f0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f7afb640 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc3f0031040 0x7fc3f0032940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x56235275f8c0 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x56235275f8c0 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.636+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3ec0ab030 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f001f070 con 0x7fc3ec0ab030 2024-09-14T10:44:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x56235275f8c0 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x56235275f8c0 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3ec0ab030 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc3f001f070 con 0x7fc3ec0ab030 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.640+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x56235275f8c0 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x56235275f8c0 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3ec0ab030 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f001f070 con 0x7fc3ec0ab030 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x56235275f8c0 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.644+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3ec0ab030 2024-09-14T10:44:31.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f001f070 con 0x7fc3ec0ab030 2024-09-14T10:44:31.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x562352765a00 2024-09-14T10:44:31.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3f0031040 2024-09-14T10:44:31.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x56235275f8c0 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623527684a0 con 0x7fc3ec0ab030 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f001f070 con 0x7fc3ec0ab030 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352764450 con 0x56235275f8c0 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352764cf0 con 0x56235275f8c0 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352764090 con 0x56235275f8c0 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 zone default found 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 4 Realm: () 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:31.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 zonegroup default 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352764cf0 con 0x7fc3f0031040 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56235276a2f0 con 0x562352765a00 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.648+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56235276a690 con 0x562352765a00 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 20 started sync module instance, tier type = 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562352769790 con 0x7fc3ec0ab030 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f0040040 con 0x7fc3ec0ab030 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94709707348864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276af30 con 0x7fc3ec0ab030 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276b780 con 0x56235275f8c0 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.652+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94709707348864] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f0040040 con 0x7fc3ec0ab030 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94709707352704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276b470 con 0x56235275f8c0 2024-09-14T10:44:31.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276bf90 con 0x562352765a00 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94709707352704] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94709707356768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276c380 con 0x562352765a00 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276cd40 con 0x7fc3ec0ab030 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f0040040 con 0x7fc3ec0ab030 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94709707360672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276d430 con 0x7fc3ec0ab030 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.656+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276df50 con 0x56235275f8c0 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.660+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94709707356768] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.660+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94709707360672] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f0040040 con 0x7fc3ec0ab030 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.660+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.660+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94709707364896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276df10 con 0x56235275f8c0 2024-09-14T10:44:31.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.660+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276e7f0 con 0x7fc3f0031040 2024-09-14T10:44:31.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.660+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94709707364896] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.664+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.664+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94709707353824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276e3c0 con 0x7fc3f0031040 2024-09-14T10:44:31.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.664+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276ecb0 con 0x7fc3f0031040 2024-09-14T10:44:31.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.664+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.664+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94709707367360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276f360 con 0x7fc3f0031040 2024-09-14T10:44:31.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.664+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276fc10 con 0x7fc3f0031040 2024-09-14T10:44:31.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.664+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94709707353824] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94709707367360] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94709707366160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276f360 con 0x7fc3f0031040 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 20 add_watcher() i=0 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 20 add_watcher() i=1 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 20 add_watcher() i=2 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 20 add_watcher() i=3 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 20 add_watcher() i=4 2024-09-14T10:44:31.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 20 add_watcher() i=5 2024-09-14T10:44:31.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 20 add_watcher() i=6 2024-09-14T10:44:31.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94709707366160] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 20 add_watcher() i=7 2024-09-14T10:44:31.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:31.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352772d10 con 0x56235275f8c0 2024-09-14T10:44:31.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.668+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94709707370160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562352770190 con 0x56235275f8c0 2024-09-14T10:44:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94709707370160] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc2adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 5 note: GC not initialized 2024-09-14T10:44:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc2acfe1640 20 reqs_thread_entry: start 2024-09-14T10:44:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 20 Filter name: none 2024-09-14T10:44:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc2267fc640 20 reqs_thread_entry: start 2024-09-14T10:44:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562352795d50 con 0x7fc3ec0ab030 2024-09-14T10:44:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fc3f0040040 con 0x7fc3ec0ab030 2024-09-14T10:44:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:31.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc2adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.672+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94709707370160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562352793a40 con 0x56235275f8c0 2024-09-14T10:44:31.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94709707370160] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94709707348864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562352793a40 con 0x7fc3ec0ab030 2024-09-14T10:44:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94709707348864] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f0040040 con 0x7fc3ec0ab030 2024-09-14T10:44:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f9ff59c0 20 remove_watcher() i=0 2024-09-14T10:44:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f9ff59c0 2 removed watcher, disabling cache 2024-09-14T10:44:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94709707352704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562352793a40 con 0x56235275f8c0 2024-09-14T10:44:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94709707352704] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f9ff59c0 20 remove_watcher() i=1 2024-09-14T10:44:31.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.676+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94709707356768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562352793a40 con 0x562352765a00 2024-09-14T10:44:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.680+0000 7fc3f72fa640 1 -- 172.21.15.96:0/3490302187 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94709707356768] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec0d5070 con 0x562352765a00 2024-09-14T10:44:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.680+0000 7fc3f9ff59c0 20 remove_watcher() i=2 2024-09-14T10:44:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.680+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94709707360672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562352769b80 con 0x7fc3ec0ab030 2024-09-14T10:44:31.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.680+0000 7fc3f82fc640 1 -- 172.21.15.96:0/3490302187 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94709707360672] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f0040040 con 0x7fc3ec0ab030 2024-09-14T10:44:31.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.680+0000 7fc3f9ff59c0 20 remove_watcher() i=3 2024-09-14T10:44:31.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.680+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94709707364896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276ba60 con 0x56235275f8c0 2024-09-14T10:44:31.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.684+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94709707364896] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x56235275f8c0 2024-09-14T10:44:31.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.684+0000 7fc3f9ff59c0 20 remove_watcher() i=4 2024-09-14T10:44:31.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.684+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94709707353824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276c9a0 con 0x7fc3f0031040 2024-09-14T10:44:31.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.684+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94709707353824] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.684+0000 7fc3f9ff59c0 20 remove_watcher() i=5 2024-09-14T10:44:31.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.684+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94709707367360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276af30 con 0x7fc3f0031040 2024-09-14T10:44:31.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94709707367360] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 20 remove_watcher() i=6 2024-09-14T10:44:31.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94709707366160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56235276af30 con 0x7fc3f0031040 2024-09-14T10:44:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94709707366160] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e8008030 con 0x7fc3f0031040 2024-09-14T10:44:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 20 remove_watcher() i=7 2024-09-14T10:44:31.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc3f0031040 msgr2=0x7fc3f0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc3f0031040 0x7fc3f0032940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56235275f8c0 msgr2=0x562352761d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56235275f8c0 0x562352761d80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc3ec0ab030 msgr2=0x7fc3ec0c1880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc3ec0ab030 0x7fc3ec0c1880 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562352765a00 msgr2=0x562352767df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562352765a00 0x562352767df0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2c003a150 msgr2=0x7fc2c003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2c003a150 0x7fc2c003c610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x56235272a320 tx=0x7fc3f001f000 comp rx=0 tx=0).stop 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 msgr2=0x5623527543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3490302187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56235274de60 0x5623527543f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0abfd0 tx=0x7fc3ec0eb630 comp rx=0 tx=0).stop 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 reap_dead start 2024-09-14T10:44:31.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f7afb640 1 -- 172.21.15.96:0/3490302187 reap_dead start 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 shutdown_connections 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 >> 172.21.15.96:0/3490302187 conn(0x562352749280 msgr2=0x562352747490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 shutdown_connections 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3490302187 wait complete. 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3501423206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2d003a140 msgr2=0x7fc2d003c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3501423206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2d003a140 0x7fc2d003c600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x562352730fa0 tx=0x7fc3f0005850 comp rx=0 tx=0).stop 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3501423206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562352740610 msgr2=0x562352740a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3501423206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562352740610 0x562352740a30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec01b2c0 tx=0x7fc3ec018020 comp rx=0 tx=0).stop 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3501423206 shutdown_connections 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3501423206 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2d003a140 0x7fc2d003c600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/3501423206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562352740610 0x562352740a30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3501423206 >> 172.21.15.96:0/3501423206 conn(0x562352735fc0 msgr2=0x5623527363a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3501423206 shutdown_connections 2024-09-14T10:44:31.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.688+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/3501423206 wait complete. 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5623525a8e50 msgr2=0x56235272ffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5623525a8e50 0x56235272ffb0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2e003a150 msgr2=0x7fc2e003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2e003a150 0x7fc2e003c610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0ad000 tx=0x7fc3ec0a5040 comp rx=0 tx=0).stop 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 msgr2=0x562352728e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x562352728e40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x562352722560 tx=0x7fc3e8000bd0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 shutdown_connections 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5623525a8e50 0x56235272ffb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc2e003a150 0x7fc2e003c610 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 --2- 172.21.15.96:0/1765057630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623525a8a70 0x562352728e40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 >> 172.21.15.96:0/1765057630 conn(0x56235262e9c0 msgr2=0x5623527229f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 shutdown_connections 2024-09-14T10:44:31.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.692+0000 7fc3f9ff59c0 1 -- 172.21.15.96:0/1765057630 wait complete. 2024-09-14T10:44:31.699 INFO:teuthology.orchestra.run.smithi096.stdout:{"key":"bucket:myfoo","ver":{"tag":"__j6MpojbwVukvRYCE3zCfV2","ver":2},"mtime":"2024-09-14T10:44:31.302367Z","data":{"bucket":{"name":"myfoo","marker":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","bucket_id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-14T10:44:29.762936Z","linked":false,"has_bucket_info":false}} 2024-09-14T10:44:31.699 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '__j6MpojbwVukvRYCE3zCfV2', 'ver': 2}, 'mtime': '2024-09-14T10:44:31.302367Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'bucket_id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-14T10:44:29.762936Z', 'linked': False, 'has_bucket_info': False}} 2024-09-14T10:44:31.699 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1'] 2024-09-14T10:44:31.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1'] 2024-09-14T10:44:31.700 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:31.776 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:31.776 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:31.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f01523409c0 1 Processor -- start 2024-09-14T10:44:31.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f01523409c0 1 -- start start 2024-09-14T10:44:31.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f01523409c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fdbaa70300 0x55fdbaa726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f01523409c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fdba9147a0 con 0x55fdba9e0230 2024-09-14T10:44:31.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f01523409c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55fdba9701b0 con 0x55fdbaa70300 2024-09-14T10:44:31.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f014f645640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fdbaa70300 0x55fdbaa726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f014fe46640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55fdba9e0230 0x55fdbaa6ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37176/0 (socket says 172.21.15.96:37176) 2024-09-14T10:44:31.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f014f645640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fdbaa70300 0x55fdbaa726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45280/0 (socket says 172.21.15.96:45280) 2024-09-14T10:44:31.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f014fe46640 1 -- 172.21.15.96:0/1930269387 learned_addr learned my addr 172.21.15.96:0/1930269387 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:31.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f014f645640 1 -- 172.21.15.96:0/1930269387 >> v1:172.21.15.70:6789/0 conn(0x55fdba9e0230 legacy=0x55fdbaa6ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.780+0000 7f014f645640 1 -- 172.21.15.96:0/1930269387 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdba8eeda0 con 0x55fdbaa70300 2024-09-14T10:44:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f014f645640 1 --2- 172.21.15.96:0/1930269387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa70300 0x55fdbaa726f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f014400a480 tx=0x7f014401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fec77fb9bc96b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f014ee44640 1 -- 172.21.15.96:0/1930269387 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01440af070 con 0x55fdbaa70300 2024-09-14T10:44:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f014ee44640 1 -- 172.21.15.96:0/1930269387 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01440aa530 con 0x55fdbaa70300 2024-09-14T10:44:31.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f014ee44640 1 -- 172.21.15.96:0/1930269387 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01440aa830 con 0x55fdbaa70300 2024-09-14T10:44:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f01523409c0 1 -- 172.21.15.96:0/1930269387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa70300 msgr2=0x55fdbaa726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f01523409c0 1 --2- 172.21.15.96:0/1930269387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa70300 0x55fdbaa726f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f014400a480 tx=0x7f014401b280 comp rx=0 tx=0).stop 2024-09-14T10:44:31.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f01523409c0 1 -- 172.21.15.96:0/1930269387 shutdown_connections 2024-09-14T10:44:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f01523409c0 1 --2- 172.21.15.96:0/1930269387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa70300 0x55fdbaa726f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f01523409c0 1 -- 172.21.15.96:0/1930269387 >> 172.21.15.96:0/1930269387 conn(0x55fdbaa66910 msgr2=0x55fdbaa68d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f01523409c0 1 -- 172.21.15.96:0/1930269387 shutdown_connections 2024-09-14T10:44:31.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.784+0000 7f01523409c0 1 -- 172.21.15.96:0/1930269387 wait complete. 2024-09-14T10:44:31.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f01523409c0 1 Processor -- start 2024-09-14T10:44:31.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f01523409c0 1 -- start start 2024-09-14T10:44:31.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f01523409c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab57720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f01523409c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdba973fc0 con 0x55fdba9e0230 2024-09-14T10:44:31.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f014fe46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab57720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f014fe46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab57720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45284/0 (socket says 172.21.15.96:45284) 2024-09-14T10:44:31.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f014fe46640 1 -- 172.21.15.96:0/2822931741 learned_addr learned my addr 172.21.15.96:0/2822931741 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f014fe46640 1 -- 172.21.15.96:0/2822931741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbab57d10 con 0x55fdba9e0230 2024-09-14T10:44:31.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f014fe46640 1 --2- 172.21.15.96:0/2822931741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab57720 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0140001e00 tx=0x7f014000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231e94df4d05ccc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f003de0b640 1 -- 172.21.15.96:0/2822931741 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0140012020 con 0x55fdba9e0230 2024-09-14T10:44:31.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f003de0b640 1 -- 172.21.15.96:0/2822931741 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014000e690 con 0x55fdba9e0230 2024-09-14T10:44:31.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.800+0000 7f003de0b640 1 -- 172.21.15.96:0/2822931741 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f014000ea10 con 0x55fdba9e0230 2024-09-14T10:44:31.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- 172.21.15.96:0/2822931741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 msgr2=0x55fdbab57720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 --2- 172.21.15.96:0/2822931741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab57720 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0140001e00 tx=0x7f014000b6d0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- 172.21.15.96:0/2822931741 shutdown_connections 2024-09-14T10:44:31.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 --2- 172.21.15.96:0/2822931741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab57720 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- 172.21.15.96:0/2822931741 >> 172.21.15.96:0/2822931741 conn(0x55fdbaa66910 msgr2=0x55fdbab53290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- 172.21.15.96:0/2822931741 shutdown_connections 2024-09-14T10:44:31.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- 172.21.15.96:0/2822931741 wait complete. 2024-09-14T10:44:31.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 Processor -- start 2024-09-14T10:44:31.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- start start 2024-09-14T10:44:31.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab5f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdba915a50 con 0x55fdba9e0230 2024-09-14T10:44:31.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f014fe46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab5f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f014fe46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab5f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45290/0 (socket says 172.21.15.96:45290) 2024-09-14T10:44:31.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f014fe46640 1 -- 172.21.15.96:0/818690667 learned_addr learned my addr 172.21.15.96:0/818690667 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f014fe46640 1 -- 172.21.15.96:0/818690667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbab5f570 con 0x55fdba9e0230 2024-09-14T10:44:31.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f014fe46640 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab5f010 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55fdbab586e0 tx=0x7f0140000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f0037fff640 1 -- 172.21.15.96:0/818690667 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0140012030 con 0x55fdba9e0230 2024-09-14T10:44:31.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdbab5f800 con 0x55fdba9e0230 2024-09-14T10:44:31.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f0037fff640 1 -- 172.21.15.96:0/818690667 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0140001460 con 0x55fdba9e0230 2024-09-14T10:44:31.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f0037fff640 1 -- 172.21.15.96:0/818690667 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f014001a7a0 con 0x55fdba9e0230 2024-09-14T10:44:31.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdbab601b0 con 0x55fdba9e0230 2024-09-14T10:44:31.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.804+0000 7f0037fff640 1 -- 172.21.15.96:0/818690667 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0140015020 con 0x55fdba9e0230 2024-09-14T10:44:31.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0037fff640 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f003803a150 0x7f003803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0037fff640 1 -- 172.21.15.96:0/818690667 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0140020030 con 0x55fdba9e0230 2024-09-14T10:44:31.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f014f645640 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f003803a150 0x7f003803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab64170 0x55fdbab66560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab66aa0 con 0x55fdbab64170 2024-09-14T10:44:31.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0150647640 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab64170 0x55fdbab66560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f014f645640 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f003803a150 0x7f003803c610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f01440ac000 tx=0x7f01440a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0150647640 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab64170 0x55fdbab66560 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0150647640 1 -- 172.21.15.96:0/818690667 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014800a4d0 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab66ed0 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0150647640 1 -- 172.21.15.96:0/818690667 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f014800a4d0 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab687d0 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0150647640 1 -- 172.21.15.96:0/818690667 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f014800a4d0 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab67a00 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0150647640 1 -- 172.21.15.96:0/818690667 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f014800a4d0 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab67e50 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f0150647640 1 -- 172.21.15.96:0/818690667 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f014800a4d0 con 0x55fdbab64170 2024-09-14T10:44:31.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 Processor -- start 2024-09-14T10:44:31.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 -- start start 2024-09-14T10:44:31.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa6c340 0x55fdbaa6abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f01523409c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdba980d80 con 0x55fdbaa6c340 2024-09-14T10:44:31.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f014f645640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa6c340 0x55fdbaa6abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f014f645640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa6c340 0x55fdbaa6abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45292/0 (socket says 172.21.15.96:45292) 2024-09-14T10:44:31.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.808+0000 7f014f645640 1 -- 172.21.15.96:0/3566000612 learned_addr learned my addr 172.21.15.96:0/3566000612 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f014f645640 1 -- 172.21.15.96:0/3566000612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbaa6c860 con 0x55fdbaa6c340 2024-09-14T10:44:31.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f014f645640 1 --2- 172.21.15.96:0/3566000612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa6c340 0x55fdbaa6abe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0144000c10 tx=0x7f0144018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f00357fa640 1 -- 172.21.15.96:0/3566000612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01440c7070 con 0x55fdbaa6c340 2024-09-14T10:44:31.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f01523409c0 1 -- 172.21.15.96:0/3566000612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdbaa6b120 con 0x55fdbaa6c340 2024-09-14T10:44:31.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f00357fa640 1 -- 172.21.15.96:0/3566000612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01440b0040 con 0x55fdbaa6c340 2024-09-14T10:44:31.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f00357fa640 1 -- 172.21.15.96:0/3566000612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01440af050 con 0x55fdbaa6c340 2024-09-14T10:44:31.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f01523409c0 1 -- 172.21.15.96:0/3566000612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdbaa6b630 con 0x55fdbaa6c340 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f00357fa640 1 -- 172.21.15.96:0/3566000612 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f01440ca070 con 0x55fdbaa6c340 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f00357fa640 1 --2- 172.21.15.96:0/3566000612 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f002803a140 0x7f002803c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f00357fa640 1 -- 172.21.15.96:0/3566000612 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f01440ed000 con 0x55fdbaa6c340 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f0150647640 1 --2- 172.21.15.96:0/3566000612 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f002803a140 0x7f002803c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f01523409c0 1 Processor -- start 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f01523409c0 1 -- start start 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f0150647640 1 --2- 172.21.15.96:0/3566000612 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f002803a140 0x7f002803c600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55fdbab67520 tx=0x7f0148005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f01523409c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab869f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f01523409c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdbab58140 con 0x55fdbab865f0 2024-09-14T10:44:31.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f014f645640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab869f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f014f645640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab869f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45296/0 (socket says 172.21.15.96:45296) 2024-09-14T10:44:31.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f014f645640 1 -- 172.21.15.96:0/238649237 learned_addr learned my addr 172.21.15.96:0/238649237 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.812+0000 7f014f645640 1 -- 172.21.15.96:0/238649237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbab86fe0 con 0x55fdbab865f0 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f014f645640 1 --2- 172.21.15.96:0/238649237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab869f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f01440c2ea0 tx=0x7f01440b44c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7215ef8e34155f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f002effd640 1 -- 172.21.15.96:0/238649237 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01440b65b0 con 0x55fdbab865f0 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f002effd640 1 -- 172.21.15.96:0/238649237 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01440a93a0 con 0x55fdbab865f0 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f002effd640 1 -- 172.21.15.96:0/238649237 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01440b47a0 con 0x55fdbab865f0 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- 172.21.15.96:0/238649237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 msgr2=0x55fdbab869f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 --2- 172.21.15.96:0/238649237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab869f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f01440c2ea0 tx=0x7f01440b44c0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- 172.21.15.96:0/238649237 shutdown_connections 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 --2- 172.21.15.96:0/238649237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab869f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- 172.21.15.96:0/238649237 >> 172.21.15.96:0/238649237 conn(0x55fdbab81a10 msgr2=0x55fdbab7fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- 172.21.15.96:0/238649237 shutdown_connections 2024-09-14T10:44:31.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- 172.21.15.96:0/238649237 wait complete. 2024-09-14T10:44:31.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 Processor -- start 2024-09-14T10:44:31.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- start start 2024-09-14T10:44:31.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab8cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdbab85540 con 0x55fdbab865f0 2024-09-14T10:44:31.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f014f645640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab8cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f014f645640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab8cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45300/0 (socket says 172.21.15.96:45300) 2024-09-14T10:44:31.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 learned_addr learned my addr 172.21.15.96:0/1701053272 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbab8d080 con 0x55fdbab865f0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f014f645640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab8cb20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f01440b7040 tx=0x7f01440eb380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f002d7fa640 1 -- 172.21.15.96:0/1701053272 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01440eb740 con 0x55fdbab865f0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdbab8d310 con 0x55fdbab865f0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f002d7fa640 1 -- 172.21.15.96:0/1701053272 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01440eb8e0 con 0x55fdbab865f0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f002d7fa640 1 -- 172.21.15.96:0/1701053272 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01440ebc00 con 0x55fdbab865f0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.816+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdbab8dcc0 con 0x55fdbab865f0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f002d7fa640 1 -- 172.21.15.96:0/1701053272 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f01440f7440 con 0x55fdbab865f0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f002d7fa640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f001803a150 0x7f001803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f002d7fa640 1 -- 172.21.15.96:0/1701053272 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f01440efc60 con 0x55fdbab865f0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f0150647640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f001803a150 0x7f001803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab980e0 0x55fdbab9a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9acc0 con 0x55fdbab980e0 2024-09-14T10:44:31.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014fe46640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab980e0 0x55fdbab9a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f0150647640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f001803a150 0x7f001803c610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55fdbab61190 tx=0x7f014801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014fe46640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab980e0 0x55fdbab9a570 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 realm 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9b120 con 0x55fdbab980e0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9b9f0 con 0x55fdbab980e0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9bd90 con 0x55fdbab980e0 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9c5e0 con 0x55fdbab980e0 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 20 searching for the correct realm 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fdbab9e350 0x55fdbaba0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014f645640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fdbab9e350 0x55fdbaba0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014f645640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fdbab9e350 0x55fdbaba0740 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014f645640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f01440cc060 0x7f01440e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.820+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f01440cc060 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f0150647640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f01440cc060 0x7f01440e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f0150647640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f01440cc060 0x7f01440e5910 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014801f070 con 0x7f01440cc060 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f0150647640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0148031040 0x7f0148032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0148031040 0x7f0148032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0148031040 0x7f0148032940 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab980e0 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab980e0 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.824+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f01440cc060 2024-09-14T10:44:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014801f070 con 0x7f01440cc060 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab980e0 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab980e0 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f01440cc060 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f014801f070 con 0x7f01440cc060 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.828+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab980e0 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab980e0 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f01440cc060 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014801f070 con 0x7f01440cc060 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab980e0 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.832+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f01440cc060 2024-09-14T10:44:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014801f070 con 0x7f01440cc060 2024-09-14T10:44:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab9e350 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f0148031040 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x55fdbab980e0 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba0d20 con 0x7f01440cc060 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014801f070 con 0x7f01440cc060 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:31.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9cf60 con 0x55fdbab980e0 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9d800 con 0x55fdbab980e0 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9d800 con 0x55fdbab980e0 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 zone default found 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 4 Realm: () 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 zonegroup default 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbab9d800 con 0x7f0148031040 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba2c10 con 0x55fdbab9e350 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.836+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba30b0 con 0x55fdbab9e350 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 20 started sync module instance, tier type = 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba20b0 con 0x7f01440cc060 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94548247848096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba1d10 con 0x7f01440cc060 2024-09-14T10:44:31.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba3fe0 con 0x55fdbab980e0 2024-09-14T10:44:31.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.840+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94548247848096] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94548247852304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba3fe0 con 0x55fdbab980e0 2024-09-14T10:44:31.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba4a20 con 0x55fdbab9e350 2024-09-14T10:44:31.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94548247852304] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94548247853872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba3f50 con 0x55fdbab9e350 2024-09-14T10:44:31.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba5770 con 0x7f01440cc060 2024-09-14T10:44:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94548247860176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba5e60 con 0x7f01440cc060 2024-09-14T10:44:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.844+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba6980 con 0x55fdbab980e0 2024-09-14T10:44:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.848+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94548247853872] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.848+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94548247860176] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.848+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.848+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94548247864400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba6940 con 0x55fdbab980e0 2024-09-14T10:44:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.848+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba7220 con 0x7f0148031040 2024-09-14T10:44:31.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.848+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94548247864400] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.852+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.852+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94548247858704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba6df0 con 0x7f0148031040 2024-09-14T10:44:31.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.852+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba76a0 con 0x7f0148031040 2024-09-14T10:44:31.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.852+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.852+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94548247866864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba7d50 con 0x7f0148031040 2024-09-14T10:44:31.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.852+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba8600 con 0x7f0148031040 2024-09-14T10:44:31.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.852+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94548247858704] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94548247866864] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94548247865664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba7d50 con 0x7f0148031040 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 20 add_watcher() i=0 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 20 add_watcher() i=1 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 20 add_watcher() i=2 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 20 add_watcher() i=3 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 20 add_watcher() i=4 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 20 add_watcher() i=5 2024-09-14T10:44:31.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 20 add_watcher() i=6 2024-09-14T10:44:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94548247865664] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 20 add_watcher() i=7 2024-09-14T10:44:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabab700 con 0x55fdbab980e0 2024-09-14T10:44:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.856+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94548247869600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba8b80 con 0x55fdbab980e0 2024-09-14T10:44:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94548247869600] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f0005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 5 note: GC not initialized 2024-09-14T10:44:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f0004fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 Filter name: none 2024-09-14T10:44:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7eff7e7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:44:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabcec90 con 0x7f0148031040 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd08d0 con 0x7f01440cc060 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd24d0 con 0x55fdbab9e350 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-14T10:44:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.860+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd6b40 con 0x7f01440cc060 2024-09-14T10:44:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabdcf00 con 0x55fdbab9e350 2024-09-14T10:44:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f01523409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f01523409c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f01523409c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f01523409c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1, ofs0, ns] 2024-09-14T10:44:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94548248046480 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd8580 con 0x55fdbab980e0 2024-09-14T10:44:31.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94548247864400 notify 137438953484 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f0140033040 con 0x55fdbab980e0 2024-09-14T10:44:31.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f002effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94548247864400 notifier 4501 bl.length()=760 2024-09-14T10:44:31.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f002effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:31.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f002effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:31.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f002effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:31.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(67 notify.4 [notify cookie 94548248046480 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f002effd640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0014003eb0 con 0x55fdbab980e0 2024-09-14T10:44:31.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.864+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.868+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94548248046480 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fdbab601b0 con 0x55fdbab980e0 2024-09-14T10:44:31.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.868+0000 7f01523409c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_sources= new_sources= 2024-09-14T10:44:31.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.868+0000 7f01523409c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential sources added=[] removed=[] 2024-09-14T10:44:31.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.868+0000 7f01523409c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_dests= new_dests= 2024-09-14T10:44:31.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.868+0000 7f01523409c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential dests added=[] removed=[] 2024-09-14T10:44:31.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.868+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd80d0 con 0x7f0148031040 2024-09-14T10:44:31.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.868+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 fud.buckets [call] v32'3 uv3 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.868+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd0d10 con 0x7f01440cc060 2024-09-14T10:44:31.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f01523409c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:44:31.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f01523409c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:31.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f01523409c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:44:31.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94548248046448 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd0d10 con 0x7f0148031040 2024-09-14T10:44:31.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== watch-notify(notify (1) cookie 94548247866864 notify 137438953481 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55fdbab5f800 con 0x7f0148031040 2024-09-14T10:44:31.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f002effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94548247866864 notifier 4501 bl.length()=314 2024-09-14T10:44:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f002effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:44:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f002effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f002effd640 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0014003eb0 con 0x7f0148031040 2024-09-14T10:44:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(71 notify.6 [notify cookie 94548248046448 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== watch-notify(notify_complete (2) cookie 94548248046448 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fdbab5f570 con 0x7f0148031040 2024-09-14T10:44:31.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f0005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:31.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.872+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94548247869600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd0d10 con 0x55fdbab980e0 2024-09-14T10:44:31.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.876+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94548247869600] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.876+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94548247848096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd0d10 con 0x7f01440cc060 2024-09-14T10:44:31.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.876+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94548247848096] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.876+0000 7f01523409c0 20 remove_watcher() i=0 2024-09-14T10:44:31.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.876+0000 7f01523409c0 2 removed watcher, disabling cache 2024-09-14T10:44:31.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.876+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94548247852304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd0d10 con 0x55fdbab980e0 2024-09-14T10:44:31.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94548247852304] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f01523409c0 20 remove_watcher() i=1 2024-09-14T10:44:31.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94548247853872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbabd0d10 con 0x55fdbab9e350 2024-09-14T10:44:31.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f014f645640 1 -- 172.21.15.96:0/1701053272 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94548247853872] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01440f4020 con 0x55fdbab9e350 2024-09-14T10:44:31.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f01523409c0 20 remove_watcher() i=2 2024-09-14T10:44:31.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94548247860176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba78a0 con 0x7f01440cc060 2024-09-14T10:44:31.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f0150647640 1 -- 172.21.15.96:0/1701053272 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94548247860176] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0148040040 con 0x7f01440cc060 2024-09-14T10:44:31.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f01523409c0 20 remove_watcher() i=3 2024-09-14T10:44:31.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.880+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94548247864400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba24a0 con 0x55fdbab980e0 2024-09-14T10:44:31.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.884+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94548247864400] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x55fdbab980e0 2024-09-14T10:44:31.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.884+0000 7f01523409c0 20 remove_watcher() i=4 2024-09-14T10:44:31.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.884+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94548247858704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba3510 con 0x7f0148031040 2024-09-14T10:44:31.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.884+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94548247858704] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.884+0000 7f01523409c0 20 remove_watcher() i=5 2024-09-14T10:44:31.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.884+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94548247866864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba3b30 con 0x7f0148031040 2024-09-14T10:44:31.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94548247866864] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 20 remove_watcher() i=6 2024-09-14T10:44:31.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94548247865664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fdbaba78a0 con 0x7f0148031040 2024-09-14T10:44:31.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94548247865664] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0140008030 con 0x7f0148031040 2024-09-14T10:44:31.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 20 remove_watcher() i=7 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0148031040 msgr2=0x7f0148032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0148031040 0x7f0148032940 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab980e0 msgr2=0x55fdbab9a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab980e0 0x55fdbab9a570 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f01440cc060 msgr2=0x7f01440e5910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f01440cc060 0x7f01440e5910 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fdbab9e350 msgr2=0x55fdbaba0740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.888+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fdbab9e350 0x55fdbaba0740 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f001803a150 msgr2=0x7f001803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f001803a150 0x7f001803c610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55fdbab61190 tx=0x7f014801f000 comp rx=0 tx=0).stop 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 msgr2=0x55fdbab8cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f014fe46640 1 -- 172.21.15.96:0/1701053272 reap_dead start 2024-09-14T10:44:31.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab8cb20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f01440b7040 tx=0x7f01440eb380 comp rx=0 tx=0).stop 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 shutdown_connections 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/1701053272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbab865f0 0x55fdbab8cb20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 >> 172.21.15.96:0/1701053272 conn(0x55fdbab81a10 msgr2=0x55fdbab7fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 shutdown_connections 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/1701053272 wait complete. 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/3566000612 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f002803a140 msgr2=0x7f002803c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/3566000612 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f002803a140 0x7f002803c600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55fdbab67520 tx=0x7f0148005850 comp rx=0 tx=0).stop 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/3566000612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa6c340 msgr2=0x55fdbaa6abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/3566000612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa6c340 0x55fdbaa6abe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0144000c10 tx=0x7f0144018020 comp rx=0 tx=0).stop 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/3566000612 shutdown_connections 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/3566000612 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f002803a140 0x7f002803c600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/3566000612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdbaa6c340 0x55fdbaa6abe0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/3566000612 >> 172.21.15.96:0/3566000612 conn(0x55fdbab6c540 msgr2=0x55fdbab6c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/3566000612 shutdown_connections 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/3566000612 wait complete. 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab64170 msgr2=0x55fdbab66560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab64170 0x55fdbab66560 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f003803a150 msgr2=0x7f003803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f003803a150 0x7f003803c610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f01440ac000 tx=0x7f01440a5000 comp rx=0 tx=0).stop 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 msgr2=0x55fdbab5f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab5f010 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55fdbab586e0 tx=0x7f0140000bd0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 shutdown_connections 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fdbab64170 0x55fdbab66560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f003803a150 0x7f003803c610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 --2- 172.21.15.96:0/818690667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdba9e0230 0x55fdbab5f010 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 >> 172.21.15.96:0/818690667 conn(0x55fdbaa66910 msgr2=0x55fdbab58b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 shutdown_connections 2024-09-14T10:44:31.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.892+0000 7f01523409c0 1 -- 172.21.15.96:0/818690667 wait complete. 2024-09-14T10:44:31.900 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-14T10:44:31.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-14T10:44:31.901 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-14T10:44:31.980 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:31.980 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:31.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f2715cf19c0 1 Processor -- start 2024-09-14T10:44:31.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f2715cf19c0 1 -- start start 2024-09-14T10:44:31.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f2715cf19c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556b88b94760 0x556b88b96b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:31.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f2715cf19c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b88a3a7a0 con 0x556b88b97090 2024-09-14T10:44:31.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f2715cf19c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x556b88a961b0 con 0x556b88b94760 2024-09-14T10:44:31.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f27137f7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556b88b94760 0x556b88b96b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:31.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f27137f7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556b88b94760 0x556b88b96b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45312/0 (socket says 172.21.15.96:45312) 2024-09-14T10:44:31.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f27137f7640 1 -- 172.21.15.96:0/3658992955 learned_addr learned my addr 172.21.15.96:0/3658992955 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:31.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f2712ff6640 1 --1- 172.21.15.96:0/3658992955 >> v1:172.21.15.70:6789/0 conn(0x556b88b97090 0x556b88b99480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37184/0 (socket says 172.21.15.96:37184) 2024-09-14T10:44:31.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f27137f7640 1 -- 172.21.15.96:0/3658992955 >> v1:172.21.15.70:6789/0 conn(0x556b88b97090 legacy=0x556b88b99480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.984+0000 7f27137f7640 1 -- 172.21.15.96:0/3658992955 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b88a14da0 con 0x556b88b94760 2024-09-14T10:44:31.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f27137f7640 1 --2- 172.21.15.96:0/3658992955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b94760 0x556b88b96b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f270800a5c0 tx=0x7f270801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476d1317764ddb28 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:31.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f27127f5640 1 -- 172.21.15.96:0/3658992955 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27080a6070 con 0x556b88b94760 2024-09-14T10:44:31.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f27127f5640 1 -- 172.21.15.96:0/3658992955 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27080af070 con 0x556b88b94760 2024-09-14T10:44:31.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f27127f5640 1 -- 172.21.15.96:0/3658992955 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27080aa5c0 con 0x556b88b94760 2024-09-14T10:44:31.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3658992955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b94760 msgr2=0x556b88b96b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3658992955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b94760 0x556b88b96b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f270800a5c0 tx=0x7f270801b340 comp rx=0 tx=0).stop 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3658992955 shutdown_connections 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3658992955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b94760 0x556b88b96b50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3658992955 >> 172.21.15.96:0/3658992955 conn(0x556b88b07af0 msgr2=0x556b88b07f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3658992955 shutdown_connections 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:31.988+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3658992955 wait complete. 2024-09-14T10:44:32.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 Processor -- start 2024-09-14T10:44:32.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 -- start start 2024-09-14T10:44:32.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b97090 0x556b88c7f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b88a99fc0 con 0x556b88b97090 2024-09-14T10:44:32.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f27137f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b97090 0x556b88c7f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f27137f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b97090 0x556b88c7f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45322/0 (socket says 172.21.15.96:45322) 2024-09-14T10:44:32.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f27137f7640 1 -- 172.21.15.96:0/3190086968 learned_addr learned my addr 172.21.15.96:0/3190086968 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f27137f7640 1 -- 172.21.15.96:0/3190086968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b88c7fd00 con 0x556b88b97090 2024-09-14T10:44:32.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f27137f7640 1 --2- 172.21.15.96:0/3190086968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b97090 0x556b88c7f710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2708018f70 tx=0x7f2708003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb75248121aa99b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f260160a640 1 -- 172.21.15.96:0/3190086968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27080aa840 con 0x556b88b97090 2024-09-14T10:44:32.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f260160a640 1 -- 172.21.15.96:0/3190086968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27080aaa00 con 0x556b88b97090 2024-09-14T10:44:32.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f260160a640 1 -- 172.21.15.96:0/3190086968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27080aad20 con 0x556b88b97090 2024-09-14T10:44:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3190086968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b97090 msgr2=0x556b88c7f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3190086968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b97090 0x556b88c7f710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2708018f70 tx=0x7f2708003030 comp rx=0 tx=0).stop 2024-09-14T10:44:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3190086968 shutdown_connections 2024-09-14T10:44:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3190086968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88b97090 0x556b88c7f710 secure :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2708018f70 tx=0x7f2708003030 comp rx=0 tx=0).stop 2024-09-14T10:44:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3190086968 >> 172.21.15.96:0/3190086968 conn(0x556b88b07af0 msgr2=0x556b88c7b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3190086968 shutdown_connections 2024-09-14T10:44:32.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.004+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3190086968 wait complete. 2024-09-14T10:44:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2715cf19c0 1 Processor -- start 2024-09-14T10:44:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2715cf19c0 1 -- start start 2024-09-14T10:44:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2715cf19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c87120 0x556b88c87540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2715cf19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b88a3ba50 con 0x556b88c87120 2024-09-14T10:44:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f27137f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c87120 0x556b88c87540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f27137f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c87120 0x556b88c87540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45332/0 (socket says 172.21.15.96:45332) 2024-09-14T10:44:32.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f27137f7640 1 -- 172.21.15.96:0/2043839267 learned_addr learned my addr 172.21.15.96:0/2043839267 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f27137f7640 1 -- 172.21.15.96:0/2043839267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b88c87aa0 con 0x556b88c87120 2024-09-14T10:44:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f27137f7640 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c87120 0x556b88c87540 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f270801b170 tx=0x7f27080180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f25ffe07640 1 -- 172.21.15.96:0/2043839267 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27080cb020 con 0x556b88c87120 2024-09-14T10:44:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b88c87d30 con 0x556b88c87120 2024-09-14T10:44:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b88c88580 con 0x556b88c87120 2024-09-14T10:44:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f25ffe07640 1 -- 172.21.15.96:0/2043839267 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27080c6650 con 0x556b88c87120 2024-09-14T10:44:32.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f25ffe07640 1 -- 172.21.15.96:0/2043839267 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27080c6800 con 0x556b88c87120 2024-09-14T10:44:32.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f25ffe07640 1 -- 172.21.15.96:0/2043839267 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f27080ce020 con 0x556b88c87120 2024-09-14T10:44:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f25ffe07640 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25f803a1a0 0x7f25f803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f25ffe07640 1 -- 172.21.15.96:0/2043839267 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f27080ec3d0 con 0x556b88c87120 2024-09-14T10:44:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2712ff6640 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25f803a1a0 0x7f25f803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88c8c690 0x556b88c8ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88c8efc0 con 0x556b88c8c690 2024-09-14T10:44:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2713ff8640 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88c8c690 0x556b88c8ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.008+0000 7f2712ff6640 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25f803a1a0 0x7f25f803c660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2704001e40 tx=0x7f27040013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2713ff8640 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88c8c690 0x556b88c8ea80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2713ff8640 1 -- 172.21.15.96:0/2043839267 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f270c00a4d0 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88c8f360 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2713ff8640 1 -- 172.21.15.96:0/2043839267 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f270c00a4d0 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88c90bc0 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2713ff8640 1 -- 172.21.15.96:0/2043839267 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f270c00a4d0 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88c8fd00 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2713ff8640 1 -- 172.21.15.96:0/2043839267 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f270c00a4d0 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88c90120 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2713ff8640 1 -- 172.21.15.96:0/2043839267 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f270c00a4d0 con 0x556b88c8c690 2024-09-14T10:44:32.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 Processor -- start 2024-09-14T10:44:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 -- start start 2024-09-14T10:44:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c9ef50 0x556b88c9f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b88aa6d80 con 0x556b88c9ef50 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2712ff6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c9ef50 0x556b88c9f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2712ff6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c9ef50 0x556b88c9f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45346/0 (socket says 172.21.15.96:45346) 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2712ff6640 1 -- 172.21.15.96:0/1169813809 learned_addr learned my addr 172.21.15.96:0/1169813809 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2712ff6640 1 -- 172.21.15.96:0/1169813809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b88c9f9b0 con 0x556b88c9ef50 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2712ff6640 1 --2- 172.21.15.96:0/1169813809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c9ef50 0x556b88c9f370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f270400e670 tx=0x7f270400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f25fd602640 1 -- 172.21.15.96:0/1169813809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2704022070 con 0x556b88c9ef50 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 -- 172.21.15.96:0/1169813809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b88ca0210 con 0x556b88c9ef50 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f25fd602640 1 -- 172.21.15.96:0/1169813809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270400d660 con 0x556b88c9ef50 2024-09-14T10:44:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f25fd602640 1 -- 172.21.15.96:0/1169813809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2704006070 con 0x556b88c9ef50 2024-09-14T10:44:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.012+0000 7f2715cf19c0 1 -- 172.21.15.96:0/1169813809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b88ca0780 con 0x556b88c9ef50 2024-09-14T10:44:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f25fd602640 1 -- 172.21.15.96:0/1169813809 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2704025070 con 0x556b88c9ef50 2024-09-14T10:44:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f25fd602640 1 --2- 172.21.15.96:0/1169813809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25ec03a150 0x7f25ec03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f25fd602640 1 -- 172.21.15.96:0/1169813809 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2704052460 con 0x556b88c9ef50 2024-09-14T10:44:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2713ff8640 1 --2- 172.21.15.96:0/1169813809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25ec03a150 0x7f25ec03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 Processor -- start 2024-09-14T10:44:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 -- start start 2024-09-14T10:44:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2713ff8640 1 --2- 172.21.15.96:0/1169813809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25ec03a150 0x7f25ec03c610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x556b88c900a0 tx=0x7f270c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cabc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b88c80070 con 0x556b88cab8b0 2024-09-14T10:44:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2712ff6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cabc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2712ff6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cabc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45352/0 (socket says 172.21.15.96:45352) 2024-09-14T10:44:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2712ff6640 1 -- 172.21.15.96:0/3176492434 learned_addr learned my addr 172.21.15.96:0/3176492434 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2712ff6640 1 -- 172.21.15.96:0/3176492434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b88cac260 con 0x556b88cab8b0 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2712ff6640 1 --2- 172.21.15.96:0/3176492434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cabc90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f27040507c0 tx=0x7f2704024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c321540679696e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f25f6ffd640 1 -- 172.21.15.96:0/3176492434 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2704024770 con 0x556b88cab8b0 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f25f6ffd640 1 -- 172.21.15.96:0/3176492434 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270400dcc0 con 0x556b88cab8b0 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f25f6ffd640 1 -- 172.21.15.96:0/3176492434 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270404f220 con 0x556b88cab8b0 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3176492434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 msgr2=0x556b88cabc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3176492434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cabc90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f27040507c0 tx=0x7f2704024c90 comp rx=0 tx=0).stop 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3176492434 shutdown_connections 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3176492434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cabc90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.016+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3176492434 >> 172.21.15.96:0/3176492434 conn(0x556b88ca7ce0 msgr2=0x556b88ca5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3176492434 shutdown_connections 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3176492434 wait complete. 2024-09-14T10:44:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 Processor -- start 2024-09-14T10:44:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 -- start start 2024-09-14T10:44:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cb2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b88cac8c0 con 0x556b88cab8b0 2024-09-14T10:44:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2712ff6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cb2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2712ff6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cb2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45358/0 (socket says 172.21.15.96:45358) 2024-09-14T10:44:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 learned_addr learned my addr 172.21.15.96:0/3669137927 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b88cb3390 con 0x556b88cab8b0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2712ff6640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cb2e30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f27040266c0 tx=0x7f2704050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f25f57fa640 1 -- 172.21.15.96:0/3669137927 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2704024b30 con 0x556b88cab8b0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b88cb3620 con 0x556b88cab8b0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b88cb3620 con 0x556b88cab8b0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f25f57fa640 1 -- 172.21.15.96:0/3669137927 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2704025c80 con 0x556b88cab8b0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f25f57fa640 1 -- 172.21.15.96:0/3669137927 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f270403a060 con 0x556b88cab8b0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f25f57fa640 1 -- 172.21.15.96:0/3669137927 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2704033070 con 0x556b88cab8b0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f25f57fa640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25dc03a1a0 0x7f25dc03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f25f57fa640 1 -- 172.21.15.96:0/3669137927 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2704045070 con 0x556b88cab8b0 2024-09-14T10:44:32.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2713ff8640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25dc03a1a0 0x7f25dc03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88cbe140 0x556b88cc0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.020+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc0ce0 con 0x556b88cbe140 2024-09-14T10:44:32.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f27137f7640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88cbe140 0x556b88cc0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2713ff8640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25dc03a1a0 0x7f25dc03c660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x556b88c8f820 tx=0x7f270c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f27137f7640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88cbe140 0x556b88cc0590 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 realm 2024-09-14T10:44:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc10f0 con 0x556b88cbe140 2024-09-14T10:44:32.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc19c0 con 0x556b88cbe140 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc1d60 con 0x556b88cbe140 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc25b0 con 0x556b88cbe140 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 20 searching for the correct realm 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b88cc4320 0x556b88cc6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2712ff6640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b88cc4320 0x556b88cc6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2712ff6640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b88cc4320 0x556b88cc6710 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f270403c070 con 0x556b88cc4320 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2712ff6640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2704035070 0x7f27040279f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f2704035070 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2713ff8640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2704035070 0x7f27040279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2713ff8640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2704035070 0x7f27040279f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f270c01f070 con 0x7f2704035070 2024-09-14T10:44:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2713ff8640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f270c031040 0x7f270c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.024+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f270c031040 0x7f270c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f270c031040 0x7f270c032940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cbe140 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cbe140 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f2704035070 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f270c01f070 con 0x7f2704035070 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f270403c070 con 0x556b88cc4320 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cbe140 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.028+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cbe140 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f2704035070 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f270c01f070 con 0x7f2704035070 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cbe140 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cbe140 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.032+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f2704035070 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f270c01f070 con 0x7f2704035070 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cbe140 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f2704035070 2024-09-14T10:44:32.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f270c01f070 con 0x7f2704035070 2024-09-14T10:44:32.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cc4320 2024-09-14T10:44:32.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f270c031040 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.036+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x556b88cbe140 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc6ca0 con 0x7f2704035070 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f270c01f070 con 0x7f2704035070 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:32.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc2f00 con 0x556b88cbe140 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc37a0 con 0x556b88cbe140 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc37a0 con 0x556b88cbe140 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 zone default found 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 4 Realm: () 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 zonegroup default 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc7100 con 0x7f270c031040 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc8bf0 con 0x556b88cc4320 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc9090 con 0x556b88cc4320 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 started sync module instance, tier type = 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.040+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc7f90 con 0x7f2704035070 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.044+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.044+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920344966016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc7bf0 con 0x7f2704035070 2024-09-14T10:44:32.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.044+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc9fc0 con 0x556b88cbe140 2024-09-14T10:44:32.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.044+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920344966016] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.044+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.044+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920344970480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc9fc0 con 0x556b88cbe140 2024-09-14T10:44:32.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.044+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cca980 con 0x556b88cc4320 2024-09-14T10:44:32.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.048+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920344970480] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.048+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.048+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920344972048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc9f30 con 0x556b88cc4320 2024-09-14T10:44:32.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.048+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccb680 con 0x7f2704035070 2024-09-14T10:44:32.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.048+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.048+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920344978144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccbf20 con 0x7f2704035070 2024-09-14T10:44:32.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.048+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccc920 con 0x556b88cbe140 2024-09-14T10:44:32.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.048+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920344972048] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.052+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920344978144] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.052+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.052+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920344976672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccba70 con 0x556b88cbe140 2024-09-14T10:44:32.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.052+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccd1c0 con 0x7f270c031040 2024-09-14T10:44:32.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.052+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920344976672] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.052+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.052+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920344982576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccba70 con 0x7f270c031040 2024-09-14T10:44:32.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.052+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccd630 con 0x7f270c031040 2024-09-14T10:44:32.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920344982576] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920344985888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccd5f0 con 0x7f270c031040 2024-09-14T10:44:32.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cce010 con 0x7f270c031040 2024-09-14T10:44:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920344985888] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920344988416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccdfd0 con 0x7f270c031040 2024-09-14T10:44:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 20 add_watcher() i=0 2024-09-14T10:44:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 20 add_watcher() i=1 2024-09-14T10:44:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 20 add_watcher() i=2 2024-09-14T10:44:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 20 add_watcher() i=3 2024-09-14T10:44:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 20 add_watcher() i=4 2024-09-14T10:44:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 20 add_watcher() i=5 2024-09-14T10:44:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.056+0000 7f2715cf19c0 20 add_watcher() i=6 2024-09-14T10:44:32.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.060+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920344988416] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.060+0000 7f2715cf19c0 20 add_watcher() i=7 2024-09-14T10:44:32.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.060+0000 7f2715cf19c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:32.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.060+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cd1400 con 0x556b88cbe140 2024-09-14T10:44:32.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.060+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.060+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920344984240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cce950 con 0x556b88cbe140 2024-09-14T10:44:32.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.060+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920344984240] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.064+0000 7f25c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.064+0000 7f2715cf19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:32.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.064+0000 7f2715cf19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:32.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.064+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cd9eb0 con 0x556b88cbe140 2024-09-14T10:44:32.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.064+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.064+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cda4c0 con 0x7f270c031040 2024-09-14T10:44:32.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.068+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.068+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cda950 con 0x556b88cc4320 2024-09-14T10:44:32.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.068+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.068+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdacf0 con 0x556b88cbe140 2024-09-14T10:44:32.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.068+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'113 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.068+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdacf0 con 0x7f2704035070 2024-09-14T10:44:32.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.072+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.072+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdb2e0 con 0x556b88cc4320 2024-09-14T10:44:32.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.072+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.072+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdb680 con 0x556b88cbe140 2024-09-14T10:44:32.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.072+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.072+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdb680 con 0x7f270c031040 2024-09-14T10:44:32.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.076+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.076+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdb680 con 0x7f2704035070 2024-09-14T10:44:32.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.080+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.080+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdbbf0 con 0x556b88cc4320 2024-09-14T10:44:32.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.080+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.080+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdbbf0 con 0x7f2704035070 2024-09-14T10:44:32.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.080+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.080+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc160 con 0x7f270c031040 2024-09-14T10:44:32.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.084+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.084+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc160 con 0x7f2704035070 2024-09-14T10:44:32.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.084+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.084+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc540 con 0x7f270c031040 2024-09-14T10:44:32.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.088+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.088+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc4f0 con 0x556b88cbe140 2024-09-14T10:44:32.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.088+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.088+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc4d0 con 0x556b88cc4320 2024-09-14T10:44:32.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.092+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.092+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc240 con 0x7f2704035070 2024-09-14T10:44:32.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.092+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.092+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc240 con 0x556b88cc4320 2024-09-14T10:44:32.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.092+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.092+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc240 con 0x556b88cbe140 2024-09-14T10:44:32.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.096+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.096+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc240 con 0x556b88cbe140 2024-09-14T10:44:32.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.096+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.096+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc240 con 0x556b88cc4320 2024-09-14T10:44:32.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.100+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.100+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc240 con 0x7f2704035070 2024-09-14T10:44:32.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.100+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.100+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc2e0 con 0x556b88cc4320 2024-09-14T10:44:32.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.100+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.100+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc320 con 0x556b88cc4320 2024-09-14T10:44:32.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.104+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.104+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc390 con 0x556b88cc4320 2024-09-14T10:44:32.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.104+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.104+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc390 con 0x556b88cc4320 2024-09-14T10:44:32.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.104+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.104+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc3b0 con 0x7f270c031040 2024-09-14T10:44:32.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.108+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.108+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc3b0 con 0x556b88cc4320 2024-09-14T10:44:32.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.108+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.108+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc3e0 con 0x7f270c031040 2024-09-14T10:44:32.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.112+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.112+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc3e0 con 0x556b88cc4320 2024-09-14T10:44:32.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.116+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.116+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc3e0 con 0x7f270c031040 2024-09-14T10:44:32.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.116+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.116+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cdc3e0 con 0x7f2704035070 2024-09-14T10:44:32.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.120+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.120+0000 7f25c8fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.120+0000 7f2715cf19c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.120+0000 7f2715cf19c0 20 Filter name: none 2024-09-14T10:44:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.120+0000 7f25427fc640 20 reqs_thread_entry: start 2024-09-14T10:44:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.120+0000 7f2715cf19c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:44:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.120+0000 7f2715cf19c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.120+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cd80f0 con 0x7f270c031040 2024-09-14T10:44:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f2715cf19c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:44:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f2715cf19c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:44:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f2715cf19c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f2715cf19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:32.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b88cd80e0 con 0x7f270c031040 2024-09-14T10:44:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv3 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.121 INFO:teuthology.orchestra.run.smithi096.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-14T10:44:32.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f25c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.124+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920344984240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cb8450 con 0x556b88cbe140 2024-09-14T10:44:32.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93920344984240] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920344966016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cccab0 con 0x7f2704035070 2024-09-14T10:44:32.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93920344966016] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f2715cf19c0 20 remove_watcher() i=0 2024-09-14T10:44:32.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f2715cf19c0 2 removed watcher, disabling cache 2024-09-14T10:44:32.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920344970480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc8380 con 0x556b88cbe140 2024-09-14T10:44:32.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93920344970480] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f2715cf19c0 20 remove_watcher() i=1 2024-09-14T10:44:32.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.128+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920344972048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc8380 con 0x556b88cc4320 2024-09-14T10:44:32.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.132+0000 7f2712ff6640 1 -- 172.21.15.96:0/3669137927 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93920344972048] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2704060040 con 0x556b88cc4320 2024-09-14T10:44:32.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.132+0000 7f2715cf19c0 20 remove_watcher() i=2 2024-09-14T10:44:32.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.132+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920344978144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc8380 con 0x7f2704035070 2024-09-14T10:44:32.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.132+0000 7f2713ff8640 1 -- 172.21.15.96:0/3669137927 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93920344978144] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f270c040040 con 0x7f2704035070 2024-09-14T10:44:32.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.132+0000 7f2715cf19c0 20 remove_watcher() i=3 2024-09-14T10:44:32.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.132+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920344976672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc8380 con 0x556b88cbe140 2024-09-14T10:44:32.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.136+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93920344976672] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x556b88cbe140 2024-09-14T10:44:32.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.136+0000 7f2715cf19c0 20 remove_watcher() i=4 2024-09-14T10:44:32.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.136+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920344982576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccad20 con 0x7f270c031040 2024-09-14T10:44:32.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.136+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93920344982576] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.136+0000 7f2715cf19c0 20 remove_watcher() i=5 2024-09-14T10:44:32.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.136+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920344985888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88cc8380 con 0x7f270c031040 2024-09-14T10:44:32.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.140+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93920344985888] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.140+0000 7f2715cf19c0 20 remove_watcher() i=6 2024-09-14T10:44:32.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.140+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920344988416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b88ccad20 con 0x7f270c031040 2024-09-14T10:44:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93920344988416] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27080ec050 con 0x7f270c031040 2024-09-14T10:44:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 20 remove_watcher() i=7 2024-09-14T10:44:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f270c031040 msgr2=0x7f270c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f270c031040 0x7f270c032940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88cbe140 msgr2=0x556b88cc0590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88cbe140 0x556b88cc0590 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2704035070 msgr2=0x7f27040279f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2704035070 0x7f27040279f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b88cc4320 msgr2=0x556b88cc6710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b88cc4320 0x556b88cc6710 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25dc03a1a0 msgr2=0x7f25dc03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25dc03a1a0 0x7f25dc03c660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x556b88c8f820 tx=0x7f270c01f000 comp rx=0 tx=0).stop 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 msgr2=0x556b88cb2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/3669137927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88cab8b0 0x556b88cb2e30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f27040266c0 tx=0x7f2704050720 comp rx=0 tx=0).stop 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 reap_dead start 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f27137f7640 1 -- 172.21.15.96:0/3669137927 reap_dead start 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 shutdown_connections 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 >> 172.21.15.96:0/3669137927 conn(0x556b88ca7ce0 msgr2=0x556b88ca5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 shutdown_connections 2024-09-14T10:44:32.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/3669137927 wait complete. 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/1169813809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25ec03a150 msgr2=0x7f25ec03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/1169813809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25ec03a150 0x7f25ec03c610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x556b88c900a0 tx=0x7f270c005850 comp rx=0 tx=0).stop 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/1169813809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c9ef50 msgr2=0x556b88c9f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/1169813809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c9ef50 0x556b88c9f370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f270400e670 tx=0x7f270400ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/1169813809 shutdown_connections 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/1169813809 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25ec03a150 0x7f25ec03c610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/1169813809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c9ef50 0x556b88c9f370 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/1169813809 >> 172.21.15.96:0/1169813809 conn(0x556b88c94900 msgr2=0x556b88c94ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/1169813809 shutdown_connections 2024-09-14T10:44:32.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/1169813809 wait complete. 2024-09-14T10:44:32.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88c8c690 msgr2=0x556b88c8ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88c8c690 0x556b88c8ea80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25f803a1a0 msgr2=0x7f25f803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25f803a1a0 0x7f25f803c660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2704001e40 tx=0x7f27040013a0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c87120 msgr2=0x556b88c87540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c87120 0x556b88c87540 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f270801b170 tx=0x7f27080180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 shutdown_connections 2024-09-14T10:44:32.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b88c8c690 0x556b88c8ea80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f25f803a1a0 0x7f25f803c660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 --2- 172.21.15.96:0/2043839267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b88c87120 0x556b88c87540 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 >> 172.21.15.96:0/2043839267 conn(0x556b88b07af0 msgr2=0x556b88c80b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 shutdown_connections 2024-09-14T10:44:32.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.144+0000 7f2715cf19c0 1 -- 172.21.15.96:0/2043839267 wait complete. 2024-09-14T10:44:32.154 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-14T10:44:32.155 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-14T10:44:32.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-14T10:44:32.155 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-14T10:44:32.235 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:32.236 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:32.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5d18799c0 1 Processor -- start 2024-09-14T10:44:32.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5d18799c0 1 -- start start 2024-09-14T10:44:32.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5d18799c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fefde061b0 0x55fefde085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5d18799c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fefdcaa7a0 con 0x55fefde02010 2024-09-14T10:44:32.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5d18799c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55fefdd061b0 con 0x55fefde061b0 2024-09-14T10:44:32.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5ceb7e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fefde061b0 0x55fefde085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5ceb7e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fefde061b0 0x55fefde085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45364/0 (socket says 172.21.15.96:45364) 2024-09-14T10:44:32.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5cf37f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55fefde02010 0x55fefde023f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37196/0 (socket says 172.21.15.96:37196) 2024-09-14T10:44:32.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/2033319861 learned_addr learned my addr 172.21.15.96:0/2033319861 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/2033319861 >> v1:172.21.15.70:6789/0 conn(0x55fefde02010 legacy=0x55fefde023f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.240+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/2033319861 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fefdc84da0 con 0x55fefde061b0 2024-09-14T10:44:32.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/2033319861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde061b0 0x55fefde085a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000a5c0 tx=0x7fc5c001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd13b4467cf5a323 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5ce37d640 1 -- 172.21.15.96:0/2033319861 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c00a9590 con 0x55fefde061b0 2024-09-14T10:44:32.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5ce37d640 1 -- 172.21.15.96:0/2033319861 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c00ae070 con 0x55fefde061b0 2024-09-14T10:44:32.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5ce37d640 1 -- 172.21.15.96:0/2033319861 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c00a9880 con 0x55fefde061b0 2024-09-14T10:44:32.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2033319861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde061b0 msgr2=0x55fefde085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2033319861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde061b0 0x55fefde085a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000a5c0 tx=0x7fc5c001b3d0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2033319861 shutdown_connections 2024-09-14T10:44:32.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2033319861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde061b0 0x55fefde085a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2033319861 >> 172.21.15.96:0/2033319861 conn(0x55fefddfdb30 msgr2=0x55fefddfff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2033319861 shutdown_connections 2024-09-14T10:44:32.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.244+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2033319861 wait complete. 2024-09-14T10:44:32.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 Processor -- start 2024-09-14T10:44:32.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 -- start start 2024-09-14T10:44:32.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdd78ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fefdd09fc0 con 0x55fefde02010 2024-09-14T10:44:32.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5cf37f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdd78ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5cf37f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdd78ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45368/0 (socket says 172.21.15.96:45368) 2024-09-14T10:44:32.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5cf37f640 1 -- 172.21.15.96:0/778216600 learned_addr learned my addr 172.21.15.96:0/778216600 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5cf37f640 1 -- 172.21.15.96:0/778216600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fefdd790c0 con 0x55fefde02010 2024-09-14T10:44:32.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5cf37f640 1 --2- 172.21.15.96:0/778216600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdd78ad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8001680 tx=0x7fc5b8001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788169360e40cf76 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc4bc618640 1 -- 172.21.15.96:0/778216600 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b8013420 con 0x55fefde02010 2024-09-14T10:44:32.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc4bc618640 1 -- 172.21.15.96:0/778216600 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b80135c0 con 0x55fefde02010 2024-09-14T10:44:32.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc4bc618640 1 -- 172.21.15.96:0/778216600 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b80138e0 con 0x55fefde02010 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 -- 172.21.15.96:0/778216600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 msgr2=0x55fefdd78ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/778216600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdd78ad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8001680 tx=0x7fc5b8001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 -- 172.21.15.96:0/778216600 shutdown_connections 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/778216600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdd78ad0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 -- 172.21.15.96:0/778216600 >> 172.21.15.96:0/778216600 conn(0x55fefddfdb30 msgr2=0x55fefdee8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 -- 172.21.15.96:0/778216600 shutdown_connections 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.260+0000 7fc5d18799c0 1 -- 172.21.15.96:0/778216600 wait complete. 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5d18799c0 1 Processor -- start 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5d18799c0 1 -- start start 2024-09-14T10:44:32.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5d18799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdef6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5d18799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fefdcaba50 con 0x55fefde02010 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5cf37f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdef6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5cf37f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdef6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45372/0 (socket says 172.21.15.96:45372) 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5cf37f640 1 -- 172.21.15.96:0/2200994596 learned_addr learned my addr 172.21.15.96:0/2200994596 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5cf37f640 1 -- 172.21.15.96:0/2200994596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fefdef7390 con 0x55fefde02010 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5cf37f640 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdef6e30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55fefdd78650 tx=0x7fc5b8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc4bae15640 1 -- 172.21.15.96:0/2200994596 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b80037a0 con 0x55fefde02010 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fefdef7620 con 0x55fefde02010 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc4bae15640 1 -- 172.21.15.96:0/2200994596 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b8023070 con 0x55fefde02010 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc4bae15640 1 -- 172.21.15.96:0/2200994596 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b8003ad0 con 0x55fefde02010 2024-09-14T10:44:32.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fefdef7f80 con 0x55fefde02010 2024-09-14T10:44:32.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc4bae15640 1 -- 172.21.15.96:0/2200994596 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc5b8010070 con 0x55fefde02010 2024-09-14T10:44:32.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc4bae15640 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4b403a1a0 0x7fc4b403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc4bae15640 1 -- 172.21.15.96:0/2200994596 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc5b8050c20 con 0x55fefde02010 2024-09-14T10:44:32.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4b403a1a0 0x7fc4b403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.264+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefde061b0 0x55fefdefdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdefe490 con 0x55fefde061b0 2024-09-14T10:44:32.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefde061b0 0x55fefdefdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4b403a1a0 0x7fc4b403c660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00ad000 tx=0x7fc5c00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefde061b0 0x55fefdefdf50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5cfb80640 1 -- 172.21.15.96:0/2200994596 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5c80083f0 con 0x55fefde061b0 2024-09-14T10:44:32.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdef8380 con 0x55fefde061b0 2024-09-14T10:44:32.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5cfb80640 1 -- 172.21.15.96:0/2200994596 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5c80083f0 con 0x55fefde061b0 2024-09-14T10:44:32.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf001f0 con 0x55fefde061b0 2024-09-14T10:44:32.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5cfb80640 1 -- 172.21.15.96:0/2200994596 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc5c80083f0 con 0x55fefde061b0 2024-09-14T10:44:32.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdeff420 con 0x55fefde061b0 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5cfb80640 1 -- 172.21.15.96:0/2200994596 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5c80083f0 con 0x55fefde061b0 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdeff870 con 0x55fefde061b0 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5cfb80640 1 -- 172.21.15.96:0/2200994596 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc5c80083f0 con 0x55fefde061b0 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 Processor -- start 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 -- start start 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf0e5b0 0x55fefdf0e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5d18799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fefdd16d80 con 0x55fefdf0e5b0 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5ceb7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf0e5b0 0x55fefdf0e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5ceb7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf0e5b0 0x55fefdf0e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45376/0 (socket says 172.21.15.96:45376) 2024-09-14T10:44:32.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/2800434147 learned_addr learned my addr 172.21.15.96:0/2800434147 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.268+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/2800434147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fefdf0f010 con 0x55fefdf0e5b0 2024-09-14T10:44:32.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/2800434147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf0e5b0 0x55fefdf0e9d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0017fe0 tx=0x7fc5c0018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b3fff640 1 -- 172.21.15.96:0/2800434147 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c00b3ba0 con 0x55fefdf0e5b0 2024-09-14T10:44:32.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b3fff640 1 -- 172.21.15.96:0/2800434147 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c00b3d40 con 0x55fefdf0e5b0 2024-09-14T10:44:32.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2800434147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fefdf0f870 con 0x55fefdf0e5b0 2024-09-14T10:44:32.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b3fff640 1 -- 172.21.15.96:0/2800434147 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c00c8580 con 0x55fefdf0e5b0 2024-09-14T10:44:32.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2800434147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fefdf0fd80 con 0x55fefdf0e5b0 2024-09-14T10:44:32.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b3fff640 1 -- 172.21.15.96:0/2800434147 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc5c00d1440 con 0x55fefdf0e5b0 2024-09-14T10:44:32.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b3fff640 1 --2- 172.21.15.96:0/2800434147 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4a803a140 0x7fc4a803c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b3fff640 1 -- 172.21.15.96:0/2800434147 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc5c00ee6b0 con 0x55fefdf0e5b0 2024-09-14T10:44:32.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/2800434147 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4a803a140 0x7fc4a803c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5d18799c0 1 Processor -- start 2024-09-14T10:44:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5d18799c0 1 -- start start 2024-09-14T10:44:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5d18799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf1b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5d18799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fefdd77410 con 0x55fefdf1adf0 2024-09-14T10:44:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/2800434147 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4a803a140 0x7fc4a803c600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800e3f0 tx=0x7fc5c8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5ceb7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf1b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5ceb7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf1b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45388/0 (socket says 172.21.15.96:45388) 2024-09-14T10:44:32.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3571463041 learned_addr learned my addr 172.21.15.96:0/3571463041 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3571463041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fefdf1b7a0 con 0x55fefdf1adf0 2024-09-14T10:44:32.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/3571463041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf1b1d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00c7480 tx=0x7fc5c00c7950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1119ce6f2618cc47 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b1ffb640 1 -- 172.21.15.96:0/3571463041 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c00bccd0 con 0x55fefdf1adf0 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b1ffb640 1 -- 172.21.15.96:0/3571463041 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c00be410 con 0x55fefdf1adf0 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.272+0000 7fc4b1ffb640 1 -- 172.21.15.96:0/3571463041 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c00bc3b0 con 0x55fefdf1adf0 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3571463041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 msgr2=0x55fefdf1b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3571463041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf1b1d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00c7480 tx=0x7fc5c00c7950 comp rx=0 tx=0).stop 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3571463041 shutdown_connections 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3571463041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf1b1d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3571463041 >> 172.21.15.96:0/3571463041 conn(0x55fefdf17220 msgr2=0x55fefdf15460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3571463041 shutdown_connections 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3571463041 wait complete. 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 Processor -- start 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- start start 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf22320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fefdf1be00 con 0x55fefdf1adf0 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5ceb7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf22320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5ceb7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf22320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45396/0 (socket says 172.21.15.96:45396) 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 learned_addr learned my addr 172.21.15.96:0/3297766519 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fefdf22880 con 0x55fefdf1adf0 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf22320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00c7720 tx=0x7fc5c00ec970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc49ffff640 1 -- 172.21.15.96:0/3297766519 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c00f3070 con 0x55fefdf1adf0 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fefdf22b10 con 0x55fefdf1adf0 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc49ffff640 1 -- 172.21.15.96:0/3297766519 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c00e4040 con 0x55fefdf1adf0 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc49ffff640 1 -- 172.21.15.96:0/3297766519 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5c00bc4e0 con 0x55fefdf1adf0 2024-09-14T10:44:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fefdf234c0 con 0x55fefdf1adf0 2024-09-14T10:44:32.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.276+0000 7fc49ffff640 1 -- 172.21.15.96:0/3297766519 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc5c00f6070 con 0x55fefdf1adf0 2024-09-14T10:44:32.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc49ffff640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc49803a150 0x7fc49803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc49ffff640 1 -- 172.21.15.96:0/3297766519 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc5c00f9ca0 con 0x55fefdf1adf0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc49803a150 0x7fc49803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefdf2d8a0 0x55fefdf2fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf30480 con 0x55fefdf2d8a0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cf37f640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefdf2d8a0 0x55fefdf2fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc49803a150 0x7fc49803c610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800f010 tx=0x7fc5c801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cf37f640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefdf2d8a0 0x55fefdf2fd30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 realm 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf30890 con 0x55fefdf2d8a0 2024-09-14T10:44:32.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf31160 con 0x55fefdf2d8a0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf31500 con 0x55fefdf2d8a0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf31d50 con 0x55fefdf2d8a0 2024-09-14T10:44:32.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 20 searching for the correct realm 2024-09-14T10:44:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fefdf33ac0 0x55fefdf35eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x55fefdf33ac0 2024-09-14T10:44:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fefdf33ac0 0x55fefdf35eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fefdf33ac0 0x55fefdf35eb0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c00f5030 con 0x55fefdf33ac0 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5ceb7e640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc5c00f8060 0x7fc5c00cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x7fc5c00f8060 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc5c00f8060 0x7fc5c00cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.280+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc5c00f8060 0x7fc5c00cd260 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cfb80640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc5c8019040 0x7fc5c8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x7fc5c8019040 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc5c8019040 0x7fc5c8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc5c8019040 0x7fc5c8019930 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x7fc5c8019040 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x7fc5c8019040 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x7fc5c00f8060 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x55fefdf33ac0 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.284+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf364e0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c8019040 2024-09-14T10:44:32.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf2d8a0 2024-09-14T10:44:32.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c00f8060 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf33ac0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf33ac0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c8019040 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf33ac0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf33ac0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf2d8a0 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf2d8a0 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.288+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c8019040 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf33ac0 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c00f8060 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf2d8a0 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c8019040 2024-09-14T10:44:32.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf33ac0 2024-09-14T10:44:32.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c8019040 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c00f8060 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf33ac0 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c8019040 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x55fefdf2d8a0 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.292+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc5b803e040 con 0x7fc5c00f8060 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf325a0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf325a0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf325a0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 zone default found 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 4 Realm: () 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 zonegroup default 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf32540 con 0x7fc5c8019040 2024-09-14T10:44:32.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf32ec0 con 0x55fefdf33ac0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf38330 con 0x55fefdf33ac0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 started sync module instance, tier type = 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf377d0 con 0x7fc5c00f8060 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94553670646720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf38b80 con 0x7fc5c00f8060 2024-09-14T10:44:32.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.296+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf393d0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.300+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94553670646720] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.300+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.300+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94553670649552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf38fa0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.300+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf39960 con 0x55fefdf33ac0 2024-09-14T10:44:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.300+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.300+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94553670653104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3a1b0 con 0x55fefdf33ac0 2024-09-14T10:44:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.300+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3abb0 con 0x7fc5c00f8060 2024-09-14T10:44:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94553670649552] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94553670650608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3afa0 con 0x7fc5c00f8060 2024-09-14T10:44:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3b960 con 0x55fefdf2d8a0 2024-09-14T10:44:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94553670653104] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94553670650608] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94553670657728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3b4b0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.304+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3bd40 con 0x7fc5c8019040 2024-09-14T10:44:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.308+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94553670657728] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.308+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.308+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94553670655232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3b960 con 0x7fc5c8019040 2024-09-14T10:44:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.308+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3c750 con 0x7fc5c8019040 2024-09-14T10:44:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.308+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.308+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94553670664864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3cb70 con 0x7fc5c8019040 2024-09-14T10:44:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.308+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3d570 con 0x7fc5c8019040 2024-09-14T10:44:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.308+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94553670655232] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94553670661296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3d530 con 0x7fc5c8019040 2024-09-14T10:44:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 20 add_watcher() i=0 2024-09-14T10:44:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 20 add_watcher() i=1 2024-09-14T10:44:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 20 add_watcher() i=2 2024-09-14T10:44:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 20 add_watcher() i=3 2024-09-14T10:44:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 20 add_watcher() i=4 2024-09-14T10:44:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 20 add_watcher() i=5 2024-09-14T10:44:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94553670664864] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 20 add_watcher() i=6 2024-09-14T10:44:32.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94553670661296] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 20 add_watcher() i=7 2024-09-14T10:44:32.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:32.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.312+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3d530 con 0x55fefdf2d8a0 2024-09-14T10:44:32.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94553670668416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3d4a0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94553670668416] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc4857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 5 note: GC not initialized 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc47f7fe640 20 reqs_thread_entry: start 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 Filter name: none 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc47d7fa640 20 reqs_thread_entry: start 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf63c80 con 0x7fc5c8019040 2024-09-14T10:44:32.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:44:32.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:44:32.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:32.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:32.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:32.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf65d70 con 0x7fc5c00f8060 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.316+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf675f0 con 0x55fefdf33ac0 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:32.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:32.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:32.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-14T10:44:32.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf6ad30 con 0x7fc5c8019040 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(65 fud.buckets [call] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf69db0 con 0x7fc5c00f8060 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.320+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf6edb0 con 0x7fc5c00f8060 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc5d18799c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc5d18799c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc5d18799c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94553670871168 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf6a760 con 0x7fc5c8019040 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== watch-notify(notify (1) cookie 94553670664864 notify 137438953482 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55fefdef7f80 con 0x7fc5c8019040 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc4b1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94553670664864 notifier 4515 bl.length()=338 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc4b1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc4b1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc4b1ffb640 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc494003eb0 con 0x7fc5c8019040 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(68 notify.6 [notify cookie 94553670871168 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.324+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== watch-notify(notify_complete (2) cookie 94553670871168 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fefdef7620 con 0x7fc5c8019040 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc4857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94553670668416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf61850 con 0x55fefdf2d8a0 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94553670668416] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94553670646720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf61850 con 0x7fc5c00f8060 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94553670646720] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc5d18799c0 20 remove_watcher() i=0 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc5d18799c0 2 removed watcher, disabling cache 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.328+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94553670649552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf37bc0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.332+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94553670649552] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.332+0000 7fc5d18799c0 20 remove_watcher() i=1 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.332+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94553670653104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf61850 con 0x55fefdf33ac0 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.332+0000 7fc5ceb7e640 1 -- 172.21.15.96:0/3297766519 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94553670653104] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c0107040 con 0x55fefdf33ac0 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.332+0000 7fc5d18799c0 20 remove_watcher() i=2 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.332+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94553670650608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf386d0 con 0x7fc5c00f8060 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5cfb80640 1 -- 172.21.15.96:0/3297766519 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94553670650608] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5c802f040 con 0x7fc5c00f8060 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5d18799c0 20 remove_watcher() i=3 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94553670657728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf37bc0 con 0x55fefdf2d8a0 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94553670657728] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x55fefdf2d8a0 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5d18799c0 20 remove_watcher() i=4 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94553670655232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf394b0 con 0x7fc5c8019040 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94553670655232] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5d18799c0 20 remove_watcher() i=5 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.336+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94553670664864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf3a6c0 con 0x7fc5c8019040 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.340+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94553670664864] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.340+0000 7fc5d18799c0 20 remove_watcher() i=6 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.340+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94553670661296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fefdf37bc0 con 0x7fc5c8019040 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94553670661296] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5b800f030 con 0x7fc5c8019040 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 20 remove_watcher() i=7 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc5c8019040 msgr2=0x7fc5c8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc5c8019040 0x7fc5c8019930 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefdf2d8a0 msgr2=0x55fefdf2fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefdf2d8a0 0x55fefdf2fd30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc5c00f8060 msgr2=0x7fc5c00cd260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc5c00f8060 0x7fc5c00cd260 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fefdf33ac0 msgr2=0x55fefdf35eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fefdf33ac0 0x55fefdf35eb0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc49803a150 msgr2=0x7fc49803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc49803a150 0x7fc49803c610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800f010 tx=0x7fc5c801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 msgr2=0x55fefdf22320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf22320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00c7720 tx=0x7fc5c00ec970 comp rx=0 tx=0).stop 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5cf37f640 1 -- 172.21.15.96:0/3297766519 reap_dead start 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 shutdown_connections 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/3297766519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf1adf0 0x55fefdf22320 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 >> 172.21.15.96:0/3297766519 conn(0x55fefdf17220 msgr2=0x55fefdf15430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 shutdown_connections 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/3297766519 wait complete. 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2800434147 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4a803a140 msgr2=0x7fc4a803c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2800434147 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4a803a140 0x7fc4a803c600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800e3f0 tx=0x7fc5c8003070 comp rx=0 tx=0).stop 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2800434147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf0e5b0 msgr2=0x55fefdf0e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2800434147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf0e5b0 0x55fefdf0e9d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0017fe0 tx=0x7fc5c0018170 comp rx=0 tx=0).stop 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2800434147 shutdown_connections 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2800434147 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4a803a140 0x7fc4a803c600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2800434147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefdf0e5b0 0x55fefdf0e9d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2800434147 >> 172.21.15.96:0/2800434147 conn(0x55fefdf03f60 msgr2=0x55fefdf04340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2800434147 shutdown_connections 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2800434147 wait complete. 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefde061b0 msgr2=0x55fefdefdf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefde061b0 0x55fefdefdf50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4b403a1a0 msgr2=0x7fc4b403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4b403a1a0 0x7fc4b403c660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00ad000 tx=0x7fc5c00a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 msgr2=0x55fefdef6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdef6e30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55fefdd78650 tx=0x7fc5b8000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 shutdown_connections 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fefde061b0 0x55fefdefdf50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc4b403a1a0 0x7fc4b403c660 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 --2- 172.21.15.96:0/2200994596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fefde02010 0x55fefdef6e30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 >> 172.21.15.96:0/2200994596 conn(0x55fefddfdb30 msgr2=0x55fefdee8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 shutdown_connections 2024-09-14T10:44:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.344+0000 7fc5d18799c0 1 -- 172.21.15.96:0/2200994596 wait complete. 2024-09-14T10:44:32.351 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1'] 2024-09-14T10:44:32.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1'] 2024-09-14T10:44:32.351 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:32.431 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:32.432 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:32.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee83379c0 1 Processor -- start 2024-09-14T10:44:32.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee83379c0 1 -- start start 2024-09-14T10:44:32.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee83379c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557ce1fe35d0 0x557ce2077750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee83379c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557ce1f177a0 con 0x557ce1fe31f0 2024-09-14T10:44:32.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee83379c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x557ce1f731b0 con 0x557ce1fe35d0 2024-09-14T10:44:32.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee563c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557ce1fe35d0 0x557ce2077750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee563c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x557ce1fe35d0 0x557ce2077750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45408/0 (socket says 172.21.15.96:45408) 2024-09-14T10:44:32.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee563c640 1 -- 172.21.15.96:0/1147460307 learned_addr learned my addr 172.21.15.96:0/1147460307 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee5e3d640 1 --1- 172.21.15.96:0/1147460307 >> v1:172.21.15.70:6789/0 conn(0x557ce1fe31f0 0x557ce2074020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37206/0 (socket says 172.21.15.96:37206) 2024-09-14T10:44:32.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee563c640 1 -- 172.21.15.96:0/1147460307 >> v1:172.21.15.70:6789/0 conn(0x557ce1fe31f0 legacy=0x557ce2074020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.436+0000 7f1ee563c640 1 -- 172.21.15.96:0/1147460307 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce1ef1da0 con 0x557ce1fe35d0 2024-09-14T10:44:32.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee563c640 1 --2- 172.21.15.96:0/1147460307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe35d0 0x557ce2077750 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00a5c0 tx=0x7f1edc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4521f810ddc373c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee4e3b640 1 -- 172.21.15.96:0/1147460307 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1edc0a6070 con 0x557ce1fe35d0 2024-09-14T10:44:32.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee4e3b640 1 -- 172.21.15.96:0/1147460307 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc0af070 con 0x557ce1fe35d0 2024-09-14T10:44:32.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee4e3b640 1 -- 172.21.15.96:0/1147460307 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1edc0aa5c0 con 0x557ce1fe35d0 2024-09-14T10:44:32.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1147460307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe35d0 msgr2=0x557ce2077750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1147460307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe35d0 0x557ce2077750 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00a5c0 tx=0x7f1edc01b340 comp rx=0 tx=0).stop 2024-09-14T10:44:32.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1147460307 shutdown_connections 2024-09-14T10:44:32.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1147460307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe35d0 0x557ce2077750 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1147460307 >> 172.21.15.96:0/1147460307 conn(0x557ce2069910 msgr2=0x557ce206bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1147460307 shutdown_connections 2024-09-14T10:44:32.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.440+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1147460307 wait complete. 2024-09-14T10:44:32.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.452+0000 7f1ee83379c0 1 Processor -- start 2024-09-14T10:44:32.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.452+0000 7f1ee83379c0 1 -- start start 2024-09-14T10:44:32.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.452+0000 7f1ee83379c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce215c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.452+0000 7f1ee83379c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ce1f76fc0 con 0x557ce1fe31f0 2024-09-14T10:44:32.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.452+0000 7f1ee5e3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce215c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.452+0000 7f1ee5e3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce215c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45420/0 (socket says 172.21.15.96:45420) 2024-09-14T10:44:32.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.452+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/3527600326 learned_addr learned my addr 172.21.15.96:0/3527600326 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.452+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/3527600326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce215cca0 con 0x557ce1fe31f0 2024-09-14T10:44:32.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee5e3d640 1 --2- 172.21.15.96:0/3527600326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce215c6b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8001ec0 tx=0x7f1ed800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211ea2243fd579a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1dd3e07640 1 -- 172.21.15.96:0/3527600326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed800e5d0 con 0x557ce1fe31f0 2024-09-14T10:44:32.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1dd3e07640 1 -- 172.21.15.96:0/3527600326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed800e770 con 0x557ce1fe31f0 2024-09-14T10:44:32.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1dd3e07640 1 -- 172.21.15.96:0/3527600326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed800ea70 con 0x557ce1fe31f0 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3527600326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 msgr2=0x557ce215c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/3527600326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce215c6b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8001ec0 tx=0x7f1ed800b6d0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3527600326 shutdown_connections 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/3527600326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce215c6b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3527600326 >> 172.21.15.96:0/3527600326 conn(0x557ce2069910 msgr2=0x557ce21582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3527600326 shutdown_connections 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3527600326 wait complete. 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 Processor -- start 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- start start 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce2163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ce1f18a50 con 0x557ce1fe31f0 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee5e3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce2163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee5e3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce2163fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45426/0 (socket says 172.21.15.96:45426) 2024-09-14T10:44:32.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/2676234044 learned_addr learned my addr 172.21.15.96:0/2676234044 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/2676234044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce2164510 con 0x557ce1fe31f0 2024-09-14T10:44:32.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee5e3d640 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce2163fb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x557ce215d670 tx=0x7f1ed8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1dd2604640 1 -- 172.21.15.96:0/2676234044 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed800f8e0 con 0x557ce1fe31f0 2024-09-14T10:44:32.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ce21647a0 con 0x557ce1fe31f0 2024-09-14T10:44:32.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ce2165150 con 0x557ce1fe31f0 2024-09-14T10:44:32.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1dd2604640 1 -- 172.21.15.96:0/2676234044 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed800fa80 con 0x557ce1fe31f0 2024-09-14T10:44:32.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.456+0000 7f1dd2604640 1 -- 172.21.15.96:0/2676234044 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed802c060 con 0x557ce1fe31f0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1dd2604640 1 -- 172.21.15.96:0/2676234044 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1ed8017070 con 0x557ce1fe31f0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1dd2604640 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dcc03a150 0x7f1dcc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1dd2604640 1 -- 172.21.15.96:0/2676234044 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1ed8015020 con 0x557ce1fe31f0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee563c640 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dcc03a150 0x7f1dcc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce1fe35d0 0x557ce216b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce216b660 con 0x557ce1fe35d0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee663e640 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce1fe35d0 0x557ce216b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee563c640 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dcc03a150 0x7f1dcc03c610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0ae000 tx=0x7f1edc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee663e640 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce1fe35d0 0x557ce216b120 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee663e640 1 -- 172.21.15.96:0/2676234044 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ee000a4d0 con 0x557ce1fe35d0 2024-09-14T10:44:32.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce216bab0 con 0x557ce1fe35d0 2024-09-14T10:44:32.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee663e640 1 -- 172.21.15.96:0/2676234044 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ee000a4d0 con 0x557ce1fe35d0 2024-09-14T10:44:32.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce216d3b0 con 0x557ce1fe35d0 2024-09-14T10:44:32.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee663e640 1 -- 172.21.15.96:0/2676234044 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ee000a4d0 con 0x557ce1fe35d0 2024-09-14T10:44:32.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce216c5e0 con 0x557ce1fe35d0 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee663e640 1 -- 172.21.15.96:0/2676234044 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ee000a4d0 con 0x557ce1fe35d0 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce216ca00 con 0x557ce1fe35d0 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee663e640 1 -- 172.21.15.96:0/2676234044 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ee000a4d0 con 0x557ce1fe35d0 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 Processor -- start 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 -- start start 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce217b780 0x557ce217bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee83379c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ce1f83d80 con 0x557ce217b780 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee563c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce217b780 0x557ce217bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee563c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce217b780 0x557ce217bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45430/0 (socket says 172.21.15.96:45430) 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.460+0000 7f1ee563c640 1 -- 172.21.15.96:0/1759048452 learned_addr learned my addr 172.21.15.96:0/1759048452 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee563c640 1 -- 172.21.15.96:0/1759048452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce217c1e0 con 0x557ce217b780 2024-09-14T10:44:32.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee563c640 1 --2- 172.21.15.96:0/1759048452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce217b780 0x557ce217bba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1edc000c10 tx=0x7f1edc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1dcb7fe640 1 -- 172.21.15.96:0/1759048452 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1edc0b3b90 con 0x557ce217b780 2024-09-14T10:44:32.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1759048452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ce217ca40 con 0x557ce217b780 2024-09-14T10:44:32.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1759048452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ce217cf50 con 0x557ce217b780 2024-09-14T10:44:32.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1dcb7fe640 1 -- 172.21.15.96:0/1759048452 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc0b3d30 con 0x557ce217b780 2024-09-14T10:44:32.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1dcb7fe640 1 -- 172.21.15.96:0/1759048452 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1edc0c8560 con 0x557ce217b780 2024-09-14T10:44:32.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1dcb7fe640 1 -- 172.21.15.96:0/1759048452 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1edc0c8700 con 0x557ce217b780 2024-09-14T10:44:32.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1dcb7fe640 1 --2- 172.21.15.96:0/1759048452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dc003a150 0x7f1dc003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1dcb7fe640 1 -- 172.21.15.96:0/1759048452 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1edc0ee570 con 0x557ce217b780 2024-09-14T10:44:32.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee663e640 1 --2- 172.21.15.96:0/1759048452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dc003a150 0x7f1dc003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee83379c0 1 Processor -- start 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee83379c0 1 -- start start 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee663e640 1 --2- 172.21.15.96:0/1759048452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dc003a150 0x7f1dc003c610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x557ce216c980 tx=0x7f1ee0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee83379c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce2187fc0 0x557ce21883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee83379c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ce215d0d0 con 0x557ce2187fc0 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee563c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce2187fc0 0x557ce21883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee563c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce2187fc0 0x557ce21883a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45436/0 (socket says 172.21.15.96:45436) 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee563c640 1 -- 172.21.15.96:0/3257350653 learned_addr learned my addr 172.21.15.96:0/3257350653 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee563c640 1 -- 172.21.15.96:0/3257350653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce2188970 con 0x557ce2187fc0 2024-09-14T10:44:32.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.464+0000 7f1ee563c640 1 --2- 172.21.15.96:0/3257350653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce2187fc0 0x557ce21883a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0aafb0 tx=0x7f1edc0ee420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f4fd04624c2ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1dc97fa640 1 -- 172.21.15.96:0/3257350653 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1edc0c7e40 con 0x557ce2187fc0 2024-09-14T10:44:32.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1dc97fa640 1 -- 172.21.15.96:0/3257350653 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc0be930 con 0x557ce2187fc0 2024-09-14T10:44:32.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1dc97fa640 1 -- 172.21.15.96:0/3257350653 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1edc0c73d0 con 0x557ce2187fc0 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3257350653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce2187fc0 msgr2=0x557ce21883a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/3257350653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce2187fc0 0x557ce21883a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0aafb0 tx=0x7f1edc0ee420 comp rx=0 tx=0).stop 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3257350653 shutdown_connections 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/3257350653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce2187fc0 0x557ce21883a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3257350653 >> 172.21.15.96:0/3257350653 conn(0x557ce21843f0 msgr2=0x557ce2182630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3257350653 shutdown_connections 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- 172.21.15.96:0/3257350653 wait complete. 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 Processor -- start 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- start start 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce218f670 0x557ce218fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ce2188fd0 con 0x557ce218f670 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee563c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce218f670 0x557ce218fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee563c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce218f670 0x557ce218fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45440/0 (socket says 172.21.15.96:45440) 2024-09-14T10:44:32.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 learned_addr learned my addr 172.21.15.96:0/1229609896 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce218fff0 con 0x557ce218f670 2024-09-14T10:44:32.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee563c640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce218f670 0x557ce218fa90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0bdfd0 tx=0x7f1edc0eb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1db77fe640 1 -- 172.21.15.96:0/1229609896 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1edc0bc3b0 con 0x557ce218f670 2024-09-14T10:44:32.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1db77fe640 1 -- 172.21.15.96:0/1229609896 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc0c7e40 con 0x557ce218f670 2024-09-14T10:44:32.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ce2190280 con 0x557ce218f670 2024-09-14T10:44:32.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1db77fe640 1 -- 172.21.15.96:0/1229609896 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1edc0be540 con 0x557ce218f670 2024-09-14T10:44:32.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.468+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ce2190b90 con 0x557ce218f670 2024-09-14T10:44:32.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1db77fe640 1 -- 172.21.15.96:0/1229609896 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1edc0f5060 con 0x557ce218f670 2024-09-14T10:44:32.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1db77fe640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1db003a1a0 0x7f1db003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1db77fe640 1 -- 172.21.15.96:0/1229609896 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1edc0d6070 con 0x557ce218f670 2024-09-14T10:44:32.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee663e640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1db003a1a0 0x7f1db003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce219b090 0x557ce219d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce219dc70 con 0x557ce219b090 2024-09-14T10:44:32.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee5e3d640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce219b090 0x557ce219d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee663e640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1db003a1a0 0x7f1db003c660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x557ce216c100 tx=0x7f1ee001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee5e3d640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce219b090 0x557ce219d520 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 realm 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce219e080 con 0x557ce219b090 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce219e950 con 0x557ce219b090 2024-09-14T10:44:32.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce219ecf0 con 0x557ce219b090 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce219f540 con 0x557ce219b090 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 20 searching for the correct realm 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557ce21a12b0 0x557ce21a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee563c640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557ce21a12b0 0x557ce21a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee563c640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557ce21a12b0 0x557ce21a36a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee563c640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1edc0f7070 0x7f1edc0d9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1edc0f7070 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee663e640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1edc0f7070 0x7f1edc0d9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.472+0000 7f1ee663e640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1edc0f7070 0x7f1edc0d9830 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee001f070 con 0x7f1edc0f7070 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee663e640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1ee0031040 0x7f1ee0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1ee0031040 0x7f1ee0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1ee0031040 0x7f1ee0032940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce219b090 2024-09-14T10:44:32.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce219b090 2024-09-14T10:44:32.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1edc0f7070 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee001f070 con 0x7f1edc0f7070 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce219b090 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.476+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce219b090 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1edc0f7070 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ee001f070 con 0x7f1edc0f7070 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce219b090 2024-09-14T10:44:32.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce219b090 2024-09-14T10:44:32.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.480+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1edc0f7070 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee001f070 con 0x7f1edc0f7070 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce219b090 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1edc0f7070 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee001f070 con 0x7f1edc0f7070 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce21a12b0 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1ee0031040 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x557ce219b090 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a3c80 con 0x7f1edc0f7070 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ee001f070 con 0x7f1edc0f7070 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:32.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce219fec0 con 0x557ce219b090 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.484+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a0760 con 0x557ce219b090 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a4100 con 0x557ce219b090 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 zone default found 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 4 Realm: () 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 zonegroup default 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a4100 con 0x7f1ee0031040 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a5f10 con 0x557ce21a12b0 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a6430 con 0x557ce21a12b0 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 started sync module instance, tier type = 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a53b0 con 0x7f1edc0f7070 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93994857682848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a5010 con 0x7f1edc0f7070 2024-09-14T10:44:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a7360 con 0x557ce219b090 2024-09-14T10:44:32.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.488+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93994857682848] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93994857687184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a7360 con 0x557ce219b090 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a7d20 con 0x557ce21a12b0 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93994857687184] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93994857688752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a72d0 con 0x557ce21a12b0 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a8a20 con 0x7f1edc0f7070 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93994857694880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a92c0 con 0x7f1edc0f7070 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.492+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a9cc0 con 0x557ce219b090 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93994857688752] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93994857694880] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93994857693376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a8e10 con 0x557ce219b090 2024-09-14T10:44:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21aa560 con 0x7f1ee0031040 2024-09-14T10:44:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93994857701024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21aa770 con 0x7f1ee0031040 2024-09-14T10:44:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21aafc0 con 0x7f1ee0031040 2024-09-14T10:44:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.496+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93994857693376] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93994857701024] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93994857702080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21aab90 con 0x7f1ee0031040 2024-09-14T10:44:32.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21ab3e0 con 0x7f1ee0031040 2024-09-14T10:44:32.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93994857704816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21ab7a0 con 0x7f1ee0031040 2024-09-14T10:44:32.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 20 add_watcher() i=0 2024-09-14T10:44:32.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 20 add_watcher() i=1 2024-09-14T10:44:32.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 20 add_watcher() i=2 2024-09-14T10:44:32.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 20 add_watcher() i=3 2024-09-14T10:44:32.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 20 add_watcher() i=4 2024-09-14T10:44:32.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.500+0000 7f1ee83379c0 20 add_watcher() i=5 2024-09-14T10:44:32.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93994857702080] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 add_watcher() i=6 2024-09-14T10:44:32.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93994857704816] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 add_watcher() i=7 2024-09-14T10:44:32.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:32.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21aa6e0 con 0x557ce219b090 2024-09-14T10:44:32.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93994857703136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21abcf0 con 0x557ce219b090 2024-09-14T10:44:32.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93994857703136] v32'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1d977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 5 note: GC not initialized 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1d967fc640 20 reqs_thread_entry: start 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 Filter name: none 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1d07fff640 20 reqs_thread_entry: start 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21d1fc0 con 0x557ce219b090 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.504+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21d40b0 con 0x7f1edc0f7070 2024-09-14T10:44:32.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21d5970 con 0x557ce21a12b0 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:32.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:32.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:32.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-14T10:44:32.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21da040 con 0x7f1ee0031040 2024-09-14T10:44:32.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(65 fud.buckets [call] v32'5 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.508+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21e02f0 con 0x557ce21a12b0 2024-09-14T10:44:32.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:32.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:32.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1, ofs0, ns] 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93994857881648 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21db950 con 0x557ce219b090 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== watch-notify(notify (1) cookie 93994857693376 notify 137438953485 ret 0) ==== 802+0+0 (crc 0 0 0) 0x557ce2165150 con 0x557ce219b090 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1dc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 93994857693376 notifier 4522 bl.length()=760 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1dc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1dc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1dc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1dc97fa640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1da8003eb0 con 0x557ce219b090 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(67 notify.4 [notify cookie 93994857881648 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== watch-notify(notify_complete (2) cookie 93994857881648 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557ce21647a0 con 0x557ce219b090 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_sources= new_sources= 2024-09-14T10:44:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential sources added=[] removed=[] 2024-09-14T10:44:32.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_dests= new_dests= 2024-09-14T10:44:32.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential dests added=[] removed=[] 2024-09-14T10:44:32.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21d6010 con 0x7f1edc0f7070 2024-09-14T10:44:32.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.512+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21d6010 con 0x7f1edc0f7070 2024-09-14T10:44:32.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee83379c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:44:32.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee83379c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:32.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee83379c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:44:32.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93994857881616 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557ce21ddd50 con 0x7f1ee0031040 2024-09-14T10:44:32.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== watch-notify(notify (1) cookie 93994857702080 notify 137438953483 ret 0) ==== 356+0+0 (crc 0 0 0) 0x557ce2164510 con 0x7f1ee0031040 2024-09-14T10:44:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1dc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 93994857702080 notifier 4522 bl.length()=314 2024-09-14T10:44:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1dc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:44:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1dc8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1dc8ff9640 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1d10003410 con 0x7f1ee0031040 2024-09-14T10:44:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.6 [notify cookie 93994857881616 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== watch-notify(notify_complete (2) cookie 93994857881616 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557ce215cca0 con 0x7f1ee0031040 2024-09-14T10:44:32.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1d977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.516+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93994857703136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21cfb90 con 0x557ce219b090 2024-09-14T10:44:32.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.520+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93994857703136] v32'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.520+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93994857682848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21cfb90 con 0x7f1edc0f7070 2024-09-14T10:44:32.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.520+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93994857682848] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.520+0000 7f1ee83379c0 20 remove_watcher() i=0 2024-09-14T10:44:32.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.520+0000 7f1ee83379c0 2 removed watcher, disabling cache 2024-09-14T10:44:32.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.520+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93994857687184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21cfb90 con 0x557ce219b090 2024-09-14T10:44:32.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93994857687184] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee83379c0 20 remove_watcher() i=1 2024-09-14T10:44:32.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93994857688752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a6890 con 0x557ce21a12b0 2024-09-14T10:44:32.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee563c640 1 -- 172.21.15.96:0/1229609896 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93994857688752] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1edc0f7d70 con 0x557ce21a12b0 2024-09-14T10:44:32.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee83379c0 20 remove_watcher() i=2 2024-09-14T10:44:32.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93994857694880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21cfb90 con 0x7f1edc0f7070 2024-09-14T10:44:32.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee663e640 1 -- 172.21.15.96:0/1229609896 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93994857694880] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ee0040040 con 0x7f1edc0f7070 2024-09-14T10:44:32.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee83379c0 20 remove_watcher() i=3 2024-09-14T10:44:32.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.524+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93994857693376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a6eb0 con 0x557ce219b090 2024-09-14T10:44:32.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.528+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93994857693376] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x557ce219b090 2024-09-14T10:44:32.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.528+0000 7f1ee83379c0 20 remove_watcher() i=4 2024-09-14T10:44:32.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.528+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93994857701024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a86a0 con 0x7f1ee0031040 2024-09-14T10:44:32.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.528+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93994857701024] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.528+0000 7f1ee83379c0 20 remove_watcher() i=5 2024-09-14T10:44:32.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.528+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93994857702080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21cfb90 con 0x7f1ee0031040 2024-09-14T10:44:32.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93994857702080] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 20 remove_watcher() i=6 2024-09-14T10:44:32.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93994857704816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557ce21a80c0 con 0x7f1ee0031040 2024-09-14T10:44:32.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93994857704816] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ed802e070 con 0x7f1ee0031040 2024-09-14T10:44:32.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 20 remove_watcher() i=7 2024-09-14T10:44:32.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1ee0031040 msgr2=0x7f1ee0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1ee0031040 0x7f1ee0032940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce219b090 msgr2=0x557ce219d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce219b090 0x557ce219d520 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1edc0f7070 msgr2=0x7f1edc0d9830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1edc0f7070 0x7f1edc0d9830 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557ce21a12b0 msgr2=0x557ce21a36a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557ce21a12b0 0x557ce21a36a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1db003a1a0 msgr2=0x7f1db003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1db003a1a0 0x7f1db003c660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x557ce216c100 tx=0x7f1ee001f000 comp rx=0 tx=0).stop 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce218f670 msgr2=0x557ce218fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1229609896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce218f670 0x557ce218fa90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0bdfd0 tx=0x7f1edc0eb000 comp rx=0 tx=0).stop 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee5e3d640 1 -- 172.21.15.96:0/1229609896 reap_dead start 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 shutdown_connections 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 >> 172.21.15.96:0/1229609896 conn(0x557ce21843f0 msgr2=0x557ce2182600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 shutdown_connections 2024-09-14T10:44:32.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1229609896 wait complete. 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1759048452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dc003a150 msgr2=0x7f1dc003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1759048452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dc003a150 0x7f1dc003c610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x557ce216c980 tx=0x7f1ee0005850 comp rx=0 tx=0).stop 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1759048452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce217b780 msgr2=0x557ce217bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1759048452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce217b780 0x557ce217bba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1edc000c10 tx=0x7f1edc0180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1759048452 shutdown_connections 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1759048452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dc003a150 0x7f1dc003c610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/1759048452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce217b780 0x557ce217bba0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1759048452 >> 172.21.15.96:0/1759048452 conn(0x557ce2171150 msgr2=0x557ce2171530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1759048452 shutdown_connections 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.532+0000 7f1ee83379c0 1 -- 172.21.15.96:0/1759048452 wait complete. 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce1fe35d0 msgr2=0x557ce216b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce1fe35d0 0x557ce216b120 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dcc03a150 msgr2=0x7f1dcc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dcc03a150 0x7f1dcc03c610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0ae000 tx=0x7f1edc0a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 msgr2=0x557ce2163fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce2163fb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x557ce215d670 tx=0x7f1ed8000bd0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 shutdown_connections 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557ce1fe35d0 0x557ce216b120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1dcc03a150 0x7f1dcc03c610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 --2- 172.21.15.96:0/2676234044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce1fe31f0 0x557ce2163fb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 >> 172.21.15.96:0/2676234044 conn(0x557ce2069910 msgr2=0x557ce215db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 shutdown_connections 2024-09-14T10:44:32.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.536+0000 7f1ee83379c0 1 -- 172.21.15.96:0/2676234044 wait complete. 2024-09-14T10:44:32.541 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-14T10:44:32.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-14T10:44:32.541 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-14T10:44:32.612 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:32.613 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:32.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e81d749c0 1 Processor -- start 2024-09-14T10:44:32.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e81d749c0 1 -- start start 2024-09-14T10:44:32.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e81d749c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558b71030250 0x558b710bec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e81d749c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b70f647a0 con 0x558b710bf1c0 2024-09-14T10:44:32.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e81d749c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x558b70fc01b0 con 0x558b71030250 2024-09-14T10:44:32.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e7f87a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558b71030250 0x558b710bec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e7f87a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x558b71030250 0x558b710bec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45448/0 (socket says 172.21.15.96:45448) 2024-09-14T10:44:32.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e7f87a640 1 -- 172.21.15.96:0/4023685348 learned_addr learned my addr 172.21.15.96:0/4023685348 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e7f079640 1 --1- 172.21.15.96:0/4023685348 >> v1:172.21.15.70:6789/0 conn(0x558b710bf1c0 0x558b710c15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37214/0 (socket says 172.21.15.96:37214) 2024-09-14T10:44:32.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e7f87a640 1 -- 172.21.15.96:0/4023685348 >> v1:172.21.15.70:6789/0 conn(0x558b710bf1c0 legacy=0x558b710c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.616+0000 7f0e7f87a640 1 -- 172.21.15.96:0/4023685348 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b70f3eda0 con 0x558b71030250 2024-09-14T10:44:32.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e7f87a640 1 --2- 172.21.15.96:0/4023685348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b710bec80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800a4e0 tx=0x7f0e7801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646e2ca768b40c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e7e878640 1 -- 172.21.15.96:0/4023685348 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e780aa540 con 0x558b71030250 2024-09-14T10:44:32.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e7e878640 1 -- 172.21.15.96:0/4023685348 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e780aa6e0 con 0x558b71030250 2024-09-14T10:44:32.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e7e878640 1 -- 172.21.15.96:0/4023685348 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e780aaa40 con 0x558b71030250 2024-09-14T10:44:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4023685348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 msgr2=0x558b710bec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/4023685348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b710bec80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800a4e0 tx=0x7f0e7801b090 comp rx=0 tx=0).stop 2024-09-14T10:44:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4023685348 shutdown_connections 2024-09-14T10:44:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/4023685348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b710bec80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4023685348 >> 172.21.15.96:0/4023685348 conn(0x558b710b6970 msgr2=0x558b710b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4023685348 shutdown_connections 2024-09-14T10:44:32.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.620+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4023685348 wait complete. 2024-09-14T10:44:32.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.632+0000 7f0e81d749c0 1 Processor -- start 2024-09-14T10:44:32.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.632+0000 7f0e81d749c0 1 -- start start 2024-09-14T10:44:32.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.632+0000 7f0e81d749c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b711a7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.632+0000 7f0e81d749c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558b70fc3fc0 con 0x558b71030250 2024-09-14T10:44:32.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.632+0000 7f0e7f87a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b711a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.632+0000 7f0e7f87a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b711a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45462/0 (socket says 172.21.15.96:45462) 2024-09-14T10:44:32.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.632+0000 7f0e7f87a640 1 -- 172.21.15.96:0/1012497777 learned_addr learned my addr 172.21.15.96:0/1012497777 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e7f87a640 1 -- 172.21.15.96:0/1012497777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b711a7a30 con 0x558b71030250 2024-09-14T10:44:32.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e7f87a640 1 --2- 172.21.15.96:0/1012497777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b711a7440 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0e78019740 tx=0x7f0e780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cb3305a9db54ad server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0d6de0b640 1 -- 172.21.15.96:0/1012497777 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e780b9070 con 0x558b71030250 2024-09-14T10:44:32.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0d6de0b640 1 -- 172.21.15.96:0/1012497777 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e780aaa90 con 0x558b71030250 2024-09-14T10:44:32.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0d6de0b640 1 -- 172.21.15.96:0/1012497777 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e780aad70 con 0x558b71030250 2024-09-14T10:44:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1012497777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 msgr2=0x558b711a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1012497777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b711a7440 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0e78019740 tx=0x7f0e780033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1012497777 shutdown_connections 2024-09-14T10:44:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1012497777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b71030250 0x558b711a7440 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1012497777 >> 172.21.15.96:0/1012497777 conn(0x558b710b6970 msgr2=0x558b711a3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1012497777 shutdown_connections 2024-09-14T10:44:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1012497777 wait complete. 2024-09-14T10:44:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 Processor -- start 2024-09-14T10:44:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- start start 2024-09-14T10:44:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b710bf1c0 0x558b711aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558b70f65a50 con 0x558b710bf1c0 2024-09-14T10:44:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e7f87a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b710bf1c0 0x558b711aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e7f87a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b710bf1c0 0x558b711aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45476/0 (socket says 172.21.15.96:45476) 2024-09-14T10:44:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e7f87a640 1 -- 172.21.15.96:0/1075093160 learned_addr learned my addr 172.21.15.96:0/1075093160 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e7f87a640 1 -- 172.21.15.96:0/1075093160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b711af2b0 con 0x558b710bf1c0 2024-09-14T10:44:32.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e7f87a640 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b710bf1c0 0x558b711aed50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0e78018cc0 tx=0x7f0e78017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0d67fff640 1 -- 172.21.15.96:0/1075093160 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e780b9070 con 0x558b710bf1c0 2024-09-14T10:44:32.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b711af540 con 0x558b710bf1c0 2024-09-14T10:44:32.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0d67fff640 1 -- 172.21.15.96:0/1075093160 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e780b6a90 con 0x558b710bf1c0 2024-09-14T10:44:32.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0d67fff640 1 -- 172.21.15.96:0/1075093160 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e780b6d70 con 0x558b710bf1c0 2024-09-14T10:44:32.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.636+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b711afef0 con 0x558b710bf1c0 2024-09-14T10:44:32.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0d67fff640 1 -- 172.21.15.96:0/1075093160 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0e780b3040 con 0x558b710bf1c0 2024-09-14T10:44:32.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0d67fff640 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d6803a150 0x7f0d6803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0d67fff640 1 -- 172.21.15.96:0/1075093160 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0e780c3070 con 0x558b710bf1c0 2024-09-14T10:44:32.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e7f079640 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d6803a150 0x7f0d6803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711b3eb0 0x558b711b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711b67e0 con 0x558b711b3eb0 2024-09-14T10:44:32.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e8007b640 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711b3eb0 0x558b711b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e7f079640 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d6803a150 0x7f0d6803c610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e68001e90 tx=0x7f0e680013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e8007b640 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711b3eb0 0x558b711b62a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e8007b640 1 -- 172.21.15.96:0/1075093160 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e700083f0 con 0x558b711b3eb0 2024-09-14T10:44:32.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711b6c30 con 0x558b711b3eb0 2024-09-14T10:44:32.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e8007b640 1 -- 172.21.15.96:0/1075093160 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e700083f0 con 0x558b711b3eb0 2024-09-14T10:44:32.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711b8530 con 0x558b711b3eb0 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e8007b640 1 -- 172.21.15.96:0/1075093160 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0e700083f0 con 0x558b711b3eb0 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711b7760 con 0x558b711b3eb0 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e8007b640 1 -- 172.21.15.96:0/1075093160 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e700083f0 con 0x558b711b3eb0 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711b7b80 con 0x558b711b3eb0 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e8007b640 1 -- 172.21.15.96:0/1075093160 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0e700083f0 con 0x558b711b3eb0 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 Processor -- start 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 -- start start 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711c6920 0x558b711c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e81d749c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558b70fd0d80 con 0x558b711c6920 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.640+0000 7f0e7f079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711c6920 0x558b711c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e7f079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711c6920 0x558b711c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45484/0 (socket says 172.21.15.96:45484) 2024-09-14T10:44:32.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e7f079640 1 -- 172.21.15.96:0/4236989315 learned_addr learned my addr 172.21.15.96:0/4236989315 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e7f079640 1 -- 172.21.15.96:0/4236989315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b711c7380 con 0x558b711c6920 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e7f079640 1 --2- 172.21.15.96:0/4236989315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711c6920 0x558b711c6d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800e670 tx=0x7f0e6800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0d657fa640 1 -- 172.21.15.96:0/4236989315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e68022070 con 0x558b711c6920 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4236989315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b711c7be0 con 0x558b711c6920 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4236989315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b711c8150 con 0x558b711c6920 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0d657fa640 1 -- 172.21.15.96:0/4236989315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6800d660 con 0x558b711c6920 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0d657fa640 1 -- 172.21.15.96:0/4236989315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e6802c060 con 0x558b711c6920 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0d657fa640 1 -- 172.21.15.96:0/4236989315 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0e68025070 con 0x558b711c6920 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0d657fa640 1 --2- 172.21.15.96:0/4236989315 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d5803a150 0x7f0d5803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0d657fa640 1 -- 172.21.15.96:0/4236989315 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0e680524a0 con 0x558b711c6920 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e8007b640 1 --2- 172.21.15.96:0/4236989315 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d5803a150 0x7f0d5803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e81d749c0 1 Processor -- start 2024-09-14T10:44:32.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e81d749c0 1 -- start start 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e8007b640 1 --2- 172.21.15.96:0/4236989315 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d5803a150 0x7f0d5803c610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x558b711b7b00 tx=0x7f0e70003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e81d749c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711d4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e81d749c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558b711a7da0 con 0x558b711d4250 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e7f079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711d4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e7f079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711d4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45498/0 (socket says 172.21.15.96:45498) 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e7f079640 1 -- 172.21.15.96:0/3167681929 learned_addr learned my addr 172.21.15.96:0/3167681929 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.644+0000 7f0e7f079640 1 -- 172.21.15.96:0/3167681929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b711d4c40 con 0x558b711d4250 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e7f079640 1 --2- 172.21.15.96:0/3167681929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711d4650 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0e68050890 tx=0x7f0e68008f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95acc8f2aefad5d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0d5effd640 1 -- 172.21.15.96:0/3167681929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e6800dcc0 con 0x558b711d4250 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0d5effd640 1 -- 172.21.15.96:0/3167681929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6801bca0 con 0x558b711d4250 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0d5effd640 1 -- 172.21.15.96:0/3167681929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e6800de60 con 0x558b711d4250 2024-09-14T10:44:32.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- 172.21.15.96:0/3167681929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 msgr2=0x558b711d4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/3167681929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711d4650 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0e68050890 tx=0x7f0e68008f80 comp rx=0 tx=0).stop 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- 172.21.15.96:0/3167681929 shutdown_connections 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/3167681929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711d4650 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- 172.21.15.96:0/3167681929 >> 172.21.15.96:0/3167681929 conn(0x558b711cf670 msgr2=0x558b711cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- 172.21.15.96:0/3167681929 shutdown_connections 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- 172.21.15.96:0/3167681929 wait complete. 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 Processor -- start 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- start start 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711da760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558b711d31a0 con 0x558b711d4250 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e7f079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e7f079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711da760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45512/0 (socket says 172.21.15.96:45512) 2024-09-14T10:44:32.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 learned_addr learned my addr 172.21.15.96:0/37314994 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b711dacc0 con 0x558b711d4250 2024-09-14T10:44:32.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e7f079640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711da760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0e68050890 tx=0x7f0e68050820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0d5d7fa640 1 -- 172.21.15.96:0/37314994 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e68036070 con 0x558b711d4250 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b711daf50 con 0x558b711d4250 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0d5d7fa640 1 -- 172.21.15.96:0/37314994 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e6804f2d0 con 0x558b711d4250 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b711daf50 con 0x558b711d4250 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0d5d7fa640 1 -- 172.21.15.96:0/37314994 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e68025a70 con 0x558b711d4250 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.648+0000 7f0d5d7fa640 1 -- 172.21.15.96:0/37314994 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0e68025c10 con 0x558b711d4250 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0d5d7fa640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d4803a150 0x7f0d4803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0d5d7fa640 1 -- 172.21.15.96:0/37314994 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0e6803bc50 con 0x558b711d4250 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e8007b640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d4803a150 0x7f0d4803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711e5ba0 0x558b711e8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711e8780 con 0x558b711e5ba0 2024-09-14T10:44:32.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f87a640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711e5ba0 0x558b711e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e8007b640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d4803a150 0x7f0d4803c610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000f010 tx=0x7f0e7001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f87a640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711e5ba0 0x558b711e8030 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 realm 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711e8b90 con 0x558b711e5ba0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711e9460 con 0x558b711e5ba0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711e9800 con 0x558b711e5ba0 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711ea050 con 0x558b711e5ba0 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 20 searching for the correct realm 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558b711ebdc0 0x558b711ee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b711ee740 con 0x558b711ebdc0 2024-09-14T10:44:32.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f079640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558b711ebdc0 0x558b711ee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f079640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558b711ebdc0 0x558b711ee1b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f079640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0e68027060 0x7f0e6801d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b711ee740 con 0x7f0e68027060 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e8007b640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0e68027060 0x7f0e6801d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e8007b640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0e68027060 0x7f0e6801d230 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e8007b640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0e70019040 0x7f0e70019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b711ee740 con 0x7f0e70019040 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.652+0000 7f0e7f87a640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0e70019040 0x7f0e70019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0e70019040 0x7f0e70019930 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b711ee740 con 0x558b711e5ba0 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b711ee740 con 0x558b711e5ba0 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b711ee740 con 0x7f0e70019040 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558b711ee740 con 0x7f0e70019040 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e68027060 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711ebdc0 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711e5ba0 2024-09-14T10:44:32.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.656+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e70019040 2024-09-14T10:44:32.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711e5ba0 2024-09-14T10:44:32.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e68027060 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711ebdc0 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711ebdc0 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e70019040 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711ebdc0 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711ebdc0 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711e5ba0 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711e5ba0 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e70019040 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711ebdc0 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.660+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e68027060 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711e5ba0 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e70019040 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711ebdc0 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e70019040 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e68027060 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711ebdc0 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e70019040 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x558b711e5ba0 2024-09-14T10:44:32.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0e780e7040 con 0x7f0e68027060 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711ea8a0 con 0x558b711e5ba0 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.664+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711eac90 con 0x558b711e5ba0 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711eac90 con 0x558b711e5ba0 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 zone default found 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 4 Realm: () 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:32.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 zonegroup default 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711eb1b0 con 0x7f0e70019040 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711f0590 con 0x558b711ebdc0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711f0930 con 0x558b711ebdc0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 started sync module instance, tier type = 2024-09-14T10:44:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711efa30 con 0x7f0e68027060 2024-09-14T10:44:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94057386669440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f0cd0 con 0x7f0e68027060 2024-09-14T10:44:32.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.668+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f1690 con 0x558b711e5ba0 2024-09-14T10:44:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.672+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94057386669440] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.672+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.672+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94057386671712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f1690 con 0x558b711e5ba0 2024-09-14T10:44:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.672+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f20a0 con 0x558b711ebdc0 2024-09-14T10:44:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.672+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94057386671712] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.672+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.672+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94057386676704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f1600 con 0x558b711ebdc0 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.672+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f2da0 con 0x7f0e68027060 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.676+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.676+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94057386682944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f3640 con 0x7f0e68027060 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.676+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f4080 con 0x558b711e5ba0 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.676+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94057386676704] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.676+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94057386682944] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.676+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.676+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94057386687312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f3190 con 0x558b711e5ba0 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.676+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f4920 con 0x7f0e70019040 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.680+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94057386687312] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.680+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.680+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94057386681408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f3190 con 0x7f0e70019040 2024-09-14T10:44:32.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.680+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f4db0 con 0x7f0e70019040 2024-09-14T10:44:32.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.680+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94057386681408] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.680+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.680+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94057386690720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f4d70 con 0x7f0e70019040 2024-09-14T10:44:32.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.680+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f57d0 con 0x7f0e70019040 2024-09-14T10:44:32.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94057386690720] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94057386693248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f5790 con 0x7f0e70019040 2024-09-14T10:44:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 20 add_watcher() i=0 2024-09-14T10:44:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 20 add_watcher() i=1 2024-09-14T10:44:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 20 add_watcher() i=2 2024-09-14T10:44:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 20 add_watcher() i=3 2024-09-14T10:44:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 20 add_watcher() i=4 2024-09-14T10:44:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 20 add_watcher() i=5 2024-09-14T10:44:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 20 add_watcher() i=6 2024-09-14T10:44:32.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94057386693248] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 20 add_watcher() i=7 2024-09-14T10:44:32.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:32.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b711f8bc0 con 0x558b711e5ba0 2024-09-14T10:44:32.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.684+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94057386689072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f6110 con 0x558b711e5ba0 2024-09-14T10:44:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94057386689072] v32'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0d35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0e81d749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0e81d749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712016a0 con 0x558b711e5ba0 2024-09-14T10:44:32.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71201c90 con 0x7f0e70019040 2024-09-14T10:44:32.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.688+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71201c00 con 0x558b711ebdc0 2024-09-14T10:44:32.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.692+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.692+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71201fa0 con 0x558b711e5ba0 2024-09-14T10:44:32.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.692+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'122 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.692+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71201fa0 con 0x7f0e68027060 2024-09-14T10:44:32.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.692+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.692+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71202510 con 0x558b711ebdc0 2024-09-14T10:44:32.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.696+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.696+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71202940 con 0x558b711e5ba0 2024-09-14T10:44:32.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.696+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.696+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712029d0 con 0x7f0e70019040 2024-09-14T10:44:32.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.700+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.700+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712029d0 con 0x7f0e68027060 2024-09-14T10:44:32.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.700+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.700+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71202f40 con 0x558b711ebdc0 2024-09-14T10:44:32.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.700+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.700+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71202fd0 con 0x7f0e68027060 2024-09-14T10:44:32.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.704+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.704+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203540 con 0x7f0e70019040 2024-09-14T10:44:32.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.704+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.704+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203540 con 0x7f0e68027060 2024-09-14T10:44:32.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.708+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.708+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203780 con 0x7f0e70019040 2024-09-14T10:44:32.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.708+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.708+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203760 con 0x558b711e5ba0 2024-09-14T10:44:32.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.712+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.712+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203700 con 0x558b711ebdc0 2024-09-14T10:44:32.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.712+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.712+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203700 con 0x7f0e68027060 2024-09-14T10:44:32.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.712+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.712+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203700 con 0x558b711ebdc0 2024-09-14T10:44:32.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.716+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.716+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203700 con 0x558b711e5ba0 2024-09-14T10:44:32.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.716+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.716+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203670 con 0x558b711e5ba0 2024-09-14T10:44:32.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.720+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.720+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203670 con 0x558b711ebdc0 2024-09-14T10:44:32.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.720+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.720+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203670 con 0x7f0e68027060 2024-09-14T10:44:32.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.720+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.720+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712037a0 con 0x558b711ebdc0 2024-09-14T10:44:32.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.724+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.724+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712037a0 con 0x558b711ebdc0 2024-09-14T10:44:32.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.724+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.724+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712037e0 con 0x558b711ebdc0 2024-09-14T10:44:32.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.728+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.728+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712037e0 con 0x558b711ebdc0 2024-09-14T10:44:32.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.728+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.728+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203820 con 0x7f0e70019040 2024-09-14T10:44:32.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.728+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.728+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203860 con 0x558b711ebdc0 2024-09-14T10:44:32.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.732+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.732+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203970 con 0x7f0e70019040 2024-09-14T10:44:32.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.732+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.732+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b71203970 con 0x558b711ebdc0 2024-09-14T10:44:32.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.736+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.736+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712031c0 con 0x7f0e70019040 2024-09-14T10:44:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.736+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.736+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712031c0 con 0x7f0e68027060 2024-09-14T10:44:32.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0d34fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 20 Filter name: none 2024-09-14T10:44:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0cae7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:44:32.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b71200e80 con 0x7f0e70019040 2024-09-14T10:44:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:44:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:44:32.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:44:32.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:32.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.740+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b71221450 con 0x7f0e70019040 2024-09-14T10:44:32.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv4 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e81d749c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-14T10:44:32.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b7121f430 con 0x7f0e70019040 2024-09-14T10:44:32.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e81d749c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:44:32.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94057386868624 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b71221870 con 0x558b711ebdc0 2024-09-14T10:44:32.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== watch-notify(notify (1) cookie 94057386676704 notify 137438953475 ret 0) ==== 212+0+0 (crc 0 0 0) 0x558b71202a20 con 0x558b711ebdc0 2024-09-14T10:44:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0d5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94057386676704 notifier 4529 bl.length()=170 2024-09-14T10:44:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0d5effd640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0d44003d70 con 0x558b711ebdc0 2024-09-14T10:44:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(97 notify.2 [notify cookie 94057386868624 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== watch-notify(notify_complete (2) cookie 94057386868624 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558b711d4c40 con 0x558b711ebdc0 2024-09-14T10:44:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e81d749c0 10 removing email index: 2024-09-14T10:44:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e81d749c0 10 removing user buckets index 2024-09-14T10:44:32.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.744+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b7121f430 con 0x7f0e70019040 2024-09-14T10:44:32.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.748+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(99 fud.buckets [delete] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.748+0000 7f0e81d749c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-14T10:44:32.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.748+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94057386868624 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b71221870 con 0x7f0e70019040 2024-09-14T10:44:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.748+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== watch-notify(notify (1) cookie 94057386690720 notify 137438953484 ret 0) ==== 202+0+0 (crc 0 0 0) 0x558b71202f40 con 0x7f0e70019040 2024-09-14T10:44:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.748+0000 7f0d5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94057386690720 notifier 4529 bl.length()=160 2024-09-14T10:44:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.748+0000 7f0d5e7fc640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0cb40032d0 con 0x7f0e70019040 2024-09-14T10:44:32.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.748+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(100 notify.6 [notify cookie 94057386868624 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.748+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== watch-notify(notify_complete (2) cookie 94057386868624 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0e780d6040 con 0x7f0e70019040 2024-09-14T10:44:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e81d749c0 10 removing user index: fud 2024-09-14T10:44:32.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b712235d0 con 0x7f0e70019040 2024-09-14T10:44:32.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e81d749c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-14T10:44:32.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e81d749c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-14T10:44:32.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94057386864512 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558b71220860 con 0x7f0e70019040 2024-09-14T10:44:32.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== watch-notify(notify (1) cookie 94057386681408 notify 137438953485 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f0e780d6040 con 0x7f0e70019040 2024-09-14T10:44:32.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0d5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94057386681408 notifier 4529 bl.length()=152 2024-09-14T10:44:32.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0d5effd640 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0d44003d70 con 0x7f0e70019040 2024-09-14T10:44:32.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== osd_op_reply(103 notify.5 [notify cookie 94057386864512 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.752+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== watch-notify(notify_complete (2) cookie 94057386864512 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558b711afef0 con 0x7f0e70019040 2024-09-14T10:44:32.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.756+0000 7f0d35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.756+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94057386689072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711fecd0 con 0x558b711e5ba0 2024-09-14T10:44:32.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.756+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94057386689072] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.756+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94057386669440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f4230 con 0x7f0e68027060 2024-09-14T10:44:32.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.756+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94057386669440] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.756+0000 7f0e81d749c0 20 remove_watcher() i=0 2024-09-14T10:44:32.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.756+0000 7f0e81d749c0 2 removed watcher, disabling cache 2024-09-14T10:44:32.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.756+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94057386671712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711ef580 con 0x558b711e5ba0 2024-09-14T10:44:32.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.760+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94057386671712] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.760+0000 7f0e81d749c0 20 remove_watcher() i=1 2024-09-14T10:44:32.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.760+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94057386676704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711ef580 con 0x558b711ebdc0 2024-09-14T10:44:32.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.760+0000 7f0e7f079640 1 -- 172.21.15.96:0/37314994 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94057386676704] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e68024030 con 0x558b711ebdc0 2024-09-14T10:44:32.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.760+0000 7f0e81d749c0 20 remove_watcher() i=2 2024-09-14T10:44:32.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.760+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94057386682944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711ef580 con 0x7f0e68027060 2024-09-14T10:44:32.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.764+0000 7f0e8007b640 1 -- 172.21.15.96:0/37314994 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94057386682944] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e7002f040 con 0x7f0e68027060 2024-09-14T10:44:32.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.764+0000 7f0e81d749c0 20 remove_watcher() i=3 2024-09-14T10:44:32.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.764+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94057386687312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711ef580 con 0x558b711e5ba0 2024-09-14T10:44:32.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.764+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94057386687312] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x558b711e5ba0 2024-09-14T10:44:32.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.764+0000 7f0e81d749c0 20 remove_watcher() i=4 2024-09-14T10:44:32.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.764+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94057386681408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f3b50 con 0x7f0e70019040 2024-09-14T10:44:32.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.768+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94057386681408] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.768+0000 7f0e81d749c0 20 remove_watcher() i=5 2024-09-14T10:44:32.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.768+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94057386690720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711ef580 con 0x7f0e70019040 2024-09-14T10:44:32.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.768+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94057386690720] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.768+0000 7f0e81d749c0 20 remove_watcher() i=6 2024-09-14T10:44:32.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.768+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94057386693248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b711f3b50 con 0x7f0e70019040 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94057386693248] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e780c63d0 con 0x7f0e70019040 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 20 remove_watcher() i=7 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0e70019040 msgr2=0x7f0e70019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0e70019040 0x7f0e70019930 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711e5ba0 msgr2=0x558b711e8030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711e5ba0 0x558b711e8030 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0e68027060 msgr2=0x7f0e6801d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0e68027060 0x7f0e6801d230 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558b711ebdc0 msgr2=0x558b711ee1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x558b711ebdc0 0x558b711ee1b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d4803a150 msgr2=0x7f0d4803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d4803a150 0x7f0d4803c610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000f010 tx=0x7f0e7001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 msgr2=0x558b711da760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/37314994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711d4250 0x558b711da760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0e68050890 tx=0x7f0e68050820 comp rx=0 tx=0).stop 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e7f87a640 1 -- 172.21.15.96:0/37314994 reap_dead start 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 shutdown_connections 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 >> 172.21.15.96:0/37314994 conn(0x558b711cf670 msgr2=0x558b711cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 shutdown_connections 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/37314994 wait complete. 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4236989315 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d5803a150 msgr2=0x7f0d5803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/4236989315 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d5803a150 0x7f0d5803c610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x558b711b7b00 tx=0x7f0e70003070 comp rx=0 tx=0).stop 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4236989315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711c6920 msgr2=0x558b711c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/4236989315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711c6920 0x558b711c6d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800e670 tx=0x7f0e6800ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4236989315 shutdown_connections 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/4236989315 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d5803a150 0x7f0d5803c610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/4236989315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b711c6920 0x558b711c6d40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4236989315 >> 172.21.15.96:0/4236989315 conn(0x558b711bc2d0 msgr2=0x558b711bc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4236989315 shutdown_connections 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/4236989315 wait complete. 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711b3eb0 msgr2=0x558b711b62a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711b3eb0 0x558b711b62a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d6803a150 msgr2=0x7f0d6803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d6803a150 0x7f0d6803c610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e68001e90 tx=0x7f0e680013f0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b710bf1c0 msgr2=0x558b711aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b710bf1c0 0x558b711aed50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0e78018cc0 tx=0x7f0e78017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:32.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 shutdown_connections 2024-09-14T10:44:32.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x558b711b3eb0 0x558b711b62a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0d6803a150 0x7f0d6803c610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 --2- 172.21.15.96:0/1075093160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b710bf1c0 0x558b711aed50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 >> 172.21.15.96:0/1075093160 conn(0x558b710b6970 msgr2=0x558b711a87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 shutdown_connections 2024-09-14T10:44:32.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.772+0000 7f0e81d749c0 1 -- 172.21.15.96:0/1075093160 wait complete. 2024-09-14T10:44:32.780 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-14T10:44:32.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-14T10:44:32.780 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-14T10:44:32.869 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:32.869 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:32.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45f4929c0 1 Processor -- start 2024-09-14T10:44:32.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45f4929c0 1 -- start start 2024-09-14T10:44:32.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45f4929c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5574adaa4fe0 0x5574adaa73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45f4929c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5574ad94a7a0 con 0x5574adaa0df0 2024-09-14T10:44:32.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45f4929c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5574ad9a61b0 con 0x5574adaa4fe0 2024-09-14T10:44:32.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45c797640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5574adaa4fe0 0x5574adaa73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45c797640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5574adaa4fe0 0x5574adaa73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45524/0 (socket says 172.21.15.96:45524) 2024-09-14T10:44:32.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45c797640 1 -- 172.21.15.96:0/4111853175 learned_addr learned my addr 172.21.15.96:0/4111853175 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45c797640 1 -- 172.21.15.96:0/4111853175 >> v1:172.21.15.70:6789/0 conn(0x5574adaa0df0 legacy=0x5574adaa11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.872+0000 7fd45c797640 1 -- 172.21.15.96:0/4111853175 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574ad924da0 con 0x5574adaa4fe0 2024-09-14T10:44:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45c797640 1 --2- 172.21.15.96:0/4111853175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa4fe0 0x5574adaa73d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd44400a4e0 tx=0x7fd44401b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383ddf9ceb50b75f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45bf96640 1 -- 172.21.15.96:0/4111853175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4440aa540 con 0x5574adaa4fe0 2024-09-14T10:44:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45bf96640 1 -- 172.21.15.96:0/4111853175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4440aa6e0 con 0x5574adaa4fe0 2024-09-14T10:44:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45bf96640 1 -- 172.21.15.96:0/4111853175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4440aaa40 con 0x5574adaa4fe0 2024-09-14T10:44:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45f4929c0 1 -- 172.21.15.96:0/4111853175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa4fe0 msgr2=0x5574adaa73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/4111853175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa4fe0 0x5574adaa73d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd44400a4e0 tx=0x7fd44401b120 comp rx=0 tx=0).stop 2024-09-14T10:44:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45f4929c0 1 -- 172.21.15.96:0/4111853175 shutdown_connections 2024-09-14T10:44:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/4111853175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa4fe0 0x5574adaa73d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45f4929c0 1 -- 172.21.15.96:0/4111853175 >> 172.21.15.96:0/4111853175 conn(0x5574ada9c910 msgr2=0x5574ada9ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45f4929c0 1 -- 172.21.15.96:0/4111853175 shutdown_connections 2024-09-14T10:44:32.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.876+0000 7fd45f4929c0 1 -- 172.21.15.96:0/4111853175 wait complete. 2024-09-14T10:44:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 Processor -- start 2024-09-14T10:44:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- start start 2024-09-14T10:44:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb8c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574ad9a9fc0 con 0x5574adaa0df0 2024-09-14T10:44:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45cf98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb8c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45cf98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb8c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45540/0 (socket says 172.21.15.96:45540) 2024-09-14T10:44:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45cf98640 1 -- 172.21.15.96:0/1676036929 learned_addr learned my addr 172.21.15.96:0/1676036929 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45cf98640 1 -- 172.21.15.96:0/1676036929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574adb8c920 con 0x5574adaa0df0 2024-09-14T10:44:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45cf98640 1 --2- 172.21.15.96:0/1676036929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb8c330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00b2d0 tx=0x7fd44c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422cea4e9ce330ab server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd349e1b640 1 -- 172.21.15.96:0/1676036929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd44c00a040 con 0x5574adaa0df0 2024-09-14T10:44:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd349e1b640 1 -- 172.21.15.96:0/1676036929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44c00f750 con 0x5574adaa0df0 2024-09-14T10:44:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd349e1b640 1 -- 172.21.15.96:0/1676036929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd44c00fa70 con 0x5574adaa0df0 2024-09-14T10:44:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1676036929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 msgr2=0x5574adb8c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/1676036929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb8c330 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00b2d0 tx=0x7fd44c00b790 comp rx=0 tx=0).stop 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1676036929 shutdown_connections 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/1676036929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb8c330 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1676036929 >> 172.21.15.96:0/1676036929 conn(0x5574ada9c910 msgr2=0x5574adb87f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1676036929 shutdown_connections 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1676036929 wait complete. 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 Processor -- start 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- start start 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb94d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.892+0000 7fd45f4929c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574ad94ba50 con 0x5574adaa0df0 2024-09-14T10:44:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45cf98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb94d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45cf98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb94d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45554/0 (socket says 172.21.15.96:45554) 2024-09-14T10:44:32.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45cf98640 1 -- 172.21.15.96:0/2607446947 learned_addr learned my addr 172.21.15.96:0/2607446947 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45cf98640 1 -- 172.21.15.96:0/2607446947 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574adb95290 con 0x5574adaa0df0 2024-09-14T10:44:32.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45cf98640 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb94d30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd44c000c10 tx=0x7fd44c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd343fff640 1 -- 172.21.15.96:0/2607446947 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd44c01c9f0 con 0x5574adaa0df0 2024-09-14T10:44:32.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574adb95520 con 0x5574adaa0df0 2024-09-14T10:44:32.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574adb95ed0 con 0x5574adaa0df0 2024-09-14T10:44:32.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd343fff640 1 -- 172.21.15.96:0/2607446947 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44c01cb90 con 0x5574adaa0df0 2024-09-14T10:44:32.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd343fff640 1 -- 172.21.15.96:0/2607446947 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd44c02c060 con 0x5574adaa0df0 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd343fff640 1 -- 172.21.15.96:0/2607446947 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd44c017050 con 0x5574adaa0df0 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd343fff640 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd343fff640 1 -- 172.21.15.96:0/2607446947 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd44c015020 con 0x5574adaa0df0 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45c797640 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adaa4fe0 0x5574adb9bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adb9c3e0 con 0x5574adaa4fe0 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45d799640 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adaa4fe0 0x5574adb9bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45c797640 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd4440ab000 tx=0x7fd4440a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45d799640 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adaa4fe0 0x5574adb9bea0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45d799640 1 -- 172.21.15.96:0/2607446947 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4540083f0 con 0x5574adaa4fe0 2024-09-14T10:44:32.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.896+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adb9c830 con 0x5574adaa4fe0 2024-09-14T10:44:32.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45d799640 1 -- 172.21.15.96:0/2607446947 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4540083f0 con 0x5574adaa4fe0 2024-09-14T10:44:32.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adb9e130 con 0x5574adaa4fe0 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45d799640 1 -- 172.21.15.96:0/2607446947 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4540083f0 con 0x5574adaa4fe0 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adb9d360 con 0x5574adaa4fe0 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45d799640 1 -- 172.21.15.96:0/2607446947 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4540083f0 con 0x5574adaa4fe0 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adb9d7b0 con 0x5574adaa4fe0 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45d799640 1 -- 172.21.15.96:0/2607446947 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4540083f0 con 0x5574adaa4fe0 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 Processor -- start 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 -- start start 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbac4f0 0x5574adbac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574ad9b6d80 con 0x5574adbac4f0 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45c797640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbac4f0 0x5574adbac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45c797640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbac4f0 0x5574adbac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45570/0 (socket says 172.21.15.96:45570) 2024-09-14T10:44:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45c797640 1 -- 172.21.15.96:0/1966915099 learned_addr learned my addr 172.21.15.96:0/1966915099 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45c797640 1 -- 172.21.15.96:0/1966915099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574adbacf50 con 0x5574adbac4f0 2024-09-14T10:44:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45c797640 1 --2- 172.21.15.96:0/1966915099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbac4f0 0x5574adbac910 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd44400a190 tx=0x7fd444017ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd3417fa640 1 -- 172.21.15.96:0/1966915099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4440c2070 con 0x5574adbac4f0 2024-09-14T10:44:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1966915099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574adbad7b0 con 0x5574adbac4f0 2024-09-14T10:44:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1966915099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574adbadcc0 con 0x5574adbac4f0 2024-09-14T10:44:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd3417fa640 1 -- 172.21.15.96:0/1966915099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4440c7450 con 0x5574adbac4f0 2024-09-14T10:44:32.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.900+0000 7fd3417fa640 1 -- 172.21.15.96:0/1966915099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4440cc060 con 0x5574adbac4f0 2024-09-14T10:44:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd3417fa640 1 -- 172.21.15.96:0/1966915099 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd4440c5070 con 0x5574adbac4f0 2024-09-14T10:44:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd3417fa640 1 --2- 172.21.15.96:0/1966915099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd33403a140 0x7fd33403c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd3417fa640 1 -- 172.21.15.96:0/1966915099 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd4440edc00 con 0x5574adbac4f0 2024-09-14T10:44:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45d799640 1 --2- 172.21.15.96:0/1966915099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd33403a140 0x7fd33403c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 Processor -- start 2024-09-14T10:44:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- start start 2024-09-14T10:44:32.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45d799640 1 --2- 172.21.15.96:0/1966915099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd33403a140 0x7fd33403c600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5574adb9ce80 tx=0x7fd454003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574adb8cd50 con 0x5574adbb9da0 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45c797640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45c797640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbba1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45576/0 (socket says 172.21.15.96:45576) 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45c797640 1 -- 172.21.15.96:0/3903693919 learned_addr learned my addr 172.21.15.96:0/3903693919 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45c797640 1 -- 172.21.15.96:0/3903693919 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574adbba790 con 0x5574adbb9da0 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45c797640 1 --2- 172.21.15.96:0/3903693919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbba1a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd4440ebff0 tx=0x7fd4440a9480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca83317fac4be0b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd33affd640 1 -- 172.21.15.96:0/3903693919 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4440d04d0 con 0x5574adbb9da0 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd33affd640 1 -- 172.21.15.96:0/3903693919 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4440d5020 con 0x5574adbb9da0 2024-09-14T10:44:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd33affd640 1 -- 172.21.15.96:0/3903693919 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4440bdba0 con 0x5574adbb9da0 2024-09-14T10:44:32.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- 172.21.15.96:0/3903693919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 msgr2=0x5574adbba1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/3903693919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbba1a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd4440ebff0 tx=0x7fd4440a9480 comp rx=0 tx=0).stop 2024-09-14T10:44:32.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- 172.21.15.96:0/3903693919 shutdown_connections 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/3903693919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbba1a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- 172.21.15.96:0/3903693919 >> 172.21.15.96:0/3903693919 conn(0x5574adbb51c0 msgr2=0x5574adbb3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- 172.21.15.96:0/3903693919 shutdown_connections 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- 172.21.15.96:0/3903693919 wait complete. 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 Processor -- start 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- start start 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbc0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.904+0000 7fd45f4929c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574adbb8cf0 con 0x5574adbb9da0 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45c797640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbc0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45c797640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbc0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45592/0 (socket says 172.21.15.96:45592) 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 learned_addr learned my addr 172.21.15.96:0/2469543868 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574adbc07f0 con 0x5574adbb9da0 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45c797640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbc0290 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd4440bdb30 tx=0x7fd4440ebf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd3397fa640 1 -- 172.21.15.96:0/2469543868 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4440f2070 con 0x5574adbb9da0 2024-09-14T10:44:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574adbc0a80 con 0x5574adbb9da0 2024-09-14T10:44:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd3397fa640 1 -- 172.21.15.96:0/2469543868 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4440d0a30 con 0x5574adbb9da0 2024-09-14T10:44:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574adbc1430 con 0x5574adbb9da0 2024-09-14T10:44:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd3397fa640 1 -- 172.21.15.96:0/2469543868 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4440d0d10 con 0x5574adbb9da0 2024-09-14T10:44:32.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd3397fa640 1 -- 172.21.15.96:0/2469543868 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd4440f5070 con 0x5574adbb9da0 2024-09-14T10:44:32.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd3397fa640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd32403a150 0x7fd32403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd3397fa640 1 -- 172.21.15.96:0/2469543868 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd4440e1030 con 0x5574adbb9da0 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45d799640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd32403a150 0x7fd32403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adbcb830 0x5574adbcdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbce410 con 0x5574adbcb830 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45cf98640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adbcb830 0x5574adbcdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45d799640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd32403a150 0x7fd32403c610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd45400f010 tx=0x7fd45401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45cf98640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adbcb830 0x5574adbcdcc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 20 realm 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbce820 con 0x5574adbcb830 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbcf0f0 con 0x5574adbcb830 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.908+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbcf490 con 0x5574adbcb830 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45f4929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbcfce0 con 0x5574adbcb830 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45f4929c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45f4929c0 20 searching for the correct realm 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574adbd1a50 0x5574adbd3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45c797640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574adbd1a50 0x5574adbd3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45c797640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574adbd1a50 0x5574adbd3e40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45c797640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4440f7060 0x7fd4440ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd4440f7060 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45d799640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4440f7060 0x7fd4440ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45d799640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4440f7060 0x7fd4440ed1a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45d799640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd454019040 0x7fd454019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd454019040 0x7fd454019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd454019040 0x7fd454019930 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbcb830 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbcb830 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.912+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd4440f7060 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbcb830 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbcb830 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd4440f7060 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.916+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbcb830 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbcb830 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd4440f7060 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbcb830 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.920+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd4440f7060 2024-09-14T10:44:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbd1a50 2024-09-14T10:44:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd454019040 2024-09-14T10:44:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x5574adbcb830 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd43d0 con 0x7fd4440f7060 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd0630 con 0x5574adbcb830 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd0ed0 con 0x5574adbcb830 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd0ed0 con 0x5574adbcb830 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 zone default found 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 4 Realm: () 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 zonegroup default 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd4830 con 0x7fd454019040 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd6320 con 0x5574adbd1a50 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd67f0 con 0x5574adbd1a50 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 started sync module instance, tier type = 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.924+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd56c0 con 0x7fd4440f7060 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.928+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.928+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93959619435184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd5320 con 0x7fd4440f7060 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.928+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd7720 con 0x5574adbcb830 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.928+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93959619435184] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.928+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.928+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93959619439696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd7720 con 0x5574adbcb830 2024-09-14T10:44:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.928+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd80e0 con 0x5574adbd1a50 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93959619443760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd8930 con 0x5574adbd1a50 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd92f0 con 0x7fd4440f7060 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93959619439696] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93959619448384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd9710 con 0x7fd4440f7060 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbda0d0 con 0x5574adbcb830 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93959619443760] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93959619448384] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.932+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93959619449440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd9680 con 0x5574adbcb830 2024-09-14T10:44:32.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbda580 con 0x7fd454019040 2024-09-14T10:44:32.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93959619453136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbda9a0 con 0x7fd454019040 2024-09-14T10:44:32.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbdb360 con 0x7fd454019040 2024-09-14T10:44:32.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93959619449440] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93959619453136] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.936+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93959619454192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbda910 con 0x7fd454019040 2024-09-14T10:44:32.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbdb810 con 0x7fd454019040 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93959619454192] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93959619457888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbdbc30 con 0x7fd454019040 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 20 add_watcher() i=0 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 20 add_watcher() i=1 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 20 add_watcher() i=2 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 20 add_watcher() i=3 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 20 add_watcher() i=4 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 20 add_watcher() i=5 2024-09-14T10:44:32.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 20 add_watcher() i=6 2024-09-14T10:44:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93959619457888] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 20 add_watcher() i=7 2024-09-14T10:44:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.940+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adbdbc30 con 0x5574adbcb830 2024-09-14T10:44:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93959619458944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbdc4b0 con 0x5574adbcb830 2024-09-14T10:44:32.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93959619458944] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 5 note: GC not initialized 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd310fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 20 Filter name: none 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd28a7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adc025d0 con 0x7fd454019040 2024-09-14T10:44:32.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adc00a60 con 0x7fd454019040 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:44:32.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.944+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adc056f0 con 0x7fd454019040 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45f4929c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45f4929c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45f4929c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93959619629296 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adc061c0 con 0x7fd4440f7060 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== watch-notify(notify (1) cookie 93959619448384 notify 137438953484 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fd454010040 con 0x7fd4440f7060 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd33affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93959619448384 notifier 4536 bl.length()=610 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd33affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd33affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:44:32.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd33affd640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd320003eb0 con 0x7fd4440f7060 2024-09-14T10:44:32.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(65 notify.3 [notify cookie 93959619629296 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== watch-notify(notify_complete (2) cookie 93959619629296 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd4540269d0 con 0x7fd4440f7060 2024-09-14T10:44:32.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.948+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adc050c0 con 0x7fd454019040 2024-09-14T10:44:32.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45f4929c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:44:32.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45f4929c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:32.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45f4929c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:44:32.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93959619629200 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574adc061c0 con 0x5574adbd1a50 2024-09-14T10:44:32.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== watch-notify(notify (1) cookie 93959619443760 notify 137438953476 ret 0) ==== 234+0+0 (crc 0 0 0) 0x5574adbc0a80 con 0x5574adbd1a50 2024-09-14T10:44:32.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd33a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93959619443760 notifier 4536 bl.length()=192 2024-09-14T10:44:32.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd33a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:44:32.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd33a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:44:32.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd33a7fc640 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd290003410 con 0x5574adbd1a50 2024-09-14T10:44:32.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(68 notify.2 [notify cookie 93959619629200 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== watch-notify(notify_complete (2) cookie 93959619629200 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5574adbc07f0 con 0x5574adbd1a50 2024-09-14T10:44:32.950 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:44:32.947922Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:32.947908Z","tags":[],"group_ids":[]} 2024-09-14T10:44:32.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd311fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:32.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93959619458944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbfff70 con 0x5574adbcb830 2024-09-14T10:44:32.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93959619458944] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.952+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93959619435184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbfff70 con 0x7fd4440f7060 2024-09-14T10:44:32.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.956+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93959619435184] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.956+0000 7fd45f4929c0 20 remove_watcher() i=0 2024-09-14T10:44:32.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.956+0000 7fd45f4929c0 2 removed watcher, disabling cache 2024-09-14T10:44:32.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.956+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93959619439696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbfff70 con 0x5574adbcb830 2024-09-14T10:44:32.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.956+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93959619439696] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.956+0000 7fd45f4929c0 20 remove_watcher() i=1 2024-09-14T10:44:32.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.956+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93959619443760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd6c50 con 0x5574adbd1a50 2024-09-14T10:44:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45c797640 1 -- 172.21.15.96:0/2469543868 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93959619443760] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4440f4030 con 0x5574adbd1a50 2024-09-14T10:44:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45f4929c0 20 remove_watcher() i=2 2024-09-14T10:44:32.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93959619448384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbfff70 con 0x7fd4440f7060 2024-09-14T10:44:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45d799640 1 -- 172.21.15.96:0/2469543868 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93959619448384] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45402f040 con 0x7fd4440f7060 2024-09-14T10:44:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45f4929c0 20 remove_watcher() i=3 2024-09-14T10:44:32.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93959619449440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd7c30 con 0x5574adbcb830 2024-09-14T10:44:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93959619449440] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x5574adbcb830 2024-09-14T10:44:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45f4929c0 20 remove_watcher() i=4 2024-09-14T10:44:32.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.960+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93959619453136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd6c50 con 0x7fd454019040 2024-09-14T10:44:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.964+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93959619453136] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.964+0000 7fd45f4929c0 20 remove_watcher() i=5 2024-09-14T10:44:32.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.964+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93959619454192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbfff70 con 0x7fd454019040 2024-09-14T10:44:32.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.964+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93959619454192] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.964+0000 7fd45f4929c0 20 remove_watcher() i=6 2024-09-14T10:44:32.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.964+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93959619457888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574adbd7c30 con 0x7fd454019040 2024-09-14T10:44:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93959619457888] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd44c02e070 con 0x7fd454019040 2024-09-14T10:44:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 20 remove_watcher() i=7 2024-09-14T10:44:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd454019040 msgr2=0x7fd454019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd454019040 0x7fd454019930 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adbcb830 msgr2=0x5574adbcdcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adbcb830 0x5574adbcdcc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4440f7060 msgr2=0x7fd4440ed1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4440f7060 0x7fd4440ed1a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574adbd1a50 msgr2=0x5574adbd3e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5574adbd1a50 0x5574adbd3e40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd32403a150 msgr2=0x7fd32403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd32403a150 0x7fd32403c610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd45400f010 tx=0x7fd45401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 msgr2=0x5574adbc0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2469543868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbb9da0 0x5574adbc0290 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd4440bdb30 tx=0x7fd4440ebf80 comp rx=0 tx=0).stop 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 reap_dead start 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45cf98640 1 -- 172.21.15.96:0/2469543868 reap_dead start 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 shutdown_connections 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 >> 172.21.15.96:0/2469543868 conn(0x5574adbb51c0 msgr2=0x5574adbb33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 shutdown_connections 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2469543868 wait complete. 2024-09-14T10:44:32.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1966915099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd33403a140 msgr2=0x7fd33403c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/1966915099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd33403a140 0x7fd33403c600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5574adb9ce80 tx=0x7fd454003070 comp rx=0 tx=0).stop 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1966915099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbac4f0 msgr2=0x5574adbac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/1966915099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbac4f0 0x5574adbac910 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd44400a190 tx=0x7fd444017ec0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1966915099 shutdown_connections 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/1966915099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd33403a140 0x7fd33403c600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/1966915099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adbac4f0 0x5574adbac910 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1966915099 >> 172.21.15.96:0/1966915099 conn(0x5574adba1ea0 msgr2=0x5574adba2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1966915099 shutdown_connections 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/1966915099 wait complete. 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adaa4fe0 msgr2=0x5574adb9bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adaa4fe0 0x5574adb9bea0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 msgr2=0x7fd34403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd4440ab000 tx=0x7fd4440a5000 comp rx=0 tx=0).stop 2024-09-14T10:44:32.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 msgr2=0x5574adb94d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:32.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb94d30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd44c000c10 tx=0x7fd44c000ee0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 shutdown_connections 2024-09-14T10:44:32.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5574adaa4fe0 0x5574adb9bea0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 --2- 172.21.15.96:0/2607446947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574adaa0df0 0x5574adb94d30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:32.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 >> 172.21.15.96:0/2607446947 conn(0x5574ada9c910 msgr2=0x5574adb8d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:32.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 shutdown_connections 2024-09-14T10:44:32.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:32.968+0000 7fd45f4929c0 1 -- 172.21.15.96:0/2607446947 wait complete. 2024-09-14T10:44:32.975 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:44:32.947922Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:32.947908Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:32.976 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-14T10:44:32.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-14T10:44:32.976 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-14T10:44:33.009 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:33.009 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:33.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0de0d4f9c0 1 Processor -- start 2024-09-14T10:44:33.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0de0d4f9c0 1 -- start start 2024-09-14T10:44:33.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0de0d4f9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562d169ce5d0 0x562d16a62750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0de0d4f9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d169027a0 con 0x562d169ce1f0 2024-09-14T10:44:33.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0de0d4f9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x562d1695e1b0 con 0x562d169ce5d0 2024-09-14T10:44:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0dde054640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562d169ce5d0 0x562d16a62750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0dde054640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562d169ce5d0 0x562d16a62750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45596/0 (socket says 172.21.15.96:45596) 2024-09-14T10:44:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0dde054640 1 -- 172.21.15.96:0/1818624814 learned_addr learned my addr 172.21.15.96:0/1818624814 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0dde855640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x562d169ce1f0 0x562d16a5f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37240/0 (socket says 172.21.15.96:37240) 2024-09-14T10:44:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0dde054640 1 -- 172.21.15.96:0/1818624814 >> v1:172.21.15.70:6789/0 conn(0x562d169ce1f0 legacy=0x562d16a5f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.012+0000 7f0dde054640 1 -- 172.21.15.96:0/1818624814 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d168dcda0 con 0x562d169ce5d0 2024-09-14T10:44:33.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0dde054640 1 --2- 172.21.15.96:0/1818624814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce5d0 0x562d16a62750 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400a5c0 tx=0x7f0dd401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db14e1dc83a09073 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0ddd853640 1 -- 172.21.15.96:0/1818624814 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd40a6070 con 0x562d169ce5d0 2024-09-14T10:44:33.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0ddd853640 1 -- 172.21.15.96:0/1818624814 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd40af070 con 0x562d169ce5d0 2024-09-14T10:44:33.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0ddd853640 1 -- 172.21.15.96:0/1818624814 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd40aa5c0 con 0x562d169ce5d0 2024-09-14T10:44:33.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1818624814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce5d0 msgr2=0x562d16a62750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/1818624814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce5d0 0x562d16a62750 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400a5c0 tx=0x7f0dd401b340 comp rx=0 tx=0).stop 2024-09-14T10:44:33.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1818624814 shutdown_connections 2024-09-14T10:44:33.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/1818624814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce5d0 0x562d16a62750 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1818624814 >> 172.21.15.96:0/1818624814 conn(0x562d16a54910 msgr2=0x562d16a56d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1818624814 shutdown_connections 2024-09-14T10:44:33.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.016+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1818624814 wait complete. 2024-09-14T10:44:33.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.028+0000 7f0de0d4f9c0 1 Processor -- start 2024-09-14T10:44:33.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.028+0000 7f0de0d4f9c0 1 -- start start 2024-09-14T10:44:33.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.028+0000 7f0de0d4f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b475f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.028+0000 7f0de0d4f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d16961fc0 con 0x562d169ce1f0 2024-09-14T10:44:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45604/0 (socket says 172.21.15.96:45604) 2024-09-14T10:44:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 -- 172.21.15.96:0/4200215740 learned_addr learned my addr 172.21.15.96:0/4200215740 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 -- 172.21.15.96:0/4200215740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d16b47be0 con 0x562d169ce1f0 2024-09-14T10:44:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 --2- 172.21.15.96:0/4200215740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b475f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0001680 tx=0x7f0dd0001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61a396a4ef98464 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0ccce09640 1 -- 172.21.15.96:0/4200215740 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd0013420 con 0x562d169ce1f0 2024-09-14T10:44:33.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0ccce09640 1 -- 172.21.15.96:0/4200215740 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd00135c0 con 0x562d169ce1f0 2024-09-14T10:44:33.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0ccce09640 1 -- 172.21.15.96:0/4200215740 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd00138e0 con 0x562d169ce1f0 2024-09-14T10:44:33.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/4200215740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 msgr2=0x562d16b475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/4200215740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b475f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0001680 tx=0x7f0dd0001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:33.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/4200215740 shutdown_connections 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/4200215740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b475f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/4200215740 >> 172.21.15.96:0/4200215740 conn(0x562d16a54910 msgr2=0x562d16b431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/4200215740 shutdown_connections 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/4200215740 wait complete. 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 Processor -- start 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- start start 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b4eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d16903a50 con 0x562d169ce1f0 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b4eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b4eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45616/0 (socket says 172.21.15.96:45616) 2024-09-14T10:44:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 -- 172.21.15.96:0/2022292183 learned_addr learned my addr 172.21.15.96:0/2022292183 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 -- 172.21.15.96:0/2022292183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d16b4f450 con 0x562d169ce1f0 2024-09-14T10:44:33.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0dde855640 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b4eef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x562d16b485b0 tx=0x7f0dd0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0ccb606640 1 -- 172.21.15.96:0/2022292183 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd00037a0 con 0x562d169ce1f0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d16b4f6e0 con 0x562d169ce1f0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0ccb606640 1 -- 172.21.15.96:0/2022292183 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd0023070 con 0x562d169ce1f0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d16b50090 con 0x562d169ce1f0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.032+0000 7f0ccb606640 1 -- 172.21.15.96:0/2022292183 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd0003a70 con 0x562d169ce1f0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ccb606640 1 -- 172.21.15.96:0/2022292183 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0dd0010070 con 0x562d169ce1f0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ccb606640 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cc403a150 0x7f0cc403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ccb606640 1 -- 172.21.15.96:0/2022292183 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0dd0050b10 con 0x562d169ce1f0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0dde054640 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cc403a150 0x7f0cc403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d169ce5d0 0x562d16b56060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b565a0 con 0x562d169ce5d0 2024-09-14T10:44:33.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ddf056640 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d169ce5d0 0x562d16b56060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0dde054640 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cc403a150 0x7f0cc403c610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ae000 tx=0x7f0dd40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ddf056640 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d169ce5d0 0x562d16b56060 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ddf056640 1 -- 172.21.15.96:0/2022292183 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dd80083f0 con 0x562d169ce5d0 2024-09-14T10:44:33.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b503f0 con 0x562d169ce5d0 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ddf056640 1 -- 172.21.15.96:0/2022292183 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0dd80083f0 con 0x562d169ce5d0 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b58380 con 0x562d169ce5d0 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ddf056640 1 -- 172.21.15.96:0/2022292183 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0dd80083f0 con 0x562d169ce5d0 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b575e0 con 0x562d169ce5d0 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ddf056640 1 -- 172.21.15.96:0/2022292183 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0dd80083f0 con 0x562d169ce5d0 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b57a30 con 0x562d169ce5d0 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0ddf056640 1 -- 172.21.15.96:0/2022292183 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0dd80083f0 con 0x562d169ce5d0 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 Processor -- start 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 -- start start 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b666c0 0x562d16b66ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.036+0000 7f0de0d4f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d1696ed80 con 0x562d16b666c0 2024-09-14T10:44:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0dde054640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b666c0 0x562d16b66ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0dde054640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b666c0 0x562d16b66ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45624/0 (socket says 172.21.15.96:45624) 2024-09-14T10:44:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0dde054640 1 -- 172.21.15.96:0/2092894974 learned_addr learned my addr 172.21.15.96:0/2092894974 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0dde054640 1 -- 172.21.15.96:0/2092894974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d16b67120 con 0x562d16b666c0 2024-09-14T10:44:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0dde054640 1 --2- 172.21.15.96:0/2092894974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b666c0 0x562d16b66ae0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4000c10 tx=0x7f0dd40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0cc8e01640 1 -- 172.21.15.96:0/2092894974 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd40b3b90 con 0x562d16b666c0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2092894974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d16b67980 con 0x562d16b666c0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0cc8e01640 1 -- 172.21.15.96:0/2092894974 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd40b3d30 con 0x562d16b666c0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0cc8e01640 1 -- 172.21.15.96:0/2092894974 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd40c8560 con 0x562d16b666c0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2092894974 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d16b67e90 con 0x562d16b666c0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0cc8e01640 1 -- 172.21.15.96:0/2092894974 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0dd40c8700 con 0x562d16b666c0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0cc8e01640 1 --2- 172.21.15.96:0/2092894974 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cb803a150 0x7f0cb803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0cc8e01640 1 -- 172.21.15.96:0/2092894974 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0dd40ee610 con 0x562d16b666c0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0ddf056640 1 --2- 172.21.15.96:0/2092894974 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cb803a150 0x7f0cb803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0de0d4f9c0 1 Processor -- start 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0de0d4f9c0 1 -- start start 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0ddf056640 1 --2- 172.21.15.96:0/2092894974 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cb803a150 0x7f0cb803c610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800e3f0 tx=0x7f0dd8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0de0d4f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b73340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0de0d4f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d16b48010 con 0x562d16b72f60 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0dde054640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b73340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0dde054640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b73340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45632/0 (socket says 172.21.15.96:45632) 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.040+0000 7f0dde054640 1 -- 172.21.15.96:0/1274708643 learned_addr learned my addr 172.21.15.96:0/1274708643 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0dde054640 1 -- 172.21.15.96:0/1274708643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d16b73910 con 0x562d16b72f60 2024-09-14T10:44:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0dde054640 1 --2- 172.21.15.96:0/1274708643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b73340 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ec940 tx=0x7f0dd40bdae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2169ad1fbc23cf2d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0cc27fc640 1 -- 172.21.15.96:0/1274708643 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd40c73d0 con 0x562d16b72f60 2024-09-14T10:44:33.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0cc27fc640 1 -- 172.21.15.96:0/1274708643 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd40bde00 con 0x562d16b72f60 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0cc27fc640 1 -- 172.21.15.96:0/1274708643 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd40bea80 con 0x562d16b72f60 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1274708643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 msgr2=0x562d16b73340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/1274708643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b73340 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ec940 tx=0x7f0dd40bdae0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1274708643 shutdown_connections 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/1274708643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b73340 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1274708643 >> 172.21.15.96:0/1274708643 conn(0x562d16b6f390 msgr2=0x562d16b6d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1274708643 shutdown_connections 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/1274708643 wait complete. 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 Processor -- start 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- start start 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b7a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d16b73f70 con 0x562d16b72f60 2024-09-14T10:44:33.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0dde054640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b7a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0dde054640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b7a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45646/0 (socket says 172.21.15.96:45646) 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 learned_addr learned my addr 172.21.15.96:0/38172482 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d16b7aa30 con 0x562d16b72f60 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0dde054640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b7a4d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40bdbb0 tx=0x7f0dd40ec8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0cc0ff9640 1 -- 172.21.15.96:0/38172482 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd40f3070 con 0x562d16b72f60 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d16b7acc0 con 0x562d16b72f60 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0cc0ff9640 1 -- 172.21.15.96:0/38172482 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd40bde00 con 0x562d16b72f60 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d16b7b670 con 0x562d16b72f60 2024-09-14T10:44:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.044+0000 7f0cc0ff9640 1 -- 172.21.15.96:0/38172482 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd40fd060 con 0x562d16b72f60 2024-09-14T10:44:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0cc0ff9640 1 -- 172.21.15.96:0/38172482 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0dd40f6070 con 0x562d16b72f60 2024-09-14T10:44:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0cc0ff9640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0ca803a150 0x7f0ca803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0cc0ff9640 1 -- 172.21.15.96:0/38172482 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0dd40e0030 con 0x562d16b72f60 2024-09-14T10:44:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0ddf056640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0ca803a150 0x7f0ca803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d16b859d0 0x562d16b87e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b88570 con 0x562d16b859d0 2024-09-14T10:44:33.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde855640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d16b859d0 0x562d16b87e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0ddf056640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0ca803a150 0x7f0ca803c610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800f010 tx=0x7f0dd801c070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde855640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d16b859d0 0x562d16b87e20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 realm 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b88980 con 0x562d16b859d0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b89250 con 0x562d16b859d0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b895f0 con 0x562d16b859d0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b89e40 con 0x562d16b859d0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 20 searching for the correct realm 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562d16b8bbb0 0x562d16b8dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde054640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562d16b8bbb0 0x562d16b8dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde054640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562d16b8bbb0 0x562d16b8dfa0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde054640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0dd40f8060 0x7f0dd40f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd40f8060 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0ddf056640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0dd40f8060 0x7f0dd40f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0ddf056640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0dd40f8060 0x7f0dd40f14f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0ddf056640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0dd801a940 0x7f0dd8011430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.048+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0dd801a940 0x7f0dd8011430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0dd801a940 0x7f0dd8011430 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b859d0 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b859d0 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd40f8060 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b859d0 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.052+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b859d0 2024-09-14T10:44:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd40f8060 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b859d0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b859d0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.056+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd40f8060 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b859d0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd40f8060 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b8bbb0 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd801a940 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x562d16b859d0 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8e5d0 con 0x7f0dd40f8060 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.060+0000 7f0de0d4f9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8a7c0 con 0x562d16b859d0 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8abb0 con 0x562d16b859d0 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8abb0 con 0x562d16b859d0 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 zone default found 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 4 Realm: () 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 zonegroup default 2024-09-14T10:44:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8afd0 con 0x7f0dd801a940 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8afd0 con 0x562d16b8bbb0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b904e0 con 0x562d16b8bbb0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 started sync module instance, tier type = 2024-09-14T10:44:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b8f8c0 con 0x7f0dd40f8060 2024-09-14T10:44:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94751654739120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b90df0 con 0x7f0dd40f8060 2024-09-14T10:44:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.064+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b91640 con 0x562d16b859d0 2024-09-14T10:44:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.068+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94751654739120] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.068+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.068+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94751654742336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b91250 con 0x562d16b859d0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.068+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b91d50 con 0x562d16b8bbb0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.068+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.068+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94751654746176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b925f0 con 0x562d16b8bbb0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.068+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b92fb0 con 0x7f0dd40f8060 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94751654742336] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94751654750976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b92f20 con 0x7f0dd40f8060 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b93d30 con 0x562d16b859d0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94751654746176] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94751654750976] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94751654748480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b93880 con 0x562d16b859d0 2024-09-14T10:44:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.072+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b945d0 con 0x7f0dd801a940 2024-09-14T10:44:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.076+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.076+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94751654755808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b946b0 con 0x7f0dd801a940 2024-09-14T10:44:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.076+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b94f80 con 0x7f0dd801a940 2024-09-14T10:44:33.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.076+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94751654748480] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.076+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94751654755808] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.076+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.076+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94751654753232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b946b0 con 0x7f0dd801a940 2024-09-14T10:44:33.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.076+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b95820 con 0x7f0dd801a940 2024-09-14T10:44:33.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94751654761024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b95b10 con 0x7f0dd801a940 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 20 add_watcher() i=0 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 20 add_watcher() i=1 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 20 add_watcher() i=2 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 20 add_watcher() i=3 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 20 add_watcher() i=4 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 20 add_watcher() i=5 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94751654753232] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 20 add_watcher() i=6 2024-09-14T10:44:33.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94751654761024] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 20 add_watcher() i=7 2024-09-14T10:44:33.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:33.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16b98770 con 0x562d16b859d0 2024-09-14T10:44:33.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.080+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94751654756864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b95b10 con 0x562d16b859d0 2024-09-14T10:44:33.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94751654756864] v32'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0c957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 5 note: GC not initialized 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0c0ffff640 20 reqs_thread_entry: start 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 Filter name: none 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0c0dffb640 20 reqs_thread_entry: start 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbc1d0 con 0x7f0dd801a940 2024-09-14T10:44:33.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T10:44:33.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-14T10:44:33.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbbb20 con 0x7f0dd40f8060 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbf960 con 0x562d16b8bbb0 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:33.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:33.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:33.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:33.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:33.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:33.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-14T10:44:33.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.084+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc3fa0 con 0x7f0dd40f8060 2024-09-14T10:44:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 8.10 8:0cf9189a:root::.bucket.meta.testx%3amyfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc7ca0 con 0x562d16b8bbb0 2024-09-14T10:44:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [create,call,writefull 0~420,setxattr (203)] v32'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x7 2024-09-14T10:44:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T10:44:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1, ofs0, ns] 2024-09-14T10:44:33.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94751654966736 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc5af0 con 0x7f0dd40f8060 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== watch-notify(notify (1) cookie 94751654750976 notify 137438953485 ret 0) ==== 897+0+0 (crc 0 0 0) 0x7f0dd8010040 con 0x7f0dd40f8060 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0cc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94751654750976 notifier 4543 bl.length()=855 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0cc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x7 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0cc27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0cc27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(67 notify.3 [notify cookie 94751654966736 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0cc27fc640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ca4003eb0 con 0x7f0dd40f8060 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== watch-notify(notify_complete (2) cookie 94751654966736 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0dd8011970 con 0x7f0dd40f8060 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 20 handle_bi_update(): bucket=testx:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_sources= new_sources= 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 20 handle_bi_update(): bucket=testx:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential sources added=[] removed=[] 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 20 handle_bi_update(): bucket=testx:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_dests= new_dests= 2024-09-14T10:44:33.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 20 handle_bi_update(): bucket=testx:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential dests added=[] removed=[] 2024-09-14T10:44:33.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.088+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc5b90 con 0x562d16b859d0 2024-09-14T10:44:33.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc5b90 con 0x562d16b859d0 2024-09-14T10:44:33.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0de0d4f9c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-14T10:44:33.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0de0d4f9c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-14T10:44:33.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0de0d4f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-14T10:44:33.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94751654958816 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc5b00 con 0x562d16b859d0 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94751654748480 notify 137438953486 ret 0) ==== 390+0+0 (crc 0 0 0) 0x562d16bc5f30 con 0x562d16b859d0 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0cc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94751654748480 notifier 4543 bl.length()=348 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0cc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0cc1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(71 notify.4 [notify cookie 94751654958816 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0cc1ffb640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0c14003410 con 0x562d16b859d0 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== watch-notify(notify_complete (2) cookie 94751654958816 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d16bc75d0 con 0x562d16b859d0 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.092+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc5b90 con 0x7f0dd40f8060 2024-09-14T10:44:33.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0de0d4f9c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-14T10:44:33.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0de0d4f9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:44:33.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94751654958816 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc5b00 con 0x7f0dd801a940 2024-09-14T10:44:33.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== watch-notify(notify (1) cookie 94751654753232 notify 137438953486 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562d16bc75d0 con 0x7f0dd801a940 2024-09-14T10:44:33.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0cc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94751654753232 notifier 4543 bl.length()=149 2024-09-14T10:44:33.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.6 [notify cookie 94751654958816 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0cc27fc640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ca4003eb0 con 0x7f0dd801a940 2024-09-14T10:44:33.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== watch-notify(notify_complete (2) cookie 94751654958816 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d16b50090 con 0x7f0dd801a940 2024-09-14T10:44:33.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:76 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc5b90 con 0x562d16b8bbb0 2024-09-14T10:44:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(76 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0de0d4f9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 from cache 2024-09-14T10:44:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0de0d4f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1, ofs0, ns] 2024-09-14T10:44:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94751654958816 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc43d0 con 0x562d16b859d0 2024-09-14T10:44:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== watch-notify(notify (1) cookie 94751654748480 notify 137438953487 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562d16b50090 con 0x562d16b859d0 2024-09-14T10:44:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0cc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94751654748480 notifier 4543 bl.length()=206 2024-09-14T10:44:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0cc27fc640 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ca4003eb0 con 0x562d16b859d0 2024-09-14T10:44:33.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(77 notify.4 [notify cookie 94751654958816 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== watch-notify(notify_complete (2) cookie 94751654958816 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d16b4f6e0 con 0x562d16b859d0 2024-09-14T10:44:33.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.096+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.100+0000 7f0c957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.100+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94751654756864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b982e0 con 0x562d16b859d0 2024-09-14T10:44:33.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.100+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94751654756864] v32'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.100+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94751654739120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16b94200 con 0x7f0dd40f8060 2024-09-14T10:44:33.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.100+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94751654739120] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.100+0000 7f0de0d4f9c0 20 remove_watcher() i=0 2024-09-14T10:44:33.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.100+0000 7f0de0d4f9c0 2 removed watcher, disabling cache 2024-09-14T10:44:33.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.100+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94751654742336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbf3a0 con 0x562d16b859d0 2024-09-14T10:44:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94751654742336] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0de0d4f9c0 20 remove_watcher() i=1 2024-09-14T10:44:33.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94751654746176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bc77a0 con 0x562d16b8bbb0 2024-09-14T10:44:33.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0dde054640 1 -- 172.21.15.96:0/38172482 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94751654746176] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd40f5030 con 0x562d16b8bbb0 2024-09-14T10:44:33.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0de0d4f9c0 20 remove_watcher() i=2 2024-09-14T10:44:33.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94751654750976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbf3a0 con 0x7f0dd40f8060 2024-09-14T10:44:33.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0ddf056640 1 -- 172.21.15.96:0/38172482 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94751654750976] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd8030040 con 0x7f0dd40f8060 2024-09-14T10:44:33.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0de0d4f9c0 20 remove_watcher() i=3 2024-09-14T10:44:33.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.104+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94751654748480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbf3a0 con 0x562d16b859d0 2024-09-14T10:44:33.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.108+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94751654748480] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x562d16b859d0 2024-09-14T10:44:33.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.108+0000 7f0de0d4f9c0 20 remove_watcher() i=4 2024-09-14T10:44:33.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.108+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94751654755808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbf3a0 con 0x7f0dd801a940 2024-09-14T10:44:33.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.108+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94751654755808] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.108+0000 7f0de0d4f9c0 20 remove_watcher() i=5 2024-09-14T10:44:33.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.108+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94751654753232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbf3a0 con 0x7f0dd801a940 2024-09-14T10:44:33.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94751654753232] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 20 remove_watcher() i=6 2024-09-14T10:44:33.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94751654761024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d16bbf3a0 con 0x7f0dd801a940 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94751654761024] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dd000f030 con 0x7f0dd801a940 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 20 remove_watcher() i=7 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0dd801a940 msgr2=0x7f0dd8011430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0dd801a940 0x7f0dd8011430 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d16b859d0 msgr2=0x562d16b87e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d16b859d0 0x562d16b87e20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0dd40f8060 msgr2=0x7f0dd40f14f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0dd40f8060 0x7f0dd40f14f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562d16b8bbb0 msgr2=0x562d16b8dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562d16b8bbb0 0x562d16b8dfa0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0ca803a150 msgr2=0x7f0ca803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0ca803a150 0x7f0ca803c610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800f010 tx=0x7f0dd801c070 comp rx=0 tx=0).stop 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 msgr2=0x562d16b7a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0dde855640 1 -- 172.21.15.96:0/38172482 reap_dead start 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b7a4d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40bdbb0 tx=0x7f0dd40ec8d0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 shutdown_connections 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/38172482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b72f60 0x562d16b7a4d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 >> 172.21.15.96:0/38172482 conn(0x562d16b6f390 msgr2=0x562d16b6d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 shutdown_connections 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/38172482 wait complete. 2024-09-14T10:44:33.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2092894974 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cb803a150 msgr2=0x7f0cb803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2092894974 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cb803a150 0x7f0cb803c610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800e3f0 tx=0x7f0dd8003070 comp rx=0 tx=0).stop 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2092894974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b666c0 msgr2=0x562d16b66ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.112+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2092894974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b666c0 0x562d16b66ae0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4000c10 tx=0x7f0dd40180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2092894974 shutdown_connections 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2092894974 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cb803a150 0x7f0cb803c610 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2092894974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d16b666c0 0x562d16b66ae0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2092894974 >> 172.21.15.96:0/2092894974 conn(0x562d16b5c070 msgr2=0x562d16b5c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2092894974 shutdown_connections 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2092894974 wait complete. 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d169ce5d0 msgr2=0x562d16b56060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d169ce5d0 0x562d16b56060 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cc403a150 msgr2=0x7f0cc403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cc403a150 0x7f0cc403c610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ae000 tx=0x7f0dd40a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 msgr2=0x562d16b4eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b4eef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x562d16b485b0 tx=0x7f0dd0000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 shutdown_connections 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562d169ce5d0 0x562d16b56060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0cc403a150 0x7f0cc403c610 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 --2- 172.21.15.96:0/2022292183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d169ce1f0 0x562d16b4eef0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 >> 172.21.15.96:0/2022292183 conn(0x562d16a54910 msgr2=0x562d16b48a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 shutdown_connections 2024-09-14T10:44:33.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.116+0000 7f0de0d4f9c0 1 -- 172.21.15.96:0/2022292183 wait complete. 2024-09-14T10:44:33.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-14T10:44:33.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-14T10:44:33.122 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-14T10:44:33.197 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:33.197 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:33.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea850f9c0 1 Processor -- start 2024-09-14T10:44:33.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea850f9c0 1 -- start start 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea850f9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x560d87f7a290 0x560d8800b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea850f9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560d87eae7a0 con 0x560d87f7a670 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea850f9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x560d87f0a1b0 con 0x560d87f7a290 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea6015640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x560d87f7a290 0x560d8800b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea6015640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x560d87f7a290 0x560d8800b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45660/0 (socket says 172.21.15.96:45660) 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea6015640 1 -- 172.21.15.96:0/3607281875 learned_addr learned my addr 172.21.15.96:0/3607281875 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea5814640 1 --1- 172.21.15.96:0/3607281875 >> v1:172.21.15.70:6789/0 conn(0x560d87f7a670 0x560d8800d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37254/0 (socket says 172.21.15.96:37254) 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea6015640 1 -- 172.21.15.96:0/3607281875 >> v1:172.21.15.70:6789/0 conn(0x560d87f7a670 legacy=0x560d8800d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.200+0000 7fbea6015640 1 -- 172.21.15.96:0/3607281875 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d87e88da0 con 0x560d87f7a290 2024-09-14T10:44:33.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea6015640 1 --2- 172.21.15.96:0/3607281875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d8800b040 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800a4e0 tx=0x7fbe9801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf18c17a682c6e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea5013640 1 -- 172.21.15.96:0/3607281875 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe980aa540 con 0x560d87f7a290 2024-09-14T10:44:33.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea5013640 1 -- 172.21.15.96:0/3607281875 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe980aa6e0 con 0x560d87f7a290 2024-09-14T10:44:33.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea5013640 1 -- 172.21.15.96:0/3607281875 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe980aaa40 con 0x560d87f7a290 2024-09-14T10:44:33.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3607281875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 msgr2=0x560d8800b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3607281875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d8800b040 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800a4e0 tx=0x7fbe9801b090 comp rx=0 tx=0).stop 2024-09-14T10:44:33.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3607281875 shutdown_connections 2024-09-14T10:44:33.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3607281875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d8800b040 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3607281875 >> 172.21.15.96:0/3607281875 conn(0x560d88000970 msgr2=0x560d88002d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3607281875 shutdown_connections 2024-09-14T10:44:33.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.204+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3607281875 wait complete. 2024-09-14T10:44:33.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 Processor -- start 2024-09-14T10:44:33.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- start start 2024-09-14T10:44:33.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880f3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d87f0dfc0 con 0x560d87f7a290 2024-09-14T10:44:33.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea6015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea6015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45662/0 (socket says 172.21.15.96:45662) 2024-09-14T10:44:33.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea6015640 1 -- 172.21.15.96:0/1877000881 learned_addr learned my addr 172.21.15.96:0/1877000881 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea6015640 1 -- 172.21.15.96:0/1877000881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d880f3c20 con 0x560d87f7a290 2024-09-14T10:44:33.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea6015640 1 --2- 172.21.15.96:0/1877000881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880f3630 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbe98017ca0 tx=0x7fbe980033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28eb89f0dbac9e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbd94608640 1 -- 172.21.15.96:0/1877000881 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe980b9070 con 0x560d87f7a290 2024-09-14T10:44:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbd94608640 1 -- 172.21.15.96:0/1877000881 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe980aaa80 con 0x560d87f7a290 2024-09-14T10:44:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbd94608640 1 -- 172.21.15.96:0/1877000881 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe980aad80 con 0x560d87f7a290 2024-09-14T10:44:33.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1877000881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 msgr2=0x560d880f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1877000881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880f3630 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbe98017ca0 tx=0x7fbe980033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1877000881 shutdown_connections 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1877000881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880f3630 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1877000881 >> 172.21.15.96:0/1877000881 conn(0x560d88000970 msgr2=0x560d880ef1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1877000881 shutdown_connections 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1877000881 wait complete. 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 Processor -- start 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- start start 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea850f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d87eafa50 con 0x560d87f7a290 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea6015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea6015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880fadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45664/0 (socket says 172.21.15.96:45664) 2024-09-14T10:44:33.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.220+0000 7fbea6015640 1 -- 172.21.15.96:0/1916227580 learned_addr learned my addr 172.21.15.96:0/1916227580 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea6015640 1 -- 172.21.15.96:0/1916227580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d880fb310 con 0x560d87f7a290 2024-09-14T10:44:33.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea6015640 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880fadb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbe9801b930 tx=0x7fbe98017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbd92e05640 1 -- 172.21.15.96:0/1916227580 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe980b9070 con 0x560d87f7a290 2024-09-14T10:44:33.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d880fb5a0 con 0x560d87f7a290 2024-09-14T10:44:33.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbd92e05640 1 -- 172.21.15.96:0/1916227580 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe980b5a50 con 0x560d87f7a290 2024-09-14T10:44:33.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbd92e05640 1 -- 172.21.15.96:0/1916227580 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe980b5d70 con 0x560d87f7a290 2024-09-14T10:44:33.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d880fbf50 con 0x560d87f7a290 2024-09-14T10:44:33.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbd92e05640 1 -- 172.21.15.96:0/1916227580 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbe980b3040 con 0x560d87f7a290 2024-09-14T10:44:33.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbd92e05640 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8c03a150 0x7fbd8c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbd92e05640 1 -- 172.21.15.96:0/1916227580 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbe980c4070 con 0x560d87f7a290 2024-09-14T10:44:33.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea5814640 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8c03a150 0x7fbd8c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d87f7a670 0x560d88101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88102460 con 0x560d87f7a670 2024-09-14T10:44:33.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea6816640 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d87f7a670 0x560d88101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea5814640 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8c03a150 0x7fbd8c03c610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe90001e90 tx=0x7fbe900013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea6816640 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d87f7a670 0x560d88101f20 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea6816640 1 -- 172.21.15.96:0/1916227580 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbea00083f0 con 0x560d87f7a670 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d881028a0 con 0x560d87f7a670 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea6816640 1 -- 172.21.15.96:0/1916227580 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbea00083f0 con 0x560d87f7a670 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.224+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d881041a0 con 0x560d87f7a670 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea6816640 1 -- 172.21.15.96:0/1916227580 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbea00083f0 con 0x560d87f7a670 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d881033d0 con 0x560d87f7a670 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea6816640 1 -- 172.21.15.96:0/1916227580 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbea00083f0 con 0x560d87f7a670 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d881037f0 con 0x560d87f7a670 2024-09-14T10:44:33.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea6816640 1 -- 172.21.15.96:0/1916227580 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbea00083f0 con 0x560d87f7a670 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea850f9c0 1 Processor -- start 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea850f9c0 1 -- start start 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea850f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d88112590 0x560d881129b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea850f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d87f1ad80 con 0x560d88112590 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea5814640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d88112590 0x560d881129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea5814640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d88112590 0x560d881129b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45666/0 (socket says 172.21.15.96:45666) 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea5814640 1 -- 172.21.15.96:0/969109713 learned_addr learned my addr 172.21.15.96:0/969109713 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea5814640 1 -- 172.21.15.96:0/969109713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d88112ff0 con 0x560d88112590 2024-09-14T10:44:33.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea5814640 1 --2- 172.21.15.96:0/969109713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d88112590 0x560d881129b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000e670 tx=0x7fbe9000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbd8bfff640 1 -- 172.21.15.96:0/969109713 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90022070 con 0x560d88112590 2024-09-14T10:44:33.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea850f9c0 1 -- 172.21.15.96:0/969109713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d88113850 con 0x560d88112590 2024-09-14T10:44:33.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbea850f9c0 1 -- 172.21.15.96:0/969109713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d88113dc0 con 0x560d88112590 2024-09-14T10:44:33.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbd8bfff640 1 -- 172.21.15.96:0/969109713 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9000d660 con 0x560d88112590 2024-09-14T10:44:33.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbd8bfff640 1 -- 172.21.15.96:0/969109713 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90006070 con 0x560d88112590 2024-09-14T10:44:33.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.228+0000 7fbd8bfff640 1 -- 172.21.15.96:0/969109713 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbe90025070 con 0x560d88112590 2024-09-14T10:44:33.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbd8bfff640 1 --2- 172.21.15.96:0/969109713 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8003a1a0 0x7fbd8003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbd8bfff640 1 -- 172.21.15.96:0/969109713 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbe90052420 con 0x560d88112590 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea6816640 1 --2- 172.21.15.96:0/969109713 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8003a1a0 0x7fbd8003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 Processor -- start 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- start start 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea6816640 1 --2- 172.21.15.96:0/969109713 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8003a1a0 0x7fbd8003c660 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x560d88103770 tx=0x7fbea0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881203a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d880f3f90 con 0x560d8811ffc0 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881203a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45682/0 (socket says 172.21.15.96:45682) 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 -- 172.21.15.96:0/3054775175 learned_addr learned my addr 172.21.15.96:0/3054775175 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 -- 172.21.15.96:0/3054775175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d88120990 con 0x560d8811ffc0 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 --2- 172.21.15.96:0/3054775175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881203a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000ef50 tx=0x7fbe90026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d1c726d38f4bea server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbd89ffb640 1 -- 172.21.15.96:0/3054775175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe9004f2d0 con 0x560d8811ffc0 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbd89ffb640 1 -- 172.21.15.96:0/3054775175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9004f470 con 0x560d8811ffc0 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbd89ffb640 1 -- 172.21.15.96:0/3054775175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90025dd0 con 0x560d8811ffc0 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3054775175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 msgr2=0x560d881203a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3054775175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881203a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000ef50 tx=0x7fbe90026680 comp rx=0 tx=0).stop 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3054775175 shutdown_connections 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3054775175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881203a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3054775175 >> 172.21.15.96:0/3054775175 conn(0x560d8811b380 msgr2=0x560d881195c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3054775175 shutdown_connections 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3054775175 wait complete. 2024-09-14T10:44:33.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 Processor -- start 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- start start 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881264c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea850f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d8811eeb0 con 0x560d8811ffc0 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881264c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45684/0 (socket says 172.21.15.96:45684) 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 learned_addr learned my addr 172.21.15.96:0/3829416024 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.232+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d88126a20 con 0x560d8811ffc0 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea5814640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881264c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbe90001590 tx=0x7fbe900507a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbd77fff640 1 -- 172.21.15.96:0/3829416024 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90048040 con 0x560d8811ffc0 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d88126cb0 con 0x560d8811ffc0 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbd77fff640 1 -- 172.21.15.96:0/3829416024 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9001da50 con 0x560d8811ffc0 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbd77fff640 1 -- 172.21.15.96:0/3829416024 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe9001dd90 con 0x560d8811ffc0 2024-09-14T10:44:33.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d88126cb0 con 0x560d8811ffc0 2024-09-14T10:44:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbd77fff640 1 -- 172.21.15.96:0/3829416024 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbe9003e3f0 con 0x560d8811ffc0 2024-09-14T10:44:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbd77fff640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd7003a100 0x7fbd7003c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbd77fff640 1 -- 172.21.15.96:0/3829416024 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbe90053140 con 0x560d8811ffc0 2024-09-14T10:44:33.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6816640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd7003a100 0x7fbd7003c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d88131810 0x560d88133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d881343f0 con 0x560d88131810 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6015640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d88131810 0x560d88133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6816640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd7003a100 0x7fbd7003c5c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbea000f010 tx=0x7fbea001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6015640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d88131810 0x560d88133ca0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 realm 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88134800 con 0x560d88131810 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d881350d0 con 0x560d88131810 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88135470 con 0x560d88131810 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88135cc0 con 0x560d88131810 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 20 searching for the correct realm 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x560d88137a30 0x560d88139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d8813a400 con 0x560d88137a30 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.236+0000 7fbea5814640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x560d88137a30 0x560d88139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea5814640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x560d88137a30 0x560d88139e20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea5814640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe90027060 0x7fbe9001a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d8813a400 con 0x7fbe90027060 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6816640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe90027060 0x7fbe9001a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6816640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe90027060 0x7fbe9001a320 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6816640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbea0019040 0x7fbea0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d8813a400 con 0x7fbea0019040 2024-09-14T10:44:33.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbea0019040 0x7fbea0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbea0019040 0x7fbea0019930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d8813a400 con 0x560d88131810 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d8813a400 con 0x560d88131810 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d8813a400 con 0x7fbea0019040 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.240+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560d8813a400 con 0x7fbea0019040 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbe90027060 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88137a30 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88131810 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbea0019040 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88131810 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbe90027060 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88137a30 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88137a30 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbea0019040 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88137a30 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88137a30 2024-09-14T10:44:33.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88131810 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88131810 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.244+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbea0019040 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88137a30 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbe90027060 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88131810 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbea0019040 2024-09-14T10:44:33.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88137a30 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbea0019040 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbe90027060 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88137a30 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.248+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbea0019040 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x560d88131810 2024-09-14T10:44:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe980e1040 con 0x7fbe90027060 2024-09-14T10:44:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88136510 con 0x560d88131810 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88136900 con 0x560d88131810 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88136900 con 0x560d88131810 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 zone default found 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 4 Realm: () 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 zonegroup default 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88136d20 con 0x7fbea0019040 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88137140 con 0x560d88137a30 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d8813c250 con 0x560d88137a30 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 started sync module instance, tier type = 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.252+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813b6f0 con 0x7fbe90027060 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.256+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.256+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94616117557984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813caa0 con 0x7fbe90027060 2024-09-14T10:44:33.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.256+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813d2f0 con 0x560d88131810 2024-09-14T10:44:33.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.256+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94616117557984] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.256+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.256+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94616117560816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813cf00 con 0x560d88131810 2024-09-14T10:44:33.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.256+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813da20 con 0x560d88137a30 2024-09-14T10:44:33.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94616117560816] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94616117564656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813de10 con 0x560d88137a30 2024-09-14T10:44:33.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813e7d0 con 0x7fbe90027060 2024-09-14T10:44:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94616117568560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813ef00 con 0x7fbe90027060 2024-09-14T10:44:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813fa20 con 0x560d88131810 2024-09-14T10:44:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94616117564656] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94616117568560] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94616117572848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813f9e0 con 0x560d88131810 2024-09-14T10:44:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.260+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d881402c0 con 0x7fbea0019040 2024-09-14T10:44:33.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.264+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94616117572848] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.264+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.264+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94616117561872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813f9e0 con 0x7fbea0019040 2024-09-14T10:44:33.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.264+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d88140760 con 0x7fbea0019040 2024-09-14T10:44:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.264+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94616117561872] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.264+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.264+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94616117575104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d88140690 con 0x7fbea0019040 2024-09-14T10:44:33.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.264+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d881410d0 con 0x7fbea0019040 2024-09-14T10:44:33.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94616117575104] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94616117578656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d881412b0 con 0x7fbea0019040 2024-09-14T10:44:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 20 add_watcher() i=0 2024-09-14T10:44:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 20 add_watcher() i=1 2024-09-14T10:44:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 20 add_watcher() i=2 2024-09-14T10:44:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 20 add_watcher() i=3 2024-09-14T10:44:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 20 add_watcher() i=4 2024-09-14T10:44:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 20 add_watcher() i=5 2024-09-14T10:44:33.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 20 add_watcher() i=6 2024-09-14T10:44:33.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94616117578656] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 20 add_watcher() i=7 2024-09-14T10:44:33.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:33.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88144680 con 0x560d88131810 2024-09-14T10:44:33.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.268+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94616117580192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d88141a70 con 0x560d88131810 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94616117580192] v32'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbd5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 5 note: GC not initialized 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbcd77fe640 20 reqs_thread_entry: start 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 20 Filter name: none 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbcd57fa640 20 reqs_thread_entry: start 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560d88167720 con 0x560d88131810 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T10:44:33.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbd5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.272+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94616117580192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d88165490 con 0x560d88131810 2024-09-14T10:44:33.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94616117580192] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94616117557984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d88165490 con 0x7fbe90027060 2024-09-14T10:44:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94616117557984] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea850f9c0 20 remove_watcher() i=0 2024-09-14T10:44:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea850f9c0 2 removed watcher, disabling cache 2024-09-14T10:44:33.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94616117560816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d88165490 con 0x560d88131810 2024-09-14T10:44:33.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94616117560816] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea850f9c0 20 remove_watcher() i=1 2024-09-14T10:44:33.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.276+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94616117564656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d88165490 con 0x560d88137a30 2024-09-14T10:44:33.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea5814640 1 -- 172.21.15.96:0/3829416024 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94616117564656] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe90024030 con 0x560d88137a30 2024-09-14T10:44:33.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea850f9c0 20 remove_watcher() i=2 2024-09-14T10:44:33.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94616117568560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813bae0 con 0x7fbe90027060 2024-09-14T10:44:33.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea6816640 1 -- 172.21.15.96:0/3829416024 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94616117568560] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbea002f040 con 0x7fbe90027060 2024-09-14T10:44:33.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea850f9c0 20 remove_watcher() i=3 2024-09-14T10:44:33.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94616117572848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813c5f0 con 0x560d88131810 2024-09-14T10:44:33.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94616117572848] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x560d88131810 2024-09-14T10:44:33.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea850f9c0 20 remove_watcher() i=4 2024-09-14T10:44:33.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.280+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94616117561872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813d4f0 con 0x7fbea0019040 2024-09-14T10:44:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.284+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94616117561872] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.284+0000 7fbea850f9c0 20 remove_watcher() i=5 2024-09-14T10:44:33.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.284+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94616117575104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813bae0 con 0x7fbea0019040 2024-09-14T10:44:33.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.284+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94616117575104] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.284+0000 7fbea850f9c0 20 remove_watcher() i=6 2024-09-14T10:44:33.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.284+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94616117578656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560d8813d4f0 con 0x7fbea0019040 2024-09-14T10:44:33.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94616117578656] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe980cd060 con 0x7fbea0019040 2024-09-14T10:44:33.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 20 remove_watcher() i=7 2024-09-14T10:44:33.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbea0019040 msgr2=0x7fbea0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbea0019040 0x7fbea0019930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d88131810 msgr2=0x560d88133ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d88131810 0x560d88133ca0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe90027060 msgr2=0x7fbe9001a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe90027060 0x7fbe9001a320 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x560d88137a30 msgr2=0x560d88139e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x560d88137a30 0x560d88139e20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd7003a100 msgr2=0x7fbd7003c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd7003a100 0x7fbd7003c5c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbea000f010 tx=0x7fbea001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 msgr2=0x560d881264c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/3829416024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8811ffc0 0x560d881264c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbe90001590 tx=0x7fbe900507a0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 reap_dead start 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea6015640 1 -- 172.21.15.96:0/3829416024 reap_dead start 2024-09-14T10:44:33.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 shutdown_connections 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 >> 172.21.15.96:0/3829416024 conn(0x560d8811b380 msgr2=0x560d88119590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 shutdown_connections 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/3829416024 wait complete. 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/969109713 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8003a1a0 msgr2=0x7fbd8003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/969109713 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8003a1a0 0x7fbd8003c660 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x560d88103770 tx=0x7fbea0003070 comp rx=0 tx=0).stop 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/969109713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d88112590 msgr2=0x560d881129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/969109713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d88112590 0x560d881129b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000e670 tx=0x7fbe9000ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/969109713 shutdown_connections 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/969109713 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8003a1a0 0x7fbd8003c660 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/969109713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d88112590 0x560d881129b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/969109713 >> 172.21.15.96:0/969109713 conn(0x560d88107f40 msgr2=0x560d88108320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/969109713 shutdown_connections 2024-09-14T10:44:33.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/969109713 wait complete. 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d87f7a670 msgr2=0x560d88101f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d87f7a670 0x560d88101f20 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8c03a150 msgr2=0x7fbd8c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8c03a150 0x7fbd8c03c610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe90001e90 tx=0x7fbe900013f0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 msgr2=0x560d880fadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880fadb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbe9801b930 tx=0x7fbe98017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 shutdown_connections 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560d87f7a670 0x560d88101f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbd8c03a150 0x7fbd8c03c610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 --2- 172.21.15.96:0/1916227580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d87f7a290 0x560d880fadb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 >> 172.21.15.96:0/1916227580 conn(0x560d88000970 msgr2=0x560d880f49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 shutdown_connections 2024-09-14T10:44:33.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.288+0000 7fbea850f9c0 1 -- 172.21.15.96:0/1916227580 wait complete. 2024-09-14T10:44:33.296 INFO:teuthology.orchestra.run.smithi096.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"BVZcM9eSklM2RwR2sqHvfPu2","ver":2},"mtime":"2024-09-14T10:44:33.093168Z","data":{"bucket":{"name":"myfoo","marker":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","bucket_id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-14T10:44:29.762936Z","linked":true,"has_bucket_info":false}} 2024-09-14T10:44:33.296 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'BVZcM9eSklM2RwR2sqHvfPu2', 'ver': 2}, 'mtime': '2024-09-14T10:44:33.093168Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'bucket_id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-14T10:44:29.762936Z', 'linked': True, 'has_bucket_info': False}} 2024-09-14T10:44:33.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-14T10:44:33.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-14T10:44:33.296 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-14T10:44:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd35c7a59c0 1 Processor -- start 2024-09-14T10:44:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd35c7a59c0 1 -- start start 2024-09-14T10:44:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd35c7a59c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5628842ca080 0x5628842c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd35c7a59c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5628841fb7a0 con 0x5628842c9b50 2024-09-14T10:44:33.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd35c7a59c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5628842571b0 con 0x5628842ca080 2024-09-14T10:44:33.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd359aaa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5628842ca080 0x5628842c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd359aaa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5628842ca080 0x5628842c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45692/0 (socket says 172.21.15.96:45692) 2024-09-14T10:44:33.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd35a2ab640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5628842c9b50 0x5628842c84f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37256/0 (socket says 172.21.15.96:37256) 2024-09-14T10:44:33.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd359aaa640 1 -- 172.21.15.96:0/798448936 learned_addr learned my addr 172.21.15.96:0/798448936 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd359aaa640 1 -- 172.21.15.96:0/798448936 >> v1:172.21.15.70:6789/0 conn(0x5628842c9b50 legacy=0x5628842c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.380+0000 7fd359aaa640 1 -- 172.21.15.96:0/798448936 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628841d5da0 con 0x5628842ca080 2024-09-14T10:44:33.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd359aaa640 1 --2- 172.21.15.96:0/798448936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842ca080 0x5628842c8c00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd34400a5c0 tx=0x7fd34401b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596b47573e85c81d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd3592a9640 1 -- 172.21.15.96:0/798448936 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3440aa540 con 0x5628842ca080 2024-09-14T10:44:33.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd3592a9640 1 -- 172.21.15.96:0/798448936 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3440af070 con 0x5628842ca080 2024-09-14T10:44:33.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd3592a9640 1 -- 172.21.15.96:0/798448936 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3440aa830 con 0x5628842ca080 2024-09-14T10:44:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/798448936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842ca080 msgr2=0x5628842c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/798448936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842ca080 0x5628842c8c00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd34400a5c0 tx=0x7fd34401b2e0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/798448936 shutdown_connections 2024-09-14T10:44:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/798448936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842ca080 0x5628842c8c00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/798448936 >> 172.21.15.96:0/798448936 conn(0x56288434eb30 msgr2=0x562884350f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/798448936 shutdown_connections 2024-09-14T10:44:33.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.384+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/798448936 wait complete. 2024-09-14T10:44:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35c7a59c0 1 Processor -- start 2024-09-14T10:44:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35c7a59c0 1 -- start start 2024-09-14T10:44:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35c7a59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884440810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35c7a59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56288425afc0 con 0x5628842c9b50 2024-09-14T10:44:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35a2ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884440810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35a2ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884440810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45708/0 (socket says 172.21.15.96:45708) 2024-09-14T10:44:33.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35a2ab640 1 -- 172.21.15.96:0/2118510321 learned_addr learned my addr 172.21.15.96:0/2118510321 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35a2ab640 1 -- 172.21.15.96:0/2118510321 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562884440e00 con 0x5628842c9b50 2024-09-14T10:44:33.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd35a2ab640 1 --2- 172.21.15.96:0/2118510321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884440810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd34c001680 tx=0x7fd34c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c58bcb99a3cecb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd248608640 1 -- 172.21.15.96:0/2118510321 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34c013420 con 0x5628842c9b50 2024-09-14T10:44:33.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd248608640 1 -- 172.21.15.96:0/2118510321 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34c0135c0 con 0x5628842c9b50 2024-09-14T10:44:33.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.396+0000 7fd248608640 1 -- 172.21.15.96:0/2118510321 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34c0138e0 con 0x5628842c9b50 2024-09-14T10:44:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2118510321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 msgr2=0x562884440810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2118510321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884440810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd34c001680 tx=0x7fd34c001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2118510321 shutdown_connections 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2118510321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884440810 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2118510321 >> 172.21.15.96:0/2118510321 conn(0x56288434eb30 msgr2=0x56288443c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2118510321 shutdown_connections 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2118510321 wait complete. 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 Processor -- start 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- start start 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884448080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5628841fca50 con 0x5628842c9b50 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35a2ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884448080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35a2ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884448080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45716/0 (socket says 172.21.15.96:45716) 2024-09-14T10:44:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35a2ab640 1 -- 172.21.15.96:0/2494297161 learned_addr learned my addr 172.21.15.96:0/2494297161 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35a2ab640 1 -- 172.21.15.96:0/2494297161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628844485e0 con 0x5628842c9b50 2024-09-14T10:44:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35a2ab640 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884448080 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5628844417a0 tx=0x7fd34c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd246e05640 1 -- 172.21.15.96:0/2494297161 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34c0037a0 con 0x5628842c9b50 2024-09-14T10:44:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562884448870 con 0x5628842c9b50 2024-09-14T10:44:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd246e05640 1 -- 172.21.15.96:0/2494297161 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34c023070 con 0x5628842c9b50 2024-09-14T10:44:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd246e05640 1 -- 172.21.15.96:0/2494297161 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34c003ad0 con 0x5628842c9b50 2024-09-14T10:44:33.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562884449220 con 0x5628842c9b50 2024-09-14T10:44:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd246e05640 1 -- 172.21.15.96:0/2494297161 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd34c010070 con 0x5628842c9b50 2024-09-14T10:44:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd246e05640 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd24003a150 0x7fd24003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd246e05640 1 -- 172.21.15.96:0/2494297161 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd34c050c20 con 0x5628842c9b50 2024-09-14T10:44:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd359aaa640 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd24003a150 0x7fd24003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5628842ca080 0x56288444f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.400+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288444f730 con 0x5628842ca080 2024-09-14T10:44:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35aaac640 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5628842ca080 0x56288444f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd359aaa640 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd24003a150 0x7fd24003c610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3440ae000 tx=0x7fd3440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35aaac640 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5628842ca080 0x56288444f1f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35aaac640 1 -- 172.21.15.96:0/2494297161 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3540083f0 con 0x5628842ca080 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288444fb50 con 0x5628842ca080 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35aaac640 1 -- 172.21.15.96:0/2494297161 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3540083f0 con 0x5628842ca080 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884451450 con 0x5628842ca080 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35aaac640 1 -- 172.21.15.96:0/2494297161 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd3540083f0 con 0x5628842ca080 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884450590 con 0x5628842ca080 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35aaac640 1 -- 172.21.15.96:0/2494297161 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3540083f0 con 0x5628842ca080 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844509f0 con 0x5628842ca080 2024-09-14T10:44:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35aaac640 1 -- 172.21.15.96:0/2494297161 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd3540083f0 con 0x5628842ca080 2024-09-14T10:44:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 Processor -- start 2024-09-14T10:44:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 -- start start 2024-09-14T10:44:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288445f820 0x56288445fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562884267d80 con 0x56288445f820 2024-09-14T10:44:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd359aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288445f820 0x56288445fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd359aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288445f820 0x56288445fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45718/0 (socket says 172.21.15.96:45718) 2024-09-14T10:44:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd359aaa640 1 -- 172.21.15.96:0/3598974561 learned_addr learned my addr 172.21.15.96:0/3598974561 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd359aaa640 1 -- 172.21.15.96:0/3598974561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562884460280 con 0x56288445f820 2024-09-14T10:44:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd359aaa640 1 --2- 172.21.15.96:0/3598974561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288445f820 0x56288445fc40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd344017f50 tx=0x7fd3440180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd23ffff640 1 -- 172.21.15.96:0/3598974561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3440b48f0 con 0x56288445f820 2024-09-14T10:44:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/3598974561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562884460ae0 con 0x56288445f820 2024-09-14T10:44:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd23ffff640 1 -- 172.21.15.96:0/3598974561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3440b4a90 con 0x56288445f820 2024-09-14T10:44:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd23ffff640 1 -- 172.21.15.96:0/3598974561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3440b4d70 con 0x56288445f820 2024-09-14T10:44:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.404+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/3598974561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562884460ff0 con 0x56288445f820 2024-09-14T10:44:33.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd23ffff640 1 -- 172.21.15.96:0/3598974561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd3440c9430 con 0x56288445f820 2024-09-14T10:44:33.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd23ffff640 1 --2- 172.21.15.96:0/3598974561 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd23403a1a0 0x7fd23403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd23ffff640 1 -- 172.21.15.96:0/3598974561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd3440ee2c0 con 0x56288445f820 2024-09-14T10:44:33.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35aaac640 1 --2- 172.21.15.96:0/3598974561 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd23403a1a0 0x7fd23403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 Processor -- start 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- start start 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35aaac640 1 --2- 172.21.15.96:0/3598974561 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd23403a1a0 0x7fd23403c660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x562884450930 tx=0x7fd354003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x56288446d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562884441230 con 0x56288446d070 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd359aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x56288446d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd359aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x56288446d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45722/0 (socket says 172.21.15.96:45722) 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd359aaa640 1 -- 172.21.15.96:0/1117131486 learned_addr learned my addr 172.21.15.96:0/1117131486 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd359aaa640 1 -- 172.21.15.96:0/1117131486 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288446da60 con 0x56288446d070 2024-09-14T10:44:33.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd359aaa640 1 --2- 172.21.15.96:0/1117131486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x56288446d470 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd3440ec6b0 tx=0x7fd3440bf7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b680abea192d3808 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd23dffb640 1 -- 172.21.15.96:0/1117131486 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3440c8e30 con 0x56288446d070 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd23dffb640 1 -- 172.21.15.96:0/1117131486 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3440eb1d0 con 0x56288446d070 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd23dffb640 1 -- 172.21.15.96:0/1117131486 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3440bd3b0 con 0x56288446d070 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1117131486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 msgr2=0x56288446d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1117131486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x56288446d470 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd3440ec6b0 tx=0x7fd3440bf7e0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1117131486 shutdown_connections 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1117131486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x56288446d470 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1117131486 >> 172.21.15.96:0/1117131486 conn(0x562884468490 msgr2=0x5628844666d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1117131486 shutdown_connections 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1117131486 wait complete. 2024-09-14T10:44:33.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 Processor -- start 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- start start 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x5628844735c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd35c7a59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56288446bfc0 con 0x56288446d070 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd359aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x5628844735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd359aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x5628844735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45736/0 (socket says 172.21.15.96:45736) 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.412+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 learned_addr learned my addr 172.21.15.96:0/1195798197 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562884473b20 con 0x56288446d070 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd359aaa640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x5628844735c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd3440c8b40 tx=0x7fd3440bff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd22bfff640 1 -- 172.21.15.96:0/1195798197 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3440bd9a0 con 0x56288446d070 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562884473db0 con 0x56288446d070 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd22bfff640 1 -- 172.21.15.96:0/1195798197 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3440bea50 con 0x56288446d070 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd22bfff640 1 -- 172.21.15.96:0/1195798197 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3440bdb40 con 0x56288446d070 2024-09-14T10:44:33.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562884474760 con 0x56288446d070 2024-09-14T10:44:33.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd22bfff640 1 -- 172.21.15.96:0/1195798197 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd3440f5060 con 0x56288446d070 2024-09-14T10:44:33.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd22bfff640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd22403a150 0x7fd22403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd22bfff640 1 -- 172.21.15.96:0/1195798197 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd3440dd0c0 con 0x56288446d070 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35aaac640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd22403a150 0x7fd22403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56288447ea00 0x562884480e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844815e0 con 0x56288447ea00 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35a2ab640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56288447ea00 0x562884480e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35aaac640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd22403a150 0x7fd22403c610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd35400f010 tx=0x7fd35401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35a2ab640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56288447ea00 0x562884480e90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 realm 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844819f0 con 0x56288447ea00 2024-09-14T10:44:33.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844822c0 con 0x56288447ea00 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884482660 con 0x56288447ea00 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.416+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884482eb0 con 0x56288447ea00 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35c7a59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35c7a59c0 20 searching for the correct realm 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562884484c20 0x562884487010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x562884484c20 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd359aaa640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562884484c20 0x562884487010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd359aaa640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562884484c20 0x562884487010 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd359aaa640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd344009040 0x7fd3440eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x7fd344009040 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35aaac640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd344009040 0x7fd3440eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35aaac640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd344009040 0x7fd3440eda30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35aaac640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd354019040 0x7fd354019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x7fd354019040 2024-09-14T10:44:33.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd354019040 0x7fd354019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd354019040 0x7fd354019930 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x56288447ea00 2024-09-14T10:44:33.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x56288447ea00 2024-09-14T10:44:33.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.420+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x7fd354019040 2024-09-14T10:44:33.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x7fd354019040 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x7fd344009040 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x562884484c20 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562884487640 con 0x56288447ea00 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd354019040 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x56288447ea00 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd344009040 2024-09-14T10:44:33.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x562884484c20 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x562884484c20 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.424+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd354019040 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x562884484c20 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x562884484c20 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x56288447ea00 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x56288447ea00 2024-09-14T10:44:33.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd354019040 2024-09-14T10:44:33.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x562884484c20 2024-09-14T10:44:33.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd344009040 2024-09-14T10:44:33.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x56288447ea00 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd354019040 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x562884484c20 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.428+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd354019040 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd344009040 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x562884484c20 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd354019040 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x56288447ea00 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd34c03e040 con 0x7fd344009040 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884483700 con 0x56288447ea00 2024-09-14T10:44:33.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884483700 con 0x56288447ea00 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884483700 con 0x56288447ea00 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 zone default found 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 4 Realm: () 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:33.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 zonegroup default 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884483670 con 0x7fd354019040 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884484040 con 0x562884484c20 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.432+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884489490 con 0x562884484c20 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35c7a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35c7a59c0 20 started sync module instance, tier type = 2024-09-14T10:44:33.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35c7a59c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:33.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562884488930 con 0x7fd344009040 2024-09-14T10:44:33.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732018025600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562884489830 con 0x7fd344009040 2024-09-14T10:44:33.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448a0e0 con 0x56288447ea00 2024-09-14T10:44:33.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732018025600] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732018027808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562884489ce0 con 0x56288447ea00 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.436+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448aaf0 con 0x562884484c20 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.440+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732018027808] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.440+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.440+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732018030640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562884489c50 con 0x562884484c20 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.440+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448b7f0 con 0x7fd344009040 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.440+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.440+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732018037840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448bf40 con 0x7fd344009040 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.440+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448ca60 con 0x56288447ea00 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732018037840] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732018030640] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732018036368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448ca20 con 0x56288447ea00 2024-09-14T10:44:33.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448d300 con 0x7fd354019040 2024-09-14T10:44:33.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732018036368] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732018042160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448ca20 con 0x7fd354019040 2024-09-14T10:44:33.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.444+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448d780 con 0x7fd354019040 2024-09-14T10:44:33.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732018042160] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732018044416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448d780 con 0x7fd354019040 2024-09-14T10:44:33.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448e140 con 0x7fd354019040 2024-09-14T10:44:33.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732018044416] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732018045472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448e140 con 0x7fd354019040 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 20 add_watcher() i=0 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 20 add_watcher() i=1 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 20 add_watcher() i=2 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 20 add_watcher() i=3 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 20 add_watcher() i=4 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 20 add_watcher() i=5 2024-09-14T10:44:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.448+0000 7fd35c7a59c0 20 add_watcher() i=6 2024-09-14T10:44:33.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732018045472] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 20 add_watcher() i=7 2024-09-14T10:44:33.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:33.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562884491540 con 0x56288447ea00 2024-09-14T10:44:33.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732018048608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288448ea30 con 0x56288447ea00 2024-09-14T10:44:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732018048608] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd210fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 5 note: GC not initialized 2024-09-14T10:44:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd18b7fe640 20 reqs_thread_entry: start 2024-09-14T10:44:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:33.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 20 Filter name: none 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd1897fa640 20 reqs_thread_entry: start 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844b4ca0 con 0x56288447ea00 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.452+0000 7fd35c7a59c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844b6d90 con 0x56288447ea00 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T10:44:33.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-14T10:44:33.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-14T10:44:33.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:33.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 8.10 8:0cf9189a:root::.bucket.meta.testx%3amyfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844b8630 con 0x562884484c20 2024-09-14T10:44:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T10:44:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T10:44:33.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844bccf0 con 0x56288447ea00 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844c0890 con 0x562884484c20 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [create,call,writefull 0~387,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x7 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1, ofs0, ns] 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94732018254288 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844bf8d0 con 0x56288447ea00 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify (1) cookie 94732018036368 notify 137438953488 ret 0) ==== 778+0+0 (crc 0 0 0) 0x562884449220 con 0x56288447ea00 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd23dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94732018036368 notifier 4557 bl.length()=736 2024-09-14T10:44:33.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd23dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x7 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd23dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd23dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(67 notify.4 [notify cookie 94732018254288 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd23dffb640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd220003eb0 con 0x56288447ea00 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== watch-notify(notify_complete (2) cookie 94732018254288 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562884448870 con 0x56288447ea00 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_sources= new_sources= 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential sources added=[] removed=[] 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_dests= new_dests= 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential dests added=[] removed=[] 2024-09-14T10:44:33.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.456+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844bf790 con 0x7fd344009040 2024-09-14T10:44:33.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.460+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.460+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844bf790 con 0x7fd344009040 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94732018250464 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844bf700 con 0x7fd354019040 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== watch-notify(notify (1) cookie 94732018044416 notify 137438953487 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5628844485e0 con 0x7fd354019040 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd23d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94732018044416 notifier 4557 bl.length()=314 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd23d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd23d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(71 notify.6 [notify cookie 94732018250464 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd23d7fa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd190003410 con 0x7fd354019040 2024-09-14T10:44:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== watch-notify(notify_complete (2) cookie 94732018250464 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562884440e00 con 0x7fd354019040 2024-09-14T10:44:33.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844be5a0 con 0x56288447ea00 2024-09-14T10:44:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-14T10:44:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-14T10:44:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94732018235040 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844bbf70 con 0x56288447ea00 2024-09-14T10:44:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== watch-notify(notify (1) cookie 94732018036368 notify 137438953489 ret 0) ==== 197+0+0 (crc 0 0 0) 0x562884440e00 con 0x56288447ea00 2024-09-14T10:44:33.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd23d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94732018036368 notifier 4557 bl.length()=155 2024-09-14T10:44:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(74 notify.4 [notify cookie 94732018235040 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd23d7fa640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd190003410 con 0x56288447ea00 2024-09-14T10:44:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== watch-notify(notify_complete (2) cookie 94732018235040 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5628841fb7a0 con 0x56288447ea00 2024-09-14T10:44:33.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.464+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:76 8.10 8:0cf9189a:root::.bucket.meta.testx%3amyfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844bd590 con 0x562884484c20 2024-09-14T10:44:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call,delete] v32'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35c7a59c0 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 from cache 2024-09-14T10:44:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35c7a59c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1, ofs0, ns] 2024-09-14T10:44:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94732018224304 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628844bbb50 con 0x7fd344009040 2024-09-14T10:44:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== watch-notify(notify (1) cookie 94732018037840 notify 137438953486 ret 0) ==== 254+0+0 (crc 0 0 0) 0x5628844bfb30 con 0x7fd344009040 2024-09-14T10:44:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd23dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94732018037840 notifier 4557 bl.length()=212 2024-09-14T10:44:33.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd23dffb640 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd220003eb0 con 0x7fd344009040 2024-09-14T10:44:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(77 notify.3 [notify cookie 94732018224304 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== watch-notify(notify_complete (2) cookie 94732018224304 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd354010040 con 0x7fd344009040 2024-09-14T10:44:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd210fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732018048608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b28c0 con 0x56288447ea00 2024-09-14T10:44:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94732018048608] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.468+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732018025600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b7fe0 con 0x7fd344009040 2024-09-14T10:44:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.472+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94732018025600] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.472+0000 7fd35c7a59c0 20 remove_watcher() i=0 2024-09-14T10:44:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.472+0000 7fd35c7a59c0 2 removed watcher, disabling cache 2024-09-14T10:44:33.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.472+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732018027808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b7fe0 con 0x56288447ea00 2024-09-14T10:44:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.472+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94732018027808] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.472+0000 7fd35c7a59c0 20 remove_watcher() i=1 2024-09-14T10:44:33.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.472+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732018030640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b7fe0 con 0x562884484c20 2024-09-14T10:44:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd359aaa640 1 -- 172.21.15.96:0/1195798197 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94732018030640] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3440cf020 con 0x562884484c20 2024-09-14T10:44:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd35c7a59c0 20 remove_watcher() i=2 2024-09-14T10:44:33.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732018037840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b7fe0 con 0x7fd344009040 2024-09-14T10:44:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd35aaac640 1 -- 172.21.15.96:0/1195798197 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94732018037840] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35402f040 con 0x7fd344009040 2024-09-14T10:44:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd35c7a59c0 20 remove_watcher() i=3 2024-09-14T10:44:33.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732018036368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b7fe0 con 0x56288447ea00 2024-09-14T10:44:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94732018036368] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x56288447ea00 2024-09-14T10:44:33.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd35c7a59c0 20 remove_watcher() i=4 2024-09-14T10:44:33.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.476+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732018042160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b7fe0 con 0x7fd354019040 2024-09-14T10:44:33.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.480+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94732018042160] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.480+0000 7fd35c7a59c0 20 remove_watcher() i=5 2024-09-14T10:44:33.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.480+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732018044416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b7fe0 con 0x7fd354019040 2024-09-14T10:44:33.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.480+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94732018044416] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.480+0000 7fd35c7a59c0 20 remove_watcher() i=6 2024-09-14T10:44:33.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.480+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732018045472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628844b7fe0 con 0x7fd354019040 2024-09-14T10:44:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94732018045472] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd34c00f030 con 0x7fd354019040 2024-09-14T10:44:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 20 remove_watcher() i=7 2024-09-14T10:44:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd354019040 msgr2=0x7fd354019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd354019040 0x7fd354019930 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56288447ea00 msgr2=0x562884480e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56288447ea00 0x562884480e90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd344009040 msgr2=0x7fd3440eda30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd344009040 0x7fd3440eda30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562884484c20 msgr2=0x562884487010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562884484c20 0x562884487010 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd22403a150 msgr2=0x7fd22403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd22403a150 0x7fd22403c610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd35400f010 tx=0x7fd35401b070 comp rx=0 tx=0).stop 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 msgr2=0x5628844735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35a2ab640 1 -- 172.21.15.96:0/1195798197 reap_dead start 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x5628844735c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd3440c8b40 tx=0x7fd3440bff70 comp rx=0 tx=0).stop 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 shutdown_connections 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/1195798197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288446d070 0x5628844735c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 >> 172.21.15.96:0/1195798197 conn(0x562884468490 msgr2=0x5628844666a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 shutdown_connections 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/1195798197 wait complete. 2024-09-14T10:44:33.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/3598974561 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd23403a1a0 msgr2=0x7fd23403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/3598974561 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd23403a1a0 0x7fd23403c660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x562884450930 tx=0x7fd354003070 comp rx=0 tx=0).stop 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/3598974561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288445f820 msgr2=0x56288445fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/3598974561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288445f820 0x56288445fc40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd344017f50 tx=0x7fd3440180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/3598974561 shutdown_connections 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/3598974561 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd23403a1a0 0x7fd23403c660 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/3598974561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56288445f820 0x56288445fc40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/3598974561 >> 172.21.15.96:0/3598974561 conn(0x5628844551d0 msgr2=0x5628844555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/3598974561 shutdown_connections 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/3598974561 wait complete. 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5628842ca080 msgr2=0x56288444f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5628842ca080 0x56288444f1f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd24003a150 msgr2=0x7fd24003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd24003a150 0x7fd24003c610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3440ae000 tx=0x7fd3440a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 msgr2=0x562884448080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884448080 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5628844417a0 tx=0x7fd34c000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 shutdown_connections 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5628842ca080 0x56288444f1f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd24003a150 0x7fd24003c610 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 --2- 172.21.15.96:0/2494297161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628842c9b50 0x562884448080 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 >> 172.21.15.96:0/2494297161 conn(0x56288434eb30 msgr2=0x562884441c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 shutdown_connections 2024-09-14T10:44:33.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.484+0000 7fd35c7a59c0 1 -- 172.21.15.96:0/2494297161 wait complete. 2024-09-14T10:44:33.491 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-14T10:44:33.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-14T10:44:33.491 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-14T10:44:33.560 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:33.560 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7d4849c0 1 Processor -- start 2024-09-14T10:44:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7d4849c0 1 -- start start 2024-09-14T10:44:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7d4849c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5609b33852a0 0x5609b3411a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7d4849c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609b32b97a0 con 0x5609b3411f80 2024-09-14T10:44:33.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7d4849c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5609b33151b0 con 0x5609b33852a0 2024-09-14T10:44:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7af8a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5609b33852a0 0x5609b3411a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7af8a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5609b33852a0 0x5609b3411a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45752/0 (socket says 172.21.15.96:45752) 2024-09-14T10:44:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7af8a640 1 -- 172.21.15.96:0/21838190 learned_addr learned my addr 172.21.15.96:0/21838190 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7a789640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5609b3411f80 0x5609b34143a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37272/0 (socket says 172.21.15.96:37272) 2024-09-14T10:44:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7af8a640 1 -- 172.21.15.96:0/21838190 >> v1:172.21.15.70:6789/0 conn(0x5609b3411f80 legacy=0x5609b34143a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.564+0000 7ffa7af8a640 1 -- 172.21.15.96:0/21838190 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b3293da0 con 0x5609b33852a0 2024-09-14T10:44:33.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa7af8a640 1 --2- 172.21.15.96:0/21838190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3411a40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400a5c0 tx=0x7ffa7401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e38c4ccc9203819 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa79f88640 1 -- 172.21.15.96:0/21838190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa740b1070 con 0x5609b33852a0 2024-09-14T10:44:33.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa79f88640 1 -- 172.21.15.96:0/21838190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa740a8070 con 0x5609b33852a0 2024-09-14T10:44:33.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa79f88640 1 -- 172.21.15.96:0/21838190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa740ac5b0 con 0x5609b33852a0 2024-09-14T10:44:33.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/21838190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 msgr2=0x5609b3411a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/21838190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3411a40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400a5c0 tx=0x7ffa7401b340 comp rx=0 tx=0).stop 2024-09-14T10:44:33.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/21838190 shutdown_connections 2024-09-14T10:44:33.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/21838190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3411a40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/21838190 >> 172.21.15.96:0/21838190 conn(0x5609b340b980 msgr2=0x5609b340dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/21838190 shutdown_connections 2024-09-14T10:44:33.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.568+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/21838190 wait complete. 2024-09-14T10:44:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7d4849c0 1 Processor -- start 2024-09-14T10:44:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7d4849c0 1 -- start start 2024-09-14T10:44:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7d4849c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3503090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7d4849c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5609b3318fc0 con 0x5609b33852a0 2024-09-14T10:44:33.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7af8a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3503090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7af8a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3503090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45768/0 (socket says 172.21.15.96:45768) 2024-09-14T10:44:33.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7af8a640 1 -- 172.21.15.96:0/75276028 learned_addr learned my addr 172.21.15.96:0/75276028 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7af8a640 1 -- 172.21.15.96:0/75276028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b3503680 con 0x5609b33852a0 2024-09-14T10:44:33.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ffa7af8a640 1 --2- 172.21.15.96:0/75276028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3503090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa740af040 tx=0x7ffa74003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417b3408f93eadb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ff968e09640 1 -- 172.21.15.96:0/75276028 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa740b1040 con 0x5609b33852a0 2024-09-14T10:44:33.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ff968e09640 1 -- 172.21.15.96:0/75276028 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa740bc070 con 0x5609b33852a0 2024-09-14T10:44:33.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.580+0000 7ff968e09640 1 -- 172.21.15.96:0/75276028 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa740ac8d0 con 0x5609b33852a0 2024-09-14T10:44:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/75276028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 msgr2=0x5609b3503090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/75276028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3503090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa740af040 tx=0x7ffa74003030 comp rx=0 tx=0).stop 2024-09-14T10:44:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/75276028 shutdown_connections 2024-09-14T10:44:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/75276028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b3503090 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/75276028 >> 172.21.15.96:0/75276028 conn(0x5609b340b980 msgr2=0x5609b34fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/75276028 shutdown_connections 2024-09-14T10:44:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/75276028 wait complete. 2024-09-14T10:44:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 Processor -- start 2024-09-14T10:44:33.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- start start 2024-09-14T10:44:33.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b350a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5609b32baa50 con 0x5609b33852a0 2024-09-14T10:44:33.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7af8a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b350a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7af8a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b350a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45772/0 (socket says 172.21.15.96:45772) 2024-09-14T10:44:33.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7af8a640 1 -- 172.21.15.96:0/265614475 learned_addr learned my addr 172.21.15.96:0/265614475 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7af8a640 1 -- 172.21.15.96:0/265614475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b350adb0 con 0x5609b33852a0 2024-09-14T10:44:33.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7af8a640 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b350a850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa74018f70 tx=0x7ffa740180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ff967606640 1 -- 172.21.15.96:0/265614475 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa740c4030 con 0x5609b33852a0 2024-09-14T10:44:33.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b350b040 con 0x5609b33852a0 2024-09-14T10:44:33.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ff967606640 1 -- 172.21.15.96:0/265614475 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa740bc040 con 0x5609b33852a0 2024-09-14T10:44:33.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ff967606640 1 -- 172.21.15.96:0/265614475 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa740b1050 con 0x5609b33852a0 2024-09-14T10:44:33.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b350ba70 con 0x5609b33852a0 2024-09-14T10:44:33.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.584+0000 7ff967606640 1 -- 172.21.15.96:0/265614475 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ffa740c7030 con 0x5609b33852a0 2024-09-14T10:44:33.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ff967606640 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff96003a150 0x7ff96003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ff967606640 1 -- 172.21.15.96:0/265614475 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffa740c5070 con 0x5609b33852a0 2024-09-14T10:44:33.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7a789640 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff96003a150 0x7ff96003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3411f80 0x5609b35119c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3511f00 con 0x5609b3411f80 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3411f80 0x5609b35119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7a789640 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff96003a150 0x7ff96003c610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffa70001e40 tx=0x7ffa700013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3411f80 0x5609b35119c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7b78b640 1 -- 172.21.15.96:0/265614475 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6c00a4d0 con 0x5609b3411f80 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b350be80 con 0x5609b3411f80 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7b78b640 1 -- 172.21.15.96:0/265614475 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa6c00a4d0 con 0x5609b3411f80 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3513cb0 con 0x5609b3411f80 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7b78b640 1 -- 172.21.15.96:0/265614475 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa6c00a4d0 con 0x5609b3411f80 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3512ee0 con 0x5609b3411f80 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7b78b640 1 -- 172.21.15.96:0/265614475 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa6c00a4d0 con 0x5609b3411f80 2024-09-14T10:44:33.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3513300 con 0x5609b3411f80 2024-09-14T10:44:33.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7b78b640 1 -- 172.21.15.96:0/265614475 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa6c00a4d0 con 0x5609b3411f80 2024-09-14T10:44:33.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 Processor -- start 2024-09-14T10:44:33.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 -- start start 2024-09-14T10:44:33.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b35220a0 0x5609b35224c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7d4849c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5609b3325d80 con 0x5609b35220a0 2024-09-14T10:44:33.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7a789640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b35220a0 0x5609b35224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7a789640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b35220a0 0x5609b35224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45778/0 (socket says 172.21.15.96:45778) 2024-09-14T10:44:33.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7a789640 1 -- 172.21.15.96:0/3870118025 learned_addr learned my addr 172.21.15.96:0/3870118025 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7a789640 1 -- 172.21.15.96:0/3870118025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b3522b00 con 0x5609b35220a0 2024-09-14T10:44:33.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.588+0000 7ffa7a789640 1 --2- 172.21.15.96:0/3870118025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b35220a0 0x5609b35224c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000e670 tx=0x7ffa7000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff964e01640 1 -- 172.21.15.96:0/3870118025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa70022070 con 0x5609b35220a0 2024-09-14T10:44:33.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/3870118025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b3523360 con 0x5609b35220a0 2024-09-14T10:44:33.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/3870118025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b35238d0 con 0x5609b35220a0 2024-09-14T10:44:33.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff964e01640 1 -- 172.21.15.96:0/3870118025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7000d660 con 0x5609b35220a0 2024-09-14T10:44:33.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff964e01640 1 -- 172.21.15.96:0/3870118025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa70006070 con 0x5609b35220a0 2024-09-14T10:44:33.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff964e01640 1 -- 172.21.15.96:0/3870118025 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ffa70025070 con 0x5609b35220a0 2024-09-14T10:44:33.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff964e01640 1 --2- 172.21.15.96:0/3870118025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff95403a1a0 0x7ff95403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff964e01640 1 -- 172.21.15.96:0/3870118025 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffa700523f0 con 0x5609b35220a0 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/3870118025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff95403a1a0 0x7ff95403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7d4849c0 1 Processor -- start 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7d4849c0 1 -- start start 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/3870118025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff95403a1a0 0x7ff95403c660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5609b3513280 tx=0x7ffa6c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7d4849c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b352ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7d4849c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5609b35039f0 con 0x5609b352ea60 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7a789640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b352ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7a789640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b352ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45790/0 (socket says 172.21.15.96:45790) 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7a789640 1 -- 172.21.15.96:0/2508450058 learned_addr learned my addr 172.21.15.96:0/2508450058 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7a789640 1 -- 172.21.15.96:0/2508450058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b352f410 con 0x5609b352ea60 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ffa7a789640 1 --2- 172.21.15.96:0/2508450058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b352ee40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffa70050750 tx=0x7ffa7001ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb3ca756295014f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff95e7fc640 1 -- 172.21.15.96:0/2508450058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7004f280 con 0x5609b352ea60 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff95e7fc640 1 -- 172.21.15.96:0/2508450058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa700263b0 con 0x5609b352ea60 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.592+0000 7ff95e7fc640 1 -- 172.21.15.96:0/2508450058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa70025c80 con 0x5609b352ea60 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/2508450058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 msgr2=0x5609b352ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/2508450058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b352ee40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffa70050750 tx=0x7ffa7001ae00 comp rx=0 tx=0).stop 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/2508450058 shutdown_connections 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/2508450058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b352ee40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/2508450058 >> 172.21.15.96:0/2508450058 conn(0x5609b352ae90 msgr2=0x5609b35290d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/2508450058 shutdown_connections 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/2508450058 wait complete. 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 Processor -- start 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- start start 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b3535fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5609b352fa70 con 0x5609b352ea60 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7a789640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b3535fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7a789640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b3535fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45806/0 (socket says 172.21.15.96:45806) 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 learned_addr learned my addr 172.21.15.96:0/4286382798 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b3536540 con 0x5609b352ea60 2024-09-14T10:44:33.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7a789640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b3535fe0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffa7001af50 tx=0x7ffa700506b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ff95cff9640 1 -- 172.21.15.96:0/4286382798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7004f330 con 0x5609b352ea60 2024-09-14T10:44:33.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ff95cff9640 1 -- 172.21.15.96:0/4286382798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa70050d40 con 0x5609b352ea60 2024-09-14T10:44:33.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b35367d0 con 0x5609b352ea60 2024-09-14T10:44:33.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ff95cff9640 1 -- 172.21.15.96:0/4286382798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7000c2b0 con 0x5609b352ea60 2024-09-14T10:44:33.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b35367d0 con 0x5609b352ea60 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ff95cff9640 1 -- 172.21.15.96:0/4286382798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ffa7000c4a0 con 0x5609b352ea60 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ff95cff9640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff94403a150 0x7ff94403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ff95cff9640 1 -- 172.21.15.96:0/4286382798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffa70035c50 con 0x5609b352ea60 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff94403a150 0x7ff94403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3541380 0x5609b3543810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3543f60 con 0x5609b3541380 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7af8a640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3541380 0x5609b3543810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff94403a150 0x7ff94403c610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5609b3512a00 tx=0x7ffa6c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.596+0000 7ffa7af8a640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3541380 0x5609b3543810 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 realm 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3544370 con 0x5609b3541380 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3544c40 con 0x5609b3541380 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3544fe0 con 0x5609b3541380 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3545830 con 0x5609b3541380 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 20 searching for the correct realm 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5609b35475a0 0x5609b3549990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b3549f50 con 0x5609b35475a0 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7a789640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5609b35475a0 0x5609b3549990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7a789640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5609b35475a0 0x5609b3549990 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7003b070 con 0x5609b35475a0 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7a789640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffa70027060 0x7ffa70040050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b3549f50 con 0x7ffa70027060 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffa70027060 0x7ffa70040050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffa70027060 0x7ffa70040050 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c01f070 con 0x7ffa70027060 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7b78b640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffa6c031040 0x7ffa6c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b3549f50 con 0x7ffa6c031040 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7af8a640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffa6c031040 0x7ffa6c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.600+0000 7ffa7af8a640 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffa6c031040 0x7ffa6c032430 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b3549f50 con 0x5609b3541380 2024-09-14T10:44:33.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b3549f50 con 0x5609b3541380 2024-09-14T10:44:33.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b3549f50 con 0x7ffa6c031040 2024-09-14T10:44:33.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b3549f50 con 0x7ffa6c031040 2024-09-14T10:44:33.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa70027060 2024-09-14T10:44:33.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c01f070 con 0x7ffa70027060 2024-09-14T10:44:33.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b35475a0 2024-09-14T10:44:33.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7003b070 con 0x5609b35475a0 2024-09-14T10:44:33.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b3541380 2024-09-14T10:44:33.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa6c031040 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b3541380 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa70027060 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa6c01f070 con 0x7ffa70027060 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.604+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b35475a0 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b35475a0 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa6c031040 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b35475a0 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b35475a0 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b3541380 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b3541380 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa6c031040 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b35475a0 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa70027060 2024-09-14T10:44:33.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c01f070 con 0x7ffa70027060 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b3541380 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.608+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa6c031040 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b35475a0 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa6c031040 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa70027060 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c01f070 con 0x7ffa70027060 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b35475a0 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa6c031040 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x5609b3541380 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffa740e3040 con 0x7ffa70027060 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6c01f070 con 0x7ffa70027060 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3546080 con 0x5609b3541380 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3546470 con 0x5609b3541380 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3546470 con 0x5609b3541380 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 zone default found 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 4 Realm: () 2024-09-14T10:44:33.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 zonegroup default 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.612+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b3546960 con 0x7ffa6c031040 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b354bdc0 con 0x5609b35475a0 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b354c160 con 0x5609b35475a0 2024-09-14T10:44:33.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 20 started sync module instance, tier type = 2024-09-14T10:44:33.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:33.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354b260 con 0x7ffa70027060 2024-09-14T10:44:33.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599663367808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354aec0 con 0x7ffa70027060 2024-09-14T10:44:33.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354ce60 con 0x5609b3541380 2024-09-14T10:44:33.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599663367808] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599663371792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354d250 con 0x5609b3541380 2024-09-14T10:44:33.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.616+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354dc10 con 0x5609b35475a0 2024-09-14T10:44:33.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.620+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599663371792] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.620+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.620+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599663376224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354e000 con 0x5609b35475a0 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.620+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354e9c0 con 0x7ffa70027060 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.620+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.620+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599663380000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354f0b0 con 0x7ffa70027060 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.620+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354fbd0 con 0x5609b3541380 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.620+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599663376224] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.624+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.624+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599663384224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354fb90 con 0x5609b3541380 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.624+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b35505e0 con 0x7ffa6c031040 2024-09-14T10:44:33.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.624+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599663380000] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.624+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599663384224] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.624+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.624+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599663372976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b3550130 con 0x7ffa6c031040 2024-09-14T10:44:33.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.624+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b3550980 con 0x7ffa6c031040 2024-09-14T10:44:33.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599663372976] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599663386928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b3550a00 con 0x7ffa6c031040 2024-09-14T10:44:33.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b35513c0 con 0x7ffa6c031040 2024-09-14T10:44:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599663390480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b35517e0 con 0x7ffa6c031040 2024-09-14T10:44:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 20 add_watcher() i=0 2024-09-14T10:44:33.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 20 add_watcher() i=1 2024-09-14T10:44:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 20 add_watcher() i=2 2024-09-14T10:44:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 20 add_watcher() i=3 2024-09-14T10:44:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 20 add_watcher() i=4 2024-09-14T10:44:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.628+0000 7ffa7d4849c0 20 add_watcher() i=5 2024-09-14T10:44:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599663386928] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7d4849c0 20 add_watcher() i=6 2024-09-14T10:44:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599663390480] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7d4849c0 20 add_watcher() i=7 2024-09-14T10:44:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7d4849c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:33.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b35505a0 con 0x5609b3541380 2024-09-14T10:44:33.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599663388016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b3551c40 con 0x5609b3541380 2024-09-14T10:44:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599663388016] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ff9317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7d4849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7d4849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:33.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.632+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355d210 con 0x5609b3541380 2024-09-14T10:44:33.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.636+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.636+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355d880 con 0x7ffa6c031040 2024-09-14T10:44:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.636+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.636+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355d880 con 0x5609b35475a0 2024-09-14T10:44:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.640+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.640+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355dc20 con 0x5609b3541380 2024-09-14T10:44:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.640+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'135 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.640+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355dd50 con 0x7ffa70027060 2024-09-14T10:44:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.640+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.640+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355e380 con 0x5609b35475a0 2024-09-14T10:44:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.640+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.640+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355e720 con 0x5609b3541380 2024-09-14T10:44:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.644+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.644+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355e720 con 0x7ffa6c031040 2024-09-14T10:44:33.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.644+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.644+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355e720 con 0x7ffa70027060 2024-09-14T10:44:33.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.648+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.648+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355ec90 con 0x5609b35475a0 2024-09-14T10:44:33.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.648+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.648+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f030 con 0x7ffa70027060 2024-09-14T10:44:33.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.648+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.648+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f5a0 con 0x7ffa6c031040 2024-09-14T10:44:33.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.652+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.652+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f5a0 con 0x7ffa70027060 2024-09-14T10:44:33.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.652+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.652+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f960 con 0x7ffa6c031040 2024-09-14T10:44:33.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.656+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.656+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f900 con 0x5609b3541380 2024-09-14T10:44:33.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.656+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.656+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f6c0 con 0x5609b35475a0 2024-09-14T10:44:33.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.660+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.660+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f6c0 con 0x7ffa70027060 2024-09-14T10:44:33.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.660+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.660+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f6e0 con 0x5609b35475a0 2024-09-14T10:44:33.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.660+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.660+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f700 con 0x5609b3541380 2024-09-14T10:44:33.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.664+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.664+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f700 con 0x5609b3541380 2024-09-14T10:44:33.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.664+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.664+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f730 con 0x5609b35475a0 2024-09-14T10:44:33.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.664+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.664+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f730 con 0x7ffa70027060 2024-09-14T10:44:33.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.668+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.668+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f770 con 0x5609b35475a0 2024-09-14T10:44:33.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.668+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.668+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f7b0 con 0x5609b35475a0 2024-09-14T10:44:33.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.668+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.668+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f800 con 0x5609b35475a0 2024-09-14T10:44:33.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.672+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.672+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f800 con 0x5609b35475a0 2024-09-14T10:44:33.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.672+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.672+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f840 con 0x7ffa6c031040 2024-09-14T10:44:33.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.676+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.676+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f880 con 0x5609b35475a0 2024-09-14T10:44:33.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.676+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.676+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f880 con 0x7ffa6c031040 2024-09-14T10:44:33.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.680+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.680+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f880 con 0x5609b35475a0 2024-09-14T10:44:33.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.680+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.680+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f880 con 0x7ffa6c031040 2024-09-14T10:44:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b355f8c0 con 0x7ffa70027060 2024-09-14T10:44:33.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ff8abfff640 20 reqs_thread_entry: start 2024-09-14T10:44:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ffa7d4849c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ffa7d4849c0 20 Filter name: none 2024-09-14T10:44:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ff8a9ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ffa7d4849c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-14T10:44:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ffa7d4849c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.684+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b357af40 con 0x7ffa6c031040 2024-09-14T10:44:33.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T10:44:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-14T10:44:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:44:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b357d410 con 0x5609b3541380 2024-09-14T10:44:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-14T10:44:33.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b357b3f0 con 0x7ffa6c031040 2024-09-14T10:44:33.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:44:33.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94599663566672 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b357d970 con 0x5609b35475a0 2024-09-14T10:44:33.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== watch-notify(notify (1) cookie 94599663376224 notify 137438953477 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5609b355e770 con 0x5609b35475a0 2024-09-14T10:44:33.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ff95e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94599663376224 notifier 4564 bl.length()=170 2024-09-14T10:44:33.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(97 notify.2 [notify cookie 94599663566672 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ff95e7fc640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff940003d70 con 0x5609b35475a0 2024-09-14T10:44:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== watch-notify(notify_complete (2) cookie 94599663566672 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5609b352f410 con 0x5609b35475a0 2024-09-14T10:44:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 10 removing email index: 2024-09-14T10:44:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 10 removing user buckets index 2024-09-14T10:44:33.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.688+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b357d8d0 con 0x5609b3541380 2024-09-14T10:44:33.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7d4849c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94599663571904 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b357d8d0 con 0x5609b3541380 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== watch-notify(notify (1) cookie 94599663384224 notify 137438953490 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5609b355f030 con 0x5609b3541380 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ff95dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94599663384224 notifier 4564 bl.length()=175 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ff95dffb640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff8b00032d0 con 0x5609b3541380 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(100 notify.4 [notify cookie 94599663571904 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== watch-notify(notify_complete (2) cookie 94599663571904 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5609b35567c0 con 0x5609b3541380 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7d4849c0 10 removing user index: testx$tenanteduser 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b357cf60 con 0x7ffa6c031040 2024-09-14T10:44:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7d4849c0 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-14T10:44:33.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7d4849c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-14T10:44:33.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94599663571904 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b357c400 con 0x7ffa70027060 2024-09-14T10:44:33.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== watch-notify(notify (1) cookie 94599663380000 notify 137438953487 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5609b3536540 con 0x7ffa70027060 2024-09-14T10:44:33.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ff95e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94599663380000 notifier 4564 bl.length()=167 2024-09-14T10:44:33.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ff95e7fc640 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff940003d70 con 0x7ffa70027060 2024-09-14T10:44:33.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.692+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(103 notify.3 [notify cookie 94599663571904 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== watch-notify(notify_complete (2) cookie 94599663571904 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5609b355f3d0 con 0x7ffa70027060 2024-09-14T10:44:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ff9317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599663388016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b357d3c0 con 0x5609b3541380 2024-09-14T10:44:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94599663388016] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599663367808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b3550570 con 0x7ffa70027060 2024-09-14T10:44:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94599663367808] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7d4849c0 20 remove_watcher() i=0 2024-09-14T10:44:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7d4849c0 2 removed watcher, disabling cache 2024-09-14T10:44:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.696+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599663371792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354b680 con 0x5609b3541380 2024-09-14T10:44:33.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.700+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94599663371792] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.700+0000 7ffa7d4849c0 20 remove_watcher() i=1 2024-09-14T10:44:33.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.700+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599663376224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354b680 con 0x5609b35475a0 2024-09-14T10:44:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.700+0000 7ffa7a789640 1 -- 172.21.15.96:0/4286382798 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94599663376224] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa7005f040 con 0x5609b35475a0 2024-09-14T10:44:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.700+0000 7ffa7d4849c0 20 remove_watcher() i=2 2024-09-14T10:44:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.700+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599663380000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354d760 con 0x7ffa70027060 2024-09-14T10:44:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.704+0000 7ffa7b78b640 1 -- 172.21.15.96:0/4286382798 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94599663380000] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6c040040 con 0x7ffa70027060 2024-09-14T10:44:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.704+0000 7ffa7d4849c0 20 remove_watcher() i=3 2024-09-14T10:44:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.704+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599663384224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354b680 con 0x5609b3541380 2024-09-14T10:44:33.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.704+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94599663384224] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x5609b3541380 2024-09-14T10:44:33.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.704+0000 7ffa7d4849c0 20 remove_watcher() i=4 2024-09-14T10:44:33.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.704+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599663372976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354e620 con 0x7ffa6c031040 2024-09-14T10:44:33.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.704+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94599663372976] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.708+0000 7ffa7d4849c0 20 remove_watcher() i=5 2024-09-14T10:44:33.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.708+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599663386928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354f6a0 con 0x7ffa6c031040 2024-09-14T10:44:33.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.708+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94599663386928] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.708+0000 7ffa7d4849c0 20 remove_watcher() i=6 2024-09-14T10:44:33.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.708+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599663390480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b354b680 con 0x7ffa6c031040 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.708+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94599663390480] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa740d0070 con 0x7ffa6c031040 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.708+0000 7ffa7d4849c0 20 remove_watcher() i=7 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffa6c031040 msgr2=0x7ffa6c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffa6c031040 0x7ffa6c032430 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3541380 msgr2=0x5609b3543810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3541380 0x5609b3543810 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffa70027060 msgr2=0x7ffa70040050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffa70027060 0x7ffa70040050 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5609b35475a0 msgr2=0x5609b3549990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5609b35475a0 0x5609b3549990 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff94403a150 msgr2=0x7ff94403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff94403a150 0x7ff94403c610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5609b3512a00 tx=0x7ffa6c01f000 comp rx=0 tx=0).stop 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 msgr2=0x5609b3535fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7af8a640 1 -- 172.21.15.96:0/4286382798 reap_dead start 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b3535fe0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffa7001af50 tx=0x7ffa700506b0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 shutdown_connections 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/4286382798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b352ea60 0x5609b3535fe0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 >> 172.21.15.96:0/4286382798 conn(0x5609b352ae90 msgr2=0x5609b35290a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 shutdown_connections 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/4286382798 wait complete. 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/3870118025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff95403a1a0 msgr2=0x7ff95403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/3870118025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff95403a1a0 0x7ff95403c660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5609b3513280 tx=0x7ffa6c005850 comp rx=0 tx=0).stop 2024-09-14T10:44:33.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/3870118025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b35220a0 msgr2=0x5609b35224c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/3870118025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b35220a0 0x5609b35224c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000e670 tx=0x7ffa7000ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/3870118025 shutdown_connections 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/3870118025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff95403a1a0 0x7ff95403c660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/3870118025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b35220a0 0x5609b35224c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/3870118025 >> 172.21.15.96:0/3870118025 conn(0x5609b3517a50 msgr2=0x5609b3517e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/3870118025 shutdown_connections 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/3870118025 wait complete. 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3411f80 msgr2=0x5609b35119c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3411f80 0x5609b35119c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff96003a150 msgr2=0x7ff96003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff96003a150 0x7ff96003c610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffa70001e40 tx=0x7ffa700013a0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 msgr2=0x5609b350a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b350a850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa74018f70 tx=0x7ffa740180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 shutdown_connections 2024-09-14T10:44:33.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5609b3411f80 0x5609b35119c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff96003a150 0x7ff96003c610 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 --2- 172.21.15.96:0/265614475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5609b33852a0 0x5609b350a850 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 >> 172.21.15.96:0/265614475 conn(0x5609b340b980 msgr2=0x5609b34fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 shutdown_connections 2024-09-14T10:44:33.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.712+0000 7ffa7d4849c0 1 -- 172.21.15.96:0/265614475 wait complete. 2024-09-14T10:44:33.726 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-14T10:44:33.730 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-14T10:44:33.777 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:33.777 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-14T10:44:33.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-14T10:44:33.778 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-14T10:44:33.815 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:33.815 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:33.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f29279b49c0 1 Processor -- start 2024-09-14T10:44:33.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f29279b49c0 1 -- start start 2024-09-14T10:44:33.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f29279b49c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f4e25693b0 0x55f4e256b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f29279b49c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4e240d7a0 con 0x55f4e24d9260 2024-09-14T10:44:33.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f29279b49c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55f4e24691b0 con 0x55f4e25693b0 2024-09-14T10:44:33.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f2924cb9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f4e25693b0 0x55f4e256b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f29254ba640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55f4e24d9260 0x55f4e2567c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37282/0 (socket says 172.21.15.96:37282) 2024-09-14T10:44:33.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f2924cb9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f4e25693b0 0x55f4e256b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45810/0 (socket says 172.21.15.96:45810) 2024-09-14T10:44:33.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f29254ba640 1 -- 172.21.15.96:0/2534269662 learned_addr learned my addr 172.21.15.96:0/2534269662 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:33.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f2924cb9640 1 -- 172.21.15.96:0/2534269662 >> v1:172.21.15.70:6789/0 conn(0x55f4e24d9260 legacy=0x55f4e2567c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f2924cb9640 1 -- 172.21.15.96:0/2534269662 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e23e7da0 con 0x55f4e25693b0 2024-09-14T10:44:33.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.820+0000 7f2924cb9640 1 --2- 172.21.15.96:0/2534269662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e25693b0 0x55f4e256b7a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f291000a480 tx=0x7f291001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60029c4816bbaf8a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f291ffff640 1 -- 172.21.15.96:0/2534269662 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29100af070 con 0x55f4e25693b0 2024-09-14T10:44:33.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f291ffff640 1 -- 172.21.15.96:0/2534269662 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29100aa530 con 0x55f4e25693b0 2024-09-14T10:44:33.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f291ffff640 1 -- 172.21.15.96:0/2534269662 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29100aa830 con 0x55f4e25693b0 2024-09-14T10:44:33.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f29279b49c0 1 -- 172.21.15.96:0/2534269662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e25693b0 msgr2=0x55f4e256b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f29279b49c0 1 --2- 172.21.15.96:0/2534269662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e25693b0 0x55f4e256b7a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f291000a480 tx=0x7f291001b280 comp rx=0 tx=0).stop 2024-09-14T10:44:33.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f29279b49c0 1 -- 172.21.15.96:0/2534269662 shutdown_connections 2024-09-14T10:44:33.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f29279b49c0 1 --2- 172.21.15.96:0/2534269662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e25693b0 0x55f4e256b7a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f29279b49c0 1 -- 172.21.15.96:0/2534269662 >> 172.21.15.96:0/2534269662 conn(0x55f4e255f980 msgr2=0x55f4e2561da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f29279b49c0 1 -- 172.21.15.96:0/2534269662 shutdown_connections 2024-09-14T10:44:33.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.824+0000 7f29279b49c0 1 -- 172.21.15.96:0/2534269662 wait complete. 2024-09-14T10:44:33.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29279b49c0 1 Processor -- start 2024-09-14T10:44:33.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29279b49c0 1 -- start start 2024-09-14T10:44:33.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29279b49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2650650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29279b49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4e246cfc0 con 0x55f4e24d9260 2024-09-14T10:44:33.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29254ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2650650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29254ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2650650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45814/0 (socket says 172.21.15.96:45814) 2024-09-14T10:44:33.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29254ba640 1 -- 172.21.15.96:0/1994056119 learned_addr learned my addr 172.21.15.96:0/1994056119 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29254ba640 1 -- 172.21.15.96:0/1994056119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e2650c40 con 0x55f4e24d9260 2024-09-14T10:44:33.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f29254ba640 1 --2- 172.21.15.96:0/1994056119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2650650 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f29180017b0 tx=0x7f2918001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0297d27a70d2c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f2813606640 1 -- 172.21.15.96:0/1994056119 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29180044f0 con 0x55f4e24d9260 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f2813606640 1 -- 172.21.15.96:0/1994056119 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29180046b0 con 0x55f4e24d9260 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.836+0000 7f2813606640 1 -- 172.21.15.96:0/1994056119 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2918004a10 con 0x55f4e24d9260 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- 172.21.15.96:0/1994056119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 msgr2=0x55f4e2650650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 --2- 172.21.15.96:0/1994056119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2650650 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f29180017b0 tx=0x7f2918001c70 comp rx=0 tx=0).stop 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- 172.21.15.96:0/1994056119 shutdown_connections 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 --2- 172.21.15.96:0/1994056119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2650650 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- 172.21.15.96:0/1994056119 >> 172.21.15.96:0/1994056119 conn(0x55f4e255f980 msgr2=0x55f4e264c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- 172.21.15.96:0/1994056119 shutdown_connections 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- 172.21.15.96:0/1994056119 wait complete. 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 Processor -- start 2024-09-14T10:44:33.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- start start 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2657ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4e240ea50 con 0x55f4e24d9260 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29254ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2657ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29254ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2657ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45820/0 (socket says 172.21.15.96:45820) 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29254ba640 1 -- 172.21.15.96:0/3807388003 learned_addr learned my addr 172.21.15.96:0/3807388003 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29254ba640 1 -- 172.21.15.96:0/3807388003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e2658450 con 0x55f4e24d9260 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29254ba640 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2657ef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f29180012f0 tx=0x7f2918000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f2811e03640 1 -- 172.21.15.96:0/3807388003 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2918013820 con 0x55f4e24d9260 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f2811e03640 1 -- 172.21.15.96:0/3807388003 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29180139c0 con 0x55f4e24d9260 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4e26586e0 con 0x55f4e24d9260 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f2811e03640 1 -- 172.21.15.96:0/3807388003 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2918013ca0 con 0x55f4e24d9260 2024-09-14T10:44:33.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.840+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e2659090 con 0x55f4e24d9260 2024-09-14T10:44:33.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2811e03640 1 -- 172.21.15.96:0/3807388003 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2918010070 con 0x55f4e24d9260 2024-09-14T10:44:33.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2811e03640 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f280c03a150 0x7f280c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2811e03640 1 -- 172.21.15.96:0/3807388003 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2918018070 con 0x55f4e24d9260 2024-09-14T10:44:33.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2924cb9640 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f280c03a150 0x7f280c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e265d050 0x55f4e265f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e265f980 con 0x55f4e265d050 2024-09-14T10:44:33.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2925cbb640 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e265d050 0x55f4e265f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2924cb9640 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f280c03a150 0x7f280c03c610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29100ac000 tx=0x7f29100a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2925cbb640 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e265d050 0x55f4e265f440 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2925cbb640 1 -- 172.21.15.96:0/3807388003 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29200083f0 con 0x55f4e265d050 2024-09-14T10:44:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2659400 con 0x55f4e265d050 2024-09-14T10:44:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2925cbb640 1 -- 172.21.15.96:0/3807388003 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29200083f0 con 0x55f4e265d050 2024-09-14T10:44:33.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2661710 con 0x55f4e265d050 2024-09-14T10:44:33.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2925cbb640 1 -- 172.21.15.96:0/3807388003 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f29200083f0 con 0x55f4e265d050 2024-09-14T10:44:33.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2660940 con 0x55f4e265d050 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2925cbb640 1 -- 172.21.15.96:0/3807388003 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29200083f0 con 0x55f4e265d050 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2660d60 con 0x55f4e265d050 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2925cbb640 1 -- 172.21.15.96:0/3807388003 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f29200083f0 con 0x55f4e265d050 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 Processor -- start 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 -- start start 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e266fb00 0x55f4e266ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f29279b49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4e2479d80 con 0x55f4e266fb00 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2924cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e266fb00 0x55f4e266ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2924cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e266fb00 0x55f4e266ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45834/0 (socket says 172.21.15.96:45834) 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2924cb9640 1 -- 172.21.15.96:0/3138554166 learned_addr learned my addr 172.21.15.96:0/3138554166 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.844+0000 7f2924cb9640 1 -- 172.21.15.96:0/3138554166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e2670560 con 0x55f4e266fb00 2024-09-14T10:44:33.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f2924cb9640 1 --2- 172.21.15.96:0/3138554166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e266fb00 0x55f4e266ff20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f29100aa500 tx=0x7f2910018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f280affd640 1 -- 172.21.15.96:0/3138554166 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29100c7070 con 0x55f4e266fb00 2024-09-14T10:44:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f29279b49c0 1 -- 172.21.15.96:0/3138554166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4e2670dc0 con 0x55f4e266fb00 2024-09-14T10:44:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f280affd640 1 -- 172.21.15.96:0/3138554166 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29100b0040 con 0x55f4e266fb00 2024-09-14T10:44:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f29279b49c0 1 -- 172.21.15.96:0/3138554166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e26712d0 con 0x55f4e266fb00 2024-09-14T10:44:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f280affd640 1 -- 172.21.15.96:0/3138554166 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29100af050 con 0x55f4e266fb00 2024-09-14T10:44:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f280affd640 1 -- 172.21.15.96:0/3138554166 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f29100ca070 con 0x55f4e266fb00 2024-09-14T10:44:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f280affd640 1 --2- 172.21.15.96:0/3138554166 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27fc03a150 0x7f27fc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f280affd640 1 -- 172.21.15.96:0/3138554166 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f29100ecf50 con 0x55f4e266fb00 2024-09-14T10:44:33.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f2925cbb640 1 --2- 172.21.15.96:0/3138554166 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27fc03a150 0x7f27fc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f29279b49c0 1 Processor -- start 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f29279b49c0 1 -- start start 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f2925cbb640 1 --2- 172.21.15.96:0/3138554166 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27fc03a150 0x7f27fc03c610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f4e2660ce0 tx=0x7f2920003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f29279b49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e267d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f29279b49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4e2651070 con 0x55f4e267d350 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f2924cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e267d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f2924cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e267d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45840/0 (socket says 172.21.15.96:45840) 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f2924cb9640 1 -- 172.21.15.96:0/3254157692 learned_addr learned my addr 172.21.15.96:0/3254157692 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f2924cb9640 1 -- 172.21.15.96:0/3254157692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e267dd40 con 0x55f4e267d350 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.848+0000 7f2924cb9640 1 --2- 172.21.15.96:0/3254157692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e267d750 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f29100b4d40 tx=0x7f29100b4eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe503e62132246f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f2808ff9640 1 -- 172.21.15.96:0/3254157692 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29100de070 con 0x55f4e267d350 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f2808ff9640 1 -- 172.21.15.96:0/3254157692 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29100b4380 con 0x55f4e267d350 2024-09-14T10:44:33.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f2808ff9640 1 -- 172.21.15.96:0/3254157692 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29100b6480 con 0x55f4e267d350 2024-09-14T10:44:33.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- 172.21.15.96:0/3254157692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 msgr2=0x55f4e267d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3254157692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e267d750 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f29100b4d40 tx=0x7f29100b4eb0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- 172.21.15.96:0/3254157692 shutdown_connections 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3254157692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e267d750 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- 172.21.15.96:0/3254157692 >> 172.21.15.96:0/3254157692 conn(0x55f4e2678770 msgr2=0x55f4e26769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- 172.21.15.96:0/3254157692 shutdown_connections 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- 172.21.15.96:0/3254157692 wait complete. 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 Processor -- start 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- start start 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e26838c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f4e267c2a0 con 0x55f4e267d350 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f2924cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e26838c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f2924cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e26838c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45854/0 (socket says 172.21.15.96:45854) 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 learned_addr learned my addr 172.21.15.96:0/54647357 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e2683e20 con 0x55f4e267d350 2024-09-14T10:44:33.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f2924cb9640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e26838c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f29100b7820 tx=0x7f29100eb2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f27faffd640 1 -- 172.21.15.96:0/54647357 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29100de040 con 0x55f4e267d350 2024-09-14T10:44:33.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f27faffd640 1 -- 172.21.15.96:0/54647357 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29100b7c30 con 0x55f4e267d350 2024-09-14T10:44:33.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f27faffd640 1 -- 172.21.15.96:0/54647357 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29100b5810 con 0x55f4e267d350 2024-09-14T10:44:33.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4e26840b0 con 0x55f4e267d350 2024-09-14T10:44:33.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.852+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e2684a60 con 0x55f4e267d350 2024-09-14T10:44:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f27faffd640 1 -- 172.21.15.96:0/54647357 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f29100b59b0 con 0x55f4e267d350 2024-09-14T10:44:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f27faffd640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27f003a150 0x7f27f003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f27faffd640 1 -- 172.21.15.96:0/54647357 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f29100ea350 con 0x55f4e267d350 2024-09-14T10:44:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2925cbb640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27f003a150 0x7f27f003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e268eeb0 0x55f4e2691340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2691a90 con 0x55f4e268eeb0 2024-09-14T10:44:33.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29254ba640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e268eeb0 0x55f4e2691340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2925cbb640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27f003a150 0x7f27f003c610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f292000f010 tx=0x7f292001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29254ba640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e268eeb0 0x55f4e2691340 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 realm 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2691ea0 con 0x55f4e268eeb0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2692770 con 0x55f4e268eeb0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2692b10 con 0x55f4e268eeb0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 20 searching for the correct realm 2024-09-14T10:44:33.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4e26950d0 0x55f4e26974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2697a50 con 0x55f4e26950d0 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2924cb9640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4e26950d0 0x55f4e26974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2924cb9640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4e26950d0 0x55f4e26974c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2924cb9640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f29100cc060 0x7f29100ba960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2697a50 con 0x7f29100cc060 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2925cbb640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f29100cc060 0x7f29100ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2925cbb640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f29100cc060 0x7f29100ba960 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2925cbb640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2920019040 0x7f2920019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2697a50 con 0x7f2920019040 2024-09-14T10:44:33.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.856+0000 7f29254ba640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2920019040 0x7f2920019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:33.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2920019040 0x7f2920019930 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f2920019040 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f2920019040 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f29100cc060 2024-09-14T10:44:33.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e26950d0 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f2920019040 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.860+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f29100cc060 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e26950d0 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e26950d0 2024-09-14T10:44:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f2920019040 2024-09-14T10:44:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e26950d0 2024-09-14T10:44:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e26950d0 2024-09-14T10:44:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f2920019040 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e26950d0 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f29100cc060 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.864+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f2920019040 2024-09-14T10:44:33.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e26950d0 2024-09-14T10:44:33.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f2920019040 2024-09-14T10:44:33.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f29100cc060 2024-09-14T10:44:33.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e26950d0 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f2920019040 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x55f4e268eeb0 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693360 con 0x7f29100cc060 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:33.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693bb0 con 0x55f4e268eeb0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693fa0 con 0x55f4e268eeb0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693fa0 con 0x55f4e268eeb0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 zone default found 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 4 Realm: () 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 zonegroup default 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.868+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2693730 con 0x7f2920019040 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26998a0 con 0x55f4e26950d0 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2699c40 con 0x55f4e26950d0 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 20 started sync module instance, tier type = 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2698d40 con 0x7f29100cc060 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94510258950496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269a490 con 0x7f29100cc060 2024-09-14T10:44:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269ace0 con 0x55f4e268eeb0 2024-09-14T10:44:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.872+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94510258950496] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94510258954208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269a8b0 con 0x55f4e268eeb0 2024-09-14T10:44:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269b350 con 0x55f4e26950d0 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94510258954208] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94510258955264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269a820 con 0x55f4e26950d0 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269c0a0 con 0x7f29100cc060 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.876+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94510258961696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269c940 con 0x7f29100cc060 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269d340 con 0x55f4e268eeb0 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94510258955264] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94510258961696] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94510258960192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269c490 con 0x55f4e268eeb0 2024-09-14T10:44:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269dbe0 con 0x7f2920019040 2024-09-14T10:44:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94510258960192] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94510258966096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269c490 con 0x7f2920019040 2024-09-14T10:44:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.880+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269e030 con 0x7f2920019040 2024-09-14T10:44:33.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94510258969408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269e450 con 0x7f2920019040 2024-09-14T10:44:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269ef40 con 0x7f2920019040 2024-09-14T10:44:33.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94510258966096] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94510258973200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269ef00 con 0x7f2920019040 2024-09-14T10:44:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 20 add_watcher() i=0 2024-09-14T10:44:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 20 add_watcher() i=1 2024-09-14T10:44:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 20 add_watcher() i=2 2024-09-14T10:44:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 20 add_watcher() i=3 2024-09-14T10:44:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 20 add_watcher() i=4 2024-09-14T10:44:33.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.884+0000 7f29279b49c0 20 add_watcher() i=5 2024-09-14T10:44:33.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94510258969408] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29279b49c0 20 add_watcher() i=6 2024-09-14T10:44:33.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94510258973200] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29279b49c0 20 add_watcher() i=7 2024-09-14T10:44:33.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29279b49c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:33.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269df60 con 0x55f4e268eeb0 2024-09-14T10:44:33.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94510258970464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269f360 con 0x55f4e268eeb0 2024-09-14T10:44:33.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94510258970464] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f27dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29279b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:33.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29279b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:33.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.888+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26aa950 con 0x55f4e268eeb0 2024-09-14T10:44:33.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.892+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.892+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26aaf80 con 0x7f2920019040 2024-09-14T10:44:33.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.892+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.892+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26aaef0 con 0x55f4e26950d0 2024-09-14T10:44:33.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.892+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.892+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26ab2b0 con 0x55f4e268eeb0 2024-09-14T10:44:33.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.896+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'140 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.896+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26ab320 con 0x7f29100cc060 2024-09-14T10:44:33.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.896+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.896+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26ab890 con 0x55f4e26950d0 2024-09-14T10:44:33.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.896+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.896+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26abc30 con 0x55f4e268eeb0 2024-09-14T10:44:33.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.900+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.900+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26abc30 con 0x7f2920019040 2024-09-14T10:44:33.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.900+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.900+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26abc70 con 0x7f29100cc060 2024-09-14T10:44:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.904+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.904+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26ac2e0 con 0x55f4e26950d0 2024-09-14T10:44:33.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.904+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.904+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26ac250 con 0x7f29100cc060 2024-09-14T10:44:33.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.904+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.904+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26ac820 con 0x7f2920019040 2024-09-14T10:44:33.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.908+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.908+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26ac7c0 con 0x7f29100cc060 2024-09-14T10:44:33.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.908+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.908+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acd50 con 0x7f2920019040 2024-09-14T10:44:33.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.912+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.912+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x55f4e268eeb0 2024-09-14T10:44:33.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.912+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.912+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x55f4e26950d0 2024-09-14T10:44:33.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.912+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.912+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x7f29100cc060 2024-09-14T10:44:33.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.916+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.916+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26aca80 con 0x55f4e26950d0 2024-09-14T10:44:33.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.916+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.916+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26aca80 con 0x55f4e268eeb0 2024-09-14T10:44:33.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.920+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.920+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26aca80 con 0x55f4e268eeb0 2024-09-14T10:44:33.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.920+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.920+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26aca80 con 0x55f4e26950d0 2024-09-14T10:44:33.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.924+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.924+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26aca80 con 0x7f29100cc060 2024-09-14T10:44:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.924+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.924+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acae0 con 0x55f4e26950d0 2024-09-14T10:44:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.924+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.924+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x55f4e26950d0 2024-09-14T10:44:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.924+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.924+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x55f4e26950d0 2024-09-14T10:44:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.928+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.928+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x55f4e26950d0 2024-09-14T10:44:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.928+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.928+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x7f2920019040 2024-09-14T10:44:33.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.932+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.932+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x55f4e26950d0 2024-09-14T10:44:33.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.932+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.932+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x7f2920019040 2024-09-14T10:44:33.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.932+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.932+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x55f4e26950d0 2024-09-14T10:44:33.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.936+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.936+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x7f2920019040 2024-09-14T10:44:33.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26acaa0 con 0x7f29100cc060 2024-09-14T10:44:33.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f27dafe5640 20 reqs_thread_entry: start 2024-09-14T10:44:33.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 Filter name: none 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f27d8fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26c8280 con 0x7f29100cc060 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:33.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:95 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26c9a10 con 0x55f4e26950d0 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(95 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 get_obj_state: octx=0x7f2918010a50 obj=myfoo:four state=0x55f4e26cabc8 s->prefetch_data=0 2024-09-14T10:44:33.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 3.34s0 3:2d40e3e1:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1_four:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26cce20 con 0x55f4e268eeb0 2024-09-14T10:44:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(96 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1_four [call out=24b,getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 276+0+889 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 10 manifest: total_size = 4 2024-09-14T10:44:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 get_obj_state: setting s->obj_tag to 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.3696162225078118149 2024-09-14T10:44:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 get_obj_state: octx=0x7f2918010a50 obj=myfoo:four state=0x55f4e26cabc8 s->prefetch_data=0 2024-09-14T10:44:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 prepare_atomic_modification: state is not atomic. state=0x55f4e26cabc8 2024-09-14T10:44:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6 2024-09-14T10:44:33.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.940+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:97 4.2a 4:5661d8ff:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26d0a90 con 0x55f4e268eeb0 2024-09-14T10:44:33.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.944+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(97 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.944+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:98 3.34s0 3:2d40e3e1:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26d0a90 con 0x55f4e268eeb0 2024-09-14T10:44:33.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.944+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(98 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.944+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 4.2a 4:5661d8ff:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26d1500 con 0x55f4e268eeb0 2024-09-14T10:44:33.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(99 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f27dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:33.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f2808ff9640 20 handle_completion(): completion ok for obj=four 2024-09-14T10:44:33.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94510258970464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e26ca0b0 con 0x55f4e268eeb0 2024-09-14T10:44:33.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94510258970464] v32'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94510258950496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269df60 con 0x7f29100cc060 2024-09-14T10:44:33.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94510258950496] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f29279b49c0 20 remove_watcher() i=0 2024-09-14T10:44:33.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f29279b49c0 2 removed watcher, disabling cache 2024-09-14T10:44:33.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.948+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94510258954208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2699160 con 0x55f4e268eeb0 2024-09-14T10:44:33.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94510258954208] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f29279b49c0 20 remove_watcher() i=1 2024-09-14T10:44:33.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94510258955264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2699160 con 0x55f4e26950d0 2024-09-14T10:44:33.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f2924cb9640 1 -- 172.21.15.96:0/54647357 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94510258955264] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29100e9020 con 0x55f4e26950d0 2024-09-14T10:44:33.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f29279b49c0 20 remove_watcher() i=2 2024-09-14T10:44:33.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94510258961696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2699160 con 0x7f29100cc060 2024-09-14T10:44:33.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f2925cbb640 1 -- 172.21.15.96:0/54647357 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94510258961696] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292002f040 con 0x7f29100cc060 2024-09-14T10:44:33.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f29279b49c0 20 remove_watcher() i=3 2024-09-14T10:44:33.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.952+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94510258960192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2699160 con 0x55f4e268eeb0 2024-09-14T10:44:33.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.956+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94510258960192] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x55f4e268eeb0 2024-09-14T10:44:33.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.956+0000 7f29279b49c0 20 remove_watcher() i=4 2024-09-14T10:44:33.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.956+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94510258966096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2699160 con 0x7f2920019040 2024-09-14T10:44:33.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.956+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94510258966096] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.956+0000 7f29279b49c0 20 remove_watcher() i=5 2024-09-14T10:44:33.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.956+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94510258969408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e269ce50 con 0x7f2920019040 2024-09-14T10:44:33.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94510258969408] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 20 remove_watcher() i=6 2024-09-14T10:44:33.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94510258973200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4e2699160 con 0x7f2920019040 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94510258973200] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291801b030 con 0x7f2920019040 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 20 remove_watcher() i=7 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2920019040 msgr2=0x7f2920019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2920019040 0x7f2920019930 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e268eeb0 msgr2=0x55f4e2691340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e268eeb0 0x55f4e2691340 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f29100cc060 msgr2=0x7f29100ba960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f29100cc060 0x7f29100ba960 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4e26950d0 msgr2=0x55f4e26974c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f4e26950d0 0x55f4e26974c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27f003a150 msgr2=0x7f27f003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27f003a150 0x7f27f003c610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f292000f010 tx=0x7f292001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 msgr2=0x55f4e26838c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29254ba640 1 -- 172.21.15.96:0/54647357 reap_dead start 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e26838c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f29100b7820 tx=0x7f29100eb2d0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 shutdown_connections 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 --2- 172.21.15.96:0/54647357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e267d350 0x55f4e26838c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 >> 172.21.15.96:0/54647357 conn(0x55f4e2678770 msgr2=0x55f4e2676980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 shutdown_connections 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.960+0000 7f29279b49c0 1 -- 172.21.15.96:0/54647357 wait complete. 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3138554166 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27fc03a150 msgr2=0x7f27fc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3138554166 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27fc03a150 0x7f27fc03c610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f4e2660ce0 tx=0x7f2920003070 comp rx=0 tx=0).stop 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3138554166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e266fb00 msgr2=0x55f4e266ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3138554166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e266fb00 0x55f4e266ff20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f29100aa500 tx=0x7f2910018020 comp rx=0 tx=0).stop 2024-09-14T10:44:33.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3138554166 shutdown_connections 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3138554166 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f27fc03a150 0x7f27fc03c610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3138554166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e266fb00 0x55f4e266ff20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3138554166 >> 172.21.15.96:0/3138554166 conn(0x55f4e26654b0 msgr2=0x55f4e2665890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3138554166 shutdown_connections 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3138554166 wait complete. 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e265d050 msgr2=0x55f4e265f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e265d050 0x55f4e265f440 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f280c03a150 msgr2=0x7f280c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f280c03a150 0x7f280c03c610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29100ac000 tx=0x7f29100a5000 comp rx=0 tx=0).stop 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 msgr2=0x55f4e2657ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2657ef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f29180012f0 tx=0x7f2918000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 shutdown_connections 2024-09-14T10:44:33.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f4e265d050 0x55f4e265f440 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f280c03a150 0x7f280c03c610 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 --2- 172.21.15.96:0/3807388003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f4e24d9260 0x55f4e2657ef0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:33.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 >> 172.21.15.96:0/3807388003 conn(0x55f4e255f980 msgr2=0x55f4e2651aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:33.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 shutdown_connections 2024-09-14T10:44:33.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:33.964+0000 7f29279b49c0 1 -- 172.21.15.96:0/3807388003 wait complete. 2024-09-14T10:44:33.970 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:44:33.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:44:33.970 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-14T10:44:34.041 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:34.041 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:34.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb0034fb9c0 1 Processor -- start 2024-09-14T10:44:34.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb0034fb9c0 1 -- start start 2024-09-14T10:44:34.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb0034fb9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e2cbabb800 0x55e2cbaba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb0034fb9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2cb9ed7a0 con 0x55e2cbabb2d0 2024-09-14T10:44:34.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb0034fb9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55e2cba491b0 con 0x55e2cbabb800 2024-09-14T10:44:34.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb000800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e2cbabb800 0x55e2cbaba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb000800640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e2cbabb800 0x55e2cbaba3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45866/0 (socket says 172.21.15.96:45866) 2024-09-14T10:44:34.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb000800640 1 -- 172.21.15.96:0/3405478610 learned_addr learned my addr 172.21.15.96:0/3405478610 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb000800640 1 -- 172.21.15.96:0/3405478610 >> v1:172.21.15.70:6789/0 conn(0x55e2cbabb2d0 legacy=0x55e2cbab9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.044+0000 7fb000800640 1 -- 172.21.15.96:0/3405478610 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cb9c7da0 con 0x55e2cbabb800 2024-09-14T10:44:34.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7fb000800640 1 --2- 172.21.15.96:0/3405478610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb800 0x55e2cbaba3d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faff000a5c0 tx=0x7faff001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47326f9663af94a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7faff7fff640 1 -- 172.21.15.96:0/3405478610 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff00b0070 con 0x55e2cbabb800 2024-09-14T10:44:34.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7faff7fff640 1 -- 172.21.15.96:0/3405478610 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff00ab540 con 0x55e2cbabb800 2024-09-14T10:44:34.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7faff7fff640 1 -- 172.21.15.96:0/3405478610 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff00ab840 con 0x55e2cbabb800 2024-09-14T10:44:34.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3405478610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb800 msgr2=0x55e2cbaba3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3405478610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb800 0x55e2cbaba3d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faff000a5c0 tx=0x7faff001b280 comp rx=0 tx=0).stop 2024-09-14T10:44:34.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3405478610 shutdown_connections 2024-09-14T10:44:34.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3405478610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb800 0x55e2cbaba3d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3405478610 >> 172.21.15.96:0/3405478610 conn(0x55e2cbb40af0 msgr2=0x55e2cbb42f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3405478610 shutdown_connections 2024-09-14T10:44:34.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.048+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3405478610 wait complete. 2024-09-14T10:44:34.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 Processor -- start 2024-09-14T10:44:34.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 -- start start 2024-09-14T10:44:34.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc37080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e2cba4cfc0 con 0x55e2cbabb2d0 2024-09-14T10:44:34.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb001001640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc37080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb001001640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc37080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45878/0 (socket says 172.21.15.96:45878) 2024-09-14T10:44:34.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb001001640 1 -- 172.21.15.96:0/2298941253 learned_addr learned my addr 172.21.15.96:0/2298941253 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb001001640 1 -- 172.21.15.96:0/2298941253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbc37670 con 0x55e2cbabb2d0 2024-09-14T10:44:34.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb001001640 1 --2- 172.21.15.96:0/2298941253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc37080 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faffc001680 tx=0x7faffc001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42ad1a01da8d1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7faeef606640 1 -- 172.21.15.96:0/2298941253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc016070 con 0x55e2cbabb2d0 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7faeef606640 1 -- 172.21.15.96:0/2298941253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc00f660 con 0x55e2cbabb2d0 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7faeef606640 1 -- 172.21.15.96:0/2298941253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc00f980 con 0x55e2cbabb2d0 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/2298941253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 msgr2=0x55e2cbc37080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/2298941253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc37080 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faffc001680 tx=0x7faffc001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/2298941253 shutdown_connections 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/2298941253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc37080 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/2298941253 >> 172.21.15.96:0/2298941253 conn(0x55e2cbb40af0 msgr2=0x55e2cbc32c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/2298941253 shutdown_connections 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/2298941253 wait complete. 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.064+0000 7fb0034fb9c0 1 Processor -- start 2024-09-14T10:44:34.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb0034fb9c0 1 -- start start 2024-09-14T10:44:34.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb0034fb9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc3e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb0034fb9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e2cb9eea50 con 0x55e2cbabb2d0 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb001001640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc3e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb001001640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc3e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45884/0 (socket says 172.21.15.96:45884) 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb001001640 1 -- 172.21.15.96:0/1817712979 learned_addr learned my addr 172.21.15.96:0/1817712979 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb001001640 1 -- 172.21.15.96:0/1817712979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbc3ee80 con 0x55e2cbabb2d0 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb001001640 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc3e920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55e2cbc38040 tx=0x7faffc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7faeede03640 1 -- 172.21.15.96:0/1817712979 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc016040 con 0x55e2cbabb2d0 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7faeede03640 1 -- 172.21.15.96:0/1817712979 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc022070 con 0x55e2cbabb2d0 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2cbc3f110 con 0x55e2cbabb2d0 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7faeede03640 1 -- 172.21.15.96:0/1817712979 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc006330 con 0x55e2cbabb2d0 2024-09-14T10:44:34.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2cbc3fac0 con 0x55e2cbabb2d0 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7faeede03640 1 -- 172.21.15.96:0/1817712979 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7faffc011510 con 0x55e2cbabb2d0 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7faeede03640 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faee803a2f0 0x7faee803c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7faeede03640 1 -- 172.21.15.96:0/1817712979 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faffc050740 con 0x55e2cbabb2d0 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb000800640 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faee803a2f0 0x7faee803c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbabb800 0x55e2cbc45a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc45fd0 con 0x55e2cbabb800 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb001802640 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbabb800 0x55e2cbc45a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.068+0000 7fb000800640 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faee803a2f0 0x7faee803c7b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faff00ad000 tx=0x7faff00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb001802640 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbabb800 0x55e2cbc45a90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb001802640 1 -- 172.21.15.96:0/1817712979 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faff80083f0 con 0x55e2cbabb800 2024-09-14T10:44:34.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc46420 con 0x55e2cbabb800 2024-09-14T10:44:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb001802640 1 -- 172.21.15.96:0/1817712979 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faff80083f0 con 0x55e2cbabb800 2024-09-14T10:44:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc47d20 con 0x55e2cbabb800 2024-09-14T10:44:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb001802640 1 -- 172.21.15.96:0/1817712979 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faff80083f0 con 0x55e2cbabb800 2024-09-14T10:44:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc46f50 con 0x55e2cbabb800 2024-09-14T10:44:34.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb001802640 1 -- 172.21.15.96:0/1817712979 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faff80083f0 con 0x55e2cbabb800 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc47370 con 0x55e2cbabb800 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb001802640 1 -- 172.21.15.96:0/1817712979 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faff80083f0 con 0x55e2cbabb800 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 Processor -- start 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 -- start start 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc56110 0x55e2cbc56530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e2cba59d80 con 0x55e2cbc56110 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb000800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc56110 0x55e2cbc56530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb000800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc56110 0x55e2cbc56530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45890/0 (socket says 172.21.15.96:45890) 2024-09-14T10:44:34.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb000800640 1 -- 172.21.15.96:0/1908195357 learned_addr learned my addr 172.21.15.96:0/1908195357 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb000800640 1 -- 172.21.15.96:0/1908195357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbc56b70 con 0x55e2cbc56110 2024-09-14T10:44:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb000800640 1 --2- 172.21.15.96:0/1908195357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc56110 0x55e2cbc56530 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faff001b2c0 tx=0x7faff0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7faee6ffd640 1 -- 172.21.15.96:0/1908195357 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff00b0040 con 0x55e2cbc56110 2024-09-14T10:44:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1908195357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2cbc573d0 con 0x55e2cbc56110 2024-09-14T10:44:34.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7faee6ffd640 1 -- 172.21.15.96:0/1908195357 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff00c6070 con 0x55e2cbc56110 2024-09-14T10:44:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1908195357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2cbc578e0 con 0x55e2cbc56110 2024-09-14T10:44:34.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.072+0000 7faee6ffd640 1 -- 172.21.15.96:0/1908195357 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff00abdf0 con 0x55e2cbc56110 2024-09-14T10:44:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7faee6ffd640 1 -- 172.21.15.96:0/1908195357 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7faff00cb670 con 0x55e2cbc56110 2024-09-14T10:44:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7faee6ffd640 1 --2- 172.21.15.96:0/1908195357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faed803a150 0x7faed803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7faee6ffd640 1 -- 172.21.15.96:0/1908195357 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faff00a8070 con 0x55e2cbc56110 2024-09-14T10:44:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb001802640 1 --2- 172.21.15.96:0/1908195357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faed803a150 0x7faed803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 Processor -- start 2024-09-14T10:44:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 -- start start 2024-09-14T10:44:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb001802640 1 --2- 172.21.15.96:0/1908195357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faed803a150 0x7faed803c610 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55e2cbc472f0 tx=0x7faff8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc62d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbc37aa0 con 0x55e2cbc62950 2024-09-14T10:44:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb000800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc62d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb000800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc62d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45904/0 (socket says 172.21.15.96:45904) 2024-09-14T10:44:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb000800640 1 -- 172.21.15.96:0/435878239 learned_addr learned my addr 172.21.15.96:0/435878239 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb000800640 1 -- 172.21.15.96:0/435878239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbc63300 con 0x55e2cbc62950 2024-09-14T10:44:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb000800640 1 --2- 172.21.15.96:0/435878239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc62d30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faff00ec1b0 tx=0x7faff0006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1daecd870913f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7faee4ff9640 1 -- 172.21.15.96:0/435878239 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff00db070 con 0x55e2cbc62950 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7faee4ff9640 1 -- 172.21.15.96:0/435878239 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff0006390 con 0x55e2cbc62950 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7faee4ff9640 1 -- 172.21.15.96:0/435878239 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff00b6470 con 0x55e2cbc62950 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/435878239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 msgr2=0x55e2cbc62d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/435878239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc62d30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faff00ec1b0 tx=0x7faff0006ae0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/435878239 shutdown_connections 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/435878239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc62d30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.076+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/435878239 >> 172.21.15.96:0/435878239 conn(0x55e2cbc5ed80 msgr2=0x55e2cbc5cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/435878239 shutdown_connections 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/435878239 wait complete. 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 Processor -- start 2024-09-14T10:44:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 -- start start 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc69f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbc63960 con 0x55e2cbc62950 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb000800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc69f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb000800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc69f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45916/0 (socket says 172.21.15.96:45916) 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 learned_addr learned my addr 172.21.15.96:0/3091028025 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbc6a490 con 0x55e2cbc62950 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb000800640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc69f30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faff00b7ca0 tx=0x7faff00ec140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7faed6ffd640 1 -- 172.21.15.96:0/3091028025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff00db040 con 0x55e2cbc62950 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2cbc6a720 con 0x55e2cbc62950 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7faed6ffd640 1 -- 172.21.15.96:0/3091028025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff00b55f0 con 0x55e2cbc62950 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7faed6ffd640 1 -- 172.21.15.96:0/3091028025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff00b5910 con 0x55e2cbc62950 2024-09-14T10:44:34.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2cbc6b0d0 con 0x55e2cbc62950 2024-09-14T10:44:34.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7faed6ffd640 1 -- 172.21.15.96:0/3091028025 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7faff00de070 con 0x55e2cbc62950 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7faed6ffd640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faecc03a150 0x7faecc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7faed6ffd640 1 -- 172.21.15.96:0/3091028025 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faff00a41c0 con 0x55e2cbc62950 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb001802640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faecc03a150 0x7faecc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbc753f0 0x55e2cbc77880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc77fd0 con 0x55e2cbc753f0 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.080+0000 7fb001001640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbc753f0 0x55e2cbc77880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001802640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faecc03a150 0x7faecc03c610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faff800f010 tx=0x7faff801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001001640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbc753f0 0x55e2cbc77880 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 realm 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc783e0 con 0x55e2cbc753f0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc78cb0 con 0x55e2cbc753f0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc79050 con 0x55e2cbc753f0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc794f0 con 0x55e2cbc753f0 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 20 searching for the correct realm 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e2cbc7b4f0 0x55e2cbc7d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb000800640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e2cbc7b4f0 0x55e2cbc7d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb000800640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e2cbc7b4f0 0x55e2cbc7d8e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb000800640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7faff00e0070 0x7faff00f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff00e0070 2024-09-14T10:44:34.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001802640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7faff00e0070 0x7faff00f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001802640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7faff00e0070 0x7faff00f6870 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001802640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7faff8019040 0x7faff8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.084+0000 7fb001001640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7faff8019040 0x7faff8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7faff8019040 0x7faff8019930 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc753f0 2024-09-14T10:44:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc753f0 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff00e0070 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc753f0 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc753f0 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.088+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff00e0070 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc753f0 2024-09-14T10:44:34.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc753f0 2024-09-14T10:44:34.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff00e0070 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.092+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc753f0 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff00e0070 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff8019040 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x55e2cbc753f0 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7df90 con 0x7faff00e0070 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc79f60 con 0x55e2cbc753f0 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.096+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7a800 con 0x55e2cbc753f0 2024-09-14T10:44:34.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc79ba0 con 0x55e2cbc753f0 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 zone default found 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 4 Realm: () 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 zonegroup default 2024-09-14T10:44:34.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7a800 con 0x7faff8019040 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7fe00 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc801a0 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 started sync module instance, tier type = 2024-09-14T10:44:34.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:34.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc7f2a0 con 0x7faff00e0070 2024-09-14T10:44:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94432569849488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc80a40 con 0x7faff00e0070 2024-09-14T10:44:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.100+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc81290 con 0x55e2cbc753f0 2024-09-14T10:44:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.104+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94432569849488] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.104+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.104+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94432569853328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc80ee0 con 0x55e2cbc753f0 2024-09-14T10:44:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.104+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc81a00 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.104+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94432569853328] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.104+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.104+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94432569857232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc81df0 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.104+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc827b0 con 0x7faff00e0070 2024-09-14T10:44:34.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.108+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.108+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94432569861168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc83050 con 0x7faff00e0070 2024-09-14T10:44:34.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.108+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc83a70 con 0x55e2cbc753f0 2024-09-14T10:44:34.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.108+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94432569857232] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.108+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94432569861168] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.108+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.108+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94432569865568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc82ba0 con 0x55e2cbc753f0 2024-09-14T10:44:34.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.108+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc84310 con 0x7faff8019040 2024-09-14T10:44:34.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.112+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.112+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94432569867408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc84560 con 0x7faff8019040 2024-09-14T10:44:34.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.112+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc84db0 con 0x7faff8019040 2024-09-14T10:44:34.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.112+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94432569865568] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.112+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94432569867408] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.112+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.112+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94432569868464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc84980 con 0x7faff8019040 2024-09-14T10:44:34.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.112+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc851d0 con 0x7faff8019040 2024-09-14T10:44:34.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94432569868464] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94432569870000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc850a0 con 0x7faff8019040 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 20 add_watcher() i=0 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 20 add_watcher() i=1 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 20 add_watcher() i=2 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 20 add_watcher() i=3 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 20 add_watcher() i=4 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 20 add_watcher() i=5 2024-09-14T10:44:34.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 20 add_watcher() i=6 2024-09-14T10:44:34.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94432569870000] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 20 add_watcher() i=7 2024-09-14T10:44:34.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:34.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.116+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc885b0 con 0x55e2cbc753f0 2024-09-14T10:44:34.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94432569871184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbc85ad0 con 0x55e2cbc753f0 2024-09-14T10:44:34.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94432569871184] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7faeb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:34.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:34.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:34.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 5 note: GC not initialized 2024-09-14T10:44:34.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7faeb67e4640 20 reqs_thread_entry: start 2024-09-14T10:44:34.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:34.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 Filter name: none 2024-09-14T10:44:34.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fae27fff640 20 reqs_thread_entry: start 2024-09-14T10:44:34.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcabc90 con 0x7faff00e0070 2024-09-14T10:44:34.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:63 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcac620 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(63 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcadcf0 con 0x7faff00e0070 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.120+0000 7fb0034fb9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:34.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcadcf0 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(65 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 4.2e 4:77aa7d25:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcaf5e0 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 4.31 4:8c880be2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcb1ff0 con 0x55e2cbc753f0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 4.15 4:aa6540a5:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcb49b0 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 4.1c 4:3adf25d2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcb7410 con 0x7faff8019040 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 4.2 4:4285a78a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcb9c80 con 0x55e2cbc753f0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 4.2c 4:37c95a4c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcbc4f0 con 0x55e2cbc753f0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 4.2a 4:5661d8ff:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcbc4f0 con 0x55e2cbc753f0 2024-09-14T10:44:34.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 4.2d 4:b689318c:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcc1850 con 0x7faff8019040 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:74 4.16 4:68627ddf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcc4220 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:75 4.18 4:1a24b59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcc6d20 con 0x7faff00e0070 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 4.4 4:2304044a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcc9bb0 con 0x7faff8019040 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(67 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(70 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(72 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(75 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(71 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.5 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(66 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(68 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(69 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(76 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(74 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7faeb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:34.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94432569871184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbcc9bb0 con 0x55e2cbc753f0 2024-09-14T10:44:34.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94432569871184] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.124+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94432569849488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbca95a0 con 0x7faff00e0070 2024-09-14T10:44:34.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.128+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94432569849488] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.128+0000 7fb0034fb9c0 20 remove_watcher() i=0 2024-09-14T10:44:34.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.128+0000 7fb0034fb9c0 2 removed watcher, disabling cache 2024-09-14T10:44:34.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.128+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94432569853328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbca95a0 con 0x55e2cbc753f0 2024-09-14T10:44:34.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.128+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94432569853328] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.128+0000 7fb0034fb9c0 20 remove_watcher() i=1 2024-09-14T10:44:34.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.128+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94432569857232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbca95a0 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.132+0000 7fb000800640 1 -- 172.21.15.96:0/3091028025 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94432569857232] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff00dd030 con 0x55e2cbc7b4f0 2024-09-14T10:44:34.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.132+0000 7fb0034fb9c0 20 remove_watcher() i=2 2024-09-14T10:44:34.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.132+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94432569861168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbca95a0 con 0x7faff00e0070 2024-09-14T10:44:34.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.132+0000 7fb001802640 1 -- 172.21.15.96:0/3091028025 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94432569861168] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff802f040 con 0x7faff00e0070 2024-09-14T10:44:34.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.132+0000 7fb0034fb9c0 20 remove_watcher() i=3 2024-09-14T10:44:34.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.132+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94432569865568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbca95a0 con 0x55e2cbc753f0 2024-09-14T10:44:34.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.136+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94432569865568] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x55e2cbc753f0 2024-09-14T10:44:34.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.136+0000 7fb0034fb9c0 20 remove_watcher() i=4 2024-09-14T10:44:34.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.136+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94432569867408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbca95a0 con 0x7faff8019040 2024-09-14T10:44:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.136+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94432569867408] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.136+0000 7fb0034fb9c0 20 remove_watcher() i=5 2024-09-14T10:44:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.136+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94432569868464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbca95a0 con 0x7faff8019040 2024-09-14T10:44:34.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94432569868464] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 20 remove_watcher() i=6 2024-09-14T10:44:34.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94432569870000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2cbca95a0 con 0x7faff8019040 2024-09-14T10:44:34.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94432569870000] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc00f070 con 0x7faff8019040 2024-09-14T10:44:34.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 20 remove_watcher() i=7 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7faff8019040 msgr2=0x7faff8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7faff8019040 0x7faff8019930 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbc753f0 msgr2=0x55e2cbc77880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbc753f0 0x55e2cbc77880 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7faff00e0070 msgr2=0x7faff00f6870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7faff00e0070 0x7faff00f6870 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e2cbc7b4f0 msgr2=0x55e2cbc7d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e2cbc7b4f0 0x55e2cbc7d8e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faecc03a150 msgr2=0x7faecc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faecc03a150 0x7faecc03c610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faff800f010 tx=0x7faff801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 msgr2=0x55e2cbc69f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/3091028025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc62950 0x55e2cbc69f30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faff00b7ca0 tx=0x7faff00ec140 comp rx=0 tx=0).stop 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 reap_dead start 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb001001640 1 -- 172.21.15.96:0/3091028025 reap_dead start 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 shutdown_connections 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 >> 172.21.15.96:0/3091028025 conn(0x55e2cbc5ed80 msgr2=0x55e2cbc5cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 shutdown_connections 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/3091028025 wait complete. 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1908195357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faed803a150 msgr2=0x7faed803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1908195357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faed803a150 0x7faed803c610 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55e2cbc472f0 tx=0x7faff8003070 comp rx=0 tx=0).stop 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1908195357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc56110 msgr2=0x55e2cbc56530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1908195357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc56110 0x55e2cbc56530 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faff001b2c0 tx=0x7faff0018020 comp rx=0 tx=0).stop 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1908195357 shutdown_connections 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1908195357 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faed803a150 0x7faed803c610 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1908195357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbc56110 0x55e2cbc56530 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1908195357 >> 172.21.15.96:0/1908195357 conn(0x55e2cbc4bac0 msgr2=0x55e2cbc4bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1908195357 shutdown_connections 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.140+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1908195357 wait complete. 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbabb800 msgr2=0x55e2cbc45a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbabb800 0x55e2cbc45a90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faee803a2f0 msgr2=0x7faee803c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faee803a2f0 0x7faee803c7b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faff00ad000 tx=0x7faff00a5040 comp rx=0 tx=0).stop 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 msgr2=0x55e2cbc3e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc3e920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55e2cbc38040 tx=0x7faffc000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 shutdown_connections 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e2cbabb800 0x55e2cbc45a90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7faee803a2f0 0x7faee803c7b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 --2- 172.21.15.96:0/1817712979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2cbabb2d0 0x55e2cbc3e920 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 >> 172.21.15.96:0/1817712979 conn(0x55e2cbb40af0 msgr2=0x55e2cbc384d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 shutdown_connections 2024-09-14T10:44:34.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.144+0000 7fb0034fb9c0 1 -- 172.21.15.96:0/1817712979 wait complete. 2024-09-14T10:44:34.151 INFO:teuthology.orchestra.run.smithi096.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"81c91f69-c086-4f6e-b0d8-6162f65a1a15","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","marker":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-14T10:44:33.459006Z","creation_time":"2024-09-14T10:44:29.762936Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-14T10:44:34.151 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:44:33.459006Z', 'creation_time': '2024-09-14T10:44:29.762936Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-14T10:44:34.151 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-14T10:44:34.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-14T10:44:34.151 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-14T10:44:34.225 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:34.225 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:34.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff412f499c0 1 Processor -- start 2024-09-14T10:44:34.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff412f499c0 1 -- start start 2024-09-14T10:44:34.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff412f499c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x564c422c1190 0x564c422c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff412f499c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c421657a0 con 0x564c422bcff0 2024-09-14T10:44:34.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff412f499c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x564c421c11b0 con 0x564c422c1190 2024-09-14T10:44:34.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff41024e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x564c422c1190 0x564c422c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff410a4f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x564c422bcff0 0x564c422bd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37304/0 (socket says 172.21.15.96:37304) 2024-09-14T10:44:34.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff410a4f640 1 -- 172.21.15.96:0/3570425243 learned_addr learned my addr 172.21.15.96:0/3570425243 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:34.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.228+0000 7ff41024e640 1 -- 172.21.15.96:0/3570425243 >> v1:172.21.15.70:6789/0 conn(0x564c422bcff0 legacy=0x564c422bd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff41024e640 1 -- 172.21.15.96:0/3570425243 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4213fda0 con 0x564c422c1190 2024-09-14T10:44:34.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff41024e640 1 --2- 172.21.15.96:0/3570425243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422c1190 0x564c422c3580 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff40400a480 tx=0x7ff40401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb387b8c85bb84e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff40fa4d640 1 -- 172.21.15.96:0/3570425243 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040aa570 con 0x564c422c1190 2024-09-14T10:44:34.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff40fa4d640 1 -- 172.21.15.96:0/3570425243 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4040af070 con 0x564c422c1190 2024-09-14T10:44:34.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff40fa4d640 1 -- 172.21.15.96:0/3570425243 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040aa860 con 0x564c422c1190 2024-09-14T10:44:34.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff412f499c0 1 -- 172.21.15.96:0/3570425243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422c1190 msgr2=0x564c422c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3570425243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422c1190 0x564c422c3580 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff40400a480 tx=0x7ff40401b310 comp rx=0 tx=0).stop 2024-09-14T10:44:34.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff412f499c0 1 -- 172.21.15.96:0/3570425243 shutdown_connections 2024-09-14T10:44:34.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3570425243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422c1190 0x564c422c3580 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff412f499c0 1 -- 172.21.15.96:0/3570425243 >> 172.21.15.96:0/3570425243 conn(0x564c422b8b10 msgr2=0x564c422baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff412f499c0 1 -- 172.21.15.96:0/3570425243 shutdown_connections 2024-09-14T10:44:34.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.232+0000 7ff412f499c0 1 -- 172.21.15.96:0/3570425243 wait complete. 2024-09-14T10:44:34.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.248+0000 7ff412f499c0 1 Processor -- start 2024-09-14T10:44:34.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.248+0000 7ff412f499c0 1 -- start start 2024-09-14T10:44:34.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.248+0000 7ff412f499c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423a8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.248+0000 7ff412f499c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564c421c4fc0 con 0x564c422bcff0 2024-09-14T10:44:34.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.248+0000 7ff410a4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.248+0000 7ff410a4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423a8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45932/0 (socket says 172.21.15.96:45932) 2024-09-14T10:44:34.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.248+0000 7ff410a4f640 1 -- 172.21.15.96:0/3814392606 learned_addr learned my addr 172.21.15.96:0/3814392606 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.248+0000 7ff410a4f640 1 -- 172.21.15.96:0/3814392606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c423a8970 con 0x564c422bcff0 2024-09-14T10:44:34.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff410a4f640 1 --2- 172.21.15.96:0/3814392606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423a8380 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff4080017b0 tx=0x7ff408001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c018e2ca4613f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff2fee0d640 1 -- 172.21.15.96:0/3814392606 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4080044f0 con 0x564c422bcff0 2024-09-14T10:44:34.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff2fee0d640 1 -- 172.21.15.96:0/3814392606 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4080046b0 con 0x564c422bcff0 2024-09-14T10:44:34.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff2fee0d640 1 -- 172.21.15.96:0/3814392606 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff408004a10 con 0x564c422bcff0 2024-09-14T10:44:34.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- 172.21.15.96:0/3814392606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 msgr2=0x564c423a8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3814392606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423a8380 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff4080017b0 tx=0x7ff408001c70 comp rx=0 tx=0).stop 2024-09-14T10:44:34.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- 172.21.15.96:0/3814392606 shutdown_connections 2024-09-14T10:44:34.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3814392606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423a8380 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- 172.21.15.96:0/3814392606 >> 172.21.15.96:0/3814392606 conn(0x564c422b8b10 msgr2=0x564c423a3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- 172.21.15.96:0/3814392606 shutdown_connections 2024-09-14T10:44:34.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- 172.21.15.96:0/3814392606 wait complete. 2024-09-14T10:44:34.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 Processor -- start 2024-09-14T10:44:34.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- start start 2024-09-14T10:44:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564c42166a50 con 0x564c422bcff0 2024-09-14T10:44:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff410a4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff410a4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45934/0 (socket says 172.21.15.96:45934) 2024-09-14T10:44:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff410a4f640 1 -- 172.21.15.96:0/1086032172 learned_addr learned my addr 172.21.15.96:0/1086032172 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff410a4f640 1 -- 172.21.15.96:0/1086032172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c423b0130 con 0x564c422bcff0 2024-09-14T10:44:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff410a4f640 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423afbd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff4080012f0 tx=0x7ff408000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff2fd60a640 1 -- 172.21.15.96:0/1086032172 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff408013820 con 0x564c422bcff0 2024-09-14T10:44:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c423b03c0 con 0x564c422bcff0 2024-09-14T10:44:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff2fd60a640 1 -- 172.21.15.96:0/1086032172 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4080139c0 con 0x564c422bcff0 2024-09-14T10:44:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff2fd60a640 1 -- 172.21.15.96:0/1086032172 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff408013ca0 con 0x564c422bcff0 2024-09-14T10:44:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.252+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c423b0d70 con 0x564c422bcff0 2024-09-14T10:44:34.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff2fd60a640 1 -- 172.21.15.96:0/1086032172 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ff408010070 con 0x564c422bcff0 2024-09-14T10:44:34.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff2fd60a640 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2f803a150 0x7ff2f803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff2fd60a640 1 -- 172.21.15.96:0/1086032172 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff408018070 con 0x564c422bcff0 2024-09-14T10:44:34.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff41024e640 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2f803a150 0x7ff2f803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c422c1190 0x564c423b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423b7280 con 0x564c422c1190 2024-09-14T10:44:34.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff411250640 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c422c1190 0x564c423b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff41024e640 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2f803a150 0x7ff2f803c610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff4040ae000 tx=0x7ff4040a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff411250640 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c422c1190 0x564c423b6d40 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff411250640 1 -- 172.21.15.96:0/1086032172 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff4000083f0 con 0x564c422c1190 2024-09-14T10:44:34.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423b10e0 con 0x564c422c1190 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff411250640 1 -- 172.21.15.96:0/1086032172 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff4000083f0 con 0x564c422c1190 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423b9060 con 0x564c422c1190 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff411250640 1 -- 172.21.15.96:0/1086032172 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff4000083f0 con 0x564c422c1190 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423b8290 con 0x564c422c1190 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff411250640 1 -- 172.21.15.96:0/1086032172 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff4000083f0 con 0x564c422c1190 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423b86e0 con 0x564c422c1190 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.256+0000 7ff411250640 1 -- 172.21.15.96:0/1086032172 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff4000083f0 con 0x564c422c1190 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff412f499c0 1 Processor -- start 2024-09-14T10:44:34.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff412f499c0 1 -- start start 2024-09-14T10:44:34.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff412f499c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c423c7420 0x564c423c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff412f499c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564c421d1d80 con 0x564c423c7420 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff41024e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c423c7420 0x564c423c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff41024e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c423c7420 0x564c423c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45946/0 (socket says 172.21.15.96:45946) 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff41024e640 1 -- 172.21.15.96:0/3135766658 learned_addr learned my addr 172.21.15.96:0/3135766658 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff41024e640 1 -- 172.21.15.96:0/3135766658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c423c7e80 con 0x564c423c7420 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff41024e640 1 --2- 172.21.15.96:0/3135766658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c423c7420 0x564c423c7840 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff404000c10 tx=0x7ff4040180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff2f67fc640 1 -- 172.21.15.96:0/3135766658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040c5030 con 0x564c423c7420 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff412f499c0 1 -- 172.21.15.96:0/3135766658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c423c86e0 con 0x564c423c7420 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff412f499c0 1 -- 172.21.15.96:0/3135766658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c423c8c50 con 0x564c423c7420 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff2f67fc640 1 -- 172.21.15.96:0/3135766658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4040b5950 con 0x564c423c7420 2024-09-14T10:44:34.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff2f67fc640 1 -- 172.21.15.96:0/3135766658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040cf060 con 0x564c423c7420 2024-09-14T10:44:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff2f67fc640 1 -- 172.21.15.96:0/3135766658 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ff4040c8030 con 0x564c423c7420 2024-09-14T10:44:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff2f67fc640 1 --2- 172.21.15.96:0/3135766658 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2e803a140 0x7ff2e803c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff2f67fc640 1 -- 172.21.15.96:0/3135766658 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff4040c6070 con 0x564c423c7420 2024-09-14T10:44:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff411250640 1 --2- 172.21.15.96:0/3135766658 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2e803a140 0x7ff2e803c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff412f499c0 1 Processor -- start 2024-09-14T10:44:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff412f499c0 1 -- start start 2024-09-14T10:44:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.260+0000 7ff411250640 1 --2- 172.21.15.96:0/3135766658 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2e803a140 0x7ff2e803c600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff40000e3f0 tx=0x7ff400003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c42232930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564c423a8da0 con 0x564c42232530 2024-09-14T10:44:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c42232930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c42232930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45952/0 (socket says 172.21.15.96:45952) 2024-09-14T10:44:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 -- 172.21.15.96:0/3462715881 learned_addr learned my addr 172.21.15.96:0/3462715881 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 -- 172.21.15.96:0/3462715881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c42232e70 con 0x564c42232530 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 --2- 172.21.15.96:0/3462715881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c42232930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff4040ec3f0 tx=0x7ff4040c93c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa880e3f8aa26ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff2e7fff640 1 -- 172.21.15.96:0/3462715881 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040d8020 con 0x564c42232530 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff2e7fff640 1 -- 172.21.15.96:0/3462715881 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4040c1440 con 0x564c42232530 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff2e7fff640 1 -- 172.21.15.96:0/3462715881 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040c03a0 con 0x564c42232530 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- 172.21.15.96:0/3462715881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 msgr2=0x564c42232930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3462715881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c42232930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff4040ec3f0 tx=0x7ff4040c93c0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- 172.21.15.96:0/3462715881 shutdown_connections 2024-09-14T10:44:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3462715881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c42232930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- 172.21.15.96:0/3462715881 >> 172.21.15.96:0/3462715881 conn(0x564c423d0070 msgr2=0x564c423ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- 172.21.15.96:0/3462715881 shutdown_connections 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- 172.21.15.96:0/3462715881 wait complete. 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 Processor -- start 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- start start 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c423dd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564c422333f0 con 0x564c42232530 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c423dd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c423dd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45954/0 (socket says 172.21.15.96:45954) 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 learned_addr learned my addr 172.21.15.96:0/1430325838 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c423dda50 con 0x564c42232530 2024-09-14T10:44:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff41024e640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c423dd4f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff4040ec3f0 tx=0x7ff4040ec380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff2e67fc640 1 -- 172.21.15.96:0/1430325838 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040b6b10 con 0x564c42232530 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c423ddce0 con 0x564c42232530 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff2e67fc640 1 -- 172.21.15.96:0/1430325838 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4040b6cb0 con 0x564c42232530 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff2e67fc640 1 -- 172.21.15.96:0/1430325838 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040b47e0 con 0x564c42232530 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.264+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c423ddce0 con 0x564c42232530 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff2e67fc640 1 -- 172.21.15.96:0/1430325838 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ff4040db020 con 0x564c42232530 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff2e67fc640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2dc03a150 0x7ff2dc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff2e67fc640 1 -- 172.21.15.96:0/1430325838 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff4040f4c50 con 0x564c42232530 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff411250640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2dc03a150 0x7ff2dc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c423e87e0 0x564c423eac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423eb3c0 con 0x564c423e87e0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff410a4f640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c423e87e0 0x564c423eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff411250640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2dc03a150 0x7ff2dc03c610 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff40000f010 tx=0x7ff40001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff410a4f640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c423e87e0 0x564c423eac70 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 realm 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423eb820 con 0x564c423e87e0 2024-09-14T10:44:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec0f0 con 0x564c423e87e0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec490 con 0x564c423e87e0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.268+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff412f499c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff412f499c0 20 searching for the correct realm 2024-09-14T10:44:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564c423ee930 0x564c423f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f13d0 con 0x564c423ee930 2024-09-14T10:44:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff41024e640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564c423ee930 0x564c423f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff41024e640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564c423ee930 0x564c423f0d20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff41024e640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff4040dd040 0x7ff4040ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f13d0 con 0x7ff4040dd040 2024-09-14T10:44:34.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff411250640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff4040dd040 0x7ff4040ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff411250640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff4040dd040 0x7ff4040ea8e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff411250640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff400019040 0x7ff400019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f13d0 con 0x7ff400019040 2024-09-14T10:44:34.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff400019040 0x7ff400019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff400019040 0x7ff400019930 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.272+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff400019040 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff400019040 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff4040dd040 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423ee930 2024-09-14T10:44:34.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff400019040 2024-09-14T10:44:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff4040dd040 2024-09-14T10:44:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423ee930 2024-09-14T10:44:34.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423ee930 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.276+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff400019040 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423ee930 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423ee930 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff400019040 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423ee930 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff4040dd040 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff400019040 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.280+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423ee930 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff400019040 2024-09-14T10:44:34.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff4040dd040 2024-09-14T10:44:34.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423ee930 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff400019040 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x564c423e87e0 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423ec930 con 0x7ff4040dd040 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:34.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423ed2a0 con 0x564c423e87e0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423ed2a0 con 0x564c423e87e0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423ed2a0 con 0x564c423e87e0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 zone default found 2024-09-14T10:44:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 4 Realm: () 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 zonegroup default 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.284+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423ed690 con 0x7ff400019040 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423edab0 con 0x564c423ee930 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423f3220 con 0x564c423ee930 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 20 started sync module instance, tier type = 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x7ff4040dd040 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94885528936976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f35c0 con 0x7ff4040dd040 2024-09-14T10:44:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f3e10 con 0x564c423e87e0 2024-09-14T10:44:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.288+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94885528936976] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.292+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.292+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94885528942016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f3e90 con 0x564c423e87e0 2024-09-14T10:44:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.292+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f46e0 con 0x564c423ee930 2024-09-14T10:44:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.292+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94885528942016] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.292+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.292+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94885528943344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f4a80 con 0x564c423ee930 2024-09-14T10:44:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.292+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f5440 con 0x7ff4040dd040 2024-09-14T10:44:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.296+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.296+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94885528948896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f5b50 con 0x7ff4040dd040 2024-09-14T10:44:34.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.296+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f6650 con 0x564c423e87e0 2024-09-14T10:44:34.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.296+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94885528943344] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.296+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94885528948896] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.296+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.296+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94885528953152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f6610 con 0x564c423e87e0 2024-09-14T10:44:34.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.296+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f6a70 con 0x7ff400019040 2024-09-14T10:44:34.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.300+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94885528953152] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.300+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.300+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94885528944464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f6a20 con 0x7ff400019040 2024-09-14T10:44:34.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.300+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7480 con 0x7ff400019040 2024-09-14T10:44:34.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.300+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94885528944464] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.300+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.300+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94885528950176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7480 con 0x7ff400019040 2024-09-14T10:44:34.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.300+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7e40 con 0x7ff400019040 2024-09-14T10:44:34.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94885528950176] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94885528957152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7e40 con 0x7ff400019040 2024-09-14T10:44:34.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 20 add_watcher() i=0 2024-09-14T10:44:34.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 20 add_watcher() i=1 2024-09-14T10:44:34.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 20 add_watcher() i=2 2024-09-14T10:44:34.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 20 add_watcher() i=3 2024-09-14T10:44:34.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 20 add_watcher() i=4 2024-09-14T10:44:34.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 20 add_watcher() i=5 2024-09-14T10:44:34.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 20 add_watcher() i=6 2024-09-14T10:44:34.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94885528957152] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 20 add_watcher() i=7 2024-09-14T10:44:34.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:34.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c423fb130 con 0x564c423e87e0 2024-09-14T10:44:34.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.304+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94885528959744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f83d0 con 0x564c423e87e0 2024-09-14T10:44:34.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94885528959744] v32'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff2c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:34.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff412f499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:34.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff412f499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:34.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff412f499c0 5 note: GC not initialized 2024-09-14T10:44:34.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff2c5fe3640 20 reqs_thread_entry: start 2024-09-14T10:44:34.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff412f499c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:34.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff412f499c0 20 Filter name: none 2024-09-14T10:44:34.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff2377fe640 20 reqs_thread_entry: start 2024-09-14T10:44:34.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c4241ddc0 con 0x7ff400019040 2024-09-14T10:44:34.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff400019040 2024-09-14T10:44:34.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.308+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423ee930 2024-09-14T10:44:34.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff400019040 2024-09-14T10:44:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423e87e0 2024-09-14T10:44:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff4040dd040 2024-09-14T10:44:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x564c423ee930 2024-09-14T10:44:34.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x564c423ee930 2024-09-14T10:44:34.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x564c423ee930 2024-09-14T10:44:34.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x7ff4040dd040 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x7ff4040dd040 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x564c423ee930 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x564c423ee930 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.312+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x564c423ee930 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c423f26c0 con 0x564c423e87e0 2024-09-14T10:44:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423ee930 2024-09-14T10:44:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'11 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423e87e0 2024-09-14T10:44:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423ee930 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423ee930 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423e87e0 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff4040dd040 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff4040dd040 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423e87e0 2024-09-14T10:44:34.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.316+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff400019040 2024-09-14T10:44:34.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff4040dd040 2024-09-14T10:44:34.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff400019040 2024-09-14T10:44:34.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423ee930 2024-09-14T10:44:34.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423ee930 2024-09-14T10:44:34.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423ee930 2024-09-14T10:44:34.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x564c423e87e0 2024-09-14T10:44:34.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff4040dd040 2024-09-14T10:44:34.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff408063040 con 0x7ff400019040 2024-09-14T10:44:34.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.320+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.320 INFO:teuthology.orchestra.run.smithi096.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-14T10:44:34.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.324+0000 7ff2c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:34.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.324+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94885528959744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c4241d720 con 0x564c423e87e0 2024-09-14T10:44:34.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.324+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94885528959744] v32'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.324+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94885528936976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7b00 con 0x7ff4040dd040 2024-09-14T10:44:34.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.328+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94885528936976] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.328+0000 7ff412f499c0 20 remove_watcher() i=0 2024-09-14T10:44:34.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.328+0000 7ff412f499c0 2 removed watcher, disabling cache 2024-09-14T10:44:34.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.328+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94885528942016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7b00 con 0x564c423e87e0 2024-09-14T10:44:34.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.328+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94885528942016] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.328+0000 7ff412f499c0 20 remove_watcher() i=1 2024-09-14T10:44:34.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.328+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94885528943344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f35c0 con 0x564c423ee930 2024-09-14T10:44:34.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff41024e640 1 -- 172.21.15.96:0/1430325838 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94885528943344] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff4040a8070 con 0x564c423ee930 2024-09-14T10:44:34.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff412f499c0 20 remove_watcher() i=2 2024-09-14T10:44:34.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94885528948896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7b00 con 0x7ff4040dd040 2024-09-14T10:44:34.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff411250640 1 -- 172.21.15.96:0/1430325838 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94885528948896] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002f040 con 0x7ff4040dd040 2024-09-14T10:44:34.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff412f499c0 20 remove_watcher() i=3 2024-09-14T10:44:34.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94885528953152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7b00 con 0x564c423e87e0 2024-09-14T10:44:34.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94885528953152] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x564c423e87e0 2024-09-14T10:44:34.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff412f499c0 20 remove_watcher() i=4 2024-09-14T10:44:34.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.332+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94885528944464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7b00 con 0x7ff400019040 2024-09-14T10:44:34.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.336+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94885528944464] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.336+0000 7ff412f499c0 20 remove_watcher() i=5 2024-09-14T10:44:34.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.336+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94885528950176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7b00 con 0x7ff400019040 2024-09-14T10:44:34.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94885528950176] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 20 remove_watcher() i=6 2024-09-14T10:44:34.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94885528957152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c423f7b00 con 0x7ff400019040 2024-09-14T10:44:34.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94885528957152] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40801b030 con 0x7ff400019040 2024-09-14T10:44:34.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 20 remove_watcher() i=7 2024-09-14T10:44:34.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff400019040 msgr2=0x7ff400019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ff400019040 0x7ff400019930 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c423e87e0 msgr2=0x564c423eac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c423e87e0 0x564c423eac70 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff4040dd040 msgr2=0x7ff4040ea8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ff4040dd040 0x7ff4040ea8e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564c423ee930 msgr2=0x564c423f0d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564c423ee930 0x564c423f0d20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2dc03a150 msgr2=0x7ff2dc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2dc03a150 0x7ff2dc03c610 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff40000f010 tx=0x7ff40001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 msgr2=0x564c423dd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1430325838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c42232530 0x564c423dd4f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff4040ec3f0 tx=0x7ff4040ec380 comp rx=0 tx=0).stop 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff410a4f640 1 -- 172.21.15.96:0/1430325838 reap_dead start 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 shutdown_connections 2024-09-14T10:44:34.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 >> 172.21.15.96:0/1430325838 conn(0x564c423d0070 msgr2=0x564c423ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 shutdown_connections 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/1430325838 wait complete. 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/3135766658 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2e803a140 msgr2=0x7ff2e803c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3135766658 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2e803a140 0x7ff2e803c600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff40000e3f0 tx=0x7ff400003070 comp rx=0 tx=0).stop 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/3135766658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c423c7420 msgr2=0x564c423c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3135766658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c423c7420 0x564c423c7840 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff404000c10 tx=0x7ff4040180b0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/3135766658 shutdown_connections 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3135766658 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2e803a140 0x7ff2e803c600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 --2- 172.21.15.96:0/3135766658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c423c7420 0x564c423c7840 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/3135766658 >> 172.21.15.96:0/3135766658 conn(0x564c423bcdd0 msgr2=0x564c423bd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/3135766658 shutdown_connections 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.340+0000 7ff412f499c0 1 -- 172.21.15.96:0/3135766658 wait complete. 2024-09-14T10:44:34.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c422c1190 msgr2=0x564c423b6d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c422c1190 0x564c423b6d40 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2f803a150 msgr2=0x7ff2f803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2f803a150 0x7ff2f803c610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff4040ae000 tx=0x7ff4040a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 msgr2=0x564c423afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423afbd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff4080012f0 tx=0x7ff408000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 shutdown_connections 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564c422c1190 0x564c423b6d40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff2f803a150 0x7ff2f803c610 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 --2- 172.21.15.96:0/1086032172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564c422bcff0 0x564c423afbd0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 >> 172.21.15.96:0/1086032172 conn(0x564c422b8b10 msgr2=0x564c423a97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 shutdown_connections 2024-09-14T10:44:34.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.344+0000 7ff412f499c0 1 -- 172.21.15.96:0/1086032172 wait complete. 2024-09-14T10:44:34.351 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-14T10:44:34.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-14T10:44:34.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-14T10:44:34.352 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-14T10:44:34.433 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:34.433 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:34.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0e4d39c0 1 Processor -- start 2024-09-14T10:44:34.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0e4d39c0 1 -- start start 2024-09-14T10:44:34.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0e4d39c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e9b7e1e760 0x55e9b7e20b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0e4d39c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e9b7cc47a0 con 0x55e9b7e21090 2024-09-14T10:44:34.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0e4d39c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55e9b7d201b0 con 0x55e9b7e1e760 2024-09-14T10:44:34.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0bfd9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e9b7e1e760 0x55e9b7e20b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0b7d8640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55e9b7e21090 0x55e9b7e23480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:37314/0 (socket says 172.21.15.96:37314) 2024-09-14T10:44:34.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/1705470411 learned_addr learned my addr 172.21.15.96:0/1705470411 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:34.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/1705470411 >> v1:172.21.15.70:6789/0 conn(0x55e9b7e21090 legacy=0x55e9b7e23480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.436+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/1705470411 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b7c9eda0 con 0x55e9b7e1e760 2024-09-14T10:44:34.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0bfd9640 1 --2- 172.21.15.96:0/1705470411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7e20b50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400a420 tx=0x7f6c0401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0b72964cf39767 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0afd7640 1 -- 172.21.15.96:0/1705470411 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c040af070 con 0x55e9b7e1e760 2024-09-14T10:44:34.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0afd7640 1 -- 172.21.15.96:0/1705470411 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c040aa530 con 0x55e9b7e1e760 2024-09-14T10:44:34.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0afd7640 1 -- 172.21.15.96:0/1705470411 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c040aa850 con 0x55e9b7e1e760 2024-09-14T10:44:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1705470411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 msgr2=0x55e9b7e20b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/1705470411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7e20b50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400a420 tx=0x7f6c0401afd0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1705470411 shutdown_connections 2024-09-14T10:44:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/1705470411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7e20b50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1705470411 >> 172.21.15.96:0/1705470411 conn(0x55e9b7d91af0 msgr2=0x55e9b7d91f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1705470411 shutdown_connections 2024-09-14T10:44:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.440+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1705470411 wait complete. 2024-09-14T10:44:34.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0e4d39c0 1 Processor -- start 2024-09-14T10:44:34.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0e4d39c0 1 -- start start 2024-09-14T10:44:34.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0e4d39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f09580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0e4d39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9b7d23fc0 con 0x55e9b7e1e760 2024-09-14T10:44:34.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0bfd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f09580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0bfd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f09580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45984/0 (socket says 172.21.15.96:45984) 2024-09-14T10:44:34.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/1378996794 learned_addr learned my addr 172.21.15.96:0/1378996794 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/1378996794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b7f09b70 con 0x55e9b7e1e760 2024-09-14T10:44:34.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6c0bfd9640 1 --2- 172.21.15.96:0/1378996794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f09580 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6c040ad040 tx=0x7f6c040033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2278cba3471fecc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6af9e0b640 1 -- 172.21.15.96:0/1378996794 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c040af050 con 0x55e9b7e1e760 2024-09-14T10:44:34.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6af9e0b640 1 -- 172.21.15.96:0/1378996794 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c040b0040 con 0x55e9b7e1e760 2024-09-14T10:44:34.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.456+0000 7f6af9e0b640 1 -- 172.21.15.96:0/1378996794 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c040aaad0 con 0x55e9b7e1e760 2024-09-14T10:44:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1378996794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 msgr2=0x55e9b7f09580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/1378996794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f09580 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6c040ad040 tx=0x7f6c040033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1378996794 shutdown_connections 2024-09-14T10:44:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/1378996794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f09580 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1378996794 >> 172.21.15.96:0/1378996794 conn(0x55e9b7d91af0 msgr2=0x55e9b7f051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1378996794 shutdown_connections 2024-09-14T10:44:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1378996794 wait complete. 2024-09-14T10:44:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 Processor -- start 2024-09-14T10:44:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- start start 2024-09-14T10:44:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f10dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9b7cc5a50 con 0x55e9b7e1e760 2024-09-14T10:44:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0bfd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f10dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0bfd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f10dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45992/0 (socket says 172.21.15.96:45992) 2024-09-14T10:44:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/601799311 learned_addr learned my addr 172.21.15.96:0/601799311 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/601799311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b7f11320 con 0x55e9b7e1e760 2024-09-14T10:44:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0bfd9640 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f10dc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6c0401b4b0 tx=0x7f6c04017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6af3fff640 1 -- 172.21.15.96:0/601799311 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c040b6c20 con 0x55e9b7e1e760 2024-09-14T10:44:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9b7f115b0 con 0x55e9b7e1e760 2024-09-14T10:44:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6af3fff640 1 -- 172.21.15.96:0/601799311 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c040b6dc0 con 0x55e9b7e1e760 2024-09-14T10:44:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6af3fff640 1 -- 172.21.15.96:0/601799311 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c040bf590 con 0x55e9b7e1e760 2024-09-14T10:44:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.460+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b7f11f60 con 0x55e9b7e1e760 2024-09-14T10:44:34.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6af3fff640 1 -- 172.21.15.96:0/601799311 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6c040bf7c0 con 0x55e9b7e1e760 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6af3fff640 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6af403a150 0x7f6af403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6af3fff640 1 -- 172.21.15.96:0/601799311 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6c040bb070 con 0x55e9b7e1e760 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0b7d8640 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6af403a150 0x7f6af403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7e21090 0x55e9b7f17f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f18470 con 0x55e9b7e21090 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7e21090 0x55e9b7f17f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0b7d8640 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6af403a150 0x7f6af403c610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4001d80 tx=0x7f6bf40012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7e21090 0x55e9b7f17f30 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0c7da640 1 -- 172.21.15.96:0/601799311 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bfc0083f0 con 0x55e9b7e21090 2024-09-14T10:44:34.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f18870 con 0x55e9b7e21090 2024-09-14T10:44:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0c7da640 1 -- 172.21.15.96:0/601799311 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6bfc0083f0 con 0x55e9b7e21090 2024-09-14T10:44:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f1a170 con 0x55e9b7e21090 2024-09-14T10:44:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0c7da640 1 -- 172.21.15.96:0/601799311 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6bfc0083f0 con 0x55e9b7e21090 2024-09-14T10:44:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f193a0 con 0x55e9b7e21090 2024-09-14T10:44:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0c7da640 1 -- 172.21.15.96:0/601799311 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6bfc0083f0 con 0x55e9b7e21090 2024-09-14T10:44:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f197f0 con 0x55e9b7e21090 2024-09-14T10:44:34.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0c7da640 1 -- 172.21.15.96:0/601799311 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6bfc0083f0 con 0x55e9b7e21090 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 Processor -- start 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 -- start start 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f28530 0x55e9b7f28950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0e4d39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9b7d30d80 con 0x55e9b7f28530 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0b7d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f28530 0x55e9b7f28950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0b7d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f28530 0x55e9b7f28950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45998/0 (socket says 172.21.15.96:45998) 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.464+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/714000490 learned_addr learned my addr 172.21.15.96:0/714000490 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/714000490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b7f28f90 con 0x55e9b7f28530 2024-09-14T10:44:34.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0b7d8640 1 --2- 172.21.15.96:0/714000490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f28530 0x55e9b7f28950 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400d660 tx=0x7f6bf400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6af17fa640 1 -- 172.21.15.96:0/714000490 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf400c6b0 con 0x55e9b7f28530 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/714000490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9b7f297f0 con 0x55e9b7f28530 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/714000490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b7f29d60 con 0x55e9b7f28530 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6af17fa640 1 -- 172.21.15.96:0/714000490 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf400c850 con 0x55e9b7f28530 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6af17fa640 1 -- 172.21.15.96:0/714000490 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf400cb30 con 0x55e9b7f28530 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6af17fa640 1 -- 172.21.15.96:0/714000490 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6bf4023020 con 0x55e9b7f28530 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6af17fa640 1 --2- 172.21.15.96:0/714000490 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ae403a190 0x7f6ae403c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6af17fa640 1 -- 172.21.15.96:0/714000490 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6bf4021020 con 0x55e9b7f28530 2024-09-14T10:44:34.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/714000490 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ae403a190 0x7f6ae403c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0e4d39c0 1 Processor -- start 2024-09-14T10:44:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/714000490 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ae403a190 0x7f6ae403c650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00e3f0 tx=0x7f6bfc003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0e4d39c0 1 -- start start 2024-09-14T10:44:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0e4d39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f36260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0e4d39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9b7f09ee0 con 0x55e9b7f35e60 2024-09-14T10:44:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0b7d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f36260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0b7d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f36260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:46010/0 (socket says 172.21.15.96:46010) 2024-09-14T10:44:34.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/1107747213 learned_addr learned my addr 172.21.15.96:0/1107747213 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.468+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/1107747213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b7f36850 con 0x55e9b7f35e60 2024-09-14T10:44:34.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0b7d8640 1 --2- 172.21.15.96:0/1107747213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f36260 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40244d0 tx=0x7f6bf40233d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae7ccc324cb0154 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6aeaffd640 1 -- 172.21.15.96:0/1107747213 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf400ccd0 con 0x55e9b7f35e60 2024-09-14T10:44:34.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6aeaffd640 1 -- 172.21.15.96:0/1107747213 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf401bcc0 con 0x55e9b7f35e60 2024-09-14T10:44:34.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6aeaffd640 1 -- 172.21.15.96:0/1107747213 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4050280 con 0x55e9b7f35e60 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1107747213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 msgr2=0x55e9b7f36260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/1107747213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f36260 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40244d0 tx=0x7f6bf40233d0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1107747213 shutdown_connections 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/1107747213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f36260 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1107747213 >> 172.21.15.96:0/1107747213 conn(0x55e9b7f31280 msgr2=0x55e9b7f2f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1107747213 shutdown_connections 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/1107747213 wait complete. 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 Processor -- start 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- start start 2024-09-14T10:44:34.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f3c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9b7f34db0 con 0x55e9b7f35e60 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0b7d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f3c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0b7d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f3c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:46014/0 (socket says 172.21.15.96:46014) 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 learned_addr learned my addr 172.21.15.96:0/501355571 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b7f3c920 con 0x55e9b7f35e60 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0b7d8640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f3c3c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40435c0 tx=0x7f6bf4051760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6ae97fa640 1 -- 172.21.15.96:0/501355571 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4025410 con 0x55e9b7f35e60 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6ae97fa640 1 -- 172.21.15.96:0/501355571 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf4023a60 con 0x55e9b7f35e60 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6ae97fa640 1 -- 172.21.15.96:0/501355571 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4024ba0 con 0x55e9b7f35e60 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9b7f3cbb0 con 0x55e9b7f35e60 2024-09-14T10:44:34.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.472+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b7f3cbb0 con 0x55e9b7f35e60 2024-09-14T10:44:34.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6ae97fa640 1 -- 172.21.15.96:0/501355571 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6bf4035030 con 0x55e9b7f35e60 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6ae97fa640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ad403a150 0x7f6ad403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6ae97fa640 1 -- 172.21.15.96:0/501355571 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6bf4033070 con 0x55e9b7f35e60 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ad403a150 0x7f6ad403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7f47760 0x55e9b7f49bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f4a340 con 0x55e9b7f47760 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0bfd9640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7f47760 0x55e9b7f49bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ad403a150 0x7f6ad403c610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00f010 tx=0x7f6bfc01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0bfd9640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7f47760 0x55e9b7f49bf0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 realm 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f4a750 con 0x55e9b7f47760 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f4b020 con 0x55e9b7f47760 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f4b3c0 con 0x55e9b7f47760 2024-09-14T10:44:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f4bc10 con 0x55e9b7f47760 2024-09-14T10:44:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 20 searching for the correct realm 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e9b7f4d980 0x55e9b7f4fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x55e9b7f4d980 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0b7d8640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e9b7f4d980 0x55e9b7f4fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0b7d8640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e9b7f4d980 0x55e9b7f4fd70 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0b7d8640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6bf40403d0 0x7f6bf4019770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.476+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x7f6bf40403d0 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6bf40403d0 0x7f6bf4019770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6bf40403d0 0x7f6bf4019770 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0c7da640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6bfc019040 0x7f6bfc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x7f6bfc019040 2024-09-14T10:44:34.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6bfc019040 0x7f6bfc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6bfc019040 0x7f6bfc019930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x7f6bfc019040 2024-09-14T10:44:34.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x55e9b7f47760 2024-09-14T10:44:34.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x55e9b7f47760 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x7f6bfc019040 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x7f6bfc019040 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x7f6bfc019040 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x7f6bfc019040 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.480+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x7f6bf40403d0 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x55e9b7f4d980 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x55e9b7f47760 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x7f6bfc019040 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x7f6bfc019040 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x55e9b7f47760 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x7f6bf40403d0 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x55e9b7f4d980 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50300 con 0x55e9b7f4d980 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x7f6bfc019040 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x7f6bfc019040 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f4d980 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f4d980 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.484+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f47760 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f47760 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x7f6bfc019040 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040cf070 con 0x7f6bfc019040 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f4d980 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f47760 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c040cf070 con 0x55e9b7f47760 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x7f6bfc019040 2024-09-14T10:44:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f4d980 2024-09-14T10:44:34.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x7f6bfc019040 2024-09-14T10:44:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.488+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f4d980 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x7f6bfc019040 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x55e9b7f47760 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6bf405f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f4c560 con 0x55e9b7f47760 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f4ce00 con 0x55e9b7f47760 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50760 con 0x55e9b7f47760 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 zone default found 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 4 Realm: () 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 zonegroup default 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f50780 con 0x7f6bfc019040 2024-09-14T10:44:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f525b0 con 0x55e9b7f4d980 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.492+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f52a70 con 0x55e9b7f4d980 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0e4d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0e4d39c0 20 started sync module instance, tier type = 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0e4d39c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f51a50 con 0x7f6bf40403d0 2024-09-14T10:44:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94462302035520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f516b0 con 0x7f6bf40403d0 2024-09-14T10:44:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f539a0 con 0x55e9b7f47760 2024-09-14T10:44:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94462302035520] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94462302039760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f539a0 con 0x55e9b7f47760 2024-09-14T10:44:34.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.496+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f54360 con 0x55e9b7f4d980 2024-09-14T10:44:34.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.500+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94462302039760] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.500+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.500+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94462302041328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f53910 con 0x55e9b7f4d980 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.500+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f55110 con 0x7f6bf40403d0 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.500+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.500+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94462302047232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f559b0 con 0x7f6bf40403d0 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.500+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f563f0 con 0x55e9b7f47760 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.504+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94462302041328] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.504+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94462302047232] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.504+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.504+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94462302052032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f55500 con 0x55e9b7f47760 2024-09-14T10:44:34.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.504+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f56c90 con 0x7f6bfc019040 2024-09-14T10:44:34.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.504+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94462302052032] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.508+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.508+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94462302046032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f569b0 con 0x7f6bfc019040 2024-09-14T10:44:34.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.508+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f57200 con 0x7f6bfc019040 2024-09-14T10:44:34.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.508+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94462302046032] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.508+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.508+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94462302053904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f56fe0 con 0x7f6bfc019040 2024-09-14T10:44:34.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.508+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f57b00 con 0x7f6bfc019040 2024-09-14T10:44:34.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94462302057936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f57f70 con 0x7f6bfc019040 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 20 add_watcher() i=0 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 20 add_watcher() i=1 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 20 add_watcher() i=2 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 20 add_watcher() i=3 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 20 add_watcher() i=4 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 20 add_watcher() i=5 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94462302053904] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 20 add_watcher() i=6 2024-09-14T10:44:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94462302057936] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 20 add_watcher() i=7 2024-09-14T10:44:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f57f70 con 0x55e9b7f47760 2024-09-14T10:44:34.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.512+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94462302059200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f57ee0 con 0x55e9b7f47760 2024-09-14T10:44:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94462302059200] v32'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6ac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 5 note: GC not initialized 2024-09-14T10:44:34.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6ac0fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:34.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:34.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 Filter name: none 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6a3a7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7e7a0 con 0x55e9b7f47760 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7e180 con 0x7f6bf40403d0 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 disabling bucket name=myfoo 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7f210 con 0x7f6bf40403d0 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f80af0 con 0x55e9b7f4d980 2024-09-14T10:44:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(65 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:34.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.516+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f895b0 con 0x55e9b7f4d980 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1, ofs0, ns] 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94462302226112 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f83b70 con 0x55e9b7f47760 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== watch-notify(notify (1) cookie 94462302052032 notify 137438953491 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55e9b7f11f60 con 0x55e9b7f47760 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94462302052032 notifier 4592 bl.length()=760 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(67 notify.4 [notify cookie 94462302226112 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:34.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6ad0003eb0 con 0x55e9b7f47760 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== watch-notify(notify_complete (2) cookie 94462302226112 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e9b7f115b0 con 0x55e9b7f47760 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_sources= new_sources= 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential sources added=[] removed=[] 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_dests= new_dests= 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential dests added=[] removed=[] 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f80640 con 0x55e9b7f47760 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:34.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94462302225984 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f86e40 con 0x55e9b7f47760 2024-09-14T10:44:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== watch-notify(notify (1) cookie 94462302052032 notify 137438953492 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55e9b7f115b0 con 0x55e9b7f47760 2024-09-14T10:44:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94462302052032 notifier 4592 bl.length()=567 2024-09-14T10:44:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6aeaffd640 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6ad0003eb0 con 0x55e9b7f47760 2024-09-14T10:44:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(70 notify.4 [notify cookie 94462302225984 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.520+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== watch-notify(notify_complete (2) cookie 94462302225984 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e9b7f11320 con 0x55e9b7f47760 2024-09-14T10:44:34.523 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:34.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.524+0000 7f6ac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.524+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94462302059200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x55e9b7f47760 2024-09-14T10:44:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.524+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94462302059200] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.524+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94462302035520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x7f6bf40403d0 2024-09-14T10:44:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.524+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94462302035520] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.524+0000 7f6c0e4d39c0 20 remove_watcher() i=0 2024-09-14T10:44:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.524+0000 7f6c0e4d39c0 2 removed watcher, disabling cache 2024-09-14T10:44:34.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.524+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94462302039760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x55e9b7f47760 2024-09-14T10:44:34.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94462302039760] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0e4d39c0 20 remove_watcher() i=1 2024-09-14T10:44:34.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94462302041328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0b7d8640 1 -- 172.21.15.96:0/501355571 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94462302041328] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bf40514a0 con 0x55e9b7f4d980 2024-09-14T10:44:34.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0e4d39c0 20 remove_watcher() i=2 2024-09-14T10:44:34.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94462302047232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x7f6bf40403d0 2024-09-14T10:44:34.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0c7da640 1 -- 172.21.15.96:0/501355571 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94462302047232] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bfc02f040 con 0x7f6bf40403d0 2024-09-14T10:44:34.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0e4d39c0 20 remove_watcher() i=3 2024-09-14T10:44:34.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.528+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94462302052032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x55e9b7f47760 2024-09-14T10:44:34.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.532+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94462302052032] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x55e9b7f47760 2024-09-14T10:44:34.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.532+0000 7f6c0e4d39c0 20 remove_watcher() i=4 2024-09-14T10:44:34.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.532+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94462302046032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x7f6bfc019040 2024-09-14T10:44:34.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.532+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94462302046032] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.536+0000 7f6c0e4d39c0 20 remove_watcher() i=5 2024-09-14T10:44:34.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.536+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94462302053904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x7f6bfc019040 2024-09-14T10:44:34.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.536+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94462302053904] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.536+0000 7f6c0e4d39c0 20 remove_watcher() i=6 2024-09-14T10:44:34.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.536+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94462302057936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9b7f7c3a0 con 0x7f6bfc019040 2024-09-14T10:44:34.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94462302057936] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c040fa040 con 0x7f6bfc019040 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 20 remove_watcher() i=7 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6bfc019040 msgr2=0x7f6bfc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f6bfc019040 0x7f6bfc019930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7f47760 msgr2=0x55e9b7f49bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7f47760 0x55e9b7f49bf0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6bf40403d0 msgr2=0x7f6bf4019770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f6bf40403d0 0x7f6bf4019770 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e9b7f4d980 msgr2=0x55e9b7f4fd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e9b7f4d980 0x55e9b7f4fd70 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ad403a150 msgr2=0x7f6ad403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ad403a150 0x7f6ad403c610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00f010 tx=0x7f6bfc01b070 comp rx=0 tx=0).stop 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 msgr2=0x55e9b7f3c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0bfd9640 1 -- 172.21.15.96:0/501355571 reap_dead start 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f3c3c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40435c0 tx=0x7f6bf4051760 comp rx=0 tx=0).stop 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 shutdown_connections 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/501355571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f35e60 0x55e9b7f3c3c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 >> 172.21.15.96:0/501355571 conn(0x55e9b7f31280 msgr2=0x55e9b7f2f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 shutdown_connections 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/501355571 wait complete. 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/714000490 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ae403a190 msgr2=0x7f6ae403c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/714000490 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ae403a190 0x7f6ae403c650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00e3f0 tx=0x7f6bfc003070 comp rx=0 tx=0).stop 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/714000490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f28530 msgr2=0x55e9b7f28950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/714000490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f28530 0x55e9b7f28950 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400d660 tx=0x7f6bf400da60 comp rx=0 tx=0).stop 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/714000490 shutdown_connections 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/714000490 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ae403a190 0x7f6ae403c650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/714000490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7f28530 0x55e9b7f28950 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/714000490 >> 172.21.15.96:0/714000490 conn(0x55e9b7f1dee0 msgr2=0x55e9b7f1e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/714000490 shutdown_connections 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/714000490 wait complete. 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7e21090 msgr2=0x55e9b7f17f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7e21090 0x55e9b7f17f30 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6af403a150 msgr2=0x7f6af403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6af403a150 0x7f6af403c610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4001d80 tx=0x7f6bf40012e0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 msgr2=0x55e9b7f10dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f10dc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6c0401b4b0 tx=0x7f6c04017d70 comp rx=0 tx=0).stop 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 shutdown_connections 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e9b7e21090 0x55e9b7f17f30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6af403a150 0x7f6af403c610 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4001d80 tx=0x7f6bf40012e0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 --2- 172.21.15.96:0/601799311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9b7e1e760 0x55e9b7f10dc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 >> 172.21.15.96:0/601799311 conn(0x55e9b7d91af0 msgr2=0x55e9b7f0a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 shutdown_connections 2024-09-14T10:44:34.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.540+0000 7f6c0e4d39c0 1 -- 172.21.15.96:0/601799311 wait complete. 2024-09-14T10:44:34.549 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:34.551 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-14T10:44:34.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-14T10:44:34.551 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-14T10:44:34.628 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:34.629 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:34.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04892a49c0 1 Processor -- start 2024-09-14T10:44:34.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04892a49c0 1 -- start start 2024-09-14T10:44:34.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04892a49c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5621dc0fe120 0x5621dc100510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04892a49c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5621dbfa27a0 con 0x5621dc0f9fd0 2024-09-14T10:44:34.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04892a49c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5621dbffe1b0 con 0x5621dc0fe120 2024-09-14T10:44:34.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04865a9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5621dc0fe120 0x5621dc100510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04865a9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5621dc0fe120 0x5621dc100510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:46024/0 (socket says 172.21.15.96:46024) 2024-09-14T10:44:34.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04865a9640 1 -- 172.21.15.96:0/2418074156 learned_addr learned my addr 172.21.15.96:0/2418074156 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04865a9640 1 -- 172.21.15.96:0/2418074156 >> v1:172.21.15.70:6789/0 conn(0x5621dc0f9fd0 legacy=0x5621dc0fa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.632+0000 7f04865a9640 1 -- 172.21.15.96:0/2418074156 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621dbf7cda0 con 0x5621dc0fe120 2024-09-14T10:44:34.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f04865a9640 1 --2- 172.21.15.96:0/2418074156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0fe120 0x5621dc100510 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f047000a5c0 tx=0x7f047001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bb444c2a1701f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f0485da8640 1 -- 172.21.15.96:0/2418074156 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04700a9590 con 0x5621dc0fe120 2024-09-14T10:44:34.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f0485da8640 1 -- 172.21.15.96:0/2418074156 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04700ae070 con 0x5621dc0fe120 2024-09-14T10:44:34.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f0485da8640 1 -- 172.21.15.96:0/2418074156 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04700a9880 con 0x5621dc0fe120 2024-09-14T10:44:34.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f04892a49c0 1 -- 172.21.15.96:0/2418074156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0fe120 msgr2=0x5621dc100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f04892a49c0 1 --2- 172.21.15.96:0/2418074156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0fe120 0x5621dc100510 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f047000a5c0 tx=0x7f047001b3d0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f04892a49c0 1 -- 172.21.15.96:0/2418074156 shutdown_connections 2024-09-14T10:44:34.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f04892a49c0 1 --2- 172.21.15.96:0/2418074156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0fe120 0x5621dc100510 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f04892a49c0 1 -- 172.21.15.96:0/2418074156 >> 172.21.15.96:0/2418074156 conn(0x5621dc0f5af0 msgr2=0x5621dc0f7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f04892a49c0 1 -- 172.21.15.96:0/2418074156 shutdown_connections 2024-09-14T10:44:34.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.636+0000 7f04892a49c0 1 -- 172.21.15.96:0/2418074156 wait complete. 2024-09-14T10:44:34.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 Processor -- start 2024-09-14T10:44:34.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 -- start start 2024-09-14T10:44:34.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc1e5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621dc001fc0 con 0x5621dc0f9fd0 2024-09-14T10:44:34.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f0486daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc1e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f0486daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc1e5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:46030/0 (socket says 172.21.15.96:46030) 2024-09-14T10:44:34.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f0486daa640 1 -- 172.21.15.96:0/3010306517 learned_addr learned my addr 172.21.15.96:0/3010306517 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f0486daa640 1 -- 172.21.15.96:0/3010306517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621dc1e5a10 con 0x5621dc0f9fd0 2024-09-14T10:44:34.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f0486daa640 1 --2- 172.21.15.96:0/3010306517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc1e5420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0478001680 tx=0x7f0478001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f8518b938357b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f0374e09640 1 -- 172.21.15.96:0/3010306517 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0478016070 con 0x5621dc0f9fd0 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f0374e09640 1 -- 172.21.15.96:0/3010306517 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047800f660 con 0x5621dc0f9fd0 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f0374e09640 1 -- 172.21.15.96:0/3010306517 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f047800f980 con 0x5621dc0f9fd0 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 -- 172.21.15.96:0/3010306517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 msgr2=0x5621dc1e5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 --2- 172.21.15.96:0/3010306517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc1e5420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0478001680 tx=0x7f0478001b40 comp rx=0 tx=0).stop 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 -- 172.21.15.96:0/3010306517 shutdown_connections 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 --2- 172.21.15.96:0/3010306517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc1e5420 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 -- 172.21.15.96:0/3010306517 >> 172.21.15.96:0/3010306517 conn(0x5621dc0f5af0 msgr2=0x5621dc1e1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 -- 172.21.15.96:0/3010306517 shutdown_connections 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.652+0000 7f04892a49c0 1 -- 172.21.15.96:0/3010306517 wait complete. 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f04892a49c0 1 Processor -- start 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f04892a49c0 1 -- start start 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f04892a49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f04892a49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621dbfa3a50 con 0x5621dc0f9fd0 2024-09-14T10:44:34.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f0486daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f0486daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:46046/0 (socket says 172.21.15.96:46046) 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f0486daa640 1 -- 172.21.15.96:0/846873099 learned_addr learned my addr 172.21.15.96:0/846873099 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f0486daa640 1 -- 172.21.15.96:0/846873099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621dc0709a0 con 0x5621dc0f9fd0 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f0486daa640 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc070440 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5621dc1e63e0 tx=0x7f0478000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f0373606640 1 -- 172.21.15.96:0/846873099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0478016040 con 0x5621dc0f9fd0 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f0373606640 1 -- 172.21.15.96:0/846873099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0478022070 con 0x5621dc0f9fd0 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f0373606640 1 -- 172.21.15.96:0/846873099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0478006330 con 0x5621dc0f9fd0 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621dc06ed80 con 0x5621dc0f9fd0 2024-09-14T10:44:34.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.656+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621dc06f310 con 0x5621dc0f9fd0 2024-09-14T10:44:34.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f0373606640 1 -- 172.21.15.96:0/846873099 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0478011510 con 0x5621dc0f9fd0 2024-09-14T10:44:34.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f0373606640 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036c03a2f0 0x7f036c03c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f0373606640 1 -- 172.21.15.96:0/846873099 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0478050630 con 0x5621dc0f9fd0 2024-09-14T10:44:34.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04865a9640 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036c03a2f0 0x7f036c03c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc0fe120 0x5621dc1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc1f6640 con 0x5621dc0fe120 2024-09-14T10:44:34.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04875ab640 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc0fe120 0x5621dc1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04865a9640 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036c03a2f0 0x7f036c03c7b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f04700ad000 tx=0x7f04700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04875ab640 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc0fe120 0x5621dc1f6100 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04875ab640 1 -- 172.21.15.96:0/846873099 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04800083f0 con 0x5621dc0fe120 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc1f6a20 con 0x5621dc0fe120 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04875ab640 1 -- 172.21.15.96:0/846873099 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04800083f0 con 0x5621dc0fe120 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc1f8320 con 0x5621dc0fe120 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04875ab640 1 -- 172.21.15.96:0/846873099 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f04800083f0 con 0x5621dc0fe120 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc1f7550 con 0x5621dc0fe120 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04875ab640 1 -- 172.21.15.96:0/846873099 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04800083f0 con 0x5621dc0fe120 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc1f7970 con 0x5621dc0fe120 2024-09-14T10:44:34.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04875ab640 1 -- 172.21.15.96:0/846873099 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04800083f0 con 0x5621dc0fe120 2024-09-14T10:44:34.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 Processor -- start 2024-09-14T10:44:34.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 -- start start 2024-09-14T10:44:34.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc206700 0x5621dc206b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04892a49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621dc00ed80 con 0x5621dc206700 2024-09-14T10:44:34.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04865a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc206700 0x5621dc206b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.660+0000 7f04865a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc206700 0x5621dc206b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:46054/0 (socket says 172.21.15.96:46054) 2024-09-14T10:44:34.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04865a9640 1 -- 172.21.15.96:0/3224287721 learned_addr learned my addr 172.21.15.96:0/3224287721 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04865a9640 1 -- 172.21.15.96:0/3224287721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621dc207160 con 0x5621dc206700 2024-09-14T10:44:34.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04865a9640 1 --2- 172.21.15.96:0/3224287721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc206700 0x5621dc206b20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f04700ab040 tx=0x7f0470018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f0370e01640 1 -- 172.21.15.96:0/3224287721 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04700b3ba0 con 0x5621dc206700 2024-09-14T10:44:34.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04892a49c0 1 -- 172.21.15.96:0/3224287721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621dc2079c0 con 0x5621dc206700 2024-09-14T10:44:34.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f0370e01640 1 -- 172.21.15.96:0/3224287721 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04700b3d40 con 0x5621dc206700 2024-09-14T10:44:34.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f0370e01640 1 -- 172.21.15.96:0/3224287721 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04700c8580 con 0x5621dc206700 2024-09-14T10:44:34.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04892a49c0 1 -- 172.21.15.96:0/3224287721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621dc207ed0 con 0x5621dc206700 2024-09-14T10:44:34.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f0370e01640 1 -- 172.21.15.96:0/3224287721 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f04700d1440 con 0x5621dc206700 2024-09-14T10:44:34.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f0370e01640 1 --2- 172.21.15.96:0/3224287721 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036003a150 0x7f036003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f0370e01640 1 -- 172.21.15.96:0/3224287721 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04700ee5c0 con 0x5621dc206700 2024-09-14T10:44:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04875ab640 1 --2- 172.21.15.96:0/3224287721 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036003a150 0x7f036003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04892a49c0 1 Processor -- start 2024-09-14T10:44:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04892a49c0 1 -- start start 2024-09-14T10:44:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.664+0000 7f04875ab640 1 --2- 172.21.15.96:0/3224287721 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036003a150 0x7f036003c610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5621dc1f78f0 tx=0x7f0480003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc214350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621dc1e5e40 con 0x5621dc213f50 2024-09-14T10:44:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc214350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc214350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:46070/0 (socket says 172.21.15.96:46070) 2024-09-14T10:44:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 -- 172.21.15.96:0/2168482544 learned_addr learned my addr 172.21.15.96:0/2168482544 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 -- 172.21.15.96:0/2168482544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621dc214940 con 0x5621dc213f50 2024-09-14T10:44:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 --2- 172.21.15.96:0/2168482544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc214350 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f04700ec9b0 tx=0x7f04700c73d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b154c423a2e19fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f036a7fc640 1 -- 172.21.15.96:0/2168482544 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04700a8cc0 con 0x5621dc213f50 2024-09-14T10:44:34.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f036a7fc640 1 -- 172.21.15.96:0/2168482544 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04700ee0d0 con 0x5621dc213f50 2024-09-14T10:44:34.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f036a7fc640 1 -- 172.21.15.96:0/2168482544 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04700a8e60 con 0x5621dc213f50 2024-09-14T10:44:34.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 -- 172.21.15.96:0/2168482544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 msgr2=0x5621dc214350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 --2- 172.21.15.96:0/2168482544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc214350 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f04700ec9b0 tx=0x7f04700c73d0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 -- 172.21.15.96:0/2168482544 shutdown_connections 2024-09-14T10:44:34.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 --2- 172.21.15.96:0/2168482544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc214350 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 -- 172.21.15.96:0/2168482544 >> 172.21.15.96:0/2168482544 conn(0x5621dc20f370 msgr2=0x5621dc20d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 -- 172.21.15.96:0/2168482544 shutdown_connections 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 -- 172.21.15.96:0/2168482544 wait complete. 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 Processor -- start 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 -- start start 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc21a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04892a49c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621dc212ea0 con 0x5621dc213f50 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc21a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc21a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:46080/0 (socket says 172.21.15.96:46080) 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 learned_addr learned my addr 172.21.15.96:0/143042499 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621dc21a9d0 con 0x5621dc213f50 2024-09-14T10:44:34.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.668+0000 7f04865a9640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc21a470 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f04700c0fd0 tx=0x7f04700ec940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0368ff9640 1 -- 172.21.15.96:0/143042499 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04700f3070 con 0x5621dc213f50 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621dc21ac60 con 0x5621dc213f50 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0368ff9640 1 -- 172.21.15.96:0/143042499 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04700ecc20 con 0x5621dc213f50 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621dc21b610 con 0x5621dc213f50 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0368ff9640 1 -- 172.21.15.96:0/143042499 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04700bcac0 con 0x5621dc213f50 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0368ff9640 1 -- 172.21.15.96:0/143042499 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f04700f6070 con 0x5621dc213f50 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0368ff9640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f035003a100 0x7f035003c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0368ff9640 1 -- 172.21.15.96:0/143042499 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04700f9ca0 con 0x5621dc213f50 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04875ab640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f035003a100 0x7f035003c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc225a90 0x5621dc227f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc228670 con 0x5621dc225a90 2024-09-14T10:44:34.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0486daa640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc225a90 0x5621dc227f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04875ab640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f035003a100 0x7f035003c5c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f048000f010 tx=0x7f048001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0486daa640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc225a90 0x5621dc227f20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 realm 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc228a80 con 0x5621dc225a90 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc229350 con 0x5621dc225a90 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc2296f0 con 0x5621dc225a90 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc229f40 con 0x5621dc225a90 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 20 searching for the correct realm 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.672+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5621dc22bcb0 0x5621dc22e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04865a9640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5621dc22bcb0 0x5621dc22e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04865a9640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5621dc22bcb0 0x5621dc22e0a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04865a9640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f04700f8060 0x7f04700e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f04700f8060 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04875ab640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f04700f8060 0x7f04700e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04875ab640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f04700f8060 0x7f04700e9aa0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04875ab640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0480019040 0x7f0480019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f0486daa640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0480019040 0x7f0480019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:34.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f0486daa640 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0480019040 0x7f0480019930 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:34.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc225a90 2024-09-14T10:44:34.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc225a90 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.676+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f04700f8060 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc225a90 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc225a90 2024-09-14T10:44:34.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f04700f8060 2024-09-14T10:44:34.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.680+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc225a90 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc225a90 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f04700f8060 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc225a90 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.684+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f04700f8060 2024-09-14T10:44:34.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f0480019040 2024-09-14T10:44:34.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x5621dc225a90 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22e5e0 con 0x7f04700f8060 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22a890 con 0x5621dc225a90 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22b130 con 0x5621dc225a90 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22b130 con 0x5621dc225a90 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.688+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 zone default found 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 4 Realm: () 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:34.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 zonegroup default 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22ea60 con 0x7f0480019040 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc230550 con 0x5621dc22bcb0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc2309e0 con 0x5621dc22bcb0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:34.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 started sync module instance, tier type = 2024-09-14T10:44:34.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:34.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22f8f0 con 0x7f04700f8060 2024-09-14T10:44:34.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94703427190032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22f550 con 0x7f04700f8060 2024-09-14T10:44:34.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.692+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc231910 con 0x5621dc225a90 2024-09-14T10:44:34.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.696+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94703427190032] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.696+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.696+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94703427194432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc231910 con 0x5621dc225a90 2024-09-14T10:44:34.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.696+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc232320 con 0x5621dc22bcb0 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.696+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.696+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94703427198576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc232b70 con 0x5621dc22bcb0 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.696+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc233570 con 0x7f04700f8060 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.696+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94703427194432] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.700+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.700+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94703427196000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc233960 con 0x7f04700f8060 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.700+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc234320 con 0x5621dc225a90 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.700+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94703427198576] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.700+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94703427196000] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.700+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.700+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94703427203200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc233e70 con 0x5621dc225a90 2024-09-14T10:44:34.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.700+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc234bc0 con 0x7f0480019040 2024-09-14T10:44:34.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.704+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94703427203200] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.704+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.704+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94703427200704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc234860 con 0x7f0480019040 2024-09-14T10:44:34.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.704+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc2350b0 con 0x7f0480019040 2024-09-14T10:44:34.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.704+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94703427200704] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.704+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.704+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94703427208384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc234f10 con 0x7f0480019040 2024-09-14T10:44:34.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.704+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc2359a0 con 0x7f0480019040 2024-09-14T10:44:34.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94703427208384] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94703427212400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc235960 con 0x7f0480019040 2024-09-14T10:44:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 20 add_watcher() i=0 2024-09-14T10:44:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 20 add_watcher() i=1 2024-09-14T10:44:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 20 add_watcher() i=2 2024-09-14T10:44:34.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 20 add_watcher() i=3 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 20 add_watcher() i=4 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 20 add_watcher() i=5 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 20 add_watcher() i=6 2024-09-14T10:44:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94703427212400] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 20 add_watcher() i=7 2024-09-14T10:44:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc238dc0 con 0x5621dc225a90 2024-09-14T10:44:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.708+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94703427209568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc2362e0 con 0x5621dc225a90 2024-09-14T10:44:34.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94703427209568] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f033d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:34.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:34.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:34.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 5 note: GC not initialized 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f02b7fff640 20 reqs_thread_entry: start 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 Filter name: none 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f02b5ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc25c5d0 con 0x5621dc225a90 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:34.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:34.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:34.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:34.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc25f060 con 0x7f04700f8060 2024-09-14T10:44:34.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 enabling bucket name=myfoo 2024-09-14T10:44:34.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:34.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc25d040 con 0x7f04700f8060 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 : miss 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc25f9a0 con 0x5621dc22bcb0 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(65 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:34.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.712+0000 7f04892a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 8.14 8:2aabc7d9:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc2677f0 con 0x5621dc22bcb0 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1, ofs0, ns] 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94703427387488 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc266440 con 0x5621dc225a90 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== watch-notify(notify (1) cookie 94703427203200 notify 137438953493 ret 0) ==== 802+0+0 (crc 0 0 0) 0x5621dc06f310 con 0x5621dc225a90 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f036a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94703427203200 notifier 4599 bl.length()=760 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f036a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 info.flags=0x17 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f036a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1 to cache LRU end 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f036a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:34.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(67 notify.4 [notify cookie 94703427387488 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f036a7fc640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f034c003eb0 con 0x5621dc225a90 2024-09-14T10:44:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== watch-notify(notify_complete (2) cookie 94703427387488 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621dc06ed80 con 0x5621dc225a90 2024-09-14T10:44:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_sources= new_sources= 2024-09-14T10:44:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential sources added=[] removed=[] 2024-09-14T10:44:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): orig_dests= new_dests= 2024-09-14T10:44:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 20 handle_bi_update(): bucket=:myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1]): potential dests added=[] removed=[] 2024-09-14T10:44:34.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc267180 con 0x5621dc225a90 2024-09-14T10:44:34.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.716+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94703427365584 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5621dc267180 con 0x5621dc225a90 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== watch-notify(notify (1) cookie 94703427203200 notify 137438953494 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5621dc06ed80 con 0x5621dc225a90 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f036a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94703427203200 notifier 4599 bl.length()=567 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f036a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f036a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(70 notify.4 [notify cookie 94703427365584 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f036a7fc640 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f034c003eb0 con 0x5621dc225a90 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== watch-notify(notify_complete (2) cookie 94703427365584 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621dc0709a0 con 0x5621dc225a90 2024-09-14T10:44:34.720 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f033d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94703427209568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc238660 con 0x5621dc225a90 2024-09-14T10:44:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94703427209568] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.720+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94703427190032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc238660 con 0x7f04700f8060 2024-09-14T10:44:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.724+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94703427190032] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.724+0000 7f04892a49c0 20 remove_watcher() i=0 2024-09-14T10:44:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.724+0000 7f04892a49c0 2 removed watcher, disabling cache 2024-09-14T10:44:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.724+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94703427194432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc238660 con 0x5621dc225a90 2024-09-14T10:44:34.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.724+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94703427194432] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.724+0000 7f04892a49c0 20 remove_watcher() i=1 2024-09-14T10:44:34.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.724+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94703427198576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc238660 con 0x5621dc22bcb0 2024-09-14T10:44:34.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f04865a9640 1 -- 172.21.15.96:0/143042499 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94703427198576] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04700f5030 con 0x5621dc22bcb0 2024-09-14T10:44:34.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f04892a49c0 20 remove_watcher() i=2 2024-09-14T10:44:34.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94703427196000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22fd10 con 0x7f04700f8060 2024-09-14T10:44:34.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f04875ab640 1 -- 172.21.15.96:0/143042499 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94703427196000] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048002f040 con 0x7f04700f8060 2024-09-14T10:44:34.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f04892a49c0 20 remove_watcher() i=3 2024-09-14T10:44:34.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94703427203200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc230e40 con 0x5621dc225a90 2024-09-14T10:44:34.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94703427203200] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x5621dc225a90 2024-09-14T10:44:34.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f04892a49c0 20 remove_watcher() i=4 2024-09-14T10:44:34.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.728+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94703427200704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc231e70 con 0x7f0480019040 2024-09-14T10:44:34.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.732+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94703427200704] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.732+0000 7f04892a49c0 20 remove_watcher() i=5 2024-09-14T10:44:34.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.732+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94703427208384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc22fd10 con 0x7f0480019040 2024-09-14T10:44:34.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94703427208384] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 20 remove_watcher() i=6 2024-09-14T10:44:34.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94703427212400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5621dc233080 con 0x7f0480019040 2024-09-14T10:44:34.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94703427212400] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f047800f070 con 0x7f0480019040 2024-09-14T10:44:34.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 20 remove_watcher() i=7 2024-09-14T10:44:34.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0480019040 msgr2=0x7f0480019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0480019040 0x7f0480019930 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc225a90 msgr2=0x5621dc227f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc225a90 0x5621dc227f20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f04700f8060 msgr2=0x7f04700e9aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f04700f8060 0x7f04700e9aa0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5621dc22bcb0 msgr2=0x5621dc22e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5621dc22bcb0 0x5621dc22e0a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f035003a100 msgr2=0x7f035003c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f035003a100 0x7f035003c5c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f048000f010 tx=0x7f048001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 msgr2=0x5621dc21a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f0486daa640 1 -- 172.21.15.96:0/143042499 reap_dead start 2024-09-14T10:44:34.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc21a470 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f04700c0fd0 tx=0x7f04700ec940 comp rx=0 tx=0).stop 2024-09-14T10:44:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 shutdown_connections 2024-09-14T10:44:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/143042499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc213f50 0x5621dc21a470 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 >> 172.21.15.96:0/143042499 conn(0x5621dc20f370 msgr2=0x5621dc20d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 shutdown_connections 2024-09-14T10:44:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/143042499 wait complete. 2024-09-14T10:44:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/3224287721 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036003a150 msgr2=0x7f036003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/3224287721 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036003a150 0x7f036003c610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5621dc1f78f0 tx=0x7f0480003070 comp rx=0 tx=0).stop 2024-09-14T10:44:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/3224287721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc206700 msgr2=0x5621dc206b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/3224287721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc206700 0x5621dc206b20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f04700ab040 tx=0x7f0470018170 comp rx=0 tx=0).stop 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/3224287721 shutdown_connections 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/3224287721 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036003a150 0x7f036003c610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/3224287721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc206700 0x5621dc206b20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/3224287721 >> 172.21.15.96:0/3224287721 conn(0x5621dc1fc0b0 msgr2=0x5621dc1fc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/3224287721 shutdown_connections 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/3224287721 wait complete. 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc0fe120 msgr2=0x5621dc1f6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc0fe120 0x5621dc1f6100 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036c03a2f0 msgr2=0x7f036c03c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036c03a2f0 0x7f036c03c7b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f04700ad000 tx=0x7f04700a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 msgr2=0x5621dc070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc070440 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5621dc1e63e0 tx=0x7f0478000f50 comp rx=0 tx=0).stop 2024-09-14T10:44:34.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 shutdown_connections 2024-09-14T10:44:34.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5621dc0fe120 0x5621dc1f6100 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f036c03a2f0 0x7f036c03c7b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 --2- 172.21.15.96:0/846873099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621dc0f9fd0 0x5621dc070440 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:34.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.736+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 >> 172.21.15.96:0/846873099 conn(0x5621dc0f5af0 msgr2=0x5621dc1e6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:34.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.740+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 shutdown_connections 2024-09-14T10:44:34.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:34.740+0000 7f04892a49c0 1 -- 172.21.15.96:0/846873099 wait complete. 2024-09-14T10:44:34.746 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:34.755 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-14T10:44:35.114 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-14T10:44:35.129 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:50.130 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-14T10:44:50.130 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-14T10:44:50.131 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-14T10:44:50.169 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:50.169 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:50.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804fed09c0 1 Processor -- start 2024-09-14T10:44:50.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804fed09c0 1 -- start start 2024-09-14T10:44:50.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804fed09c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c321e27290 0x55c321eb8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804fed09c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c321d5b7a0 con 0x55c321e27670 2024-09-14T10:44:50.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804fed09c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55c321db71b0 con 0x55c321e27290 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804d9d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c321e27290 0x55c321eb8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804d1d5640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55c321e27670 0x55c321eba590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33296/0 (socket says 172.21.15.96:33296) 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804d9d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c321e27290 0x55c321eb8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54024/0 (socket says 172.21.15.96:54024) 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804d1d5640 1 -- 172.21.15.96:0/1975697510 learned_addr learned my addr 172.21.15.96:0/1975697510 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804d9d6640 1 -- 172.21.15.96:0/1975697510 >> v1:172.21.15.70:6789/0 conn(0x55c321e27670 legacy=0x55c321eba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804d9d6640 1 -- 172.21.15.96:0/1975697510 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c321d35da0 con 0x55c321e27290 2024-09-14T10:44:50.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.171+0000 7f804c9d4640 1 -- 172.21.15.96:0/1975697510 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375040609 0 0) 0x55c321d5b7a0 con 0x55c321e27670 2024-09-14T10:44:50.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804d9d6640 1 --2- 172.21.15.96:0/1975697510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321eb8040 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f804800a420 tx=0x7f804801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29edcf9f4ffd0f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804c9d4640 1 -- 172.21.15.96:0/1975697510 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80480af070 con 0x55c321e27290 2024-09-14T10:44:50.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804c9d4640 1 -- 172.21.15.96:0/1975697510 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80480aa530 con 0x55c321e27290 2024-09-14T10:44:50.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804c9d4640 1 -- 172.21.15.96:0/1975697510 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80480aa810 con 0x55c321e27290 2024-09-14T10:44:50.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804fed09c0 1 -- 172.21.15.96:0/1975697510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 msgr2=0x55c321eb8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1975697510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321eb8040 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f804800a420 tx=0x7f804801afd0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804fed09c0 1 -- 172.21.15.96:0/1975697510 shutdown_connections 2024-09-14T10:44:50.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1975697510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321eb8040 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804fed09c0 1 -- 172.21.15.96:0/1975697510 >> 172.21.15.96:0/1975697510 conn(0x55c321ead970 msgr2=0x55c321eafd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804fed09c0 1 -- 172.21.15.96:0/1975697510 shutdown_connections 2024-09-14T10:44:50.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.175+0000 7f804fed09c0 1 -- 172.21.15.96:0/1975697510 wait complete. 2024-09-14T10:44:50.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.191+0000 7f804fed09c0 1 Processor -- start 2024-09-14T10:44:50.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.191+0000 7f804fed09c0 1 -- start start 2024-09-14T10:44:50.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c321dbafc0 con 0x55c321e27290 2024-09-14T10:44:50.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54034/0 (socket says 172.21.15.96:54034) 2024-09-14T10:44:50.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 -- 172.21.15.96:0/674820168 learned_addr learned my addr 172.21.15.96:0/674820168 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 -- 172.21.15.96:0/674820168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c321fa09e0 con 0x55c321e27290 2024-09-14T10:44:50.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 --2- 172.21.15.96:0/674820168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa03f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f80480ad040 tx=0x7f80480033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab86b93605bae8be server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f7f3be07640 1 -- 172.21.15.96:0/674820168 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80480af050 con 0x55c321e27290 2024-09-14T10:44:50.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f7f3be07640 1 -- 172.21.15.96:0/674820168 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80480b0040 con 0x55c321e27290 2024-09-14T10:44:50.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f7f3be07640 1 -- 172.21.15.96:0/674820168 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80480aaad0 con 0x55c321e27290 2024-09-14T10:44:50.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 -- 172.21.15.96:0/674820168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 msgr2=0x55c321fa03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 --2- 172.21.15.96:0/674820168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa03f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f80480ad040 tx=0x7f80480033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 -- 172.21.15.96:0/674820168 shutdown_connections 2024-09-14T10:44:50.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 --2- 172.21.15.96:0/674820168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa03f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 -- 172.21.15.96:0/674820168 >> 172.21.15.96:0/674820168 conn(0x55c321ead970 msgr2=0x55c321f9bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 -- 172.21.15.96:0/674820168 shutdown_connections 2024-09-14T10:44:50.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 -- 172.21.15.96:0/674820168 wait complete. 2024-09-14T10:44:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 Processor -- start 2024-09-14T10:44:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 -- start start 2024-09-14T10:44:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804fed09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c321d5ca50 con 0x55c321e27290 2024-09-14T10:44:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54044/0 (socket says 172.21.15.96:54044) 2024-09-14T10:44:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 -- 172.21.15.96:0/3623491775 learned_addr learned my addr 172.21.15.96:0/3623491775 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.195+0000 7f804d9d6640 1 -- 172.21.15.96:0/3623491775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c321fa80d0 con 0x55c321e27290 2024-09-14T10:44:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804d9d6640 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa7b70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f80480aa500 tx=0x7f8048017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f7f3a604640 1 -- 172.21.15.96:0/3623491775 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80480b6c40 con 0x55c321e27290 2024-09-14T10:44:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c321fa8360 con 0x55c321e27290 2024-09-14T10:44:50.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f7f3a604640 1 -- 172.21.15.96:0/3623491775 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80480b6de0 con 0x55c321e27290 2024-09-14T10:44:50.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f7f3a604640 1 -- 172.21.15.96:0/3623491775 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80480bf590 con 0x55c321e27290 2024-09-14T10:44:50.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c321fa8d10 con 0x55c321e27290 2024-09-14T10:44:50.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f7f3a604640 1 -- 172.21.15.96:0/3623491775 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f80480bf800 con 0x55c321e27290 2024-09-14T10:44:50.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f7f3a604640 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f3403a150 0x7f7f3403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f7f3a604640 1 -- 172.21.15.96:0/3623491775 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f80480bb070 con 0x55c321e27290 2024-09-14T10:44:50.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804d1d5640 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f3403a150 0x7f7f3403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804fed09c0 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321e27670 0x55c321faece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321faf220 con 0x55c321e27670 2024-09-14T10:44:50.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804e1d7640 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321e27670 0x55c321faece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804d1d5640 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f3403a150 0x7f7f3403c610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8038000c10 tx=0x7f80380013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804e1d7640 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321e27670 0x55c321faece0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804e1d7640 1 -- 172.21.15.96:0/3623491775 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80400083f0 con 0x55c321e27670 2024-09-14T10:44:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321faf620 con 0x55c321e27670 2024-09-14T10:44:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804e1d7640 1 -- 172.21.15.96:0/3623491775 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80400083f0 con 0x55c321e27670 2024-09-14T10:44:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.199+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fb0f20 con 0x55c321e27670 2024-09-14T10:44:50.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804e1d7640 1 -- 172.21.15.96:0/3623491775 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f80400083f0 con 0x55c321e27670 2024-09-14T10:44:50.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fb0150 con 0x55c321e27670 2024-09-14T10:44:50.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804e1d7640 1 -- 172.21.15.96:0/3623491775 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80400083f0 con 0x55c321e27670 2024-09-14T10:44:50.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fb05a0 con 0x55c321e27670 2024-09-14T10:44:50.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804e1d7640 1 -- 172.21.15.96:0/3623491775 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f80400083f0 con 0x55c321e27670 2024-09-14T10:44:50.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804fed09c0 1 Processor -- start 2024-09-14T10:44:50.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804fed09c0 1 -- start start 2024-09-14T10:44:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804fed09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fbf2e0 0x55c321fbf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804fed09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c321dc7d80 con 0x55c321fbf2e0 2024-09-14T10:44:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804d1d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fbf2e0 0x55c321fbf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804d1d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fbf2e0 0x55c321fbf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54058/0 (socket says 172.21.15.96:54058) 2024-09-14T10:44:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804d1d5640 1 -- 172.21.15.96:0/1735745114 learned_addr learned my addr 172.21.15.96:0/1735745114 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804d1d5640 1 -- 172.21.15.96:0/1735745114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c321fbfd40 con 0x55c321fbf2e0 2024-09-14T10:44:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804d1d5640 1 --2- 172.21.15.96:0/1735745114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fbf2e0 0x55c321fbf700 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f803800e620 tx=0x7f803800e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f7f337fe640 1 -- 172.21.15.96:0/1735745114 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8038022070 con 0x55c321fbf2e0 2024-09-14T10:44:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f7f337fe640 1 -- 172.21.15.96:0/1735745114 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803801b380 con 0x55c321fbf2e0 2024-09-14T10:44:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804fed09c0 1 -- 172.21.15.96:0/1735745114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c321fc05a0 con 0x55c321fbf2e0 2024-09-14T10:44:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f7f337fe640 1 -- 172.21.15.96:0/1735745114 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803801b660 con 0x55c321fbf2e0 2024-09-14T10:44:50.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.203+0000 7f804fed09c0 1 -- 172.21.15.96:0/1735745114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c321fc0b10 con 0x55c321fbf2e0 2024-09-14T10:44:50.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f7f337fe640 1 -- 172.21.15.96:0/1735745114 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f8038025070 con 0x55c321fbf2e0 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f7f337fe640 1 --2- 172.21.15.96:0/1735745114 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f2803a140 0x7f7f2803c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f7f337fe640 1 -- 172.21.15.96:0/1735745114 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8038052130 con 0x55c321fbf2e0 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804e1d7640 1 --2- 172.21.15.96:0/1735745114 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f2803a140 0x7f7f2803c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 Processor -- start 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 -- start start 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804e1d7640 1 --2- 172.21.15.96:0/1735745114 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f2803a140 0x7f7f2803c600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f804000e3f0 tx=0x7f8040003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fcbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c321fa0d50 con 0x55c321fcbbe0 2024-09-14T10:44:50.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804d1d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fcbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804d1d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fcbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54064/0 (socket says 172.21.15.96:54064) 2024-09-14T10:44:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804d1d5640 1 -- 172.21.15.96:0/2817448686 learned_addr learned my addr 172.21.15.96:0/2817448686 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804d1d5640 1 -- 172.21.15.96:0/2817448686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c321fcc590 con 0x55c321fcbbe0 2024-09-14T10:44:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804d1d5640 1 --2- 172.21.15.96:0/2817448686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fcbfc0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f80380504b0 tx=0x7f803800df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba35e571684c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f7f317fa640 1 -- 172.21.15.96:0/2817448686 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80380263b0 con 0x55c321fcbbe0 2024-09-14T10:44:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f7f317fa640 1 -- 172.21.15.96:0/2817448686 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803801bb80 con 0x55c321fcbbe0 2024-09-14T10:44:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f7f317fa640 1 -- 172.21.15.96:0/2817448686 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803800d300 con 0x55c321fcbbe0 2024-09-14T10:44:50.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 -- 172.21.15.96:0/2817448686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 msgr2=0x55c321fcbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 --2- 172.21.15.96:0/2817448686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fcbfc0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f80380504b0 tx=0x7f803800df90 comp rx=0 tx=0).stop 2024-09-14T10:44:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 -- 172.21.15.96:0/2817448686 shutdown_connections 2024-09-14T10:44:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 --2- 172.21.15.96:0/2817448686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fcbfc0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 -- 172.21.15.96:0/2817448686 >> 172.21.15.96:0/2817448686 conn(0x55c321fc8010 msgr2=0x55c321fc6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 -- 172.21.15.96:0/2817448686 shutdown_connections 2024-09-14T10:44:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 -- 172.21.15.96:0/2817448686 wait complete. 2024-09-14T10:44:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 Processor -- start 2024-09-14T10:44:50.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.207+0000 7f804fed09c0 1 -- start start 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804fed09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fd3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804fed09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c321fccbf0 con 0x55c321fcbbe0 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804d1d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fd3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804d1d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fd3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54076/0 (socket says 172.21.15.96:54076) 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 learned_addr learned my addr 172.21.15.96:0/1854922830 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c321fd36f0 con 0x55c321fcbbe0 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804d1d5640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fd3190 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f80380256a0 tx=0x7f8038050410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f7f1f7fe640 1 -- 172.21.15.96:0/1854922830 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8038024ca0 con 0x55c321fcbbe0 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c321fd36f0 con 0x55c321fcbbe0 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f7f1f7fe640 1 -- 172.21.15.96:0/1854922830 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8038024e40 con 0x55c321fcbbe0 2024-09-14T10:44:50.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f7f1f7fe640 1 -- 172.21.15.96:0/1854922830 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f803801ac40 con 0x55c321fcbbe0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c321fd36f0 con 0x55c321fcbbe0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f7f1f7fe640 1 -- 172.21.15.96:0/1854922830 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f803803e0b0 con 0x55c321fcbbe0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f7f1f7fe640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f1803a150 0x7f7f1803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f7f1f7fe640 1 -- 172.21.15.96:0/1854922830 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8038048040 con 0x55c321fcbbe0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804e1d7640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f1803a150 0x7f7f1803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321fde270 0x55c321fe0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe0e50 con 0x55c321fde270 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.211+0000 7f804d9d6640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321fde270 0x55c321fe0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804e1d7640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f1803a150 0x7f7f1803c610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f804000f010 tx=0x7f804001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d9d6640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321fde270 0x55c321fe0700 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 realm 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe1260 con 0x55c321fde270 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe1b30 con 0x55c321fde270 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe1ed0 con 0x55c321fde270 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe2370 con 0x55c321fde270 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 20 searching for the correct realm 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c321fe4370 0x55c321fe6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d1d5640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c321fe4370 0x55c321fe6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d1d5640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c321fe4370 0x55c321fe6760 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d1d5640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8038027060 0x7f803802a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8038027060 2024-09-14T10:44:50.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804e1d7640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8038027060 0x7f803802a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804e1d7640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8038027060 0x7f803802a120 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804e1d7640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8040019040 0x7f8040019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8040019040 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.215+0000 7f804d9d6640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8040019040 0x7f8040019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8040019040 0x7f8040019930 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fde270 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fde270 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8040019040 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8040019040 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8038027060 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fde270 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.219+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8040019040 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fde270 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8038027060 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8040019040 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fde270 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fde270 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.223+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8040019040 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8038027060 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fde270 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8038027060 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8040019040 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8038027060 2024-09-14T10:44:50.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fe4370 2024-09-14T10:44:50.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.227+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8040019040 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x55c321fde270 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe6e30 con 0x7f8038027060 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:50.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe2e10 con 0x55c321fde270 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe36b0 con 0x55c321fde270 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe2a50 con 0x55c321fde270 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 zone default found 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 4 Realm: () 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 zonegroup default 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe36b0 con 0x7f8038027060 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe9150 con 0x55c321fe4370 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe94f0 con 0x55c321fe4370 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 started sync module instance, tier type = 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.231+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe8590 con 0x7f8038027060 2024-09-14T10:44:50.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.235+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.235+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94296577313424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe8590 con 0x7f8038027060 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.235+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe9ef0 con 0x55c321fde270 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.235+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94296577313424] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.235+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.235+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94296577317376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe8590 con 0x55c321fde270 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.235+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fea900 con 0x55c321fe4370 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.239+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94296577317376] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.239+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.239+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94296577310944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe8500 con 0x55c321fe4370 2024-09-14T10:44:50.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.239+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321feb640 con 0x7f8038027060 2024-09-14T10:44:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.239+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.239+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94296577323344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321febee0 con 0x7f8038027060 2024-09-14T10:44:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.239+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fec920 con 0x55c321fde270 2024-09-14T10:44:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.239+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94296577310944] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.243+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.243+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94296577328112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fec8e0 con 0x55c321fde270 2024-09-14T10:44:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.243+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fed330 con 0x7f8040019040 2024-09-14T10:44:50.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.243+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94296577323344] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.243+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.243+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94296577325616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fed330 con 0x7f8040019040 2024-09-14T10:44:50.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.243+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fedbc0 con 0x7f8040019040 2024-09-14T10:44:50.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.243+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94296577328112] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94296577325616] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94296577322144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fed330 con 0x7f8040019040 2024-09-14T10:44:50.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fee460 con 0x7f8040019040 2024-09-14T10:44:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94296577322144] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94296577330816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fed2a0 con 0x7f8040019040 2024-09-14T10:44:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 20 add_watcher() i=0 2024-09-14T10:44:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 20 add_watcher() i=1 2024-09-14T10:44:50.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 20 add_watcher() i=2 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 20 add_watcher() i=3 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 20 add_watcher() i=4 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 20 add_watcher() i=5 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.247+0000 7f804fed09c0 20 add_watcher() i=6 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94296577330816] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804fed09c0 20 add_watcher() i=7 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804fed09c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff1430 con 0x55c321fde270 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94296577334848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fee8e0 con 0x55c321fde270 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94296577334848] v34'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f7eff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:50.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804fed09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:50.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804fed09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:50.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.251+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff9b30 con 0x55c321fde270 2024-09-14T10:44:50.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.255+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.255+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffa1e0 con 0x7f8040019040 2024-09-14T10:44:50.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.255+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.255+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffa1e0 con 0x55c321fe4370 2024-09-14T10:44:50.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.259+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.259+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffaa30 con 0x55c321fde270 2024-09-14T10:44:50.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.259+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'153 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.259+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffaa30 con 0x7f8038027060 2024-09-14T10:44:50.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.259+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.259+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffae50 con 0x55c321fe4370 2024-09-14T10:44:50.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.263+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.263+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffb280 con 0x55c321fde270 2024-09-14T10:44:50.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.263+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.263+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffb730 con 0x7f8040019040 2024-09-14T10:44:50.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.267+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.267+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffb730 con 0x7f8038027060 2024-09-14T10:44:50.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.267+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.267+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff8b00 con 0x55c321fe4370 2024-09-14T10:44:50.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.271+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.271+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc290 con 0x7f8038027060 2024-09-14T10:44:50.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.271+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.271+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc290 con 0x7f8040019040 2024-09-14T10:44:50.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.271+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.271+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc200 con 0x7f8038027060 2024-09-14T10:44:50.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.275+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.275+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc200 con 0x7f8040019040 2024-09-14T10:44:50.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.275+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.275+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc200 con 0x55c321fde270 2024-09-14T10:44:50.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.279+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.279+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc200 con 0x55c321fe4370 2024-09-14T10:44:50.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.279+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.279+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc3d0 con 0x7f8038027060 2024-09-14T10:44:50.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.283+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.283+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc3d0 con 0x55c321fe4370 2024-09-14T10:44:50.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.283+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.283+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc3d0 con 0x55c321fde270 2024-09-14T10:44:50.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.287+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.287+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc3d0 con 0x55c321fde270 2024-09-14T10:44:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.287+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.287+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc3d0 con 0x55c321fe4370 2024-09-14T10:44:50.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.291+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.291+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc3d0 con 0x7f8038027060 2024-09-14T10:44:50.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.291+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.291+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc6b0 con 0x55c321fe4370 2024-09-14T10:44:50.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.291+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.291+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc6b0 con 0x55c321fe4370 2024-09-14T10:44:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.295+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.295+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc6b0 con 0x55c321fe4370 2024-09-14T10:44:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.295+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.295+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc6b0 con 0x55c321fe4370 2024-09-14T10:44:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.299+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.299+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc880 con 0x7f8040019040 2024-09-14T10:44:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.299+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.299+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc880 con 0x55c321fe4370 2024-09-14T10:44:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.303+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.303+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc880 con 0x7f8040019040 2024-09-14T10:44:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.303+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.303+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc6b0 con 0x55c321fe4370 2024-09-14T10:44:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.307+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.307+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc6b0 con 0x7f8040019040 2024-09-14T10:44:50.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.307+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ffc6b0 con 0x7f8038027060 2024-09-14T10:44:50.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f7efe7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:50.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804fed09c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:50.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804fed09c0 20 Filter name: none 2024-09-14T10:44:50.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f7e6ffff640 20 reqs_thread_entry: start 2024-09-14T10:44:50.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fde270 2024-09-14T10:44:50.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff76e0 con 0x55c321fde270 2024-09-14T10:44:50.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.311+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff7230 con 0x55c321fde270 2024-09-14T10:44:50.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff7230 con 0x7f8040019040 2024-09-14T10:44:50.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff7230 con 0x7f8040019040 2024-09-14T10:44:50.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x7f8040019040 2024-09-14T10:44:50.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fe4370 2024-09-14T10:44:50.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.315+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff76e0 con 0x55c321fe4370 2024-09-14T10:44:50.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fe4370 2024-09-14T10:44:50.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fde270 2024-09-14T10:44:50.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff76e0 con 0x55c321fde270 2024-09-14T10:44:50.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fde270 2024-09-14T10:44:50.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x7f8038027060 2024-09-14T10:44:50.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff76e0 con 0x7f8038027060 2024-09-14T10:44:50.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x7f8038027060 2024-09-14T10:44:50.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fe4370 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff76e0 con 0x55c321fe4370 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fe4370 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.319+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fde270 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff76e0 con 0x55c321fde270 2024-09-14T10:44:50.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x55c321fde270 2024-09-14T10:44:50.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x7f8040019040 2024-09-14T10:44:50.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff76e0 con 0x7f8040019040 2024-09-14T10:44:50.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3220181d0 con 0x7f8040019040 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(117 gc.7 [call out=1701b] v0'0 uv29 ondisk = 0) ==== 148+0+1701 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8038027060 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.323+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8038027060 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.327+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8040019040 2024-09-14T10:44:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8038027060 2024-09-14T10:44:50.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.331+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8040019040 2024-09-14T10:44:50.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fde270 2024-09-14T10:44:50.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fde270 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fde270 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8038027060 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.335+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fde270 2024-09-14T10:44:50.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.339+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8038027060 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.343+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8040019040 2024-09-14T10:44:50.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.347+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8040019040 2024-09-14T10:44:50.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.351+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x55c321fe4370 2024-09-14T10:44:50.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x55c321fe4370 2024-09-14T10:44:50.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8040019040 2024-09-14T10:44:50.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8040019040 2024-09-14T10:44:50.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.355+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322017d20 con 0x7f8038027060 2024-09-14T10:44:50.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c322018d30 con 0x7f8038027060 2024-09-14T10:44:50.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f7eff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:50.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94296577334848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff6e40 con 0x55c321fde270 2024-09-14T10:44:50.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94296577334848] v34'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.359+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94296577313424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fede40 con 0x7f8038027060 2024-09-14T10:44:50.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.363+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94296577313424] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.363+0000 7f804fed09c0 20 remove_watcher() i=0 2024-09-14T10:44:50.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.363+0000 7f804fed09c0 2 removed watcher, disabling cache 2024-09-14T10:44:50.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.363+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94296577317376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321fe8a90 con 0x55c321fde270 2024-09-14T10:44:50.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.363+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94296577317376] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.363+0000 7f804fed09c0 20 remove_watcher() i=1 2024-09-14T10:44:50.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.363+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94296577310944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff80c0 con 0x55c321fe4370 2024-09-14T10:44:50.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.367+0000 7f804d1d5640 1 -- 172.21.15.96:0/1854922830 <== osd.3 v2:172.21.15.96:6800/3683402699 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94296577310944] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8038024030 con 0x55c321fe4370 2024-09-14T10:44:50.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.367+0000 7f804fed09c0 20 remove_watcher() i=2 2024-09-14T10:44:50.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.367+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94296577323344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff80c0 con 0x7f8038027060 2024-09-14T10:44:50.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.367+0000 7f804e1d7640 1 -- 172.21.15.96:0/1854922830 <== osd.2 v2:172.21.15.96:6816/2312202642 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94296577323344] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f804002f040 con 0x7f8038027060 2024-09-14T10:44:50.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.367+0000 7f804fed09c0 20 remove_watcher() i=3 2024-09-14T10:44:50.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.367+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94296577328112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff80c0 con 0x55c321fde270 2024-09-14T10:44:50.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.371+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.1 v2:172.21.15.96:6808/2339799699 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94296577328112] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x55c321fde270 2024-09-14T10:44:50.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.371+0000 7f804fed09c0 20 remove_watcher() i=4 2024-09-14T10:44:50.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.371+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94296577325616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff80c0 con 0x7f8040019040 2024-09-14T10:44:50.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.371+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94296577325616] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.371+0000 7f804fed09c0 20 remove_watcher() i=5 2024-09-14T10:44:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.371+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94296577322144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff80c0 con 0x7f8040019040 2024-09-14T10:44:50.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.375+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94296577322144] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.375+0000 7f804fed09c0 20 remove_watcher() i=6 2024-09-14T10:44:50.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.375+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94296577330816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c321ff80c0 con 0x7f8040019040 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 <== osd.0 v2:172.21.15.70:6800/3481052616 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94296577330816] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80480cf070 con 0x7f8040019040 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 20 remove_watcher() i=7 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8040019040 msgr2=0x7f8040019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8040019040 0x7f8040019930 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321fde270 msgr2=0x55c321fe0700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321fde270 0x55c321fe0700 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8038027060 msgr2=0x7f803802a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8038027060 0x7f803802a120 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c321fe4370 msgr2=0x55c321fe6760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c321fe4370 0x55c321fe6760 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f1803a150 msgr2=0x7f7f1803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f1803a150 0x7f7f1803c610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f804000f010 tx=0x7f804001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 msgr2=0x55c321fd3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fd3190 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f80380256a0 tx=0x7f8038050410 comp rx=0 tx=0).stop 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804d9d6640 1 -- 172.21.15.96:0/1854922830 reap_dead start 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 shutdown_connections 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1854922830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fcbbe0 0x55c321fd3190 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 >> 172.21.15.96:0/1854922830 conn(0x55c321fc8010 msgr2=0x55c321fc6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 shutdown_connections 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1854922830 wait complete. 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1735745114 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f2803a140 msgr2=0x7f7f2803c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1735745114 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f2803a140 0x7f7f2803c600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f804000e3f0 tx=0x7f8040003070 comp rx=0 tx=0).stop 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1735745114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fbf2e0 msgr2=0x55c321fbf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1735745114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fbf2e0 0x55c321fbf700 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f803800e620 tx=0x7f803800e650 comp rx=0 tx=0).stop 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1735745114 shutdown_connections 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1735745114 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f2803a140 0x7f7f2803c600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/1735745114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321fbf2e0 0x55c321fbf700 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1735745114 >> 172.21.15.96:0/1735745114 conn(0x55c321fb4c90 msgr2=0x55c321fb5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1735745114 shutdown_connections 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/1735745114 wait complete. 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321e27670 msgr2=0x55c321faece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321e27670 0x55c321faece0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f3403a150 msgr2=0x7f7f3403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f3403a150 0x7f7f3403c610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8038000c10 tx=0x7f80380013c0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 msgr2=0x55c321fa7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa7b70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f80480aa500 tx=0x7f8048017d70 comp rx=0 tx=0).stop 2024-09-14T10:44:50.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 shutdown_connections 2024-09-14T10:44:50.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c321e27670 0x55c321faece0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7f3403a150 0x7f7f3403c610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 --2- 172.21.15.96:0/3623491775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c321e27290 0x55c321fa7b70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 >> 172.21.15.96:0/3623491775 conn(0x55c321ead970 msgr2=0x55c321fa17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 shutdown_connections 2024-09-14T10:44:50.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.379+0000 7f804fed09c0 1 -- 172.21.15.96:0/3623491775 wait complete. 2024-09-14T10:44:50.390 INFO:teuthology.orchestra.run.smithi096.stdout:[{"tag":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.4585286559132046115\u0000","time":"2024-09-14T10:44:50.132436+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_7","key":"","instance":""}]}] 2024-09-14T10:44:50.390 DEBUG:tasks.util.rgw: json result: [{'tag': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.4585286559132046115\x00', 'time': '2024-09-14T10:44:50.132436+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_7', 'key': '', 'instance': ''}]}] 2024-09-14T10:44:50.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-14T10:44:50.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-14T10:44:50.391 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-14T10:44:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839e7df9c0 1 Processor -- start 2024-09-14T10:44:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839e7df9c0 1 -- start start 2024-09-14T10:44:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839e7df9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f3f27022c0 0x55f3f27026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839e7df9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3f26347a0 con 0x55f3f2700cb0 2024-09-14T10:44:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839e7df9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55f3f26901b0 con 0x55f3f27022c0 2024-09-14T10:44:50.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839c2e5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f3f27022c0 0x55f3f27026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839bae4640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55f3f2700cb0 0x55f3f27010c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33310/0 (socket says 172.21.15.96:33310) 2024-09-14T10:44:50.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839c2e5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55f3f27022c0 0x55f3f27026a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54078/0 (socket says 172.21.15.96:54078) 2024-09-14T10:44:50.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839bae4640 1 -- 172.21.15.96:0/3558017595 learned_addr learned my addr 172.21.15.96:0/3558017595 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:50.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839c2e5640 1 -- 172.21.15.96:0/3558017595 >> v1:172.21.15.70:6789/0 conn(0x55f3f2700cb0 legacy=0x55f3f27010c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.471+0000 7f839c2e5640 1 -- 172.21.15.96:0/3558017595 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f260eda0 con 0x55f3f27022c0 2024-09-14T10:44:50.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839c2e5640 1 --2- 172.21.15.96:0/3558017595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f27022c0 0x55f3f27026a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f839400a420 tx=0x7f839401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317086e75f902b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839b2e3640 1 -- 172.21.15.96:0/3558017595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83940af070 con 0x55f3f27022c0 2024-09-14T10:44:50.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839b2e3640 1 -- 172.21.15.96:0/3558017595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83940aa530 con 0x55f3f27022c0 2024-09-14T10:44:50.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839b2e3640 1 -- 172.21.15.96:0/3558017595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83940aa850 con 0x55f3f27022c0 2024-09-14T10:44:50.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839e7df9c0 1 -- 172.21.15.96:0/3558017595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f27022c0 msgr2=0x55f3f27026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/3558017595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f27022c0 0x55f3f27026a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f839400a420 tx=0x7f839401afd0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839e7df9c0 1 -- 172.21.15.96:0/3558017595 shutdown_connections 2024-09-14T10:44:50.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/3558017595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f27022c0 0x55f3f27026a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839e7df9c0 1 -- 172.21.15.96:0/3558017595 >> 172.21.15.96:0/3558017595 conn(0x55f3f2787ae0 msgr2=0x55f3f2789f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839e7df9c0 1 -- 172.21.15.96:0/3558017595 shutdown_connections 2024-09-14T10:44:50.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.475+0000 7f839e7df9c0 1 -- 172.21.15.96:0/3558017595 wait complete. 2024-09-14T10:44:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839e7df9c0 1 Processor -- start 2024-09-14T10:44:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839e7df9c0 1 -- start start 2024-09-14T10:44:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839e7df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2879860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839e7df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f3f2693fc0 con 0x55f3f2700cb0 2024-09-14T10:44:50.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839c2e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2879860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839c2e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2879860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54092/0 (socket says 172.21.15.96:54092) 2024-09-14T10:44:50.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839c2e5640 1 -- 172.21.15.96:0/334764984 learned_addr learned my addr 172.21.15.96:0/334764984 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839c2e5640 1 -- 172.21.15.96:0/334764984 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f2879e50 con 0x55f3f2700cb0 2024-09-14T10:44:50.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f839c2e5640 1 --2- 172.21.15.96:0/334764984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2879860 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f83940ad040 tx=0x7f83940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9c2d2c6e453337 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f828a60c640 1 -- 172.21.15.96:0/334764984 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83940af050 con 0x55f3f2700cb0 2024-09-14T10:44:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f828a60c640 1 -- 172.21.15.96:0/334764984 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83940b0040 con 0x55f3f2700cb0 2024-09-14T10:44:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.491+0000 7f828a60c640 1 -- 172.21.15.96:0/334764984 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83940aaad0 con 0x55f3f2700cb0 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- 172.21.15.96:0/334764984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 msgr2=0x55f3f2879860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/334764984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2879860 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f83940ad040 tx=0x7f83940033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- 172.21.15.96:0/334764984 shutdown_connections 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/334764984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2879860 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- 172.21.15.96:0/334764984 >> 172.21.15.96:0/334764984 conn(0x55f3f2787ae0 msgr2=0x55f3f2875470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- 172.21.15.96:0/334764984 shutdown_connections 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- 172.21.15.96:0/334764984 wait complete. 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 Processor -- start 2024-09-14T10:44:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- start start 2024-09-14T10:44:50.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2880ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f3f2635a50 con 0x55f3f2700cb0 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839c2e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2880ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839c2e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2880ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54104/0 (socket says 172.21.15.96:54104) 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839c2e5640 1 -- 172.21.15.96:0/83498296 learned_addr learned my addr 172.21.15.96:0/83498296 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839c2e5640 1 -- 172.21.15.96:0/83498296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f2881550 con 0x55f3f2700cb0 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839c2e5640 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2880ff0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f83940aa500 tx=0x7f8394017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f8288e09640 1 -- 172.21.15.96:0/83498296 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83940b6a30 con 0x55f3f2700cb0 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f8288e09640 1 -- 172.21.15.96:0/83498296 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83940b6bd0 con 0x55f3f2700cb0 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3f28817e0 con 0x55f3f2700cb0 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f8288e09640 1 -- 172.21.15.96:0/83498296 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83940bf460 con 0x55f3f2700cb0 2024-09-14T10:44:50.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.495+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f2882190 con 0x55f3f2700cb0 2024-09-14T10:44:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f8288e09640 1 -- 172.21.15.96:0/83498296 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f83940bf6d0 con 0x55f3f2700cb0 2024-09-14T10:44:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f8288e09640 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f828403a150 0x7f828403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f8288e09640 1 -- 172.21.15.96:0/83498296 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f83940bb070 con 0x55f3f2700cb0 2024-09-14T10:44:50.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839bae4640 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f828403a150 0x7f828403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f27022c0 0x55f3f2888160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28886a0 con 0x55f3f27022c0 2024-09-14T10:44:50.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839cae6640 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f27022c0 0x55f3f2888160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839bae4640 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f828403a150 0x7f828403c610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8390001d80 tx=0x7f83900012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839cae6640 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f27022c0 0x55f3f2888160 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839cae6640 1 -- 172.21.15.96:0/83498296 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f838c0083f0 con 0x55f3f27022c0 2024-09-14T10:44:50.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f2888a40 con 0x55f3f27022c0 2024-09-14T10:44:50.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839cae6640 1 -- 172.21.15.96:0/83498296 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f838c0083f0 con 0x55f3f27022c0 2024-09-14T10:44:50.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f288a2f0 con 0x55f3f27022c0 2024-09-14T10:44:50.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839cae6640 1 -- 172.21.15.96:0/83498296 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f838c0083f0 con 0x55f3f27022c0 2024-09-14T10:44:50.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f2889520 con 0x55f3f27022c0 2024-09-14T10:44:50.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839cae6640 1 -- 172.21.15.96:0/83498296 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f838c0083f0 con 0x55f3f27022c0 2024-09-14T10:44:50.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f2889940 con 0x55f3f27022c0 2024-09-14T10:44:50.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839cae6640 1 -- 172.21.15.96:0/83498296 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f838c0083f0 con 0x55f3f27022c0 2024-09-14T10:44:50.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 Processor -- start 2024-09-14T10:44:50.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 -- start start 2024-09-14T10:44:50.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28986e0 0x55f3f2898b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.499+0000 7f839e7df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f3f26a0d80 con 0x55f3f28986e0 2024-09-14T10:44:50.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839bae4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28986e0 0x55f3f2898b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839bae4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28986e0 0x55f3f2898b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54112/0 (socket says 172.21.15.96:54112) 2024-09-14T10:44:50.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839bae4640 1 -- 172.21.15.96:0/683295628 learned_addr learned my addr 172.21.15.96:0/683295628 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839bae4640 1 -- 172.21.15.96:0/683295628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f2899140 con 0x55f3f28986e0 2024-09-14T10:44:50.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839bae4640 1 --2- 172.21.15.96:0/683295628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28986e0 0x55f3f2898b00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f839000d660 tx=0x7f839000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f8281ffb640 1 -- 172.21.15.96:0/683295628 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839000c6b0 con 0x55f3f28986e0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f8281ffb640 1 -- 172.21.15.96:0/683295628 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839000c850 con 0x55f3f28986e0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839e7df9c0 1 -- 172.21.15.96:0/683295628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3f28999a0 con 0x55f3f28986e0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f8281ffb640 1 -- 172.21.15.96:0/683295628 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839000cb30 con 0x55f3f28986e0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839e7df9c0 1 -- 172.21.15.96:0/683295628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f2899f10 con 0x55f3f28986e0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f8281ffb640 1 -- 172.21.15.96:0/683295628 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f8390023020 con 0x55f3f28986e0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f8281ffb640 1 --2- 172.21.15.96:0/683295628 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f827403a1f0 0x7f827403c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f8281ffb640 1 -- 172.21.15.96:0/683295628 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8390021020 con 0x55f3f28986e0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839cae6640 1 --2- 172.21.15.96:0/683295628 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f827403a1f0 0x7f827403c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839e7df9c0 1 Processor -- start 2024-09-14T10:44:50.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.503+0000 7f839e7df9c0 1 -- start start 2024-09-14T10:44:50.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839cae6640 1 --2- 172.21.15.96:0/683295628 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f827403a1f0 0x7f827403c6b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55f3f28898c0 tx=0x7f838c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f3f287a1c0 con 0x55f3f28a5000 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28a53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54118/0 (socket says 172.21.15.96:54118) 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 -- 172.21.15.96:0/1370495988 learned_addr learned my addr 172.21.15.96:0/1370495988 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 -- 172.21.15.96:0/1370495988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f28a59b0 con 0x55f3f28a5000 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 --2- 172.21.15.96:0/1370495988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28a53e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8390051770 tx=0x7f83900193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98d7153a3e3dbde server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f827b7fe640 1 -- 172.21.15.96:0/1370495988 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83900236b0 con 0x55f3f28a5000 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f827b7fe640 1 -- 172.21.15.96:0/1370495988 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839004e020 con 0x55f3f28a5000 2024-09-14T10:44:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f827b7fe640 1 -- 172.21.15.96:0/1370495988 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f839000ccd0 con 0x55f3f28a5000 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 -- 172.21.15.96:0/1370495988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 msgr2=0x55f3f28a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/1370495988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28a53e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8390051770 tx=0x7f83900193e0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 -- 172.21.15.96:0/1370495988 shutdown_connections 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/1370495988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28a53e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 -- 172.21.15.96:0/1370495988 >> 172.21.15.96:0/1370495988 conn(0x55f3f28a1430 msgr2=0x55f3f289f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 -- 172.21.15.96:0/1370495988 shutdown_connections 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 -- 172.21.15.96:0/1370495988 wait complete. 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 Processor -- start 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 -- start start 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839e7df9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f3f28a6010 con 0x55f3f28a5000 2024-09-14T10:44:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28ac5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:54126/0 (socket says 172.21.15.96:54126) 2024-09-14T10:44:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 learned_addr learned my addr 172.21.15.96:0/623850748 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.507+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f28acb10 con 0x55f3f28a5000 2024-09-14T10:44:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839bae4640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28ac5b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f83900238a0 tx=0x7f83900516d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f8279ffb640 1 -- 172.21.15.96:0/623850748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8390033020 con 0x55f3f28a5000 2024-09-14T10:44:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3f28acda0 con 0x55f3f28a5000 2024-09-14T10:44:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f8279ffb640 1 -- 172.21.15.96:0/623850748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8390019a70 con 0x55f3f28a5000 2024-09-14T10:44:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f8279ffb640 1 -- 172.21.15.96:0/623850748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8390019c40 con 0x55f3f28a5000 2024-09-14T10:44:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3f28acda0 con 0x55f3f28a5000 2024-09-14T10:44:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f8279ffb640 1 -- 172.21.15.96:0/623850748 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f8390036020 con 0x55f3f28a5000 2024-09-14T10:44:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f8279ffb640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f826c03a150 0x7f826c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f8279ffb640 1 -- 172.21.15.96:0/623850748 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f839004f030 con 0x55f3f28a5000 2024-09-14T10:44:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839cae6640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f826c03a150 0x7f826c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f28b78c0 0x55f3f28b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28ba4d0 con 0x55f3f28b78c0 2024-09-14T10:44:50.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839c2e5640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f28b78c0 0x55f3f28b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839cae6640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f826c03a150 0x7f826c03c610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f838c00f010 tx=0x7f838c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839c2e5640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f28b78c0 0x55f3f28b9d80 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 20 realm 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28ba8e0 con 0x55f3f28b78c0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28bb1b0 con 0x55f3f28b78c0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28bb550 con 0x55f3f28b78c0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.511+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839e7df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28bbda0 con 0x55f3f28b78c0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839e7df9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839e7df9c0 20 searching for the correct realm 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f3f28bdb10 0x55f3f28bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839bae4640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f3f28bdb10 0x55f3f28bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839bae4640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f3f28bdb10 0x55f3f28bff00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839bae4640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8390038020 0x7f839001a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f8390038020 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839cae6640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8390038020 0x7f839001a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839cae6640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8390038020 0x7f839001a590 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839cae6640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f838c019040 0x7f838c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f838c019040 2024-09-14T10:44:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839c2e5640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f838c019040 0x7f838c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839c2e5640 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f838c019040 0x7f838c019930 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.515+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28b78c0 2024-09-14T10:44:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28b78c0 2024-09-14T10:44:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f838c019040 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f838c019040 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f8390038020 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28b78c0 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f838c019040 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28b78c0 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f8390038020 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.519+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f838c019040 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28b78c0 2024-09-14T10:44:50.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28b78c0 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f838c019040 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f8390038020 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28b78c0 2024-09-14T10:44:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f8390038020 2024-09-14T10:44:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.523+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f838c019040 2024-09-14T10:44:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f8390038020 2024-09-14T10:44:50.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28bdb10 2024-09-14T10:44:50.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x7f838c019040 2024-09-14T10:44:50.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0490 con 0x55f3f28b78c0 2024-09-14T10:44:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f83940fe080 con 0x7f8390038020 2024-09-14T10:44:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:50.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28bc720 con 0x55f3f28b78c0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28bcfc0 con 0x55f3f28b78c0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28bcfc0 con 0x55f3f28b78c0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:50.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 zone default found 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 4 Realm: () 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 zonegroup default 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.527+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c0910 con 0x7f8390038020 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c27d0 con 0x55f3f28bdb10 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c2ce0 con 0x55f3f28bdb10 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 20 started sync module instance, tier type = 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c1b40 con 0x7f8390038020 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94506234683488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c1b40 con 0x7f8390038020 2024-09-14T10:44:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c37e0 con 0x55f3f28b78c0 2024-09-14T10:44:50.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.531+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94506234683488] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94506234688176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c1b40 con 0x55f3f28b78c0 2024-09-14T10:44:50.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c41f0 con 0x55f3f28bdb10 2024-09-14T10:44:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94506234690880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c4a90 con 0x55f3f28bdb10 2024-09-14T10:44:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c5500 con 0x7f8390038020 2024-09-14T10:44:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94506234688176] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94506234695632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c58f0 con 0x7f8390038020 2024-09-14T10:44:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.535+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c62b0 con 0x55f3f28b78c0 2024-09-14T10:44:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.539+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94506234690880] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.539+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94506234695632] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.539+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.539+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94506234680976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c5e00 con 0x55f3f28b78c0 2024-09-14T10:44:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.539+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6b50 con 0x7f838c019040 2024-09-14T10:44:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.543+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94506234680976] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.543+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.543+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94506234693088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6810 con 0x7f838c019040 2024-09-14T10:44:50.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.543+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c7060 con 0x7f838c019040 2024-09-14T10:44:50.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.543+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.543+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94506234702112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c7410 con 0x7f838c019040 2024-09-14T10:44:50.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.543+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c7f30 con 0x7f838c019040 2024-09-14T10:44:50.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.543+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94506234693088] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94506234702112] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94506234706432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6e60 con 0x7f838c019040 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 20 add_watcher() i=0 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 20 add_watcher() i=1 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 20 add_watcher() i=2 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 20 add_watcher() i=3 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 20 add_watcher() i=4 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 20 add_watcher() i=5 2024-09-14T10:44:50.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 20 add_watcher() i=6 2024-09-14T10:44:50.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94506234706432] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 20 add_watcher() i=7 2024-09-14T10:44:50.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:50.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28caf20 con 0x55f3f28b78c0 2024-09-14T10:44:50.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.547+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94506234700640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c83a0 con 0x55f3f28b78c0 2024-09-14T10:44:50.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.551+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94506234700640] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.551+0000 7f82527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:50.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.551+0000 7f839e7df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:50.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.551+0000 7f839e7df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:50.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.551+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d38a0 con 0x55f3f28b78c0 2024-09-14T10:44:50.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.551+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.551+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d3ed0 con 0x7f838c019040 2024-09-14T10:44:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.555+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.555+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d3eb0 con 0x55f3f28bdb10 2024-09-14T10:44:50.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.555+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.555+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d4290 con 0x55f3f28b78c0 2024-09-14T10:44:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.555+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'158 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.555+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d4270 con 0x7f8390038020 2024-09-14T10:44:50.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.555+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.555+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d48c0 con 0x55f3f28bdb10 2024-09-14T10:44:50.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.559+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.559+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d48a0 con 0x55f3f28b78c0 2024-09-14T10:44:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.559+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.559+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d4870 con 0x7f838c019040 2024-09-14T10:44:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.563+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.563+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d4820 con 0x7f8390038020 2024-09-14T10:44:50.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.563+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.563+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d4eb0 con 0x55f3f28bdb10 2024-09-14T10:44:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.567+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.567+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d4e90 con 0x7f8390038020 2024-09-14T10:44:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.567+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.567+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d54a0 con 0x7f838c019040 2024-09-14T10:44:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.567+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.567+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5420 con 0x7f8390038020 2024-09-14T10:44:50.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.571+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.571+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d59f0 con 0x7f838c019040 2024-09-14T10:44:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.571+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.571+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d56f0 con 0x55f3f28b78c0 2024-09-14T10:44:50.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.575+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.575+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d56b0 con 0x55f3f28bdb10 2024-09-14T10:44:50.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.575+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.575+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5670 con 0x7f8390038020 2024-09-14T10:44:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.575+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.575+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5af0 con 0x55f3f28bdb10 2024-09-14T10:44:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.579+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.579+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5820 con 0x55f3f28b78c0 2024-09-14T10:44:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.579+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.579+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5800 con 0x55f3f28b78c0 2024-09-14T10:44:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.579+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.579+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5800 con 0x55f3f28bdb10 2024-09-14T10:44:50.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.583+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.583+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5800 con 0x7f8390038020 2024-09-14T10:44:50.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.583+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:50.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.583+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5800 con 0x55f3f28bdb10 2024-09-14T10:44:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.587+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.587+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5860 con 0x55f3f28bdb10 2024-09-14T10:44:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.587+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.587+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5820 con 0x55f3f28bdb10 2024-09-14T10:44:50.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.587+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.587+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5820 con 0x55f3f28bdb10 2024-09-14T10:44:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.587+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.587+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5840 con 0x7f838c019040 2024-09-14T10:44:50.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.591+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.591+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5880 con 0x55f3f28bdb10 2024-09-14T10:44:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.591+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.591+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5840 con 0x7f838c019040 2024-09-14T10:44:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.595+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.595+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d5880 con 0x55f3f28bdb10 2024-09-14T10:44:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.595+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.595+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d58a0 con 0x7f838c019040 2024-09-14T10:44:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.599+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.599+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d58c0 con 0x7f8390038020 2024-09-14T10:44:51.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.599+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.599+0000 7f82517e2640 20 reqs_thread_entry: start 2024-09-14T10:44:51.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.599+0000 7f839e7df9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:51.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.599+0000 7f839e7df9c0 20 Filter name: none 2024-09-14T10:44:51.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.599+0000 7f81c2ffd640 20 reqs_thread_entry: start 2024-09-14T10:44:51.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.599+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:94 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(94 gc.22 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:95 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(95 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:96 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(96 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(97 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:98 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(98 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 31 ==== osd_op_reply(99 gc.22 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.603+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:100 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 32 ==== osd_op_reply(100 gc.23 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:101 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 33 ==== osd_op_reply(101 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 34 ==== osd_op_reply(102 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 35 ==== osd_op_reply(103 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 36 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:105 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 37 ==== osd_op_reply(105 gc.23 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.607+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 38 ==== osd_op_reply(106 gc.24 [call] v34'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 39 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:108 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 40 ==== osd_op_reply(108 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:109 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 41 ==== osd_op_reply(109 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:110 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 42 ==== osd_op_reply(110 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:111 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 43 ==== osd_op_reply(111 gc.24 [call] v34'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.611+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:112 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 44 ==== osd_op_reply(112 gc.25 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:113 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 45 ==== osd_op_reply(113 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:114 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28bdb10 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 46 ==== osd_op_reply(114 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:115 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 47 ==== osd_op_reply(115 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:116 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 48 ==== osd_op_reply(116 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:117 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 49 ==== osd_op_reply(117 gc.25 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.615+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:118 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(118 gc.26 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:119 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(119 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:120 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(120 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:121 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(121 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:122 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(122 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.619+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:123 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(123 gc.26 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:124 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 50 ==== osd_op_reply(124 gc.27 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:125 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 51 ==== osd_op_reply(125 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:126 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 52 ==== osd_op_reply(126 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:127 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 53 ==== osd_op_reply(127 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.623+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:128 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.627+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 54 ==== osd_op_reply(128 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.627+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.627+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:129 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.627+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 55 ==== osd_op_reply(129 gc.27 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.627+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.627+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:130 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.627+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(130 gc.28 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.627+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:131 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(131 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:132 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x7f838c019040 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(132 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:133 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(133 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:134 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(134 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.631+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:135 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== osd_op_reply(135 gc.28 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:136 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 56 ==== osd_op_reply(136 gc.29 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:137 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 57 ==== osd_op_reply(137 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:138 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28bdb10 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 58 ==== osd_op_reply(138 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.635+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:139 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 59 ==== osd_op_reply(139 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:140 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 60 ==== osd_op_reply(140 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:141 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 61 ==== osd_op_reply(141 gc.29 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.639+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:142 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== osd_op_reply(142 gc.30 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:143 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(143 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:144 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x7f838c019040 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== osd_op_reply(144 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:145 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== osd_op_reply(145 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:146 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(146 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.643+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:147 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.647+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(147 gc.30 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.647+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.647+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:148 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(148 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:149 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(149 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:150 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(150 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:151 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(151 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:152 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(152 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.651+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:153 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(153 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:154 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(154 gc.0 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:155 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(155 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:156 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(156 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.655+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:157 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(157 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:158 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(158 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:159 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(159 gc.0 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.659+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:160 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 40 ==== osd_op_reply(160 gc.1 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:161 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 41 ==== osd_op_reply(161 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:162 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x7f838c019040 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 42 ==== osd_op_reply(162 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:163 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 43 ==== osd_op_reply(163 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:164 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.663+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 44 ==== osd_op_reply(164 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:165 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 45 ==== osd_op_reply(165 gc.1 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:166 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 62 ==== osd_op_reply(166 gc.2 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:167 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 63 ==== osd_op_reply(167 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.667+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:168 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28bdb10 2024-09-14T10:44:51.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 64 ==== osd_op_reply(168 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:169 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 65 ==== osd_op_reply(169 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:170 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 66 ==== osd_op_reply(170 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:171 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 67 ==== osd_op_reply(171 gc.2 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:172 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(172 gc.3 [call] v34'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.671+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:173 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(173 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:174 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28b78c0 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(174 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:175 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 38 ==== osd_op_reply(175 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:176 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 39 ==== osd_op_reply(176 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:177 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 40 ==== osd_op_reply(177 gc.3 [call] v34'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-14T10:44:51.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.675+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:178 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(178 gc.4 [call] v34'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:179 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(179 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:180 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(180 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:181 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 29 ==== osd_op_reply(181 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:182 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 30 ==== osd_op_reply(182 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.679+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:183 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f8390038020 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 31 ==== osd_op_reply(183 gc.4 [call] v34'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:184 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 68 ==== osd_op_reply(184 gc.5 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:185 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 69 ==== osd_op_reply(185 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:186 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28bdb10 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 70 ==== osd_op_reply(186 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:187 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 71 ==== osd_op_reply(187 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:188 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 72 ==== osd_op_reply(188 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.683+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:189 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28bdb10 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.687+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 73 ==== osd_op_reply(189 gc.5 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.687+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.687+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:190 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.687+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 41 ==== osd_op_reply(190 gc.6 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.687+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:191 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.687+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 42 ==== osd_op_reply(191 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.687+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.687+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:192 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x55f3f28b78c0 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 43 ==== osd_op_reply(192 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:193 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 44 ==== osd_op_reply(193 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:194 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 45 ==== osd_op_reply(194 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:195 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x55f3f28b78c0 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 46 ==== osd_op_reply(195 gc.6 [call] v34'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.691+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:196 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.695+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 46 ==== osd_op_reply(196 gc.7 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.695+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:197 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.695+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 47 ==== osd_op_reply(197 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.695+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.695+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:198 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f0f40 con 0x7f838c019040 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.695+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 48 ==== osd_op_reply(198 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:199 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 49 ==== osd_op_reply(199 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:200 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f1f50 con 0x7f838c019040 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 50 ==== osd_op_reply(200 gc.7 [call out=1701b] v0'0 uv36 ondisk = 0) ==== 148+0+1701 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 20 garbage collection: RGWGC::process iterating over entry tag='67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.4585286559132046115', time=2024-09-14T10:44:50.132436+0000, chain.objs.size()=7 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_1 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:201 3.23s0 3:c5d03676:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2400 con 0x7f838c019040 2024-09-14T10:44:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_2 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:202 3.31s0 3:8c8507db:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f4d30 con 0x7f838c019040 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_3 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:203 3.15s0 3:aaaaf842:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f4d30 con 0x7f8390038020 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_4 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:204 3.28s0 3:15670dd3:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x55f3f28bdb10 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_5 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:205 3.3cs0 3:3c644ffa:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28fc9c0 con 0x7f8390038020 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_6 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:206 3.4s0 3:22716b56:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_7 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.699+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:207 3.38s0 3:1fa3748d:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.703+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 74 ==== osd_op_reply(204 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.707+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 32 ==== osd_op_reply(203 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_3 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.707+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 51 ==== osd_op_reply(206 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.707+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 52 ==== osd_op_reply(207 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.707+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 53 ==== osd_op_reply(202 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.707+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 33 ==== osd_op_reply(205 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.707+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 54 ==== osd_op_reply(201 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.1__shadow_.zyUF23Nl3v-R2C-tN1T0B3La6bDoMOJ_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.707+0000 7f839e7df9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.707+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:208 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.715+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 55 ==== osd_op_reply(208 gc.7 [call] v34'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.715+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:209 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.715+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 56 ==== osd_op_reply(209 gc.7 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.715+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.715+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:210 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 34 ==== osd_op_reply(210 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:211 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 35 ==== osd_op_reply(211 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:212 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 36 ==== osd_op_reply(212 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:213 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 37 ==== osd_op_reply(213 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:214 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 38 ==== osd_op_reply(214 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.719+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:215 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.723+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 39 ==== osd_op_reply(215 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.723+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.723+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:216 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.723+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 75 ==== osd_op_reply(216 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.723+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:217 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.723+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 76 ==== osd_op_reply(217 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.723+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.723+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:218 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 77 ==== osd_op_reply(218 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:219 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 78 ==== osd_op_reply(219 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:220 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 79 ==== osd_op_reply(220 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:221 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x55f3f28bdb10 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 80 ==== osd_op_reply(221 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.727+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:222 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 40 ==== osd_op_reply(222 gc.10 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:223 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 41 ==== osd_op_reply(223 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:224 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 42 ==== osd_op_reply(224 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:225 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 43 ==== osd_op_reply(225 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:226 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 44 ==== osd_op_reply(226 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.731+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:227 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.735+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 45 ==== osd_op_reply(227 gc.10 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.735+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.735+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:228 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 57 ==== osd_op_reply(228 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:229 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 58 ==== osd_op_reply(229 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:230 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 59 ==== osd_op_reply(230 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:231 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 60 ==== osd_op_reply(231 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:232 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 61 ==== osd_op_reply(232 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.739+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:233 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.743+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 62 ==== osd_op_reply(233 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.743+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.743+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:234 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.743+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 46 ==== osd_op_reply(234 gc.12 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.743+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:235 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.743+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 47 ==== osd_op_reply(235 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.743+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.743+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:236 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 48 ==== osd_op_reply(236 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:237 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 49 ==== osd_op_reply(237 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:238 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 50 ==== osd_op_reply(238 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:239 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f8390038020 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 51 ==== osd_op_reply(239 gc.12 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.747+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:240 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.751+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 63 ==== osd_op_reply(240 gc.13 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.751+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:241 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f9dd0 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.751+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 64 ==== osd_op_reply(241 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.751+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.751+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:242 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f13f0 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.751+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 65 ==== osd_op_reply(242 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.751+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:243 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 66 ==== osd_op_reply(243 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:244 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 67 ==== osd_op_reply(244 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:245 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f838c019040 2024-09-14T10:44:51.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 68 ==== osd_op_reply(245 gc.13 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.755+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:246 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 47 ==== osd_op_reply(246 gc.14 [call] v34'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:247 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 48 ==== osd_op_reply(247 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:248 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 49 ==== osd_op_reply(248 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:249 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 50 ==== osd_op_reply(249 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:250 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 51 ==== osd_op_reply(250 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.759+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:251 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.763+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 52 ==== osd_op_reply(251 gc.14 [call] v34'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.763+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.763+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:252 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.763+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 81 ==== osd_op_reply(252 gc.15 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.763+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:253 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 82 ==== osd_op_reply(253 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:254 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 83 ==== osd_op_reply(254 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:255 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 84 ==== osd_op_reply(255 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:256 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 85 ==== osd_op_reply(256 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.767+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:257 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 86 ==== osd_op_reply(257 gc.15 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:258 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 52 ==== osd_op_reply(258 gc.16 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:259 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 53 ==== osd_op_reply(259 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:260 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 54 ==== osd_op_reply(260 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:261 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 55 ==== osd_op_reply(261 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:262 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 56 ==== osd_op_reply(262 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.771+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:263 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 57 ==== osd_op_reply(263 gc.16 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:264 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 87 ==== osd_op_reply(264 gc.17 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:265 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 88 ==== osd_op_reply(265 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.775+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:266 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 89 ==== osd_op_reply(266 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:267 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 90 ==== osd_op_reply(267 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:268 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 91 ==== osd_op_reply(268 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:269 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 92 ==== osd_op_reply(269 gc.17 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.779+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:270 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 53 ==== osd_op_reply(270 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:271 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 54 ==== osd_op_reply(271 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:272 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 55 ==== osd_op_reply(272 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:273 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 56 ==== osd_op_reply(273 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:274 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 57 ==== osd_op_reply(274 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.783+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:275 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.787+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 58 ==== osd_op_reply(275 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.787+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.787+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:276 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.787+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 59 ==== osd_op_reply(276 gc.19 [call] v34'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.787+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:277 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 60 ==== osd_op_reply(277 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:278 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 61 ==== osd_op_reply(278 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:279 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 62 ==== osd_op_reply(279 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:280 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 63 ==== osd_op_reply(280 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:281 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28b78c0 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 64 ==== osd_op_reply(281 gc.19 [call] v34'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.791+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:282 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 93 ==== osd_op_reply(282 gc.20 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:283 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 94 ==== osd_op_reply(283 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:284 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 95 ==== osd_op_reply(284 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:285 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 96 ==== osd_op_reply(285 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:286 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 97 ==== osd_op_reply(286 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.795+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:287 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x55f3f28bdb10 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.799+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 98 ==== osd_op_reply(287 gc.20 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.799+0000 7f839e7df9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.799+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:288 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.799+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 58 ==== osd_op_reply(288 gc.21 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.799+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:289 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 59 ==== osd_op_reply(289 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:290 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 60 ==== osd_op_reply(290 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:291 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 61 ==== osd_op_reply(291 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:292 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 62 ==== osd_op_reply(292 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839e7df9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:293 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28f2770 con 0x7f8390038020 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.803+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 63 ==== osd_op_reply(293 gc.21 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.807+0000 7f82527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.807+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94506234700640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28d2060 con 0x55f3f28b78c0 2024-09-14T10:44:51.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.807+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94506234700640] v34'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.807+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94506234683488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6360 con 0x7f8390038020 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.811+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94506234683488] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.811+0000 7f839e7df9c0 20 remove_watcher() i=0 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.811+0000 7f839e7df9c0 2 removed watcher, disabling cache 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.811+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94506234688176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6360 con 0x55f3f28b78c0 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.811+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94506234688176] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.811+0000 7f839e7df9c0 20 remove_watcher() i=1 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.811+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94506234690880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6360 con 0x55f3f28bdb10 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.815+0000 7f839bae4640 1 -- 172.21.15.96:0/623850748 <== osd.3 v2:172.21.15.96:6800/3683402699 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94506234690880] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839004ad70 con 0x55f3f28bdb10 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.815+0000 7f839e7df9c0 20 remove_watcher() i=2 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.815+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94506234695632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6360 con 0x7f8390038020 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.815+0000 7f839cae6640 1 -- 172.21.15.96:0/623850748 <== osd.2 v2:172.21.15.96:6816/2312202642 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94506234695632] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c02f040 con 0x7f8390038020 2024-09-14T10:44:51.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.815+0000 7f839e7df9c0 20 remove_watcher() i=3 2024-09-14T10:44:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.815+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94506234680976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6360 con 0x55f3f28b78c0 2024-09-14T10:44:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.819+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.1 v2:172.21.15.96:6808/2339799699 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94506234680976] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x55f3f28b78c0 2024-09-14T10:44:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.819+0000 7f839e7df9c0 20 remove_watcher() i=4 2024-09-14T10:44:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.819+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94506234693088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c1690 con 0x7f838c019040 2024-09-14T10:44:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.819+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94506234693088] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.819+0000 7f839e7df9c0 20 remove_watcher() i=5 2024-09-14T10:44:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.819+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94506234702112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c6360 con 0x7f838c019040 2024-09-14T10:44:51.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.823+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94506234702112] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.823+0000 7f839e7df9c0 20 remove_watcher() i=6 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.823+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94506234706432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f3f28c45e0 con 0x7f838c019040 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 <== osd.0 v2:172.21.15.70:6800/3481052616 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94506234706432] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83940cf070 con 0x7f838c019040 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 20 remove_watcher() i=7 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f838c019040 msgr2=0x7f838c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f838c019040 0x7f838c019930 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f28b78c0 msgr2=0x55f3f28b9d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f28b78c0 0x55f3f28b9d80 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8390038020 msgr2=0x7f839001a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f8390038020 0x7f839001a590 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f3f28bdb10 msgr2=0x55f3f28bff00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55f3f28bdb10 0x55f3f28bff00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f826c03a150 msgr2=0x7f826c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f826c03a150 0x7f826c03c610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f838c00f010 tx=0x7f838c01b070 comp rx=0 tx=0).stop 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839c2e5640 1 -- 172.21.15.96:0/623850748 reap_dead start 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 msgr2=0x55f3f28ac5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28ac5b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f83900238a0 tx=0x7f83900516d0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 shutdown_connections 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/623850748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28a5000 0x55f3f28ac5b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 >> 172.21.15.96:0/623850748 conn(0x55f3f28a1430 msgr2=0x55f3f289f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 shutdown_connections 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/623850748 wait complete. 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/683295628 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f827403a1f0 msgr2=0x7f827403c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/683295628 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f827403a1f0 0x7f827403c6b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55f3f28898c0 tx=0x7f838c003070 comp rx=0 tx=0).stop 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/683295628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28986e0 msgr2=0x55f3f2898b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/683295628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28986e0 0x55f3f2898b00 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f839000d660 tx=0x7f839000da60 comp rx=0 tx=0).stop 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/683295628 shutdown_connections 2024-09-14T10:44:51.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/683295628 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f827403a1f0 0x7f827403c6b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/683295628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f28986e0 0x55f3f2898b00 secure :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f839000d660 tx=0x7f839000da60 comp rx=0 tx=0).stop 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/683295628 >> 172.21.15.96:0/683295628 conn(0x55f3f288e090 msgr2=0x55f3f288e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/683295628 shutdown_connections 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/683295628 wait complete. 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f27022c0 msgr2=0x55f3f2888160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f27022c0 0x55f3f2888160 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f828403a150 msgr2=0x7f828403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f828403a150 0x7f828403c610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8390001d80 tx=0x7f83900012e0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 msgr2=0x55f3f2880ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2880ff0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f83940aa500 tx=0x7f8394017d70 comp rx=0 tx=0).stop 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 shutdown_connections 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55f3f27022c0 0x55f3f2888160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f828403a150 0x7f828403c610 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 --2- 172.21.15.96:0/83498296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3f2700cb0 0x55f3f2880ff0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 >> 172.21.15.96:0/83498296 conn(0x55f3f2787ae0 msgr2=0x55f3f287ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 shutdown_connections 2024-09-14T10:44:51.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:50.827+0000 7f839e7df9c0 1 -- 172.21.15.96:0/83498296 wait complete. 2024-09-14T10:44:51.256 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-14T10:44:51.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-14T10:44:51.256 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-14T10:44:51.294 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:51.294 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:51.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.295+0000 7fbd7fb939c0 1 Processor -- start 2024-09-14T10:44:51.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.295+0000 7fbd7fb939c0 1 -- start start 2024-09-14T10:44:51.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.295+0000 7fbd7fb939c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5583e1659250 0x5583e1659630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.295+0000 7fbd7fb939c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583e14ff7a0 con 0x5583e165c390 2024-09-14T10:44:51.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.295+0000 7fbd7fb939c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5583e155b1b0 con 0x5583e1659250 2024-09-14T10:44:51.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7d699640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5583e1659250 0x5583e1659630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7d699640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5583e1659250 0x5583e1659630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37752/0 (socket says 172.21.15.96:37752) 2024-09-14T10:44:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7ce98640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5583e165c390 0x5583e165e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:39192/0 (socket says 172.21.15.96:39192) 2024-09-14T10:44:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7d699640 1 -- 172.21.15.96:0/2252366847 learned_addr learned my addr 172.21.15.96:0/2252366847 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7d699640 1 -- 172.21.15.96:0/2252366847 >> v1:172.21.15.70:6789/0 conn(0x5583e165c390 legacy=0x5583e165e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7d699640 1 -- 172.21.15.96:0/2252366847 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e14d9da0 con 0x5583e1659250 2024-09-14T10:44:51.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7d699640 1 --2- 172.21.15.96:0/2252366847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1659630 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800a4e0 tx=0x7fbd7801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8954370b4a84e296 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd77fff640 1 -- 172.21.15.96:0/2252366847 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd780aa540 con 0x5583e1659250 2024-09-14T10:44:51.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd77fff640 1 -- 172.21.15.96:0/2252366847 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd780aa6e0 con 0x5583e1659250 2024-09-14T10:44:51.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd77fff640 1 -- 172.21.15.96:0/2252366847 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd780aaa40 con 0x5583e1659250 2024-09-14T10:44:51.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/2252366847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 msgr2=0x5583e1659630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/2252366847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1659630 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800a4e0 tx=0x7fbd7801b090 comp rx=0 tx=0).stop 2024-09-14T10:44:51.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/2252366847 shutdown_connections 2024-09-14T10:44:51.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/2252366847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1659630 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.299+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/2252366847 >> 172.21.15.96:0/2252366847 conn(0x5583e15ccb60 msgr2=0x5583e15ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.303+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/2252366847 shutdown_connections 2024-09-14T10:44:51.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.303+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/2252366847 wait complete. 2024-09-14T10:44:51.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.315+0000 7fbd7fb939c0 1 Processor -- start 2024-09-14T10:44:51.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.315+0000 7fbd7fb939c0 1 -- start start 2024-09-14T10:44:51.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.315+0000 7fbd7fb939c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e15ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.315+0000 7fbd7fb939c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583e155efc0 con 0x5583e1659250 2024-09-14T10:44:51.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7d699640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e15ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7d699640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e15ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37766/0 (socket says 172.21.15.96:37766) 2024-09-14T10:44:51.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7d699640 1 -- 172.21.15.96:0/1326362069 learned_addr learned my addr 172.21.15.96:0/1326362069 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7d699640 1 -- 172.21.15.96:0/1326362069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e15ce6b0 con 0x5583e1659250 2024-09-14T10:44:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7d699640 1 --2- 172.21.15.96:0/1326362069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e15ce0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbd78019740 tx=0x7fbd780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf16230610554494 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbc6b606640 1 -- 172.21.15.96:0/1326362069 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd780b9070 con 0x5583e1659250 2024-09-14T10:44:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbc6b606640 1 -- 172.21.15.96:0/1326362069 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd780aaa90 con 0x5583e1659250 2024-09-14T10:44:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbc6b606640 1 -- 172.21.15.96:0/1326362069 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd780aad70 con 0x5583e1659250 2024-09-14T10:44:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1326362069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 msgr2=0x5583e15ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1326362069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e15ce0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbd78019740 tx=0x7fbd780033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1326362069 shutdown_connections 2024-09-14T10:44:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1326362069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e15ce0c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1326362069 >> 172.21.15.96:0/1326362069 conn(0x5583e15ccb60 msgr2=0x5583e17401c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1326362069 shutdown_connections 2024-09-14T10:44:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1326362069 wait complete. 2024-09-14T10:44:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 Processor -- start 2024-09-14T10:44:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 -- start start 2024-09-14T10:44:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1750050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7fb939c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583e1500a50 con 0x5583e1659250 2024-09-14T10:44:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7d699640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1750050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7d699640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1750050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37776/0 (socket says 172.21.15.96:37776) 2024-09-14T10:44:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.319+0000 7fbd7d699640 1 -- 172.21.15.96:0/1489425926 learned_addr learned my addr 172.21.15.96:0/1489425926 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7d699640 1 -- 172.21.15.96:0/1489425926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e17505b0 con 0x5583e1659250 2024-09-14T10:44:51.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7d699640 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1750050 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbd78018cc0 tx=0x7fbd78017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbc69e03640 1 -- 172.21.15.96:0/1489425926 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd780b9070 con 0x5583e1659250 2024-09-14T10:44:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbc69e03640 1 -- 172.21.15.96:0/1489425926 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd780b5b10 con 0x5583e1659250 2024-09-14T10:44:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbc69e03640 1 -- 172.21.15.96:0/1489425926 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd780b5df0 con 0x5583e1659250 2024-09-14T10:44:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583e1750840 con 0x5583e1659250 2024-09-14T10:44:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583e17511f0 con 0x5583e1659250 2024-09-14T10:44:51.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbc69e03640 1 -- 172.21.15.96:0/1489425926 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbd780b3040 con 0x5583e1659250 2024-09-14T10:44:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbc69e03640 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6403a1a0 0x7fbc6403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbc69e03640 1 -- 172.21.15.96:0/1489425926 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd780c4070 con 0x5583e1659250 2024-09-14T10:44:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7ce98640 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6403a1a0 0x7fbc6403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e165c390 0x5583e17571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e1757700 con 0x5583e165c390 2024-09-14T10:44:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e165c390 0x5583e17571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7ce98640 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6403a1a0 0x7fbc6403c660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd68001e40 tx=0x7fbd680013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.323+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e165c390 0x5583e17571c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1489425926 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd700083f0 con 0x5583e165c390 2024-09-14T10:44:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e1757b20 con 0x5583e165c390 2024-09-14T10:44:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1489425926 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd700083f0 con 0x5583e165c390 2024-09-14T10:44:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e1759420 con 0x5583e165c390 2024-09-14T10:44:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1489425926 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd700083f0 con 0x5583e165c390 2024-09-14T10:44:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e1758650 con 0x5583e165c390 2024-09-14T10:44:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1489425926 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd700083f0 con 0x5583e165c390 2024-09-14T10:44:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e1758aa0 con 0x5583e165c390 2024-09-14T10:44:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1489425926 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd700083f0 con 0x5583e165c390 2024-09-14T10:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 Processor -- start 2024-09-14T10:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 -- start start 2024-09-14T10:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e17677c0 0x5583e1767be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583e156bd80 con 0x5583e17677c0 2024-09-14T10:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7ce98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e17677c0 0x5583e1767be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7ce98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e17677c0 0x5583e1767be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37786/0 (socket says 172.21.15.96:37786) 2024-09-14T10:44:51.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7ce98640 1 -- 172.21.15.96:0/701755298 learned_addr learned my addr 172.21.15.96:0/701755298 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7ce98640 1 -- 172.21.15.96:0/701755298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e1768220 con 0x5583e17677c0 2024-09-14T10:44:51.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7ce98640 1 --2- 172.21.15.96:0/701755298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e17677c0 0x5583e1767be0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800e670 tx=0x7fbd6800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbc62ffd640 1 -- 172.21.15.96:0/701755298 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd68022070 con 0x5583e17677c0 2024-09-14T10:44:51.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbc62ffd640 1 -- 172.21.15.96:0/701755298 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6800d660 con 0x5583e17677c0 2024-09-14T10:44:51.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/701755298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583e1768a80 con 0x5583e17677c0 2024-09-14T10:44:51.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/701755298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583e1768ff0 con 0x5583e17677c0 2024-09-14T10:44:51.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.327+0000 7fbc62ffd640 1 -- 172.21.15.96:0/701755298 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd68006070 con 0x5583e17677c0 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbc62ffd640 1 -- 172.21.15.96:0/701755298 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbd68025070 con 0x5583e17677c0 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbc62ffd640 1 --2- 172.21.15.96:0/701755298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5803a150 0x7fbc5803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbc62ffd640 1 -- 172.21.15.96:0/701755298 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd68052440 con 0x5583e17677c0 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/701755298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5803a150 0x7fbc5803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 Processor -- start 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 -- start start 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e1774500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583e15cea20 con 0x5583e1774120 2024-09-14T10:44:51.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/701755298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5803a150 0x7fbc5803c610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5583e1758170 tx=0x7fbd70003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7ce98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e1774500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7ce98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e1774500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37802/0 (socket says 172.21.15.96:37802) 2024-09-14T10:44:51.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7ce98640 1 -- 172.21.15.96:0/554502051 learned_addr learned my addr 172.21.15.96:0/554502051 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7ce98640 1 -- 172.21.15.96:0/554502051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e1774ad0 con 0x5583e1774120 2024-09-14T10:44:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7ce98640 1 --2- 172.21.15.96:0/554502051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e1774500 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbd680507c0 tx=0x7fbd6801ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cdc23d15e1107 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbc60ff9640 1 -- 172.21.15.96:0/554502051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6804f280 con 0x5583e1774120 2024-09-14T10:44:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbc60ff9640 1 -- 172.21.15.96:0/554502051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6800dcc0 con 0x5583e1774120 2024-09-14T10:44:51.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbc60ff9640 1 -- 172.21.15.96:0/554502051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd680520d0 con 0x5583e1774120 2024-09-14T10:44:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/554502051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 msgr2=0x5583e1774500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/554502051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e1774500 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbd680507c0 tx=0x7fbd6801ae00 comp rx=0 tx=0).stop 2024-09-14T10:44:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/554502051 shutdown_connections 2024-09-14T10:44:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/554502051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e1774500 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.331+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/554502051 >> 172.21.15.96:0/554502051 conn(0x5583e1770550 msgr2=0x5583e176e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/554502051 shutdown_connections 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/554502051 wait complete. 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 1 Processor -- start 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 1 -- start start 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e177b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583e1775130 con 0x5583e1774120 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7ce98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e177b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7ce98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e177b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37808/0 (socket says 172.21.15.96:37808) 2024-09-14T10:44:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 learned_addr learned my addr 172.21.15.96:0/1319466549 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e177bc50 con 0x5583e1774120 2024-09-14T10:44:51.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7ce98640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e177b6f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbd6801af50 tx=0x7fbd68050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbc4effd640 1 -- 172.21.15.96:0/1319466549 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd68025c80 con 0x5583e1774120 2024-09-14T10:44:51.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583e177bee0 con 0x5583e1774120 2024-09-14T10:44:51.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbc4effd640 1 -- 172.21.15.96:0/1319466549 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd68025e20 con 0x5583e1774120 2024-09-14T10:44:51.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbc4effd640 1 -- 172.21.15.96:0/1319466549 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6801a450 con 0x5583e1774120 2024-09-14T10:44:51.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583e177bee0 con 0x5583e1774120 2024-09-14T10:44:51.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.335+0000 7fbc4effd640 1 -- 172.21.15.96:0/1319466549 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbd6801a680 con 0x5583e1774120 2024-09-14T10:44:51.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbc4effd640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc4803a150 0x7fbc4803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbc4effd640 1 -- 172.21.15.96:0/1319466549 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd68035d10 con 0x5583e1774120 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc4803a150 0x7fbc4803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e17869b0 0x5583e1788e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e1789590 con 0x5583e17869b0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7d699640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e17869b0 0x5583e1788e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc4803a150 0x7fbc4803c610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000f010 tx=0x7fbd7001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7d699640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e17869b0 0x5583e1788e40 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 realm 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17899a0 con 0x5583e17869b0 2024-09-14T10:44:51.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e178a270 con 0x5583e17869b0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e178a610 con 0x5583e17869b0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e178aab0 con 0x5583e17869b0 2024-09-14T10:44:51.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:51.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 20 searching for the correct realm 2024-09-14T10:44:51.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5583e178ca50 0x5583e178eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583e178f590 con 0x5583e178ca50 2024-09-14T10:44:51.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7ce98640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5583e178ca50 0x5583e178eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7ce98640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5583e178ca50 0x5583e178eec0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7ce98640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd68027060 0x7fbd680404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583e178f590 con 0x7fbd68027060 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd68027060 0x7fbd680404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd68027060 0x7fbd680404b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7de9a640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd70019040 0x7fbd70019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.339+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583e178f590 con 0x7fbd70019040 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd70019040 0x7fbd70019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd70019040 0x7fbd70019930 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583e178f590 con 0x5583e17869b0 2024-09-14T10:44:51.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583e178f590 con 0x5583e17869b0 2024-09-14T10:44:51.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583e178f590 con 0x7fbd70019040 2024-09-14T10:44:51.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5583e178f590 con 0x7fbd70019040 2024-09-14T10:44:51.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd68027060 2024-09-14T10:44:51.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.343+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e178ca50 2024-09-14T10:44:51.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e17869b0 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd70019040 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e17869b0 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd68027060 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e178ca50 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e178ca50 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd70019040 2024-09-14T10:44:51.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e178ca50 2024-09-14T10:44:51.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e178ca50 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e17869b0 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e17869b0 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.347+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd70019040 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e178ca50 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd68027060 2024-09-14T10:44:51.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e17869b0 2024-09-14T10:44:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd68027060 2024-09-14T10:44:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e178ca50 2024-09-14T10:44:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd70019040 2024-09-14T10:44:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd68027060 2024-09-14T10:44:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e178ca50 2024-09-14T10:44:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.351+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x7fbd70019040 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780dd040 con 0x5583e17869b0 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd780f4040 con 0x7fbd68027060 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e178b3c0 con 0x5583e17869b0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e178b7b0 con 0x5583e17869b0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e178b7b0 con 0x5583e17869b0 2024-09-14T10:44:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 zone default found 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 4 Realm: () 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 zonegroup default 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e178bbd0 con 0x7fbd68027060 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e1791400 con 0x5583e178ca50 2024-09-14T10:44:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17917a0 con 0x5583e178ca50 2024-09-14T10:44:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 started sync module instance, tier type = 2024-09-14T10:44:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.355+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17908a0 con 0x7fbd68027060 2024-09-14T10:44:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.359+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.359+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94024911883680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17908a0 con 0x7fbd68027060 2024-09-14T10:44:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.359+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1792230 con 0x5583e17869b0 2024-09-14T10:44:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.359+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94024911883680] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.359+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.359+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94024911887648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17908a0 con 0x5583e17869b0 2024-09-14T10:44:51.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.359+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1792c70 con 0x5583e178ca50 2024-09-14T10:44:51.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94024911887648] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94024911881200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1790810 con 0x5583e178ca50 2024-09-14T10:44:51.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17939d0 con 0x7fbd68027060 2024-09-14T10:44:51.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94024911893696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1794270 con 0x7fbd68027060 2024-09-14T10:44:51.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1794cb0 con 0x5583e17869b0 2024-09-14T10:44:51.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94024911881200] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.363+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94024911893696] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.367+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.367+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94024911898496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1793dc0 con 0x5583e17869b0 2024-09-14T10:44:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.367+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1795550 con 0x7fbd70019040 2024-09-14T10:44:51.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.367+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.367+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94024911900336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1795780 con 0x7fbd70019040 2024-09-14T10:44:51.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.367+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1795fd0 con 0x7fbd70019040 2024-09-14T10:44:51.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.367+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94024911898496] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94024911900336] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94024911901392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1795ba0 con 0x7fbd70019040 2024-09-14T10:44:51.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17963f0 con 0x7fbd70019040 2024-09-14T10:44:51.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94024911901392] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94024911902720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1796210 con 0x7fbd70019040 2024-09-14T10:44:51.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 20 add_watcher() i=0 2024-09-14T10:44:51.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 20 add_watcher() i=1 2024-09-14T10:44:51.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 20 add_watcher() i=2 2024-09-14T10:44:51.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 20 add_watcher() i=3 2024-09-14T10:44:51.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 20 add_watcher() i=4 2024-09-14T10:44:51.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 20 add_watcher() i=5 2024-09-14T10:44:51.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.371+0000 7fbd7fb939c0 20 add_watcher() i=6 2024-09-14T10:44:51.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94024911902720] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7fb939c0 20 add_watcher() i=7 2024-09-14T10:44:51.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7fb939c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:51.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e1799750 con 0x5583e17869b0 2024-09-14T10:44:51.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94024911903904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1796bd0 con 0x5583e17869b0 2024-09-14T10:44:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94024911903904] v34'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbc33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7fb939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.375+0000 7fbd7fb939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.379+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a1df0 con 0x5583e17869b0 2024-09-14T10:44:51.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.379+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.379+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a2400 con 0x7fbd70019040 2024-09-14T10:44:51.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.383+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.383+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a2330 con 0x5583e178ca50 2024-09-14T10:44:51.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.383+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.383+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a2710 con 0x5583e17869b0 2024-09-14T10:44:51.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.383+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.383+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a26f0 con 0x7fbd68027060 2024-09-14T10:44:51.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.387+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.387+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a2cc0 con 0x5583e178ca50 2024-09-14T10:44:51.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.387+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.387+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a3120 con 0x5583e17869b0 2024-09-14T10:44:51.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.387+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.387+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a3120 con 0x7fbd70019040 2024-09-14T10:44:51.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.391+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'39 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.391+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a3120 con 0x7fbd68027060 2024-09-14T10:44:51.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.395+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.395+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a3750 con 0x5583e178ca50 2024-09-14T10:44:51.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.395+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.395+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a3b80 con 0x7fbd68027060 2024-09-14T10:44:51.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.395+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.395+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a4130 con 0x7fbd70019040 2024-09-14T10:44:51.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.399+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.399+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a4110 con 0x7fbd68027060 2024-09-14T10:44:51.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.399+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.399+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a41a0 con 0x7fbd70019040 2024-09-14T10:44:51.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.403+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.403+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a41a0 con 0x5583e17869b0 2024-09-14T10:44:51.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.403+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.403+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a41a0 con 0x5583e178ca50 2024-09-14T10:44:51.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.407+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.407+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a41a0 con 0x7fbd68027060 2024-09-14T10:44:51.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.407+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.407+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a42a0 con 0x5583e178ca50 2024-09-14T10:44:51.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.411+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.411+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a42a0 con 0x5583e17869b0 2024-09-14T10:44:51.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.411+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.411+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a42a0 con 0x5583e17869b0 2024-09-14T10:44:51.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.415+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.415+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a42a0 con 0x5583e178ca50 2024-09-14T10:44:51.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.415+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.415+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a42a0 con 0x7fbd68027060 2024-09-14T10:44:51.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.419+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.419+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x5583e178ca50 2024-09-14T10:44:51.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.419+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.419+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x5583e178ca50 2024-09-14T10:44:51.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.419+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.419+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x5583e178ca50 2024-09-14T10:44:51.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.423+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.423+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x5583e178ca50 2024-09-14T10:44:51.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.423+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.423+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x7fbd70019040 2024-09-14T10:44:51.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.427+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.427+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x5583e178ca50 2024-09-14T10:44:51.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.427+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.427+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x7fbd70019040 2024-09-14T10:44:51.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.431+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.431+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x5583e178ca50 2024-09-14T10:44:51.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.431+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.431+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x7fbd70019040 2024-09-14T10:44:51.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.435+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.435+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a43a0 con 0x7fbd68027060 2024-09-14T10:44:51.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.435+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.435+0000 7fbc32fe5640 20 reqs_thread_entry: start 2024-09-14T10:44:51.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7fb939c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:51.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7fb939c0 20 Filter name: none 2024-09-14T10:44:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbc30fe1640 20 reqs_thread_entry: start 2024-09-14T10:44:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e17869b0 2024-09-14T10:44:51.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0ab0 con 0x5583e17869b0 2024-09-14T10:44:51.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0ab0 con 0x7fbd70019040 2024-09-14T10:44:51.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0ab0 con 0x7fbd70019040 2024-09-14T10:44:51.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.439+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0ab0 con 0x7fbd70019040 2024-09-14T10:44:51.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a18a0 con 0x5583e178ca50 2024-09-14T10:44:51.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a18a0 con 0x5583e178ca50 2024-09-14T10:44:51.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a18a0 con 0x5583e178ca50 2024-09-14T10:44:51.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a18a0 con 0x5583e17869b0 2024-09-14T10:44:51.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e17869b0 2024-09-14T10:44:51.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd68027060 2024-09-14T10:44:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.443+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e17869b0 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd70019040 2024-09-14T10:44:51.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.447+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd68027060 2024-09-14T10:44:51.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd68027060 2024-09-14T10:44:51.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.451+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd70019040 2024-09-14T10:44:51.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd68027060 2024-09-14T10:44:51.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.455+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd70019040 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e17869b0 2024-09-14T10:44:51.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.459+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd68027060 2024-09-14T10:44:51.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.463+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e17869b0 2024-09-14T10:44:51.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e17869b0 2024-09-14T10:44:51.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e17869b0 2024-09-14T10:44:51.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd68027060 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.467+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.471+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd70019040 2024-09-14T10:44:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.475+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd70019040 2024-09-14T10:44:51.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e178ca50 2024-09-14T10:44:51.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.479+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x5583e178ca50 2024-09-14T10:44:51.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd70019040 2024-09-14T10:44:51.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd70019040 2024-09-14T10:44:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x7fbd68027060 2024-09-14T10:44:51.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.483+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583e17bfed0 con 0x7fbd68027060 2024-09-14T10:44:51.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.487+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.487+0000 7fbc33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:51.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.487+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94024911903904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17a0f60 con 0x5583e17869b0 2024-09-14T10:44:51.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.487+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94024911903904] v34'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.487+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94024911883680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1795c60 con 0x7fbd68027060 2024-09-14T10:44:51.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.491+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94024911883680] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.491+0000 7fbd7fb939c0 20 remove_watcher() i=0 2024-09-14T10:44:51.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.491+0000 7fbd7fb939c0 2 removed watcher, disabling cache 2024-09-14T10:44:51.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.491+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94024911887648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1790da0 con 0x5583e17869b0 2024-09-14T10:44:51.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.491+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94024911887648] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.491+0000 7fbd7fb939c0 20 remove_watcher() i=1 2024-09-14T10:44:51.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.491+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94024911881200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1790da0 con 0x5583e178ca50 2024-09-14T10:44:51.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.495+0000 7fbd7ce98640 1 -- 172.21.15.96:0/1319466549 <== osd.3 v2:172.21.15.96:6800/3683402699 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94024911881200] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6803b070 con 0x5583e178ca50 2024-09-14T10:44:51.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.495+0000 7fbd7fb939c0 20 remove_watcher() i=2 2024-09-14T10:44:51.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.495+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94024911893696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17903f0 con 0x7fbd68027060 2024-09-14T10:44:51.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.495+0000 7fbd7de9a640 1 -- 172.21.15.96:0/1319466549 <== osd.2 v2:172.21.15.96:6816/2312202642 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94024911893696] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7002f040 con 0x7fbd68027060 2024-09-14T10:44:51.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.495+0000 7fbd7fb939c0 20 remove_watcher() i=3 2024-09-14T10:44:51.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.495+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94024911898496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17903f0 con 0x5583e17869b0 2024-09-14T10:44:51.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.499+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.1 v2:172.21.15.96:6808/2339799699 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94024911898496] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x5583e17869b0 2024-09-14T10:44:51.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.499+0000 7fbd7fb939c0 20 remove_watcher() i=4 2024-09-14T10:44:51.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.499+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94024911900336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1794780 con 0x7fbd70019040 2024-09-14T10:44:51.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.499+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94024911900336] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.499+0000 7fbd7fb939c0 20 remove_watcher() i=5 2024-09-14T10:44:51.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.499+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94024911901392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e17903f0 con 0x7fbd70019040 2024-09-14T10:44:51.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.503+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94024911901392] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.503+0000 7fbd7fb939c0 20 remove_watcher() i=6 2024-09-14T10:44:51.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.503+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94024911902720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5583e1794780 con 0x7fbd70019040 2024-09-14T10:44:51.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.503+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 <== osd.0 v2:172.21.15.70:6800/3481052616 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94024911902720] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd780c6d80 con 0x7fbd70019040 2024-09-14T10:44:51.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 20 remove_watcher() i=7 2024-09-14T10:44:51.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd70019040 msgr2=0x7fbd70019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd70019040 0x7fbd70019930 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e17869b0 msgr2=0x5583e1788e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e17869b0 0x5583e1788e40 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd68027060 msgr2=0x7fbd680404b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd68027060 0x7fbd680404b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5583e178ca50 msgr2=0x5583e178eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5583e178ca50 0x5583e178eec0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc4803a150 msgr2=0x7fbc4803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc4803a150 0x7fbc4803c610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000f010 tx=0x7fbd7001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 msgr2=0x5583e177b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7d699640 1 -- 172.21.15.96:0/1319466549 reap_dead start 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e177b6f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbd6801af50 tx=0x7fbd68050720 comp rx=0 tx=0).stop 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 shutdown_connections 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1319466549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1774120 0x5583e177b6f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 >> 172.21.15.96:0/1319466549 conn(0x5583e1770550 msgr2=0x5583e176e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 shutdown_connections 2024-09-14T10:44:51.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1319466549 wait complete. 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/701755298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5803a150 msgr2=0x7fbc5803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/701755298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5803a150 0x7fbc5803c610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5583e1758170 tx=0x7fbd70003070 comp rx=0 tx=0).stop 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/701755298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e17677c0 msgr2=0x5583e1767be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/701755298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e17677c0 0x5583e1767be0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800e670 tx=0x7fbd6800ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/701755298 shutdown_connections 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/701755298 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5803a150 0x7fbc5803c610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/701755298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e17677c0 0x5583e1767be0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/701755298 >> 172.21.15.96:0/701755298 conn(0x5583e175d170 msgr2=0x5583e175d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/701755298 shutdown_connections 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/701755298 wait complete. 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e165c390 msgr2=0x5583e17571c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e165c390 0x5583e17571c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6403a1a0 msgr2=0x7fbc6403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6403a1a0 0x7fbc6403c660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd68001e40 tx=0x7fbd680013a0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 msgr2=0x5583e1750050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1750050 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbd78018cc0 tx=0x7fbd78017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 shutdown_connections 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5583e165c390 0x5583e17571c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6403a1a0 0x7fbc6403c660 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 --2- 172.21.15.96:0/1489425926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583e1659250 0x5583e1750050 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 >> 172.21.15.96:0/1489425926 conn(0x5583e15ccb60 msgr2=0x5583e15cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 shutdown_connections 2024-09-14T10:44:51.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.507+0000 7fbd7fb939c0 1 -- 172.21.15.96:0/1489425926 wait complete. 2024-09-14T10:44:51.521 INFO:teuthology.orchestra.run.smithi096.stdout:[] 2024-09-14T10:44:51.521 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:44:51.522 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-14T10:44:51.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-14T10:44:51.522 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-14T10:44:51.604 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:51.604 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:51.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc579e619c0 1 Processor -- start 2024-09-14T10:44:51.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc579e619c0 1 -- start start 2024-09-14T10:44:51.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc579e619c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55db740a0250 0x55db74131080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc579e619c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55db73fd47a0 con 0x55db740a0630 2024-09-14T10:44:51.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc579e619c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55db740301b0 con 0x55db740a0250 2024-09-14T10:44:51.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc577967640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55db740a0250 0x55db74131080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc577967640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55db740a0250 0x55db74131080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37820/0 (socket says 172.21.15.96:37820) 2024-09-14T10:44:51.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc577967640 1 -- 172.21.15.96:0/750380995 learned_addr learned my addr 172.21.15.96:0/750380995 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc577967640 1 -- 172.21.15.96:0/750380995 >> v1:172.21.15.70:6789/0 conn(0x55db740a0630 legacy=0x55db741335d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.607+0000 7fc577967640 1 -- 172.21.15.96:0/750380995 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db73faeda0 con 0x55db740a0250 2024-09-14T10:44:51.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc577967640 1 --2- 172.21.15.96:0/750380995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74131080 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc57000a4e0 tx=0x7fc57001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c44dff56ab0de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc576965640 1 -- 172.21.15.96:0/750380995 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700aa540 con 0x55db740a0250 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc576965640 1 -- 172.21.15.96:0/750380995 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5700aa6e0 con 0x55db740a0250 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc576965640 1 -- 172.21.15.96:0/750380995 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700aaa40 con 0x55db740a0250 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc579e619c0 1 -- 172.21.15.96:0/750380995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 msgr2=0x55db74131080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc579e619c0 1 --2- 172.21.15.96:0/750380995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74131080 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc57000a4e0 tx=0x7fc57001b090 comp rx=0 tx=0).stop 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc579e619c0 1 -- 172.21.15.96:0/750380995 shutdown_connections 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc579e619c0 1 --2- 172.21.15.96:0/750380995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74131080 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc579e619c0 1 -- 172.21.15.96:0/750380995 >> 172.21.15.96:0/750380995 conn(0x55db74126970 msgr2=0x55db74128d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc579e619c0 1 -- 172.21.15.96:0/750380995 shutdown_connections 2024-09-14T10:44:51.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.611+0000 7fc579e619c0 1 -- 172.21.15.96:0/750380995 wait complete. 2024-09-14T10:44:51.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc579e619c0 1 Processor -- start 2024-09-14T10:44:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc579e619c0 1 -- start start 2024-09-14T10:44:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc579e619c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db742195c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc579e619c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db74033fc0 con 0x55db740a0250 2024-09-14T10:44:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc577967640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db742195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc577967640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db742195c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37828/0 (socket says 172.21.15.96:37828) 2024-09-14T10:44:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc577967640 1 -- 172.21.15.96:0/3737479036 learned_addr learned my addr 172.21.15.96:0/3737479036 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc577967640 1 -- 172.21.15.96:0/3737479036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db74219bb0 con 0x55db740a0250 2024-09-14T10:44:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc577967640 1 --2- 172.21.15.96:0/3737479036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db742195c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc570018cc0 tx=0x7fc5700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cd63d56576cff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc465e0b640 1 -- 172.21.15.96:0/3737479036 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700b9070 con 0x55db740a0250 2024-09-14T10:44:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc465e0b640 1 -- 172.21.15.96:0/3737479036 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5700aaa80 con 0x55db740a0250 2024-09-14T10:44:51.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.627+0000 7fc465e0b640 1 -- 172.21.15.96:0/3737479036 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700aad60 con 0x55db740a0250 2024-09-14T10:44:51.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- 172.21.15.96:0/3737479036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 msgr2=0x55db742195c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 --2- 172.21.15.96:0/3737479036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db742195c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc570018cc0 tx=0x7fc5700033b0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- 172.21.15.96:0/3737479036 shutdown_connections 2024-09-14T10:44:51.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 --2- 172.21.15.96:0/3737479036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db742195c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- 172.21.15.96:0/3737479036 >> 172.21.15.96:0/3737479036 conn(0x55db74126970 msgr2=0x55db74215190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- 172.21.15.96:0/3737479036 shutdown_connections 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- 172.21.15.96:0/3737479036 wait complete. 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 Processor -- start 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- start start 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74220cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db73fd5a50 con 0x55db740a0250 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc577967640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74220cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc577967640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74220cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37844/0 (socket says 172.21.15.96:37844) 2024-09-14T10:44:51.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc577967640 1 -- 172.21.15.96:0/4042216314 learned_addr learned my addr 172.21.15.96:0/4042216314 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc577967640 1 -- 172.21.15.96:0/4042216314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db74221220 con 0x55db740a0250 2024-09-14T10:44:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc577967640 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74220cc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc570018cc0 tx=0x7fc570017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc45ffff640 1 -- 172.21.15.96:0/4042216314 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700b9070 con 0x55db740a0250 2024-09-14T10:44:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db742214b0 con 0x55db740a0250 2024-09-14T10:44:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc45ffff640 1 -- 172.21.15.96:0/4042216314 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5700b5b10 con 0x55db740a0250 2024-09-14T10:44:51.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc45ffff640 1 -- 172.21.15.96:0/4042216314 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700b5df0 con 0x55db740a0250 2024-09-14T10:44:51.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db74221e60 con 0x55db740a0250 2024-09-14T10:44:51.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc45ffff640 1 -- 172.21.15.96:0/4042216314 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc5700b3040 con 0x55db740a0250 2024-09-14T10:44:51.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc45ffff640 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc46003a150 0x7fc46003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.631+0000 7fc45ffff640 1 -- 172.21.15.96:0/4042216314 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc5700c4070 con 0x55db740a0250 2024-09-14T10:44:51.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc577166640 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc46003a150 0x7fc46003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db740a0630 0x55db74227e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db74228370 con 0x55db740a0630 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc578168640 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db740a0630 0x55db74227e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc577166640 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc46003a150 0x7fc46003c610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc560001ec0 tx=0x7fc560001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc578168640 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db740a0630 0x55db74227e30 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc578168640 1 -- 172.21.15.96:0/4042216314 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5680083f0 con 0x55db740a0630 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db74222250 con 0x55db740a0630 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc578168640 1 -- 172.21.15.96:0/4042216314 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5680083f0 con 0x55db740a0630 2024-09-14T10:44:51.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7422a170 con 0x55db740a0630 2024-09-14T10:44:51.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc578168640 1 -- 172.21.15.96:0/4042216314 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc5680083f0 con 0x55db740a0630 2024-09-14T10:44:51.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db742293a0 con 0x55db740a0630 2024-09-14T10:44:51.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc578168640 1 -- 172.21.15.96:0/4042216314 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5680083f0 con 0x55db740a0630 2024-09-14T10:44:51.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db742297f0 con 0x55db740a0630 2024-09-14T10:44:51.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc578168640 1 -- 172.21.15.96:0/4042216314 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc5680083f0 con 0x55db740a0630 2024-09-14T10:44:51.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 Processor -- start 2024-09-14T10:44:51.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 -- start start 2024-09-14T10:44:51.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74238530 0x55db74238950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc579e619c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db74040d80 con 0x55db74238530 2024-09-14T10:44:51.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc577166640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74238530 0x55db74238950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc577166640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74238530 0x55db74238950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37858/0 (socket says 172.21.15.96:37858) 2024-09-14T10:44:51.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.635+0000 7fc577166640 1 -- 172.21.15.96:0/231725872 learned_addr learned my addr 172.21.15.96:0/231725872 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc577166640 1 -- 172.21.15.96:0/231725872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db74238f90 con 0x55db74238530 2024-09-14T10:44:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc577166640 1 --2- 172.21.15.96:0/231725872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74238530 0x55db74238950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc560010fd0 tx=0x7fc56000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc45d7fa640 1 -- 172.21.15.96:0/231725872 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56000a040 con 0x55db74238530 2024-09-14T10:44:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc45d7fa640 1 -- 172.21.15.96:0/231725872 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560017050 con 0x55db74238530 2024-09-14T10:44:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc45d7fa640 1 -- 172.21.15.96:0/231725872 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56000e6b0 con 0x55db74238530 2024-09-14T10:44:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc579e619c0 1 -- 172.21.15.96:0/231725872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db742397f0 con 0x55db74238530 2024-09-14T10:44:51.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc579e619c0 1 -- 172.21.15.96:0/231725872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db74239d60 con 0x55db74238530 2024-09-14T10:44:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc45d7fa640 1 -- 172.21.15.96:0/231725872 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc56000e8e0 con 0x55db74238530 2024-09-14T10:44:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc45d7fa640 1 --2- 172.21.15.96:0/231725872 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc45003a140 0x7fc45003c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc45d7fa640 1 -- 172.21.15.96:0/231725872 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc560052af0 con 0x55db74238530 2024-09-14T10:44:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc578168640 1 --2- 172.21.15.96:0/231725872 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc45003a140 0x7fc45003c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc579e619c0 1 Processor -- start 2024-09-14T10:44:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.639+0000 7fc579e619c0 1 -- start start 2024-09-14T10:44:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc578168640 1 --2- 172.21.15.96:0/231725872 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc45003a140 0x7fc45003c600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc56800e3f0 tx=0x7fc568003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db742462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db74219f20 con 0x55db74245f00 2024-09-14T10:44:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db742462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db742462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37872/0 (socket says 172.21.15.96:37872) 2024-09-14T10:44:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 -- 172.21.15.96:0/3569707068 learned_addr learned my addr 172.21.15.96:0/3569707068 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 -- 172.21.15.96:0/3569707068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db742468d0 con 0x55db74245f00 2024-09-14T10:44:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 --2- 172.21.15.96:0/3569707068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db742462e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc560050e40 tx=0x7fc560024360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9114a1bf7f9e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc456ffd640 1 -- 172.21.15.96:0/3569707068 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56001c930 con 0x55db74245f00 2024-09-14T10:44:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc456ffd640 1 -- 172.21.15.96:0/3569707068 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56001a310 con 0x55db74245f00 2024-09-14T10:44:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc456ffd640 1 -- 172.21.15.96:0/3569707068 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56001cad0 con 0x55db74245f00 2024-09-14T10:44:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 -- 172.21.15.96:0/3569707068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 msgr2=0x55db742462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 --2- 172.21.15.96:0/3569707068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db742462e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc560050e40 tx=0x7fc560024360 comp rx=0 tx=0).stop 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 -- 172.21.15.96:0/3569707068 shutdown_connections 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 --2- 172.21.15.96:0/3569707068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db742462e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 -- 172.21.15.96:0/3569707068 >> 172.21.15.96:0/3569707068 conn(0x55db742412c0 msgr2=0x55db7423f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 -- 172.21.15.96:0/3569707068 shutdown_connections 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 -- 172.21.15.96:0/3569707068 wait complete. 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 Processor -- start 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 -- start start 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db7424c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc579e619c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db74244df0 con 0x55db74245f00 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db7424c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db7424c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37884/0 (socket says 172.21.15.96:37884) 2024-09-14T10:44:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 learned_addr learned my addr 172.21.15.96:0/2032311617 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.643+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db7424c990 con 0x55db74245f00 2024-09-14T10:44:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc577166640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db7424c430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc56004fd10 tx=0x7fc560050dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc4557fa640 1 -- 172.21.15.96:0/2032311617 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56001c410 con 0x55db74245f00 2024-09-14T10:44:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db7424cc20 con 0x55db74245f00 2024-09-14T10:44:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc4557fa640 1 -- 172.21.15.96:0/2032311617 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56001c5b0 con 0x55db74245f00 2024-09-14T10:44:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc4557fa640 1 -- 172.21.15.96:0/2032311617 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc560024580 con 0x55db74245f00 2024-09-14T10:44:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db7424d5d0 con 0x55db74245f00 2024-09-14T10:44:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc4557fa640 1 -- 172.21.15.96:0/2032311617 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc560036020 con 0x55db74245f00 2024-09-14T10:44:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc4557fa640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc44003a150 0x7fc44003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc4557fa640 1 -- 172.21.15.96:0/2032311617 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc560034020 con 0x55db74245f00 2024-09-14T10:44:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc578168640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc44003a150 0x7fc44003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db74257a00 0x55db74259e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425a5e0 con 0x55db74257a00 2024-09-14T10:44:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc577967640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db74257a00 0x55db74259e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc578168640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc44003a150 0x7fc44003c610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc56800f010 tx=0x7fc56801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc577967640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db74257a00 0x55db74259e90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 20 realm 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425a9f0 con 0x55db74257a00 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425b2c0 con 0x55db74257a00 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.647+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425b660 con 0x55db74257a00 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc579e619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425beb0 con 0x55db74257a00 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc579e619c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc579e619c0 20 searching for the correct realm 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55db7425dc20 0x55db74260010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db742605f0 con 0x55db7425dc20 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577166640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55db7425dc20 0x55db74260010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577166640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55db7425dc20 0x55db74260010 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577166640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc56001c030 0x7fc560024720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db742605f0 con 0x7fc56001c030 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc578168640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc56001c030 0x7fc560024720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc578168640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc56001c030 0x7fc560024720 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc578168640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc568019040 0x7fc568019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db742605f0 con 0x7fc568019040 2024-09-14T10:44:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577967640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc568019040 0x7fc568019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577967640 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc568019040 0x7fc568019930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x7fc568019040 2024-09-14T10:44:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.651+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db742605f0 con 0x55db74257a00 2024-09-14T10:44:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db742605f0 con 0x55db74257a00 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db742605f0 con 0x7fc568019040 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x7fc568019040 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55db742605f0 con 0x7fc568019040 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x7fc568019040 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc56001c030 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db7425dc20 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db74257a00 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc568019040 2024-09-14T10:44:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x7fc568019040 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db74257a00 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc56001c030 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db7425dc20 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.655+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db7425dc20 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc568019040 2024-09-14T10:44:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x7fc568019040 2024-09-14T10:44:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db7425dc20 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db7425dc20 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db74257a00 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db74257a00 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc5700cd060 con 0x55db74257a00 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc568019040 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db7425dc20 2024-09-14T10:44:51.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc56001c030 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db74257a00 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc56001c030 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.659+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db7425dc20 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc568019040 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc56001c030 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db7425dc20 2024-09-14T10:44:51.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc568019040 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x55db74257a00 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc5700df040 con 0x7fc56001c030 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:51.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425c700 con 0x55db74257a00 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425caf0 con 0x55db74257a00 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425caf0 con 0x55db74257a00 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 zone default found 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 4 Realm: () 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 zonegroup default 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.663+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7425cff0 con 0x7fc56001c030 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db74262560 con 0x55db7425dc20 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db74262a20 con 0x55db7425dc20 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 20 started sync module instance, tier type = 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74261900 con 0x7fc56001c030 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94401034853888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74261900 con 0x7fc56001c030 2024-09-14T10:44:51.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db742634e0 con 0x55db74257a00 2024-09-14T10:44:51.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.667+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94401034853888] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.671+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.671+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94401034858480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74261900 con 0x55db74257a00 2024-09-14T10:44:51.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.671+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74263ef0 con 0x55db7425dc20 2024-09-14T10:44:51.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.671+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94401034858480] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.671+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.671+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94401034861120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74264290 con 0x55db7425dc20 2024-09-14T10:44:51.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.671+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74264c50 con 0x7fc56001c030 2024-09-14T10:44:51.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.675+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.675+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94401034864816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74265520 con 0x7fc56001c030 2024-09-14T10:44:51.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.675+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74265ee0 con 0x55db74257a00 2024-09-14T10:44:51.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.675+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94401034861120] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.675+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94401034864816] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.675+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.675+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94401034866800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74265a30 con 0x55db74257a00 2024-09-14T10:44:51.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.675+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db742663f0 con 0x7fc568019040 2024-09-14T10:44:51.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.679+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.679+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94401034870592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74266810 con 0x7fc568019040 2024-09-14T10:44:51.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.679+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267210 con 0x7fc568019040 2024-09-14T10:44:51.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.679+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94401034866800] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.679+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.679+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94401034851408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db742671d0 con 0x7fc568019040 2024-09-14T10:44:51.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.679+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267c20 con 0x7fc568019040 2024-09-14T10:44:51.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.679+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94401034870592] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94401034851408] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94401034874144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267140 con 0x7fc568019040 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 20 add_watcher() i=0 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 20 add_watcher() i=1 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 20 add_watcher() i=2 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 20 add_watcher() i=3 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 20 add_watcher() i=4 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 20 add_watcher() i=5 2024-09-14T10:44:51.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 20 add_watcher() i=6 2024-09-14T10:44:51.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94401034874144] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 20 add_watcher() i=7 2024-09-14T10:44:51.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:51.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db7426ac50 con 0x55db74257a00 2024-09-14T10:44:51.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.683+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94401034876784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74268040 con 0x55db74257a00 2024-09-14T10:44:51.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.687+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94401034876784] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.687+0000 7fc42dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:51.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.687+0000 7fc579e619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:51.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.687+0000 7fc579e619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:51.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.687+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db742735a0 con 0x55db74257a00 2024-09-14T10:44:51.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.687+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.687+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74273b90 con 0x7fc568019040 2024-09-14T10:44:51.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.691+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.691+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74273b00 con 0x55db7425dc20 2024-09-14T10:44:51.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.691+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.691+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74273aa0 con 0x55db74257a00 2024-09-14T10:44:51.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.691+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.691+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74273aa0 con 0x7fc56001c030 2024-09-14T10:44:51.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.695+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.695+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db742740f0 con 0x55db7425dc20 2024-09-14T10:44:51.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.695+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.695+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274060 con 0x55db74257a00 2024-09-14T10:44:51.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.699+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.699+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274440 con 0x7fc568019040 2024-09-14T10:44:51.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.699+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'41 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.699+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274190 con 0x7fc56001c030 2024-09-14T10:44:51.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.703+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.703+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274740 con 0x55db7425dc20 2024-09-14T10:44:51.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.703+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.703+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274720 con 0x7fc56001c030 2024-09-14T10:44:51.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.703+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.703+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274c90 con 0x7fc568019040 2024-09-14T10:44:51.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.707+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.707+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274c90 con 0x7fc56001c030 2024-09-14T10:44:51.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.707+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.707+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274f50 con 0x7fc568019040 2024-09-14T10:44:51.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.711+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.711+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274ed0 con 0x55db74257a00 2024-09-14T10:44:51.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.711+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.711+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db7425dc20 2024-09-14T10:44:51.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.715+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.715+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x7fc56001c030 2024-09-14T10:44:51.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.715+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.715+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db7425dc20 2024-09-14T10:44:51.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.719+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.719+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db74257a00 2024-09-14T10:44:51.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.719+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.719+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db74257a00 2024-09-14T10:44:51.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.723+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.723+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db7425dc20 2024-09-14T10:44:51.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.723+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.723+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x7fc56001c030 2024-09-14T10:44:51.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.723+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.727+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db7425dc20 2024-09-14T10:44:51.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.727+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.727+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db7425dc20 2024-09-14T10:44:51.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.727+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.727+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db7425dc20 2024-09-14T10:44:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.731+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.731+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274eb0 con 0x55db7425dc20 2024-09-14T10:44:51.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.731+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.731+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274ef0 con 0x7fc568019040 2024-09-14T10:44:51.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.735+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.735+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274f20 con 0x55db7425dc20 2024-09-14T10:44:51.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.735+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.735+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274f40 con 0x7fc568019040 2024-09-14T10:44:51.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.739+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'42 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.739+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274f00 con 0x55db7425dc20 2024-09-14T10:44:51.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.743+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.743+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274f00 con 0x7fc568019040 2024-09-14T10:44:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.743+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.743+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74274f50 con 0x7fc56001c030 2024-09-14T10:44:51.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc42cfe1640 20 reqs_thread_entry: start 2024-09-14T10:44:51.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:51.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 20 Filter name: none 2024-09-14T10:44:51.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc3a67fc640 20 reqs_thread_entry: start 2024-09-14T10:44:51.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:51.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:51.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db74272f10 con 0x55db74257a00 2024-09-14T10:44:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:51.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.747+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55db74272980 con 0x7fc56001c030 2024-09-14T10:44:51.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.751+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.749 INFO:teuthology.orchestra.run.smithi096.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-14T10:44:51.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.751+0000 7fc42dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:51.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.751+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94401034876784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db7426d820 con 0x55db74257a00 2024-09-14T10:44:51.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.751+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94401034876784] v34'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.751+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94401034853888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267770 con 0x7fc56001c030 2024-09-14T10:44:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.755+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94401034853888] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.755+0000 7fc579e619c0 20 remove_watcher() i=0 2024-09-14T10:44:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.755+0000 7fc579e619c0 2 removed watcher, disabling cache 2024-09-14T10:44:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.755+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94401034858480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267770 con 0x55db74257a00 2024-09-14T10:44:51.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.755+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94401034858480] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.755+0000 7fc579e619c0 20 remove_watcher() i=1 2024-09-14T10:44:51.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.755+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94401034861120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267770 con 0x55db7425dc20 2024-09-14T10:44:51.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.759+0000 7fc577166640 1 -- 172.21.15.96:0/2032311617 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94401034861120] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56005c040 con 0x55db7425dc20 2024-09-14T10:44:51.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.759+0000 7fc579e619c0 20 remove_watcher() i=2 2024-09-14T10:44:51.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.759+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94401034864816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74263a40 con 0x7fc56001c030 2024-09-14T10:44:51.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.759+0000 7fc578168640 1 -- 172.21.15.96:0/2032311617 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94401034864816] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56802f040 con 0x7fc56001c030 2024-09-14T10:44:51.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.759+0000 7fc579e619c0 20 remove_watcher() i=3 2024-09-14T10:44:51.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.759+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94401034866800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267770 con 0x55db74257a00 2024-09-14T10:44:51.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.763+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94401034866800] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x55db74257a00 2024-09-14T10:44:51.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.763+0000 7fc579e619c0 20 remove_watcher() i=4 2024-09-14T10:44:51.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.763+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94401034870592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74265070 con 0x7fc568019040 2024-09-14T10:44:51.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.763+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94401034870592] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.763+0000 7fc579e619c0 20 remove_watcher() i=5 2024-09-14T10:44:51.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.763+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94401034851408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267770 con 0x7fc568019040 2024-09-14T10:44:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94401034851408] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 20 remove_watcher() i=6 2024-09-14T10:44:51.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94401034874144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55db74267770 con 0x7fc568019040 2024-09-14T10:44:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94401034874144] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5700f1040 con 0x7fc568019040 2024-09-14T10:44:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 20 remove_watcher() i=7 2024-09-14T10:44:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc568019040 msgr2=0x7fc568019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc568019040 0x7fc568019930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db74257a00 msgr2=0x55db74259e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db74257a00 0x55db74259e90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc56001c030 msgr2=0x7fc560024720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc56001c030 0x7fc560024720 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55db7425dc20 msgr2=0x55db74260010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55db7425dc20 0x55db74260010 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc44003a150 msgr2=0x7fc44003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc44003a150 0x7fc44003c610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc56800f010 tx=0x7fc56801b070 comp rx=0 tx=0).stop 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc577967640 1 -- 172.21.15.96:0/2032311617 reap_dead start 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 msgr2=0x55db7424c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db7424c430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc56004fd10 tx=0x7fc560050dd0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 shutdown_connections 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 --2- 172.21.15.96:0/2032311617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74245f00 0x55db7424c430 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 >> 172.21.15.96:0/2032311617 conn(0x55db742412c0 msgr2=0x55db7423f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 shutdown_connections 2024-09-14T10:44:51.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.767+0000 7fc579e619c0 1 -- 172.21.15.96:0/2032311617 wait complete. 2024-09-14T10:44:51.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/231725872 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc45003a140 msgr2=0x7fc45003c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/231725872 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc45003a140 0x7fc45003c600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc56800e3f0 tx=0x7fc568003070 comp rx=0 tx=0).stop 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/231725872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74238530 msgr2=0x55db74238950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/231725872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74238530 0x55db74238950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc560010fd0 tx=0x7fc56000f7a0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/231725872 shutdown_connections 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/231725872 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc45003a140 0x7fc45003c600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/231725872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db74238530 0x55db74238950 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/231725872 >> 172.21.15.96:0/231725872 conn(0x55db7422dee0 msgr2=0x55db7422e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/231725872 shutdown_connections 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/231725872 wait complete. 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db740a0630 msgr2=0x55db74227e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db740a0630 0x55db74227e30 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc46003a150 msgr2=0x7fc46003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc46003a150 0x7fc46003c610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc560001ec0 tx=0x7fc560001440 comp rx=0 tx=0).stop 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 msgr2=0x55db74220cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74220cc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc570018cc0 tx=0x7fc570017e30 comp rx=0 tx=0).stop 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 shutdown_connections 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55db740a0630 0x55db74227e30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc46003a150 0x7fc46003c610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 --2- 172.21.15.96:0/4042216314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db740a0250 0x55db74220cc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 >> 172.21.15.96:0/4042216314 conn(0x55db74126970 msgr2=0x55db74213c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 shutdown_connections 2024-09-14T10:44:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.771+0000 7fc579e619c0 1 -- 172.21.15.96:0/4042216314 wait complete. 2024-09-14T10:44:51.781 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-14T10:44:51.794 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-14T10:44:51.801 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:51.852 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:51.870 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:51.914 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-14T10:44:51.926 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:51.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-14T10:44:51.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-14T10:44:51.926 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-14T10:44:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108ce3e9c0 1 Processor -- start 2024-09-14T10:44:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108ce3e9c0 1 -- start start 2024-09-14T10:44:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108ce3e9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5613f9f273b0 0x5613f9f297a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108ce3e9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613f9dc97a0 con 0x5613f9f23260 2024-09-14T10:44:51.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108ce3e9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5613f9e251b0 con 0x5613f9f273b0 2024-09-14T10:44:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108a143640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5613f9f273b0 0x5613f9f297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108a143640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5613f9f273b0 0x5613f9f297a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37900/0 (socket says 172.21.15.96:37900) 2024-09-14T10:44:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108a143640 1 -- 172.21.15.96:0/1299235312 learned_addr learned my addr 172.21.15.96:0/1299235312 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.967+0000 7f108a143640 1 -- 172.21.15.96:0/1299235312 >> v1:172.21.15.70:6789/0 conn(0x5613f9f23260 legacy=0x5613f9f23640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.971+0000 7f108a143640 1 -- 172.21.15.96:0/1299235312 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613f9da3da0 con 0x5613f9f273b0 2024-09-14T10:44:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.971+0000 7f108a143640 1 --2- 172.21.15.96:0/1299235312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f273b0 0x5613f9f297a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f108000a5c0 tx=0x7f108001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3a1b523aca9f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.971+0000 7f1089942640 1 -- 172.21.15.96:0/1299235312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10800a9590 con 0x5613f9f273b0 2024-09-14T10:44:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.971+0000 7f1089942640 1 -- 172.21.15.96:0/1299235312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10800ae070 con 0x5613f9f273b0 2024-09-14T10:44:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.971+0000 7f1089942640 1 -- 172.21.15.96:0/1299235312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10800a9880 con 0x5613f9f273b0 2024-09-14T10:44:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.971+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1299235312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f273b0 msgr2=0x5613f9f297a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.971+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/1299235312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f273b0 0x5613f9f297a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f108000a5c0 tx=0x7f108001b3d0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.975+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1299235312 shutdown_connections 2024-09-14T10:44:51.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.975+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/1299235312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f273b0 0x5613f9f297a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.975+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1299235312 >> 172.21.15.96:0/1299235312 conn(0x5613f9e96b70 msgr2=0x5613f9e96f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.975+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1299235312 shutdown_connections 2024-09-14T10:44:51.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.975+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1299235312 wait complete. 2024-09-14T10:44:51.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.987+0000 7f108ce3e9c0 1 Processor -- start 2024-09-14T10:44:51.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.987+0000 7f108ce3e9c0 1 -- start start 2024-09-14T10:44:51.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa00e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613f9e28fc0 con 0x5613f9f23260 2024-09-14T10:44:51.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108a944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa00e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108a944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa00e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37908/0 (socket says 172.21.15.96:37908) 2024-09-14T10:44:51.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108a944640 1 -- 172.21.15.96:0/4289153172 learned_addr learned my addr 172.21.15.96:0/4289153172 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108a944640 1 -- 172.21.15.96:0/4289153172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613fa00ec00 con 0x5613f9f23260 2024-09-14T10:44:51.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108a944640 1 --2- 172.21.15.96:0/4289153172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa00e610 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1084001690 tx=0x7f1084001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976e325929a0c13f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f0f78e09640 1 -- 172.21.15.96:0/4289153172 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1084016070 con 0x5613f9f23260 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f0f78e09640 1 -- 172.21.15.96:0/4289153172 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108400f640 con 0x5613f9f23260 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f0f78e09640 1 -- 172.21.15.96:0/4289153172 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108400f960 con 0x5613f9f23260 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/4289153172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 msgr2=0x5613fa00e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/4289153172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa00e610 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1084001690 tx=0x7f1084001b50 comp rx=0 tx=0).stop 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/4289153172 shutdown_connections 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/4289153172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa00e610 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/4289153172 >> 172.21.15.96:0/4289153172 conn(0x5613f9e96b70 msgr2=0x5613fa00a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/4289153172 shutdown_connections 2024-09-14T10:44:51.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/4289153172 wait complete. 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 Processor -- start 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 -- start start 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa015f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108ce3e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613f9dcaa50 con 0x5613f9f23260 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108a944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa015f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108a944640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa015f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37912/0 (socket says 172.21.15.96:37912) 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.991+0000 7f108a944640 1 -- 172.21.15.96:0/967414499 learned_addr learned my addr 172.21.15.96:0/967414499 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108a944640 1 -- 172.21.15.96:0/967414499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613fa016470 con 0x5613f9f23260 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108a944640 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa015f10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x5613fa00f5d0 tx=0x7f1084001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f0f77606640 1 -- 172.21.15.96:0/967414499 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1084021020 con 0x5613f9f23260 2024-09-14T10:44:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f0f77606640 1 -- 172.21.15.96:0/967414499 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10840115f0 con 0x5613f9f23260 2024-09-14T10:44:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613fa016700 con 0x5613f9f23260 2024-09-14T10:44:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f0f77606640 1 -- 172.21.15.96:0/967414499 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1084016040 con 0x5613f9f23260 2024-09-14T10:44:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613fa0170b0 con 0x5613f9f23260 2024-09-14T10:44:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f0f77606640 1 -- 172.21.15.96:0/967414499 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1084024020 con 0x5613f9f23260 2024-09-14T10:44:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f0f77606640 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f7003a150 0x7f0f7003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f0f77606640 1 -- 172.21.15.96:0/967414499 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1084050600 con 0x5613f9f23260 2024-09-14T10:44:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108a143640 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f7003a150 0x7f0f7003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613f9f273b0 0x5613fa01d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa01d5c0 con 0x5613f9f273b0 2024-09-14T10:44:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108b145640 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613f9f273b0 0x5613fa01d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108a143640 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f7003a150 0x7f0f7003c610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f10800ad000 tx=0x7f10800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108b145640 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613f9f273b0 0x5613fa01d080 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108b145640 1 -- 172.21.15.96:0/967414499 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f107c0083f0 con 0x5613f9f273b0 2024-09-14T10:44:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa01d9f0 con 0x5613f9f273b0 2024-09-14T10:44:51.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108b145640 1 -- 172.21.15.96:0/967414499 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f107c0083f0 con 0x5613f9f273b0 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.995+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa01f2f0 con 0x5613f9f273b0 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108b145640 1 -- 172.21.15.96:0/967414499 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f107c0083f0 con 0x5613f9f273b0 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa01e520 con 0x5613f9f273b0 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108b145640 1 -- 172.21.15.96:0/967414499 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f107c0083f0 con 0x5613f9f273b0 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa01e940 con 0x5613f9f273b0 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108b145640 1 -- 172.21.15.96:0/967414499 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f107c0083f0 con 0x5613f9f273b0 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108ce3e9c0 1 Processor -- start 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108ce3e9c0 1 -- start start 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108ce3e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa02d6e0 0x5613fa02db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:51.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108ce3e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613f9e35d80 con 0x5613fa02d6e0 2024-09-14T10:44:51.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108a143640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa02d6e0 0x5613fa02db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:51.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108a143640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa02d6e0 0x5613fa02db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37922/0 (socket says 172.21.15.96:37922) 2024-09-14T10:44:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108a143640 1 -- 172.21.15.96:0/1507170613 learned_addr learned my addr 172.21.15.96:0/1507170613 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108a143640 1 -- 172.21.15.96:0/1507170613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613fa02e140 con 0x5613fa02d6e0 2024-09-14T10:44:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108a143640 1 --2- 172.21.15.96:0/1507170613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa02d6e0 0x5613fa02db00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f10800ab040 tx=0x7f1080018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f0f74e01640 1 -- 172.21.15.96:0/1507170613 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10800b3ba0 con 0x5613fa02d6e0 2024-09-14T10:44:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f0f74e01640 1 -- 172.21.15.96:0/1507170613 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10800b3d40 con 0x5613fa02d6e0 2024-09-14T10:44:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1507170613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613fa02e9a0 con 0x5613fa02d6e0 2024-09-14T10:44:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f0f74e01640 1 -- 172.21.15.96:0/1507170613 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10800c8580 con 0x5613fa02d6e0 2024-09-14T10:44:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:51.999+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1507170613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613fa02eeb0 con 0x5613fa02d6e0 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f0f74e01640 1 -- 172.21.15.96:0/1507170613 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f10800d1440 con 0x5613fa02d6e0 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f0f74e01640 1 --2- 172.21.15.96:0/1507170613 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f6403a150 0x7f0f6403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f0f74e01640 1 -- 172.21.15.96:0/1507170613 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f10800ee710 con 0x5613fa02d6e0 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108b145640 1 --2- 172.21.15.96:0/1507170613 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f6403a150 0x7f0f6403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 Processor -- start 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 -- start start 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108b145640 1 --2- 172.21.15.96:0/1507170613 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f6403a150 0x7f0f6403c610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5613fa01e8c0 tx=0x7f107c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa03b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613fa00f030 con 0x5613fa03af90 2024-09-14T10:44:52.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108a143640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa03b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108a143640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa03b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37936/0 (socket says 172.21.15.96:37936) 2024-09-14T10:44:52.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108a143640 1 -- 172.21.15.96:0/2373224565 learned_addr learned my addr 172.21.15.96:0/2373224565 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108a143640 1 -- 172.21.15.96:0/2373224565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613fa03b960 con 0x5613fa03af90 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108a143640 1 --2- 172.21.15.96:0/2373224565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa03b370 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f10800c7660 tx=0x7f10800c78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f3c3cbffa8a839 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f0f6e7fc640 1 -- 172.21.15.96:0/2373224565 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10800be540 con 0x5613fa03af90 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f0f6e7fc640 1 -- 172.21.15.96:0/2373224565 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10800bc3b0 con 0x5613fa03af90 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f0f6e7fc640 1 -- 172.21.15.96:0/2373224565 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10800bcca0 con 0x5613fa03af90 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/2373224565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 msgr2=0x5613fa03b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/2373224565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa03b370 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f10800c7660 tx=0x7f10800c78c0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/2373224565 shutdown_connections 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/2373224565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa03b370 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/2373224565 >> 172.21.15.96:0/2373224565 conn(0x5613fa036350 msgr2=0x5613fa034590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/2373224565 shutdown_connections 2024-09-14T10:44:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.003+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/2373224565 wait complete. 2024-09-14T10:44:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108ce3e9c0 1 Processor -- start 2024-09-14T10:44:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108ce3e9c0 1 -- start start 2024-09-14T10:44:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108ce3e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa0414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108ce3e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613fa039e80 con 0x5613fa03af90 2024-09-14T10:44:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108a143640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa0414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108a143640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa0414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37950/0 (socket says 172.21.15.96:37950) 2024-09-14T10:44:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 learned_addr learned my addr 172.21.15.96:0/3793173459 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613fa041a20 con 0x5613fa03af90 2024-09-14T10:44:52.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108a143640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa0414c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f10800bcc30 tx=0x7f10800ec970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f0f6cff9640 1 -- 172.21.15.96:0/3793173459 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10800f3070 con 0x5613fa03af90 2024-09-14T10:44:52.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613fa041cb0 con 0x5613fa03af90 2024-09-14T10:44:52.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f0f6cff9640 1 -- 172.21.15.96:0/3793173459 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10800e4040 con 0x5613fa03af90 2024-09-14T10:44:52.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f0f6cff9640 1 -- 172.21.15.96:0/3793173459 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10800a8a60 con 0x5613fa03af90 2024-09-14T10:44:52.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613fa042660 con 0x5613fa03af90 2024-09-14T10:44:52.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f0f6cff9640 1 -- 172.21.15.96:0/3793173459 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f10800f6070 con 0x5613fa03af90 2024-09-14T10:44:52.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f0f6cff9640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f5403a150 0x7f0f5403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f0f6cff9640 1 -- 172.21.15.96:0/3793173459 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f10800f9d60 con 0x5613fa03af90 2024-09-14T10:44:52.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.007+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613fa04c9f0 0x5613fa04eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa04f600 con 0x5613fa04c9f0 2024-09-14T10:44:52.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a944640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613fa04c9f0 0x5613fa04eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a944640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613fa04c9f0 0x5613fa04eeb0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 realm 2024-09-14T10:44:52.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa04fa10 con 0x5613fa04c9f0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa0502e0 con 0x5613fa04c9f0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa050680 con 0x5613fa04c9f0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa050ed0 con 0x5613fa04c9f0 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 20 searching for the correct realm 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613fa052c40 0x5613fa055030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a143640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613fa052c40 0x5613fa055030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a143640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613fa052c40 0x5613fa055030 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10800f5030 con 0x5613fa052c40 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a143640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f10800f8060 0x7f10800eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f10800f8060 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108b145640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f10800f8060 0x7f10800eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108b145640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f10800f8060 0x7f10800eda20 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c022040 con 0x7f10800f8060 2024-09-14T10:44:52.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108b145640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f107c019040 0x7f107c028960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.011+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f107c019040 2024-09-14T10:44:52.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f107c019040 0x7f107c028960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f107c019040 0x7f107c028960 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa04c9f0 2024-09-14T10:44:52.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa04c9f0 2024-09-14T10:44:52.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f107c019040 2024-09-14T10:44:52.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f107c019040 2024-09-14T10:44:52.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f10800f8060 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c022040 con 0x7f10800f8060 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.015+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa04c9f0 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f107c019040 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa04c9f0 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f10800f8060 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f107c022040 con 0x7f10800f8060 2024-09-14T10:44:52.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f107c019040 2024-09-14T10:44:52.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa04c9f0 2024-09-14T10:44:52.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.019+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa04c9f0 2024-09-14T10:44:52.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f107c019040 2024-09-14T10:44:52.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f10800f8060 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c022040 con 0x7f10800f8060 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa04c9f0 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f10800f8060 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c022040 con 0x7f10800f8060 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f107c019040 2024-09-14T10:44:52.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f10800f8060 2024-09-14T10:44:52.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa052c40 2024-09-14T10:44:52.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.023+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f107c019040 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x5613fa04c9f0 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055610 con 0x7f10800f8060 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:52.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa051850 con 0x5613fa04c9f0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa0520f0 con 0x5613fa04c9f0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055a90 con 0x5613fa04c9f0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 zone default found 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 4 Realm: () 2024-09-14T10:44:52.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 zonegroup default 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa055a90 con 0x7f10800f8060 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa0578d0 con 0x5613fa052c40 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa057f40 con 0x5613fa052c40 2024-09-14T10:44:52.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 started sync module instance, tier type = 2024-09-14T10:44:52.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:52.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.027+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa056d40 con 0x7f10800f8060 2024-09-14T10:44:52.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108b145640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f5403a150 0x7f0f5403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108b145640 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f5403a150 0x7f0f5403c610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5613fa050b70 tx=0x7f107c01b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94643799028016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa056d40 con 0x7f10800f8060 2024-09-14T10:44:52.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa0589c0 con 0x5613fa04c9f0 2024-09-14T10:44:52.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94643799028016] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94643799026112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa0589c0 con 0x5613fa04c9f0 2024-09-14T10:44:52.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.031+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa059380 con 0x5613fa052c40 2024-09-14T10:44:52.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.035+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94643799026112] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.035+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.035+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94643799033104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa058930 con 0x5613fa052c40 2024-09-14T10:44:52.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.035+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05a080 con 0x7f10800f8060 2024-09-14T10:44:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.035+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.035+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94643799039232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05a920 con 0x7f10800f8060 2024-09-14T10:44:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.035+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05b340 con 0x5613fa04c9f0 2024-09-14T10:44:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.035+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94643799033104] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.039+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94643799039232] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.039+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.039+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94643799043632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05a470 con 0x5613fa04c9f0 2024-09-14T10:44:52.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.039+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05bbe0 con 0x7f107c019040 2024-09-14T10:44:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.039+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94643799043632] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.039+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.039+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94643799037728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05a470 con 0x7f107c019040 2024-09-14T10:44:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.039+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05c070 con 0x7f107c019040 2024-09-14T10:44:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94643799037728] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94643799047008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05c030 con 0x7f107c019040 2024-09-14T10:44:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05ca50 con 0x7f107c019040 2024-09-14T10:44:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94643799047008] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94643799049536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05ca10 con 0x7f107c019040 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 20 add_watcher() i=0 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 20 add_watcher() i=1 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 20 add_watcher() i=2 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 20 add_watcher() i=3 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 20 add_watcher() i=4 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 20 add_watcher() i=5 2024-09-14T10:44:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.043+0000 7f108ce3e9c0 20 add_watcher() i=6 2024-09-14T10:44:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94643799049536] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108ce3e9c0 20 add_watcher() i=7 2024-09-14T10:44:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108ce3e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05fe40 con 0x5613fa04c9f0 2024-09-14T10:44:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94643799045360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa05d390 con 0x5613fa04c9f0 2024-09-14T10:44:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94643799045360] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f0f417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108ce3e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108ce3e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:52.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108ce3e9c0 5 note: GC not initialized 2024-09-14T10:44:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f0ebbfff640 20 reqs_thread_entry: start 2024-09-14T10:44:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.047+0000 7f108ce3e9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 20 Filter name: none 2024-09-14T10:44:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f0eb9ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa083af0 con 0x7f10800f8060 2024-09-14T10:44:52.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 : miss 2024-09-14T10:44:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.d 8:b6fbf1ae:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa085700 con 0x7f10800f8060 2024-09-14T10:44:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(63 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 info.flags=0x17 2024-09-14T10:44:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 to cache LRU end 2024-09-14T10:44:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 2024-09-14T10:44:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 20 get_obj_state: octx=0x7f1084040040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5613fa087e08 s->prefetch_data=0 2024-09-14T10:44:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 3.3s0 3:c1a3e7f4:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5613fa08a420 con 0x7f10800f8060 2024-09-14T10:44:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(64 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 304+0+889 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 10 manifest: total_size = 5 2024-09-14T10:44:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 20 get_obj_state: setting s->obj_tag to _SNOhd2X78Y_7CZZHmCjbyKAXCeYu15y 2024-09-14T10:44:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f0f417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.051+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94643799045360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa08a420 con 0x5613fa04c9f0 2024-09-14T10:44:52.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94643799045360] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94643799028016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa08a420 con 0x7f10800f8060 2024-09-14T10:44:52.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94643799028016] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108ce3e9c0 20 remove_watcher() i=0 2024-09-14T10:44:52.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108ce3e9c0 2 removed watcher, disabling cache 2024-09-14T10:44:52.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94643799026112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa08a420 con 0x5613fa04c9f0 2024-09-14T10:44:52.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94643799026112] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108ce3e9c0 20 remove_watcher() i=1 2024-09-14T10:44:52.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.055+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94643799033104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa08a420 con 0x5613fa052c40 2024-09-14T10:44:52.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.059+0000 7f108a143640 1 -- 172.21.15.96:0/3793173459 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94643799033104] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1080107040 con 0x5613fa052c40 2024-09-14T10:44:52.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.059+0000 7f108ce3e9c0 20 remove_watcher() i=2 2024-09-14T10:44:52.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.059+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94643799039232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa084fb0 con 0x7f10800f8060 2024-09-14T10:44:52.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.059+0000 7f108b145640 1 -- 172.21.15.96:0/3793173459 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94643799039232] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f107c035040 con 0x7f10800f8060 2024-09-14T10:44:52.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.059+0000 7f108ce3e9c0 20 remove_watcher() i=3 2024-09-14T10:44:52.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.059+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94643799043632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa084fb0 con 0x5613fa04c9f0 2024-09-14T10:44:52.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.063+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94643799043632] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x5613fa04c9f0 2024-09-14T10:44:52.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.063+0000 7f108ce3e9c0 20 remove_watcher() i=4 2024-09-14T10:44:52.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.063+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94643799037728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa084fb0 con 0x7f107c019040 2024-09-14T10:44:52.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.063+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94643799037728] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.063+0000 7f108ce3e9c0 20 remove_watcher() i=5 2024-09-14T10:44:52.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.063+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94643799047008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa084fb0 con 0x7f107c019040 2024-09-14T10:44:52.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94643799047008] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 20 remove_watcher() i=6 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94643799049536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5613fa084fb0 con 0x7f107c019040 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94643799049536] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108400f070 con 0x7f107c019040 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 20 remove_watcher() i=7 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f107c019040 msgr2=0x7f107c028960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f107c019040 0x7f107c028960 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613fa04c9f0 msgr2=0x5613fa04eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613fa04c9f0 0x5613fa04eeb0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f10800f8060 msgr2=0x7f10800eda20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f10800f8060 0x7f10800eda20 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613fa052c40 msgr2=0x5613fa055030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5613fa052c40 0x5613fa055030 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f5403a150 msgr2=0x7f0f5403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f5403a150 0x7f0f5403c610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5613fa050b70 tx=0x7f107c01b000 comp rx=0 tx=0).stop 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108a944640 1 -- 172.21.15.96:0/3793173459 reap_dead start 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 msgr2=0x5613fa0414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa0414c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f10800bcc30 tx=0x7f10800ec970 comp rx=0 tx=0).stop 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 shutdown_connections 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/3793173459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa03af90 0x5613fa0414c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 >> 172.21.15.96:0/3793173459 conn(0x5613fa036350 msgr2=0x5613fa034560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 shutdown_connections 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.067+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/3793173459 wait complete. 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1507170613 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f6403a150 msgr2=0x7f0f6403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/1507170613 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f6403a150 0x7f0f6403c610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5613fa01e8c0 tx=0x7f107c003070 comp rx=0 tx=0).stop 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1507170613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa02d6e0 msgr2=0x5613fa02db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/1507170613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa02d6e0 0x5613fa02db00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f10800ab040 tx=0x7f1080018170 comp rx=0 tx=0).stop 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1507170613 shutdown_connections 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/1507170613 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f6403a150 0x7f0f6403c610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/1507170613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613fa02d6e0 0x5613fa02db00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1507170613 >> 172.21.15.96:0/1507170613 conn(0x5613fa023090 msgr2=0x5613fa023470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1507170613 shutdown_connections 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/1507170613 wait complete. 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613f9f273b0 msgr2=0x5613fa01d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613f9f273b0 0x5613fa01d080 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f7003a150 msgr2=0x7f0f7003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f7003a150 0x7f0f7003c610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f10800ad000 tx=0x7f10800a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:52.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 msgr2=0x5613fa015f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa015f10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x5613fa00f5d0 tx=0x7f1084001260 comp rx=0 tx=0).stop 2024-09-14T10:44:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 shutdown_connections 2024-09-14T10:44:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5613f9f273b0 0x5613fa01d080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0f7003a150 0x7f0f7003c610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 --2- 172.21.15.96:0/967414499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613f9f23260 0x5613fa015f10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 >> 172.21.15.96:0/967414499 conn(0x5613f9e96b70 msgr2=0x5613fa00fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 shutdown_connections 2024-09-14T10:44:52.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.071+0000 7f108ce3e9c0 1 -- 172.21.15.96:0/967414499 wait complete. 2024-09-14T10:44:52.080 INFO:teuthology.orchestra.run.smithi096.stdout:fooFoofooFooFULL_CONTROL 2024-09-14T10:44:52.080 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-14T10:44:52.082 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-14T10:44:52.090 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:52.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-14T10:44:52.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-14T10:44:52.090 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-14T10:44:52.160 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:52.160 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:52.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39f0a7e9c0 1 Processor -- start 2024-09-14T10:44:52.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39f0a7e9c0 1 -- start start 2024-09-14T10:44:52.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39f0a7e9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555a179b62e0 0x555a179b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39f0a7e9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a178e87a0 con 0x555a179b4cd0 2024-09-14T10:44:52.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39f0a7e9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x555a179441b0 con 0x555a179b62e0 2024-09-14T10:44:52.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39ee584640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555a179b62e0 0x555a179b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39ee584640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555a179b62e0 0x555a179b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37952/0 (socket says 172.21.15.96:37952) 2024-09-14T10:44:52.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39edd83640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x555a179b4cd0 0x555a179b50e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:39214/0 (socket says 172.21.15.96:39214) 2024-09-14T10:44:52.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39ee584640 1 -- 172.21.15.96:0/3657902372 learned_addr learned my addr 172.21.15.96:0/3657902372 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39ee584640 1 -- 172.21.15.96:0/3657902372 >> v1:172.21.15.70:6789/0 conn(0x555a179b4cd0 legacy=0x555a179b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.163+0000 7f39ee584640 1 -- 172.21.15.96:0/3657902372 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a178c2da0 con 0x555a179b62e0 2024-09-14T10:44:52.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39ee584640 1 --2- 172.21.15.96:0/3657902372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b62e0 0x555a179b66c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f39e000a5c0 tx=0x7f39e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148cadededab6787 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39ed582640 1 -- 172.21.15.96:0/3657902372 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e00a6070 con 0x555a179b62e0 2024-09-14T10:44:52.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39ed582640 1 -- 172.21.15.96:0/3657902372 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e00af070 con 0x555a179b62e0 2024-09-14T10:44:52.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39ed582640 1 -- 172.21.15.96:0/3657902372 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e00aa5c0 con 0x555a179b62e0 2024-09-14T10:44:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/3657902372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b62e0 msgr2=0x555a179b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/3657902372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b62e0 0x555a179b66c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f39e000a5c0 tx=0x7f39e001b340 comp rx=0 tx=0).stop 2024-09-14T10:44:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/3657902372 shutdown_connections 2024-09-14T10:44:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/3657902372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b62e0 0x555a179b66c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/3657902372 >> 172.21.15.96:0/3657902372 conn(0x555a17a3bb00 msgr2=0x555a17a3df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/3657902372 shutdown_connections 2024-09-14T10:44:52.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.167+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/3657902372 wait complete. 2024-09-14T10:44:52.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 Processor -- start 2024-09-14T10:44:52.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 -- start start 2024-09-14T10:44:52.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b2d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a17947fc0 con 0x555a179b4cd0 2024-09-14T10:44:52.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39ee584640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b2d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39ee584640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b2d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37958/0 (socket says 172.21.15.96:37958) 2024-09-14T10:44:52.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39ee584640 1 -- 172.21.15.96:0/40708684 learned_addr learned my addr 172.21.15.96:0/40708684 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39ee584640 1 -- 172.21.15.96:0/40708684 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a17b2ded0 con 0x555a179b4cd0 2024-09-14T10:44:52.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39ee584640 1 --2- 172.21.15.96:0/40708684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b2d8e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f39e00ac040 tx=0x7f39e0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81bdb11992aa54f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f38dc608640 1 -- 172.21.15.96:0/40708684 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e00aa970 con 0x555a179b4cd0 2024-09-14T10:44:52.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f38dc608640 1 -- 172.21.15.96:0/40708684 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e00aab10 con 0x555a179b4cd0 2024-09-14T10:44:52.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f38dc608640 1 -- 172.21.15.96:0/40708684 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e00aae30 con 0x555a179b4cd0 2024-09-14T10:44:52.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/40708684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 msgr2=0x555a17b2d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/40708684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b2d8e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f39e00ac040 tx=0x7f39e0003030 comp rx=0 tx=0).stop 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/40708684 shutdown_connections 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/40708684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b2d8e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/40708684 >> 172.21.15.96:0/40708684 conn(0x555a17a3bb00 msgr2=0x555a17b294f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/40708684 shutdown_connections 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.183+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/40708684 wait complete. 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39f0a7e9c0 1 Processor -- start 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39f0a7e9c0 1 -- start start 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39f0a7e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b35070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39f0a7e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a178e9a50 con 0x555a179b4cd0 2024-09-14T10:44:52.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39ee584640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b35070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39ee584640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b35070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37968/0 (socket says 172.21.15.96:37968) 2024-09-14T10:44:52.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39ee584640 1 -- 172.21.15.96:0/1511929082 learned_addr learned my addr 172.21.15.96:0/1511929082 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39ee584640 1 -- 172.21.15.96:0/1511929082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a17b355d0 con 0x555a179b4cd0 2024-09-14T10:44:52.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39ee584640 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b35070 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f39e001b170 tx=0x7f39e00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f38dae05640 1 -- 172.21.15.96:0/1511929082 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e00c6480 con 0x555a179b4cd0 2024-09-14T10:44:52.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a17b35860 con 0x555a179b4cd0 2024-09-14T10:44:52.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f38dae05640 1 -- 172.21.15.96:0/1511929082 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e00cc070 con 0x555a179b4cd0 2024-09-14T10:44:52.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f38dae05640 1 -- 172.21.15.96:0/1511929082 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e00c6790 con 0x555a179b4cd0 2024-09-14T10:44:52.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a17b36210 con 0x555a179b4cd0 2024-09-14T10:44:52.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f38dae05640 1 -- 172.21.15.96:0/1511929082 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f39e00c6a00 con 0x555a179b4cd0 2024-09-14T10:44:52.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f38dae05640 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38d403a1a0 0x7f38d403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f38dae05640 1 -- 172.21.15.96:0/1511929082 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39e00ec680 con 0x555a179b4cd0 2024-09-14T10:44:52.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39edd83640 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38d403a1a0 0x7f38d403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a179b62e0 0x555a17b3c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b3c720 con 0x555a179b62e0 2024-09-14T10:44:52.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.187+0000 7f39eed85640 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a179b62e0 0x555a17b3c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39edd83640 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38d403a1a0 0x7f38d403c660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39e4001e40 tx=0x7f39e40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39eed85640 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a179b62e0 0x555a17b3c1e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39eed85640 1 -- 172.21.15.96:0/1511929082 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e800a4d0 con 0x555a179b62e0 2024-09-14T10:44:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b3cb90 con 0x555a179b62e0 2024-09-14T10:44:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39eed85640 1 -- 172.21.15.96:0/1511929082 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39e800a4d0 con 0x555a179b62e0 2024-09-14T10:44:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b3e490 con 0x555a179b62e0 2024-09-14T10:44:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39eed85640 1 -- 172.21.15.96:0/1511929082 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39e800a4d0 con 0x555a179b62e0 2024-09-14T10:44:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b3d6c0 con 0x555a179b62e0 2024-09-14T10:44:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39eed85640 1 -- 172.21.15.96:0/1511929082 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39e800a4d0 con 0x555a179b62e0 2024-09-14T10:44:52.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b3db10 con 0x555a179b62e0 2024-09-14T10:44:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39eed85640 1 -- 172.21.15.96:0/1511929082 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f39e800a4d0 con 0x555a179b62e0 2024-09-14T10:44:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39f0a7e9c0 1 Processor -- start 2024-09-14T10:44:52.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39f0a7e9c0 1 -- start start 2024-09-14T10:44:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39f0a7e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b4c820 0x555a17b4cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39f0a7e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a17954d80 con 0x555a17b4c820 2024-09-14T10:44:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39edd83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b4c820 0x555a17b4cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39edd83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b4c820 0x555a17b4cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37970/0 (socket says 172.21.15.96:37970) 2024-09-14T10:44:52.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39edd83640 1 -- 172.21.15.96:0/2112380110 learned_addr learned my addr 172.21.15.96:0/2112380110 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.191+0000 7f39edd83640 1 -- 172.21.15.96:0/2112380110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a17b4d280 con 0x555a17b4c820 2024-09-14T10:44:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39edd83640 1 --2- 172.21.15.96:0/2112380110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b4c820 0x555a17b4cc40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f39e400e670 tx=0x7f39e400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f38d3fff640 1 -- 172.21.15.96:0/2112380110 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e4022070 con 0x555a17b4c820 2024-09-14T10:44:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/2112380110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a17b4dae0 con 0x555a17b4c820 2024-09-14T10:44:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f38d3fff640 1 -- 172.21.15.96:0/2112380110 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e400d660 con 0x555a17b4c820 2024-09-14T10:44:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f38d3fff640 1 -- 172.21.15.96:0/2112380110 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e4006070 con 0x555a17b4c820 2024-09-14T10:44:52.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/2112380110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a17b4e050 con 0x555a17b4c820 2024-09-14T10:44:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f38d3fff640 1 -- 172.21.15.96:0/2112380110 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f39e4025070 con 0x555a17b4c820 2024-09-14T10:44:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f38d3fff640 1 --2- 172.21.15.96:0/2112380110 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38c803a150 0x7f38c803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f38d3fff640 1 -- 172.21.15.96:0/2112380110 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39e4052440 con 0x555a17b4c820 2024-09-14T10:44:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39eed85640 1 --2- 172.21.15.96:0/2112380110 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38c803a150 0x7f38c803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39f0a7e9c0 1 Processor -- start 2024-09-14T10:44:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39f0a7e9c0 1 -- start start 2024-09-14T10:44:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39eed85640 1 --2- 172.21.15.96:0/2112380110 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38c803a150 0x7f38c803c610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x555a17b3d1e0 tx=0x7f39e8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39f0a7e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b59560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39f0a7e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a17b2e240 con 0x555a17b59180 2024-09-14T10:44:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39edd83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b59560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39edd83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b59560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37986/0 (socket says 172.21.15.96:37986) 2024-09-14T10:44:52.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39edd83640 1 -- 172.21.15.96:0/222735054 learned_addr learned my addr 172.21.15.96:0/222735054 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.195+0000 7f39edd83640 1 -- 172.21.15.96:0/222735054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a17b59b30 con 0x555a17b59180 2024-09-14T10:44:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39edd83640 1 --2- 172.21.15.96:0/222735054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b59560 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f39e40507c0 tx=0x7f39e4024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124897aeee9ab9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f38d1ffb640 1 -- 172.21.15.96:0/222735054 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e400dcc0 con 0x555a17b59180 2024-09-14T10:44:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f38d1ffb640 1 -- 172.21.15.96:0/222735054 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e404f220 con 0x555a17b59180 2024-09-14T10:44:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f38d1ffb640 1 -- 172.21.15.96:0/222735054 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e400de60 con 0x555a17b59180 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/222735054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 msgr2=0x555a17b59560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/222735054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b59560 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f39e40507c0 tx=0x7f39e4024c90 comp rx=0 tx=0).stop 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/222735054 shutdown_connections 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/222735054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b59560 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/222735054 >> 172.21.15.96:0/222735054 conn(0x555a17b555b0 msgr2=0x555a17b537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/222735054 shutdown_connections 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/222735054 wait complete. 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 Processor -- start 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- start start 2024-09-14T10:44:52.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b60790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a17b5a190 con 0x555a17b59180 2024-09-14T10:44:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39edd83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b60790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39edd83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b60790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38000/0 (socket says 172.21.15.96:38000) 2024-09-14T10:44:52.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 learned_addr learned my addr 172.21.15.96:0/1424476618 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a17b60cf0 con 0x555a17b59180 2024-09-14T10:44:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39edd83640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b60790 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f39e4024d20 tx=0x7f39e4050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f38bffff640 1 -- 172.21.15.96:0/1424476618 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e4025c80 con 0x555a17b59180 2024-09-14T10:44:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a17b60f80 con 0x555a17b59180 2024-09-14T10:44:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f38bffff640 1 -- 172.21.15.96:0/1424476618 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e4025e20 con 0x555a17b59180 2024-09-14T10:44:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f38bffff640 1 -- 172.21.15.96:0/1424476618 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39e401a450 con 0x555a17b59180 2024-09-14T10:44:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.199+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a17b60f80 con 0x555a17b59180 2024-09-14T10:44:52.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f38bffff640 1 -- 172.21.15.96:0/1424476618 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f39e4033070 con 0x555a17b59180 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f38bffff640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38b803a1a0 0x7f38b803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f38bffff640 1 -- 172.21.15.96:0/1424476618 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39e4045070 con 0x555a17b59180 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39eed85640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38b803a1a0 0x7f38b803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a17b6bab0 0x555a17b6df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b6e690 con 0x555a17b6bab0 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39ee584640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a17b6bab0 0x555a17b6df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39eed85640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38b803a1a0 0x7f38b803c660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x555a17b36670 tx=0x7f39e801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39ee584640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a17b6bab0 0x555a17b6df40 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 realm 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b6eaf0 con 0x555a17b6bab0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b6f3c0 con 0x555a17b6bab0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b6f760 con 0x555a17b6bab0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b6ffb0 con 0x555a17b6bab0 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 20 searching for the correct realm 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a17b71d20 0x555a17b74110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x555a17b71d20 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39edd83640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a17b71d20 0x555a17b74110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.203+0000 7f39edd83640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a17b71d20 0x555a17b74110 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e403c070 con 0x555a17b71d20 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39edd83640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39e4035070 0x7f39e40527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x7f39e4035070 2024-09-14T10:44:52.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39eed85640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39e4035070 0x7f39e40527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39eed85640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39e4035070 0x7f39e40527e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e801f070 con 0x7f39e4035070 2024-09-14T10:44:52.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39eed85640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39e8031040 0x7f39e8032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x7f39e8031040 2024-09-14T10:44:52.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39e8031040 0x7f39e8032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39e8031040 0x7f39e8032430 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x555a17b6bab0 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x555a17b6bab0 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x7f39e8031040 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.207+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x7f39e8031040 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x7f39e4035070 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e801f070 con 0x7f39e4035070 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x555a17b71d20 2024-09-14T10:44:52.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e403c070 con 0x555a17b71d20 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x555a17b6bab0 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x7f39e8031040 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a17b74740 con 0x555a17b6bab0 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e4035070 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f39e801f070 con 0x7f39e4035070 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b71d20 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b71d20 2024-09-14T10:44:52.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e8031040 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b71d20 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.211+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b71d20 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b6bab0 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b6bab0 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e8031040 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b71d20 2024-09-14T10:44:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e4035070 2024-09-14T10:44:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e801f070 con 0x7f39e4035070 2024-09-14T10:44:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b6bab0 2024-09-14T10:44:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e4035070 2024-09-14T10:44:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e801f070 con 0x7f39e4035070 2024-09-14T10:44:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b71d20 2024-09-14T10:44:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.215+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e8031040 2024-09-14T10:44:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e4035070 2024-09-14T10:44:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e801f070 con 0x7f39e4035070 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b71d20 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e8031040 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x555a17b6bab0 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f39e00e9040 con 0x7f39e4035070 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:52.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b70800 con 0x555a17b6bab0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b70bf0 con 0x555a17b6bab0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b70bf0 con 0x555a17b6bab0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:52.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 zone default found 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 4 Realm: () 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 zonegroup default 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b71110 con 0x7f39e4035070 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b766f0 con 0x555a17b71d20 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b76c00 con 0x555a17b71d20 2024-09-14T10:44:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 started sync module instance, tier type = 2024-09-14T10:44:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:52.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.219+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b75a30 con 0x7f39e4035070 2024-09-14T10:44:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.223+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.223+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93845433311056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b75a30 con 0x7f39e4035070 2024-09-14T10:44:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.223+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b776c0 con 0x555a17b6bab0 2024-09-14T10:44:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.223+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93845433311056] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.223+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.223+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93845433315792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b75a30 con 0x555a17b6bab0 2024-09-14T10:44:52.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.223+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b780d0 con 0x555a17b71d20 2024-09-14T10:44:52.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.227+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.227+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93845433318432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b78920 con 0x555a17b71d20 2024-09-14T10:44:52.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.227+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b79320 con 0x7f39e4035070 2024-09-14T10:44:52.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.227+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93845433315792] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.227+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.227+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93845433308544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b79710 con 0x7f39e4035070 2024-09-14T10:44:52.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.227+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7a0d0 con 0x555a17b6bab0 2024-09-14T10:44:52.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.227+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93845433318432] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.231+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93845433308544] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.231+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.231+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93845433323056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b79c20 con 0x555a17b6bab0 2024-09-14T10:44:52.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.231+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7a4d0 con 0x7f39e8031040 2024-09-14T10:44:52.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.231+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93845433323056] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.231+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.231+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93845433320560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7a0d0 con 0x7f39e8031040 2024-09-14T10:44:52.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.231+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7ae10 con 0x7f39e8031040 2024-09-14T10:44:52.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93845433329856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7b280 con 0x7f39e8031040 2024-09-14T10:44:52.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7bd60 con 0x7f39e8031040 2024-09-14T10:44:52.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93845433320560] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93845433329856] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93845433333872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7bd60 con 0x7f39e8031040 2024-09-14T10:44:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 20 add_watcher() i=0 2024-09-14T10:44:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 20 add_watcher() i=1 2024-09-14T10:44:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 20 add_watcher() i=2 2024-09-14T10:44:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 20 add_watcher() i=3 2024-09-14T10:44:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 20 add_watcher() i=4 2024-09-14T10:44:52.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 20 add_watcher() i=5 2024-09-14T10:44:52.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.235+0000 7f39f0a7e9c0 20 add_watcher() i=6 2024-09-14T10:44:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93845433333872] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39f0a7e9c0 20 add_watcher() i=7 2024-09-14T10:44:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39f0a7e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7ed90 con 0x555a17b6bab0 2024-09-14T10:44:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93845433326624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b7c210 con 0x555a17b6bab0 2024-09-14T10:44:52.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93845433326624] v34'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f38a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39f0a7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39f0a7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.239+0000 7f39f0a7e9c0 5 note: GC not initialized 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f381f7fe640 20 reqs_thread_entry: start 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 20 Filter name: none 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f381d7fa640 20 reqs_thread_entry: start 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17ba2890 con 0x7f39e4035070 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 : miss 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.d 8:b6fbf1ae:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17ba4450 con 0x7f39e4035070 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(63 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 info.flags=0x17 2024-09-14T10:44:52.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 to cache LRU end 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 20 get_obj_state: octx=0x7f39e0005a50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555a17ba6b58 s->prefetch_data=0 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 3.3s0 3:c1a3e7f4:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a17ba9060 con 0x7f39e4035070 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(64 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+951 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 10 manifest: total_size = 5 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 20 get_obj_state: setting s->obj_tag to _sEwuxPB0RLFfv1RE9N4Ngc4BB6h7iyk 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f38a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93845433326624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17ba9060 con 0x555a17b6bab0 2024-09-14T10:44:52.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.243+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93845433326624] v34'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.247+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93845433311056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17ba9060 con 0x7f39e4035070 2024-09-14T10:44:52.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.247+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93845433311056] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.247+0000 7f39f0a7e9c0 20 remove_watcher() i=0 2024-09-14T10:44:52.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.247+0000 7f39f0a7e9c0 2 removed watcher, disabling cache 2024-09-14T10:44:52.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.247+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93845433315792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17ba9060 con 0x555a17b6bab0 2024-09-14T10:44:52.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.247+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93845433315792] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.247+0000 7f39f0a7e9c0 20 remove_watcher() i=1 2024-09-14T10:44:52.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.247+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93845433318432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17ba9060 con 0x555a17b71d20 2024-09-14T10:44:52.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.251+0000 7f39edd83640 1 -- 172.21.15.96:0/1424476618 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93845433318432] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4060040 con 0x555a17b71d20 2024-09-14T10:44:52.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.251+0000 7f39f0a7e9c0 20 remove_watcher() i=2 2024-09-14T10:44:52.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.251+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93845433308544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b75f50 con 0x7f39e4035070 2024-09-14T10:44:52.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.251+0000 7f39eed85640 1 -- 172.21.15.96:0/1424476618 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93845433308544] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e8040040 con 0x7f39e4035070 2024-09-14T10:44:52.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.251+0000 7f39f0a7e9c0 20 remove_watcher() i=3 2024-09-14T10:44:52.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.251+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93845433323056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b771d0 con 0x555a17b6bab0 2024-09-14T10:44:52.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.255+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93845433323056] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x555a17b6bab0 2024-09-14T10:44:52.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.255+0000 7f39f0a7e9c0 20 remove_watcher() i=4 2024-09-14T10:44:52.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.255+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93845433320560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b77c20 con 0x7f39e8031040 2024-09-14T10:44:52.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.255+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93845433320560] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.255+0000 7f39f0a7e9c0 20 remove_watcher() i=5 2024-09-14T10:44:52.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.255+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93845433329856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b75580 con 0x7f39e8031040 2024-09-14T10:44:52.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93845433329856] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 20 remove_watcher() i=6 2024-09-14T10:44:52.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93845433333872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a17b771d0 con 0x7f39e8031040 2024-09-14T10:44:52.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93845433333872] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e00bc3a0 con 0x7f39e8031040 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 20 remove_watcher() i=7 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39e8031040 msgr2=0x7f39e8032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39e8031040 0x7f39e8032430 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a17b6bab0 msgr2=0x555a17b6df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a17b6bab0 0x555a17b6df40 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39e4035070 msgr2=0x7f39e40527e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39e4035070 0x7f39e40527e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a17b71d20 msgr2=0x555a17b74110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a17b71d20 0x555a17b74110 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38b803a1a0 msgr2=0x7f38b803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38b803a1a0 0x7f38b803c660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x555a17b36670 tx=0x7f39e801f000 comp rx=0 tx=0).stop 2024-09-14T10:44:52.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 msgr2=0x555a17b60790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b60790 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f39e4024d20 tx=0x7f39e4050720 comp rx=0 tx=0).stop 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39ee584640 1 -- 172.21.15.96:0/1424476618 reap_dead start 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 shutdown_connections 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1424476618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b59180 0x555a17b60790 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 >> 172.21.15.96:0/1424476618 conn(0x555a17b555b0 msgr2=0x555a17b537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 shutdown_connections 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.259+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1424476618 wait complete. 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/2112380110 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38c803a150 msgr2=0x7f38c803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/2112380110 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38c803a150 0x7f38c803c610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x555a17b3d1e0 tx=0x7f39e8005850 comp rx=0 tx=0).stop 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/2112380110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b4c820 msgr2=0x555a17b4cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/2112380110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b4c820 0x555a17b4cc40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f39e400e670 tx=0x7f39e400ea70 comp rx=0 tx=0).stop 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/2112380110 shutdown_connections 2024-09-14T10:44:52.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/2112380110 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38c803a150 0x7f38c803c610 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/2112380110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a17b4c820 0x555a17b4cc40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/2112380110 >> 172.21.15.96:0/2112380110 conn(0x555a17b421d0 msgr2=0x555a17b425b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/2112380110 shutdown_connections 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/2112380110 wait complete. 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a179b62e0 msgr2=0x555a17b3c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a179b62e0 0x555a17b3c1e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38d403a1a0 msgr2=0x7f38d403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38d403a1a0 0x7f38d403c660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39e4001e40 tx=0x7f39e40013a0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 msgr2=0x555a17b35070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b35070 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f39e001b170 tx=0x7f39e00180e0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 shutdown_connections 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a179b62e0 0x555a17b3c1e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38d403a1a0 0x7f38d403c660 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 --2- 172.21.15.96:0/1511929082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a179b4cd0 0x555a17b35070 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 >> 172.21.15.96:0/1511929082 conn(0x555a17a3bb00 msgr2=0x555a17b2ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 shutdown_connections 2024-09-14T10:44:52.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.263+0000 7f39f0a7e9c0 1 -- 172.21.15.96:0/1511929082 wait complete. 2024-09-14T10:44:52.273 INFO:teuthology.orchestra.run.smithi096.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-14T10:44:52.273 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-14T10:44:52.276 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-14T10:44:52.299 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:52.369 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-14T10:44:52.369 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-14T10:44:52.369 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-14T10:44:52.369 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-14T10:44:52.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-14T10:44:52.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-14T10:44:52.370 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-14T10:44:52.408 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:52.408 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e71e069c0 1 Processor -- start 2024-09-14T10:44:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e71e069c0 1 -- start start 2024-09-14T10:44:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e71e069c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c37c5fed00 0x55c37c606530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e71e069c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c37c4a87a0 con 0x55c37c5fe1e0 2024-09-14T10:44:52.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e71e069c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55c37c5041b0 con 0x55c37c5fed00 2024-09-14T10:44:52.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e6f90c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55c37c5fe1e0 0x55c37c5fe5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:39226/0 (socket says 172.21.15.96:39226) 2024-09-14T10:44:52.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3721368191 learned_addr learned my addr 172.21.15.96:0/3721368191 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/3721368191 >> v2:172.21.15.70:3300/0 conn(0x55c37c5fed00 0x55c37c606530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e6e90a640 1 -- 172.21.15.96:0/3721368191 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891589708 0 0) 0x55c37c4a87a0 con 0x55c37c5fe1e0 2024-09-14T10:44:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e6e90a640 1 -- 172.21.15.96:0/3721368191 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e58001e20 con 0x55c37c5fe1e0 2024-09-14T10:44:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3721368191 >> v1:172.21.15.70:6789/0 conn(0x55c37c5fe1e0 legacy=0x55c37c5fe5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.411+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3721368191 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37c482da0 con 0x55c37c5fed00 2024-09-14T10:44:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/3721368191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fed00 0x55c37c606530 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400a480 tx=0x7f5e6401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c88e7a42e55a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e6e90a640 1 -- 172.21.15.96:0/3721368191 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e640b0070 con 0x55c37c5fed00 2024-09-14T10:44:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e6e90a640 1 -- 172.21.15.96:0/3721368191 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e640ab540 con 0x55c37c5fed00 2024-09-14T10:44:52.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e6e90a640 1 -- 172.21.15.96:0/3721368191 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e640ab840 con 0x55c37c5fed00 2024-09-14T10:44:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3721368191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fed00 msgr2=0x55c37c606530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3721368191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fed00 0x55c37c606530 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400a480 tx=0x7f5e6401b280 comp rx=0 tx=0).stop 2024-09-14T10:44:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3721368191 shutdown_connections 2024-09-14T10:44:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3721368191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fed00 0x55c37c606530 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3721368191 >> 172.21.15.96:0/3721368191 conn(0x55c37c5fa130 msgr2=0x55c37c5fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3721368191 shutdown_connections 2024-09-14T10:44:52.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.415+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3721368191 wait complete. 2024-09-14T10:44:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e71e069c0 1 Processor -- start 2024-09-14T10:44:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e71e069c0 1 -- start start 2024-09-14T10:44:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e71e069c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e71e069c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c37c507fc0 con 0x55c37c5fe1e0 2024-09-14T10:44:52.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e6f90c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e6f90c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6eb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38008/0 (socket says 172.21.15.96:38008) 2024-09-14T10:44:52.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3077926084 learned_addr learned my addr 172.21.15.96:0/3077926084 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3077926084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37c6eb890 con 0x55c37c5fe1e0 2024-09-14T10:44:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5e6f90c640 1 --2- 172.21.15.96:0/3077926084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6eb2a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5e68001e40 tx=0x7f5e6800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffce9d77ac51c538 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5d5de0b640 1 -- 172.21.15.96:0/3077926084 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68012020 con 0x55c37c5fe1e0 2024-09-14T10:44:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5d5de0b640 1 -- 172.21.15.96:0/3077926084 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6800e690 con 0x55c37c5fe1e0 2024-09-14T10:44:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.431+0000 7f5d5de0b640 1 -- 172.21.15.96:0/3077926084 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e6800e9b0 con 0x55c37c5fe1e0 2024-09-14T10:44:52.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3077926084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 msgr2=0x55c37c6eb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3077926084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6eb2a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5e68001e40 tx=0x7f5e6800b790 comp rx=0 tx=0).stop 2024-09-14T10:44:52.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3077926084 shutdown_connections 2024-09-14T10:44:52.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3077926084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6eb2a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3077926084 >> 172.21.15.96:0/3077926084 conn(0x55c37c5fa130 msgr2=0x55c37c6e6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3077926084 shutdown_connections 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3077926084 wait complete. 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 Processor -- start 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- start start 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c37c4a9a50 con 0x55c37c5fe1e0 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e6f90c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e6f90c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38012/0 (socket says 172.21.15.96:38012) 2024-09-14T10:44:52.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e6f90c640 1 -- 172.21.15.96:0/2733306406 learned_addr learned my addr 172.21.15.96:0/2733306406 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e6f90c640 1 -- 172.21.15.96:0/2733306406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37c6f3100 con 0x55c37c5fe1e0 2024-09-14T10:44:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e6f90c640 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6f2ba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x55c37c6ec260 tx=0x7f5e680040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5d57fff640 1 -- 172.21.15.96:0/2733306406 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e68012030 con 0x55c37c5fe1e0 2024-09-14T10:44:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c37c6f3390 con 0x55c37c5fe1e0 2024-09-14T10:44:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5d57fff640 1 -- 172.21.15.96:0/2733306406 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6801a720 con 0x55c37c5fe1e0 2024-09-14T10:44:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5d57fff640 1 -- 172.21.15.96:0/2733306406 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e6801aa60 con 0x55c37c5fe1e0 2024-09-14T10:44:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37c6f3d40 con 0x55c37c5fe1e0 2024-09-14T10:44:52.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5d57fff640 1 -- 172.21.15.96:0/2733306406 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5e68015020 con 0x55c37c5fe1e0 2024-09-14T10:44:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.435+0000 7f5d57fff640 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d5803a150 0x7f5d5803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5d57fff640 1 -- 172.21.15.96:0/2733306406 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5e68020070 con 0x55c37c5fe1e0 2024-09-14T10:44:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d5803a150 0x7f5d5803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c5fed00 0x55c37c6f9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c6fa250 con 0x55c37c5fed00 2024-09-14T10:44:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e7010d640 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c5fed00 0x55c37c6f9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d5803a150 0x7f5d5803c610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e640ad000 tx=0x7f5e640a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e7010d640 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c5fed00 0x55c37c6f9d10 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e7010d640 1 -- 172.21.15.96:0/2733306406 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e6000a4d0 con 0x55c37c5fed00 2024-09-14T10:44:52.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c6f4080 con 0x55c37c5fed00 2024-09-14T10:44:52.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e7010d640 1 -- 172.21.15.96:0/2733306406 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e6000a4d0 con 0x55c37c5fed00 2024-09-14T10:44:52.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c6fbfb0 con 0x55c37c5fed00 2024-09-14T10:44:52.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e7010d640 1 -- 172.21.15.96:0/2733306406 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e6000a4d0 con 0x55c37c5fed00 2024-09-14T10:44:52.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c6fb1e0 con 0x55c37c5fed00 2024-09-14T10:44:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e7010d640 1 -- 172.21.15.96:0/2733306406 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e6000a4d0 con 0x55c37c5fed00 2024-09-14T10:44:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c6fb630 con 0x55c37c5fed00 2024-09-14T10:44:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e7010d640 1 -- 172.21.15.96:0/2733306406 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e6000a4d0 con 0x55c37c5fed00 2024-09-14T10:44:52.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 Processor -- start 2024-09-14T10:44:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 -- start start 2024-09-14T10:44:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c600c50 0x55c37c5ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e71e069c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c37c514d80 con 0x55c37c600c50 2024-09-14T10:44:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e6f10b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c600c50 0x55c37c5ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e6f10b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c600c50 0x55c37c5ff4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38022/0 (socket says 172.21.15.96:38022) 2024-09-14T10:44:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.439+0000 7f5e6f10b640 1 -- 172.21.15.96:0/2764659802 learned_addr learned my addr 172.21.15.96:0/2764659802 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e6f10b640 1 -- 172.21.15.96:0/2764659802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37c601170 con 0x55c37c600c50 2024-09-14T10:44:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/2764659802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c600c50 0x55c37c5ff4f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5e64000c10 tx=0x7f5e64018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5d557fa640 1 -- 172.21.15.96:0/2764659802 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e640c7070 con 0x55c37c600c50 2024-09-14T10:44:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5d557fa640 1 -- 172.21.15.96:0/2764659802 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e640b7dd0 con 0x55c37c600c50 2024-09-14T10:44:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2764659802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c37c5ffa30 con 0x55c37c600c50 2024-09-14T10:44:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5d557fa640 1 -- 172.21.15.96:0/2764659802 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e640b0040 con 0x55c37c600c50 2024-09-14T10:44:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2764659802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37c5fff40 con 0x55c37c600c50 2024-09-14T10:44:52.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5d557fa640 1 -- 172.21.15.96:0/2764659802 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5e640ca070 con 0x55c37c600c50 2024-09-14T10:44:52.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5d557fa640 1 --2- 172.21.15.96:0/2764659802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d4803a140 0x7f5d4803c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5d557fa640 1 -- 172.21.15.96:0/2764659802 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5e640a8070 con 0x55c37c600c50 2024-09-14T10:44:52.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e7010d640 1 --2- 172.21.15.96:0/2764659802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d4803a140 0x7f5d4803c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e71e069c0 1 Processor -- start 2024-09-14T10:44:52.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e71e069c0 1 -- start start 2024-09-14T10:44:52.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e7010d640 1 --2- 172.21.15.96:0/2764659802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d4803a140 0x7f5d4803c600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55c37c6fad00 tx=0x7f5e60005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e71e069c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c71a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e71e069c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c37c6ebcc0 con 0x55c37c719e10 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e6f10b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c71a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e6f10b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c71a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38024/0 (socket says 172.21.15.96:38024) 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.443+0000 7f5e6f10b640 1 -- 172.21.15.96:0/2396134210 learned_addr learned my addr 172.21.15.96:0/2396134210 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e6f10b640 1 -- 172.21.15.96:0/2396134210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37c71a800 con 0x55c37c719e10 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/2396134210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c71a210 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5e640cbfd0 tx=0x7f5e640ca7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e279747f9f6e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5d4effd640 1 -- 172.21.15.96:0/2396134210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e640dd070 con 0x55c37c719e10 2024-09-14T10:44:52.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5d4effd640 1 -- 172.21.15.96:0/2396134210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e640cab90 con 0x55c37c719e10 2024-09-14T10:44:52.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5d4effd640 1 -- 172.21.15.96:0/2396134210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e640b5b00 con 0x55c37c719e10 2024-09-14T10:44:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2396134210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 msgr2=0x55c37c71a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2396134210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c71a210 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5e640cbfd0 tx=0x7f5e640ca7c0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2396134210 shutdown_connections 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2396134210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c71a210 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2396134210 >> 172.21.15.96:0/2396134210 conn(0x55c37c715230 msgr2=0x55c37c713470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2396134210 shutdown_connections 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2396134210 wait complete. 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 Processor -- start 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- start start 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c720350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c37c718d60 con 0x55c37c719e10 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e6f10b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c720350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e6f10b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c720350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38038/0 (socket says 172.21.15.96:38038) 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 learned_addr learned my addr 172.21.15.96:0/3082737635 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37c7208b0 con 0x55c37c719e10 2024-09-14T10:44:52.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c720350 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5e640ca800 tx=0x7f5e640eb660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5d4d7fa640 1 -- 172.21.15.96:0/3082737635 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e640e5070 con 0x55c37c719e10 2024-09-14T10:44:52.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c37c720b40 con 0x55c37c719e10 2024-09-14T10:44:52.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5d4d7fa640 1 -- 172.21.15.96:0/3082737635 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e640b6470 con 0x55c37c719e10 2024-09-14T10:44:52.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5d4d7fa640 1 -- 172.21.15.96:0/3082737635 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e640dd040 con 0x55c37c719e10 2024-09-14T10:44:52.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.447+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37c7214f0 con 0x55c37c719e10 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5d4d7fa640 1 -- 172.21.15.96:0/3082737635 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5e640e8070 con 0x55c37c719e10 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5d4d7fa640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d3803a150 0x7f5d3803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5d4d7fa640 1 -- 172.21.15.96:0/3082737635 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5e640b8040 con 0x55c37c719e10 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e7010d640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d3803a150 0x7f5d3803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c72b8f0 0x55c37c72dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c72e4d0 con 0x55c37c72b8f0 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e6f90c640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c72b8f0 0x55c37c72dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e7010d640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d3803a150 0x7f5d3803c610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55c37c6f3fc0 tx=0x7f5e6001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e6f90c640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c72b8f0 0x55c37c72dd80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 realm 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c72e8e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c72f1b0 con 0x55c37c72b8f0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c72f550 con 0x55c37c72b8f0 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c72fda0 con 0x55c37c72b8f0 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 20 searching for the correct realm 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c37c731b10 0x55c37c733f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.451+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c37c731b10 0x55c37c733f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c37c731b10 0x55c37c733f00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f10b640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5e640f7040 0x7f5e640e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e640f7040 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e7010d640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5e640f7040 0x7f5e640e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e7010d640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5e640f7040 0x7f5e640e1400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e6001f070 con 0x7f5e640f7040 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e7010d640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5e60031040 0x7f5e60032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e60031040 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f90c640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5e60031040 0x7f5e60032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f90c640 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5e60031040 0x7f5e60032430 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.455+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e60031040 2024-09-14T10:44:52.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e60031040 2024-09-14T10:44:52.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e640f7040 2024-09-14T10:44:52.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e6001f070 con 0x7f5e640f7040 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e60031040 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e640f7040 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e6001f070 con 0x7f5e640f7040 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.459+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e60031040 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e60031040 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e640f7040 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e6001f070 con 0x7f5e640f7040 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e640f7040 2024-09-14T10:44:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e6001f070 con 0x7f5e640f7040 2024-09-14T10:44:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.463+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e60031040 2024-09-14T10:44:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e640f7040 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e6001f070 con 0x7f5e640f7040 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c731b10 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e60031040 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7344e0 con 0x7f5e640f7040 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:52.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c730750 con 0x55c37c72b8f0 2024-09-14T10:44:52.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c730ff0 con 0x55c37c72b8f0 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c730ff0 con 0x55c37c72b8f0 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 zone default found 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 4 Realm: () 2024-09-14T10:44:52.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 zonegroup default 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c734960 con 0x7f5e640f7040 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7367f0 con 0x55c37c731b10 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.467+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c736d10 con 0x55c37c731b10 2024-09-14T10:44:52.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e71e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e71e069c0 20 started sync module instance, tier type = 2024-09-14T10:44:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e71e069c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c735b90 con 0x7f5e640f7040 2024-09-14T10:44:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94298094919856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c735b90 con 0x7f5e640f7040 2024-09-14T10:44:52.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7377d0 con 0x55c37c72b8f0 2024-09-14T10:44:52.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94298094919856] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.471+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.475+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94298094924512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c735b90 con 0x55c37c72b8f0 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.475+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7381e0 con 0x55c37c731b10 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.475+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94298094924512] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.475+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.475+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94298094917344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c735b00 con 0x55c37c731b10 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.475+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c738ee0 con 0x7f5e640f7040 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.479+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.479+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94298094930784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7397b0 con 0x7f5e640f7040 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.479+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73a1b0 con 0x55c37c72b8f0 2024-09-14T10:44:52.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.479+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94298094917344] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.479+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94298094930784] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.479+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.479+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94298094929280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c739300 con 0x55c37c72b8f0 2024-09-14T10:44:52.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.479+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73aa50 con 0x7f5e60031040 2024-09-14T10:44:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.483+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.483+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94298094937040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73aca0 con 0x7f5e60031040 2024-09-14T10:44:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.483+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73b4f0 con 0x7f5e60031040 2024-09-14T10:44:52.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.483+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94298094929280] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.483+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94298094937040] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.483+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.483+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94298094938096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73b0c0 con 0x7f5e60031040 2024-09-14T10:44:52.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.483+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73b910 con 0x7f5e60031040 2024-09-14T10:44:52.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94298094940832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73bd10 con 0x7f5e60031040 2024-09-14T10:44:52.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 20 add_watcher() i=0 2024-09-14T10:44:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 20 add_watcher() i=1 2024-09-14T10:44:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 20 add_watcher() i=2 2024-09-14T10:44:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 20 add_watcher() i=3 2024-09-14T10:44:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 20 add_watcher() i=4 2024-09-14T10:44:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 20 add_watcher() i=5 2024-09-14T10:44:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94298094938096] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 20 add_watcher() i=6 2024-09-14T10:44:52.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94298094940832] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 20 add_watcher() i=7 2024-09-14T10:44:52.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:52.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73ac10 con 0x55c37c72b8f0 2024-09-14T10:44:52.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.487+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94298094939152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c73c220 con 0x55c37c72b8f0 2024-09-14T10:44:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.491+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94298094939152] v34'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.491+0000 7f5d267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.491+0000 7f5e71e069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.491+0000 7f5e71e069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:52.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.491+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c747870 con 0x55c37c72b8f0 2024-09-14T10:44:52.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.491+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.491+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c747f40 con 0x7f5e60031040 2024-09-14T10:44:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.495+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.495+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c747f40 con 0x55c37c731b10 2024-09-14T10:44:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.495+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.495+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7482e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.495+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.495+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7482e0 con 0x7f5e640f7040 2024-09-14T10:44:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.499+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.499+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c748850 con 0x55c37c731b10 2024-09-14T10:44:52.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.499+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.499+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c748bf0 con 0x55c37c72b8f0 2024-09-14T10:44:52.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.503+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.503+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c748d20 con 0x7f5e60031040 2024-09-14T10:44:52.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.503+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'43 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.503+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c748d20 con 0x7f5e640f7040 2024-09-14T10:44:52.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.507+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.507+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7492b0 con 0x55c37c731b10 2024-09-14T10:44:52.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.507+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.507+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749320 con 0x7f5e640f7040 2024-09-14T10:44:52.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.507+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.507+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749890 con 0x7f5e60031040 2024-09-14T10:44:52.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.511+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.511+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749890 con 0x7f5e640f7040 2024-09-14T10:44:52.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.511+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.511+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x7f5e60031040 2024-09-14T10:44:52.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.515+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.515+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x55c37c72b8f0 2024-09-14T10:44:52.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.515+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.515+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x55c37c731b10 2024-09-14T10:44:52.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.519+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.519+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x7f5e640f7040 2024-09-14T10:44:52.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.519+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.519+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x55c37c731b10 2024-09-14T10:44:52.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.519+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.519+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x55c37c72b8f0 2024-09-14T10:44:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.523+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.523+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x55c37c72b8f0 2024-09-14T10:44:52.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.523+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.523+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x55c37c731b10 2024-09-14T10:44:52.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.527+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.527+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x7f5e640f7040 2024-09-14T10:44:52.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.527+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.527+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x55c37c731b10 2024-09-14T10:44:52.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.527+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.527+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x55c37c731b10 2024-09-14T10:44:52.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.531+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.531+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x55c37c731b10 2024-09-14T10:44:52.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.531+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.531+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x55c37c731b10 2024-09-14T10:44:52.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.531+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.531+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749d40 con 0x7f5e60031040 2024-09-14T10:44:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.535+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.535+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x55c37c731b10 2024-09-14T10:44:52.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.535+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.535+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x7f5e60031040 2024-09-14T10:44:52.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.539+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.539+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x55c37c731b10 2024-09-14T10:44:52.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.539+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.539+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749dd0 con 0x7f5e60031040 2024-09-14T10:44:52.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.543+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.543+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c749e40 con 0x7f5e640f7040 2024-09-14T10:44:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.543+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5d257e2640 20 reqs_thread_entry: start 2024-09-14T10:44:52.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 20 Filter name: none 2024-09-14T10:44:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5d1e7fc640 20 reqs_thread_entry: start 2024-09-14T10:44:52.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7653b0 con 0x7f5e640f7040 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 : miss 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 8.d 8:b6fbf1ae:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c766a70 con 0x7f5e640f7040 2024-09-14T10:44:52.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(95 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:44:52.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 info.flags=0x17 2024-09-14T10:44:52.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 to cache LRU end 2024-09-14T10:44:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:44:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 2024-09-14T10:44:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:96 4.a 4:50ce11e6:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e3fe0 con 0x7f5e640f7040 2024-09-14T10:44:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(96 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:97 4.11 4:8b0baa32:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e4060 con 0x7f5e60031040 2024-09-14T10:44:52.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(97 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.547+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:98 4.17 4:e8ffa59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e4060 con 0x7f5e60031040 2024-09-14T10:44:52.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(98 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2 [call out=430b] v0'0 uv5 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e71e069c0 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-14T10:44:52.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:99 4.33 4:ced5377e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e4060 con 0x7f5e60031040 2024-09-14T10:44:52.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(99 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 4.26 4:643b1083:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e4610 con 0x7f5e60031040 2024-09-14T10:44:52.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(100 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:101 4.32 4:4c6d19ae:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e4610 con 0x55c37c72b8f0 2024-09-14T10:44:52.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(101 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:102 4.34 4:2e1c6e36:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e45f0 con 0x7f5e640f7040 2024-09-14T10:44:52.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(102 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6 [call out=428b] v0'0 uv3 ondisk = 0) ==== 194+0+428 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e71e069c0 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-14T10:44:52.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:103 4.27 4:e4431c76:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e45f0 con 0x55c37c72b8f0 2024-09-14T10:44:52.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(103 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.551+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:104 4.18 4:1926f114:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e45f0 con 0x7f5e640f7040 2024-09-14T10:44:52.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(104 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8 [call out=429b] v0'0 uv5 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-14T10:44:52.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:105 4.2d 4:b6585a5f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e45f0 con 0x7f5e60031040 2024-09-14T10:44:52.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(105 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:106 4.16 4:699737cf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e45f0 con 0x55c37c731b10 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(106 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 [call out=701b] v0'0 uv17 ondisk = 0) ==== 195+0+701 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:107 3.10s0 3:0ac83b17:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_9c8454ddf7aa50116496bac348d7550d:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7e1b40 con 0x55c37c72b8f0 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(107 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_9c8454ddf7aa50116496bac348d7550d [call out=24b,getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+919 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 10 manifest: total_size = 6 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 20 get_obj_state: setting s->obj_tag to 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10504830719173037672 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 20 prepare_atomic_modification: state is not atomic. state=0x55c37c767318 2024-09-14T10:44:52.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2 2024-09-14T10:44:52.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.555+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:108 4.17 4:e8ffa59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76c610 con 0x7f5e60031040 2024-09-14T10:44:52.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.559+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(108 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.559+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:109 3.10s0 3:0ac83b17:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76c610 con 0x55c37c72b8f0 2024-09-14T10:44:52.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.559+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(109 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_9c8454ddf7aa50116496bac348d7550d [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.559+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:110 4.17 4:e8ffa59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76d0a0 con 0x7f5e60031040 2024-09-14T10:44:52.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.559+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.559+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:111 3.21s0 3:84a812f9:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_b1b9a972ccd8c962a473909b97007eb4:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5e6804a000 con 0x7f5e60031040 2024-09-14T10:44:52.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(111 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_b1b9a972ccd8c962a473909b97007eb4 [call out=24b,getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+915 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e71e069c0 10 manifest: total_size = 3 2024-09-14T10:44:52.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e71e069c0 20 get_obj_state: setting s->obj_tag to 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.632402517674566728 2024-09-14T10:44:52.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e71e069c0 20 prepare_atomic_modification: state is not atomic. state=0x55c37c767318 2024-09-14T10:44:52.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e71e069c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6 2024-09-14T10:44:52.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:112 4.34 4:2e1c6e36:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76c1a0 con 0x7f5e640f7040 2024-09-14T10:44:52.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(110 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5d4effd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-14T10:44:52.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(112 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.563+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:113 3.21s0 3:84a812f9:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c768e80 con 0x7f5e60031040 2024-09-14T10:44:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(113 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:114 4.34 4:2e1c6e36:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76dc90 con 0x7f5e640f7040 2024-09-14T10:44:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:115 3.ds0 3:b05a80de:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5e6804a000 con 0x55c37c731b10 2024-09-14T10:44:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(115 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_c785e1ed2950e3e36b1e2ca01f299a54 [call out=24b,getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+917 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 10 manifest: total_size = 4 2024-09-14T10:44:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 20 get_obj_state: setting s->obj_tag to 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.3197539001904046752 2024-09-14T10:44:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 20 prepare_atomic_modification: state is not atomic. state=0x55c37c767318 2024-09-14T10:44:52.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8 2024-09-14T10:44:52.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:116 4.18 4:1926f114:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c772ae0 con 0x7f5e640f7040 2024-09-14T10:44:52.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(114 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5d4e7fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-14T10:44:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(116 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.567+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:117 3.ds0 3:b05a80de:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76e490 con 0x55c37c731b10 2024-09-14T10:44:52.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(117 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:118 4.18 4:1926f114:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76ed30 con 0x7f5e640f7040 2024-09-14T10:44:52.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:119 3.cs0 3:3214e06a:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_24d27c169c2c881eb09a065116f2aa5c:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5e64104000 con 0x55c37c731b10 2024-09-14T10:44:52.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(119 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_24d27c169c2c881eb09a065116f2aa5c [call out=24b,getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+917 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 10 manifest: total_size = 5 2024-09-14T10:44:52.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 20 get_obj_state: setting s->obj_tag to 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7355596258863949462 2024-09-14T10:44:52.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 20 prepare_atomic_modification: state is not atomic. state=0x55c37c767318 2024-09-14T10:44:52.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 2024-09-14T10:44:52.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.571+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:120 4.16 4:699737cf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76ed30 con 0x55c37c731b10 2024-09-14T10:44:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.575+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(118 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.575+0000 7f5d4effd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-14T10:44:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.575+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(120 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 [stat,call,call] v34'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.575+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:121 3.cs0 3:3214e06a:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76ec10 con 0x55c37c731b10 2024-09-14T10:44:52.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.575+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 31 ==== osd_op_reply(121 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.575+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:122 4.16 4:699737cf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76ebf0 con 0x55c37c731b10 2024-09-14T10:44:52.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.575+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.575+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:123 3.3s0 3:c1a3e7f4:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5e64104000 con 0x7f5e640f7040 2024-09-14T10:44:52.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 29 ==== osd_op_reply(123 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+951 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e71e069c0 10 manifest: total_size = 5 2024-09-14T10:44:52.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e71e069c0 20 get_obj_state: setting s->obj_tag to _sEwuxPB0RLFfv1RE9N4Ngc4BB6h7iyk 2024-09-14T10:44:52.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e71e069c0 20 get_obj_state: octx=0x7f5e68016ea0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c37c767318 s->prefetch_data=0 2024-09-14T10:44:52.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e71e069c0 20 prepare_atomic_modification: state is not atomic. state=0x55c37c767318 2024-09-14T10:44:52.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e71e069c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 2024-09-14T10:44:52.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:124 4.16 4:699737cf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76ebf0 con 0x55c37c731b10 2024-09-14T10:44:52.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 32 ==== osd_op_reply(122 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 [stat,call,call] v34'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5d4e7fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-14T10:44:52.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 33 ==== osd_op_reply(124 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 [stat,call,call] v34'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.579+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:125 3.3s0 3:c1a3e7f4:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76a720 con 0x7f5e640f7040 2024-09-14T10:44:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 30 ==== osd_op_reply(125 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:126 4.16 4:699737cf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76a720 con 0x55c37c731b10 2024-09-14T10:44:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 20 list_objects_ordered: starting attempt 1 2024-09-14T10:44:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T10:44:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:127 4.a 4:50ce11e6:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76a720 con 0x7f5e640f7040 2024-09-14T10:44:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:128 4.11 4:8b0baa32:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7675e0 con 0x7f5e60031040 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:129 4.17 4:e8ffa59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c76a720 con 0x7f5e60031040 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:130 4.33 4:ced5377e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c779840 con 0x7f5e60031040 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:131 4.26 4:643b1083:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c77c410 con 0x7f5e60031040 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:132 4.32 4:4c6d19ae:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c77f1c0 con 0x55c37c72b8f0 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:133 4.34 4:2e1c6e36:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c781fc0 con 0x7f5e640f7040 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:134 4.27 4:e4431c76:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784e40 con 0x55c37c72b8f0 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:135 4.18 4:1926f114:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c787c90 con 0x7f5e640f7040 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:136 4.2d 4:b6585a5f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c78a900 con 0x7f5e60031040 2024-09-14T10:44:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:137 4.16 4:699737cf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c787c90 con 0x55c37c731b10 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 31 ==== osd_op_reply(127 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(132 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 32 ==== osd_op_reply(133 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(134 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x55c37c72b8f0 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 33 ==== osd_op_reply(135 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(128 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(129 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== osd_op_reply(130 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== osd_op_reply(131 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(136 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e68008030 con 0x7f5e60031040 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 34 ==== osd_op_reply(126 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 [stat,call,call] v34'21 uv21 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5d4effd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 35 ==== osd_op_reply(137 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 [call out=128b] v0'0 uv21 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5])"; uploads.size()=0; is_truncated=0 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:138 4.a 4:50ce11e6:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7675e0 con 0x7f5e640f7040 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:139 4.11 4:8b0baa32:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784e40 con 0x7f5e60031040 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:140 4.17 4:e8ffa59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7675e0 con 0x7f5e60031040 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:141 4.33 4:ced5377e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c787c90 con 0x7f5e60031040 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:142 4.26 4:643b1083:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784e40 con 0x7f5e60031040 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:143 4.32 4:4c6d19ae:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7675e0 con 0x55c37c72b8f0 2024-09-14T10:44:52.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:144 4.34 4:2e1c6e36:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c787c90 con 0x7f5e640f7040 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:145 4.27 4:e4431c76:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784e40 con 0x55c37c72b8f0 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:146 4.18 4:1926f114:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c77c410 con 0x7f5e640f7040 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:147 4.2d 4:b6585a5f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7675e0 con 0x7f5e60031040 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:148 4.16 4:699737cf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c787c90 con 0x55c37c731b10 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.583+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 34 ==== osd_op_reply(138 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(145 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 35 ==== osd_op_reply(146 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(143 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 36 ==== osd_op_reply(144 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 36 ==== osd_op_reply(148 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 [call out=128b] v0'0 uv21 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== osd_op_reply(139 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== osd_op_reply(141 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(140 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(142 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 40 ==== osd_op_reply(147 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c787c90 con 0x7f5e640f7040 2024-09-14T10:44:52.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 37 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e71e069c0 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-14T10:44:52.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.587+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784e40 con 0x7f5e640f7040 2024-09-14T10:44:52.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 38 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e71e069c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e71e069c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94298095242624 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e60031040 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 41 ==== watch-notify(notify (1) cookie 94298094938096 notify 146028888082 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55c37c747a90 con 0x7f5e60031040 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5d4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94298094938096 notifier 4648 bl.length()=149 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5d4e7fc640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5c980032d0 con 0x7f5e60031040 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 42 ==== osd_op_reply(151 notify.6 [notify cookie 94298095242624 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 43 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 44 ==== watch-notify(notify_complete (2) cookie 94298095242624 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5e68048040 con 0x7f5e60031040 2024-09-14T10:44:52.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.591+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:153 8.d 8:b6fbf1ae:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e640f7040 2024-09-14T10:44:52.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 39 ==== osd_op_reply(153 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 from cache 2024-09-14T10:44:52.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5, ofs0, ns] 2024-09-14T10:44:52.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify cookie 94298095623600 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x55c37c72b8f0 2024-09-14T10:44:52.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== watch-notify(notify (1) cookie 94298094929280 notify 146028888091 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f5e68048040 con 0x55c37c72b8f0 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5d4effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94298094929280 notifier 4648 bl.length()=206 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5d4effd640 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:155 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5d34003d70 con 0x55c37c72b8f0 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 38 ==== osd_op_reply(154 notify.4 [notify cookie 94298095623600 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 39 ==== osd_op_reply(155 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 40 ==== watch-notify(notify_complete (2) cookie 94298095623600 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5e68061040 con 0x55c37c72b8f0 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:156 4.a 4:50ce11e6:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e640f7040 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:157 4.11 4:8b0baa32:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7817f0 con 0x7f5e60031040 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:158 4.17 4:e8ffa59e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c781bd0 con 0x7f5e60031040 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:159 4.33 4:ced5377e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e60031040 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:160 4.26 4:643b1083:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7817f0 con 0x7f5e60031040 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:161 4.32 4:4c6d19ae:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7675c0 con 0x55c37c72b8f0 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:162 4.34 4:2e1c6e36:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e640f7040 2024-09-14T10:44:52.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:163 4.27 4:e4431c76:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7817f0 con 0x55c37c72b8f0 2024-09-14T10:44:52.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:164 4.18 4:1926f114:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7675c0 con 0x7f5e640f7040 2024-09-14T10:44:52.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:165 4.2d 4:b6585a5f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e60031040 2024-09-14T10:44:52.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.595+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:166 4.16 4:699737cf:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7817f0 con 0x55c37c731b10 2024-09-14T10:44:52.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 45 ==== osd_op_reply(160 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.4 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 46 ==== osd_op_reply(158 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.2 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 40 ==== osd_op_reply(164 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.8 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 41 ==== osd_op_reply(161 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.5 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 47 ==== osd_op_reply(157 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.1 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 48 ==== osd_op_reply(159 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.3 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 41 ==== osd_op_reply(156 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.0 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 42 ==== osd_op_reply(162 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.6 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 42 ==== osd_op_reply(163 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.7 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 37 ==== osd_op_reply(166 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.10 [delete] v34'22 uv22 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 49 ==== osd_op_reply(165 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5.9 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e71e069c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 : miss 2024-09-14T10:44:52.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e71e069c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:167 6.10 6:08f8b976:::pubsub..bucket.myfoo%2f67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c37c7675c0 con 0x7f5e60031040 2024-09-14T10:44:52.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 50 ==== osd_op_reply(167 pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e71e069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e71e069c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 info.flags=0x0 2024-09-14T10:44:52.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e71e069c0 10 adding default.rgw.log++pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 to cache LRU end 2024-09-14T10:44:52.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.599+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:168 6.10 6:08f8b976:::pubsub..bucket.myfoo%2f67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e60031040 2024-09-14T10:44:52.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.603+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 51 ==== osd_op_reply(168 pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.5 [delete] v34'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.603+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e640f7040 2024-09-14T10:44:52.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.607+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 43 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.607+0000 7f5d267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.607+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94298094939152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x55c37c72b8f0 2024-09-14T10:44:52.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.607+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 43 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94298094939152] v34'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.607+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94298094919856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e640f7040 2024-09-14T10:44:52.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.611+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 44 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94298094919856] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.611+0000 7f5e71e069c0 20 remove_watcher() i=0 2024-09-14T10:44:52.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.611+0000 7f5e71e069c0 2 removed watcher, disabling cache 2024-09-14T10:44:52.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.611+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94298094924512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x55c37c72b8f0 2024-09-14T10:44:52.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.611+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 44 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94298094924512] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.611+0000 7f5e71e069c0 20 remove_watcher() i=1 2024-09-14T10:44:52.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.611+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94298094917344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x55c37c731b10 2024-09-14T10:44:52.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.615+0000 7f5e6f10b640 1 -- 172.21.15.96:0/3082737635 <== osd.3 v2:172.21.15.96:6800/3683402699 38 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94298094917344] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e640e7030 con 0x55c37c731b10 2024-09-14T10:44:52.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.615+0000 7f5e71e069c0 20 remove_watcher() i=2 2024-09-14T10:44:52.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.615+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94298094930784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e640f7040 2024-09-14T10:44:52.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.615+0000 7f5e7010d640 1 -- 172.21.15.96:0/3082737635 <== osd.2 v2:172.21.15.96:6816/2312202642 45 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94298094930784] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e60040040 con 0x7f5e640f7040 2024-09-14T10:44:52.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.615+0000 7f5e71e069c0 20 remove_watcher() i=3 2024-09-14T10:44:52.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.615+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94298094929280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x55c37c72b8f0 2024-09-14T10:44:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.619+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.1 v2:172.21.15.96:6808/2339799699 45 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94298094929280] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x55c37c72b8f0 2024-09-14T10:44:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.619+0000 7f5e71e069c0 20 remove_watcher() i=4 2024-09-14T10:44:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.619+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94298094937040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e60031040 2024-09-14T10:44:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.619+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 52 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94298094937040] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.619+0000 7f5e71e069c0 20 remove_watcher() i=5 2024-09-14T10:44:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.619+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94298094938096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e60031040 2024-09-14T10:44:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 53 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94298094938096] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 20 remove_watcher() i=6 2024-09-14T10:44:52.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94298094940832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c37c784660 con 0x7f5e60031040 2024-09-14T10:44:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 <== osd.0 v2:172.21.15.70:6800/3481052616 54 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94298094940832] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e6805a040 con 0x7f5e60031040 2024-09-14T10:44:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 20 remove_watcher() i=7 2024-09-14T10:44:52.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5e60031040 msgr2=0x7f5e60032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5e60031040 0x7f5e60032430 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c72b8f0 msgr2=0x55c37c72dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c72b8f0 0x55c37c72dd80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5e640f7040 msgr2=0x7f5e640e1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f5e640f7040 0x7f5e640e1400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c37c731b10 msgr2=0x55c37c733f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c37c731b10 0x55c37c733f00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d3803a150 msgr2=0x7f5d3803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d3803a150 0x7f5d3803c610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55c37c6f3fc0 tx=0x7f5e6001f000 comp rx=0 tx=0).stop 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 msgr2=0x55c37c720350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e6f90c640 1 -- 172.21.15.96:0/3082737635 reap_dead start 2024-09-14T10:44:52.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c720350 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5e640ca800 tx=0x7f5e640eb660 comp rx=0 tx=0).stop 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 shutdown_connections 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/3082737635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c719e10 0x55c37c720350 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 >> 172.21.15.96:0/3082737635 conn(0x55c37c715230 msgr2=0x55c37c713440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 shutdown_connections 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.623+0000 7f5e71e069c0 1 -- 172.21.15.96:0/3082737635 wait complete. 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2764659802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d4803a140 msgr2=0x7f5d4803c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2764659802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d4803a140 0x7f5d4803c600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55c37c6fad00 tx=0x7f5e60005850 comp rx=0 tx=0).stop 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2764659802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c600c50 msgr2=0x55c37c5ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2764659802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c600c50 0x55c37c5ff4f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5e64000c10 tx=0x7f5e64018020 comp rx=0 tx=0).stop 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2764659802 shutdown_connections 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2764659802 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d4803a140 0x7f5d4803c600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2764659802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c600c50 0x55c37c5ff4f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2764659802 >> 172.21.15.96:0/2764659802 conn(0x55c37c6ffd20 msgr2=0x55c37c700100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2764659802 shutdown_connections 2024-09-14T10:44:52.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2764659802 wait complete. 2024-09-14T10:44:52.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c5fed00 msgr2=0x55c37c6f9d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c5fed00 0x55c37c6f9d10 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d5803a150 msgr2=0x7f5d5803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d5803a150 0x7f5d5803c610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e640ad000 tx=0x7f5e640a5040 comp rx=0 tx=0).stop 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 msgr2=0x55c37c6f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6f2ba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x55c37c6ec260 tx=0x7f5e680040f0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 shutdown_connections 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c37c5fed00 0x55c37c6f9d10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f5d5803a150 0x7f5d5803c610 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 --2- 172.21.15.96:0/2733306406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c37c5fe1e0 0x55c37c6f2ba0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 >> 172.21.15.96:0/2733306406 conn(0x55c37c5fa130 msgr2=0x55c37c6ec6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 shutdown_connections 2024-09-14T10:44:52.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.627+0000 7f5e71e069c0 1 -- 172.21.15.96:0/2733306406 wait complete. 2024-09-14T10:44:52.637 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-14T10:44:52.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-14T10:44:52.638 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-14T10:44:52.717 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:52.717 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:52.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c76ed9c0 1 Processor -- start 2024-09-14T10:44:52.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c76ed9c0 1 -- start start 2024-09-14T10:44:52.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c76ed9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55aebb2d5130 0x55aebb2d7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c76ed9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aebb1797a0 con 0x55aebb2d0fe0 2024-09-14T10:44:52.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c76ed9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55aebb1d51b0 con 0x55aebb2d5130 2024-09-14T10:44:52.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c51f3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55aebb2d0fe0 0x55aebb2d13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:39242/0 (socket says 172.21.15.96:39242) 2024-09-14T10:44:52.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c49f2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55aebb2d5130 0x55aebb2d7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c51f3640 1 -- 172.21.15.96:0/2161372371 learned_addr learned my addr 172.21.15.96:0/2161372371 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:52.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c49f2640 1 -- 172.21.15.96:0/2161372371 >> v1:172.21.15.70:6789/0 conn(0x55aebb2d0fe0 legacy=0x55aebb2d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81c49f2640 1 -- 172.21.15.96:0/2161372371 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebb153da0 con 0x55aebb2d5130 2024-09-14T10:44:52.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.719+0000 7f81bffff640 1 -- 172.21.15.96:0/2161372371 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660228694 0 0) 0x55aebb1797a0 con 0x55aebb2d0fe0 2024-09-14T10:44:52.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81c49f2640 1 --2- 172.21.15.96:0/2161372371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb2d7520 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f81b000a480 tx=0x7f81b001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af8303a4c6e4aea server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81bffff640 1 -- 172.21.15.96:0/2161372371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b00aa570 con 0x55aebb2d5130 2024-09-14T10:44:52.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81bffff640 1 -- 172.21.15.96:0/2161372371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b00af070 con 0x55aebb2d5130 2024-09-14T10:44:52.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81bffff640 1 -- 172.21.15.96:0/2161372371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b00aa860 con 0x55aebb2d5130 2024-09-14T10:44:52.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2161372371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 msgr2=0x55aebb2d7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2161372371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb2d7520 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f81b000a480 tx=0x7f81b001b310 comp rx=0 tx=0).stop 2024-09-14T10:44:52.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2161372371 shutdown_connections 2024-09-14T10:44:52.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2161372371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb2d7520 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2161372371 >> 172.21.15.96:0/2161372371 conn(0x55aebb2ccb00 msgr2=0x55aebb2cef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2161372371 shutdown_connections 2024-09-14T10:44:52.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.723+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2161372371 wait complete. 2024-09-14T10:44:52.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.739+0000 7f81c76ed9c0 1 Processor -- start 2024-09-14T10:44:52.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.739+0000 7f81c76ed9c0 1 -- start start 2024-09-14T10:44:52.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.739+0000 7f81c76ed9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d0fe0 0x55aebb3bc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.739+0000 7f81c76ed9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aebb1d8fc0 con 0x55aebb2d0fe0 2024-09-14T10:44:52.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.739+0000 7f81c51f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d0fe0 0x55aebb3bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.739+0000 7f81c51f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d0fe0 0x55aebb3bc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38058/0 (socket says 172.21.15.96:38058) 2024-09-14T10:44:52.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.739+0000 7f81c51f3640 1 -- 172.21.15.96:0/3137987617 learned_addr learned my addr 172.21.15.96:0/3137987617 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c51f3640 1 -- 172.21.15.96:0/3137987617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebb3bc800 con 0x55aebb2d0fe0 2024-09-14T10:44:52.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c51f3640 1 --2- 172.21.15.96:0/3137987617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d0fe0 0x55aebb3bc210 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f81b8006fb0 tx=0x7f81b8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af644a4d051aa99 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f80b3606640 1 -- 172.21.15.96:0/3137987617 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b8003460 con 0x55aebb2d0fe0 2024-09-14T10:44:52.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f80b3606640 1 -- 172.21.15.96:0/3137987617 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b8003600 con 0x55aebb2d0fe0 2024-09-14T10:44:52.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f80b3606640 1 -- 172.21.15.96:0/3137987617 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b8003920 con 0x55aebb2d0fe0 2024-09-14T10:44:52.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/3137987617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d0fe0 msgr2=0x55aebb3bc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/3137987617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d0fe0 0x55aebb3bc210 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f81b8006fb0 tx=0x7f81b8001b10 comp rx=0 tx=0).stop 2024-09-14T10:44:52.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/3137987617 shutdown_connections 2024-09-14T10:44:52.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/3137987617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d0fe0 0x55aebb3bc210 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/3137987617 >> 172.21.15.96:0/3137987617 conn(0x55aebb2ccb00 msgr2=0x55aebb3b7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/3137987617 shutdown_connections 2024-09-14T10:44:52.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/3137987617 wait complete. 2024-09-14T10:44:52.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 Processor -- start 2024-09-14T10:44:52.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 -- start start 2024-09-14T10:44:52.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb3c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c76ed9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aebb17aa50 con 0x55aebb2d5130 2024-09-14T10:44:52.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c51f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb3c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c51f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb3c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38074/0 (socket says 172.21.15.96:38074) 2024-09-14T10:44:52.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c51f3640 1 -- 172.21.15.96:0/2786627126 learned_addr learned my addr 172.21.15.96:0/2786627126 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c51f3640 1 -- 172.21.15.96:0/2786627126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebb3c43b0 con 0x55aebb2d5130 2024-09-14T10:44:52.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.743+0000 7f81c51f3640 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb3c3e50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x55aebb3bd1d0 tx=0x7f81b8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f80b1e03640 1 -- 172.21.15.96:0/2786627126 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b8025070 con 0x55aebb2d5130 2024-09-14T10:44:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f80b1e03640 1 -- 172.21.15.96:0/2786627126 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b8019040 con 0x55aebb2d5130 2024-09-14T10:44:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebb3c4640 con 0x55aebb2d5130 2024-09-14T10:44:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f80b1e03640 1 -- 172.21.15.96:0/2786627126 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b8013680 con 0x55aebb2d5130 2024-09-14T10:44:52.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebb3c4f50 con 0x55aebb2d5130 2024-09-14T10:44:52.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f80b1e03640 1 -- 172.21.15.96:0/2786627126 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f81b8010070 con 0x55aebb2d5130 2024-09-14T10:44:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f80b1e03640 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f80ac03a1a0 0x7f80ac03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f80b1e03640 1 -- 172.21.15.96:0/2786627126 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f81b8050100 con 0x55aebb2d5130 2024-09-14T10:44:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3c8f10 0x55aebb3cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c49f2640 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f80ac03a1a0 0x7f80ac03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb3cb840 con 0x55aebb3c8f10 2024-09-14T10:44:52.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c59f4640 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3c8f10 0x55aebb3cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c49f2640 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f80ac03a1a0 0x7f80ac03c660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81b00ae000 tx=0x7f81b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c59f4640 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3c8f10 0x55aebb3cb300 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c59f4640 1 -- 172.21.15.96:0/2786627126 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81c000a510 con 0x55aebb3c8f10 2024-09-14T10:44:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb3cbbe0 con 0x55aebb3c8f10 2024-09-14T10:44:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.747+0000 7f81c59f4640 1 -- 172.21.15.96:0/2786627126 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81c000a510 con 0x55aebb3c8f10 2024-09-14T10:44:52.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb3cd4e0 con 0x55aebb3c8f10 2024-09-14T10:44:52.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c59f4640 1 -- 172.21.15.96:0/2786627126 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81c000a510 con 0x55aebb3c8f10 2024-09-14T10:44:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb3cc710 con 0x55aebb3c8f10 2024-09-14T10:44:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c59f4640 1 -- 172.21.15.96:0/2786627126 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81c000a510 con 0x55aebb3c8f10 2024-09-14T10:44:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb3ccb60 con 0x55aebb3c8f10 2024-09-14T10:44:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c59f4640 1 -- 172.21.15.96:0/2786627126 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81c000a510 con 0x55aebb3c8f10 2024-09-14T10:44:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 Processor -- start 2024-09-14T10:44:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 -- start start 2024-09-14T10:44:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2474b0 0x55aebb245d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aebb1e5d80 con 0x55aebb2474b0 2024-09-14T10:44:52.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c49f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2474b0 0x55aebb245d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c49f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2474b0 0x55aebb245d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38090/0 (socket says 172.21.15.96:38090) 2024-09-14T10:44:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c49f2640 1 -- 172.21.15.96:0/1766511965 learned_addr learned my addr 172.21.15.96:0/1766511965 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c49f2640 1 -- 172.21.15.96:0/1766511965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebb2479d0 con 0x55aebb2474b0 2024-09-14T10:44:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c49f2640 1 --2- 172.21.15.96:0/1766511965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2474b0 0x55aebb245d50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f81b0018f40 tx=0x7f81b00180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f80aaffd640 1 -- 172.21.15.96:0/1766511965 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b00c6070 con 0x55aebb2474b0 2024-09-14T10:44:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f80aaffd640 1 -- 172.21.15.96:0/1766511965 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b00c2790 con 0x55aebb2474b0 2024-09-14T10:44:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/1766511965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebb246290 con 0x55aebb2474b0 2024-09-14T10:44:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f80aaffd640 1 -- 172.21.15.96:0/1766511965 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b00c2a70 con 0x55aebb2474b0 2024-09-14T10:44:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.751+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/1766511965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebb2467a0 con 0x55aebb2474b0 2024-09-14T10:44:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f80aaffd640 1 -- 172.21.15.96:0/1766511965 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f81b00c9070 con 0x55aebb2474b0 2024-09-14T10:44:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f80aaffd640 1 --2- 172.21.15.96:0/1766511965 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809c03a140 0x7f809c03c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f80aaffd640 1 -- 172.21.15.96:0/1766511965 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f81b00ee390 con 0x55aebb2474b0 2024-09-14T10:44:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c59f4640 1 --2- 172.21.15.96:0/1766511965 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809c03a140 0x7f809c03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 Processor -- start 2024-09-14T10:44:52.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 -- start start 2024-09-14T10:44:52.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c59f4640 1 --2- 172.21.15.96:0/1766511965 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809c03a140 0x7f809c03c600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55aebb3cc230 tx=0x7f81c0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3eb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aebb3bcc30 con 0x55aebb3eb2b0 2024-09-14T10:44:52.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c49f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c49f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3eb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38100/0 (socket says 172.21.15.96:38100) 2024-09-14T10:44:52.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c49f2640 1 -- 172.21.15.96:0/2407157782 learned_addr learned my addr 172.21.15.96:0/2407157782 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c49f2640 1 -- 172.21.15.96:0/2407157782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebb3ebc80 con 0x55aebb3eb2b0 2024-09-14T10:44:52.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c49f2640 1 --2- 172.21.15.96:0/2407157782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3eb690 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f81b00ec760 tx=0x7f81b00b4af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ef2f02f034d951 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f80a8ff9640 1 -- 172.21.15.96:0/2407157782 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b00c2e50 con 0x55aebb3eb2b0 2024-09-14T10:44:52.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f80a8ff9640 1 -- 172.21.15.96:0/2407157782 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b00eb150 con 0x55aebb3eb2b0 2024-09-14T10:44:52.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f80a8ff9640 1 -- 172.21.15.96:0/2407157782 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b00ee070 con 0x55aebb3eb2b0 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2407157782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 msgr2=0x55aebb3eb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2407157782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3eb690 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f81b00ec760 tx=0x7f81b00b4af0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2407157782 shutdown_connections 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2407157782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3eb690 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2407157782 >> 172.21.15.96:0/2407157782 conn(0x55aebb3e6670 msgr2=0x55aebb3e48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2407157782 shutdown_connections 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2407157782 wait complete. 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.755+0000 7f81c76ed9c0 1 Processor -- start 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c76ed9c0 1 -- start start 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c76ed9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c76ed9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aebb3ea1a0 con 0x55aebb3eb2b0 2024-09-14T10:44:52.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c49f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c49f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3f1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38108/0 (socket says 172.21.15.96:38108) 2024-09-14T10:44:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 learned_addr learned my addr 172.21.15.96:0/2524529362 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebb3f1ce0 con 0x55aebb3eb2b0 2024-09-14T10:44:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c49f2640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3f1780 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f81b00ec6e0 tx=0x7f81b00ec5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f809affd640 1 -- 172.21.15.96:0/2524529362 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b0009a70 con 0x55aebb3eb2b0 2024-09-14T10:44:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebb3f1f70 con 0x55aebb3eb2b0 2024-09-14T10:44:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f809affd640 1 -- 172.21.15.96:0/2524529362 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b00f3070 con 0x55aebb3eb2b0 2024-09-14T10:44:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f809affd640 1 -- 172.21.15.96:0/2524529362 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b00b4510 con 0x55aebb3eb2b0 2024-09-14T10:44:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebb3f2920 con 0x55aebb3eb2b0 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f809affd640 1 -- 172.21.15.96:0/2524529362 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f81b00bf050 con 0x55aebb3eb2b0 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f809affd640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809003a100 0x7f809003c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f809affd640 1 -- 172.21.15.96:0/2524529362 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f81b0002040 con 0x55aebb3eb2b0 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c59f4640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809003a100 0x7f809003c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3fccf0 0x55aebb3ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb3ff900 con 0x55aebb3fccf0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c51f3640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3fccf0 0x55aebb3ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c51f3640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3fccf0 0x55aebb3ff1b0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.759+0000 7f81c59f4640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809003a100 0x7f809003c5c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81c000e3f0 tx=0x7f81c001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 realm 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb3ffd10 con 0x55aebb3fccf0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb4005e0 con 0x55aebb3fccf0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb400980 con 0x55aebb3fccf0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb4011d0 con 0x55aebb3fccf0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:52.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 20 searching for the correct realm 2024-09-14T10:44:52.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55aebb402f40 0x55aebb405330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c49f2640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55aebb402f40 0x55aebb405330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c49f2640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55aebb402f40 0x55aebb405330 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c49f2640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f81b00e0050 0x7f81b00f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81b00e0050 2024-09-14T10:44:52.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c59f4640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f81b00e0050 0x7f81b00f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c59f4640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f81b00e0050 0x7f81b00f8a30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c59f4640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f81c0019040 0x7f81c00328d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81c0019040 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.763+0000 7f81c51f3640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f81c0019040 0x7f81c00328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f81c0019040 0x7f81c00328d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb3fccf0 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb3fccf0 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81c0019040 2024-09-14T10:44:52.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81c0019040 2024-09-14T10:44:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81b00e0050 2024-09-14T10:44:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb3fccf0 2024-09-14T10:44:52.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.767+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81c0019040 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb3fccf0 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81b00e0050 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81c0019040 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb3fccf0 2024-09-14T10:44:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb3fccf0 2024-09-14T10:44:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.771+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81c0019040 2024-09-14T10:44:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81b00e0050 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb3fccf0 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81b00e0050 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81c0019040 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81b00e0050 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb402f40 2024-09-14T10:44:52.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81c0019040 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x55aebb3fccf0 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.775+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55aebb405960 con 0x7f81b00e0050 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb401b50 con 0x55aebb3fccf0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb4023f0 con 0x55aebb3fccf0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb4023f0 con 0x55aebb3fccf0 2024-09-14T10:44:52.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 zone default found 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 4 Realm: () 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 zonegroup default 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb402410 con 0x7f81b00e0050 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb407d00 con 0x55aebb402f40 2024-09-14T10:44:52.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb408110 con 0x55aebb402f40 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 started sync module instance, tier type = 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb407190 con 0x7f81b00e0050 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94208954234240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb408a20 con 0x7f81b00e0050 2024-09-14T10:44:52.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.779+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb409270 con 0x55aebb3fccf0 2024-09-14T10:44:52.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.783+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94208954234240] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.783+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.783+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94208954238320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb408e40 con 0x55aebb3fccf0 2024-09-14T10:44:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.783+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb409940 con 0x55aebb402f40 2024-09-14T10:44:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94208954242096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40a1e0 con 0x55aebb402f40 2024-09-14T10:44:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40ac00 con 0x7f81b00e0050 2024-09-14T10:44:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94208954238320] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94208954246896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40aff0 con 0x7f81b00e0050 2024-09-14T10:44:52.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40b9b0 con 0x55aebb3fccf0 2024-09-14T10:44:52.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94208954242096] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94208954246896] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94208954239376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40b500 con 0x55aebb3fccf0 2024-09-14T10:44:52.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.787+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40c250 con 0x7f81c0019040 2024-09-14T10:44:52.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.791+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94208954239376] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.791+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.791+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94208954244400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40bf40 con 0x7f81c0019040 2024-09-14T10:44:52.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.791+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40c790 con 0x7f81c0019040 2024-09-14T10:44:52.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.791+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94208954244400] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.791+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.791+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94208954252192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40c590 con 0x7f81c0019040 2024-09-14T10:44:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.791+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40d0b0 con 0x7f81c0019040 2024-09-14T10:44:52.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94208954252192] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94208954256256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40d070 con 0x7f81c0019040 2024-09-14T10:44:52.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 20 add_watcher() i=0 2024-09-14T10:44:52.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 20 add_watcher() i=1 2024-09-14T10:44:52.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 20 add_watcher() i=2 2024-09-14T10:44:52.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 20 add_watcher() i=3 2024-09-14T10:44:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 20 add_watcher() i=4 2024-09-14T10:44:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 20 add_watcher() i=5 2024-09-14T10:44:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 20 add_watcher() i=6 2024-09-14T10:44:52.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94208954256256] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 20 add_watcher() i=7 2024-09-14T10:44:52.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:52.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.795+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb410530 con 0x55aebb3fccf0 2024-09-14T10:44:52.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94208954253312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb40da50 con 0x55aebb3fccf0 2024-09-14T10:44:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94208954253312] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f807b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:52.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 5 note: GC not initialized 2024-09-14T10:44:52.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f807a7e4640 20 reqs_thread_entry: start 2024-09-14T10:44:52.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 20 Filter name: none 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f7febfff640 20 reqs_thread_entry: start 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb433da0 con 0x55aebb3fccf0 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:52.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.799+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb43a360 con 0x55aebb3fccf0 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c76ed9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c76ed9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c76ed9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94208954441200 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55aebb435c40 con 0x55aebb3fccf0 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94208954239376 notify 146028888092 ret 0) ==== 621+0+0 (crc 0 0 0) 0x55aebb3c4f50 con 0x55aebb3fccf0 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f80a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94208954239376 notifier 4655 bl.length()=579 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f80a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f80a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(64 notify.4 [notify cookie 94208954441200 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f80a8ff9640 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8088003eb0 con 0x55aebb3fccf0 2024-09-14T10:44:52.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94208954441200 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55aebb3c4640 con 0x55aebb3fccf0 2024-09-14T10:44:52.803 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:52.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f807b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.803+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94208954253312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb431970 con 0x55aebb3fccf0 2024-09-14T10:44:52.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94208954253312] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94208954234240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb431970 con 0x7f81b00e0050 2024-09-14T10:44:52.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94208954234240] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c76ed9c0 20 remove_watcher() i=0 2024-09-14T10:44:52.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c76ed9c0 2 removed watcher, disabling cache 2024-09-14T10:44:52.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94208954238320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb407580 con 0x55aebb3fccf0 2024-09-14T10:44:52.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94208954238320] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c76ed9c0 20 remove_watcher() i=1 2024-09-14T10:44:52.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.807+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94208954242096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb431970 con 0x55aebb402f40 2024-09-14T10:44:52.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.811+0000 7f81c49f2640 1 -- 172.21.15.96:0/2524529362 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94208954242096] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b00d2070 con 0x55aebb402f40 2024-09-14T10:44:52.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.811+0000 7f81c76ed9c0 20 remove_watcher() i=2 2024-09-14T10:44:52.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.811+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94208954246896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb408570 con 0x7f81b00e0050 2024-09-14T10:44:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.811+0000 7f81c59f4640 1 -- 172.21.15.96:0/2524529362 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94208954246896] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81c002f040 con 0x7f81b00e0050 2024-09-14T10:44:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.811+0000 7f81c76ed9c0 20 remove_watcher() i=3 2024-09-14T10:44:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.811+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94208954239376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb407580 con 0x55aebb3fccf0 2024-09-14T10:44:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.815+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94208954239376] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x55aebb3fccf0 2024-09-14T10:44:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.815+0000 7f81c76ed9c0 20 remove_watcher() i=4 2024-09-14T10:44:52.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.815+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94208954244400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb409430 con 0x7f81c0019040 2024-09-14T10:44:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.815+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94208954244400] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.815+0000 7f81c76ed9c0 20 remove_watcher() i=5 2024-09-14T10:44:52.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.815+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94208954252192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb407580 con 0x7f81c0019040 2024-09-14T10:44:52.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94208954252192] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 20 remove_watcher() i=6 2024-09-14T10:44:52.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94208954256256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55aebb409430 con 0x7f81c0019040 2024-09-14T10:44:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94208954256256] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b800f030 con 0x7f81c0019040 2024-09-14T10:44:52.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 20 remove_watcher() i=7 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f81c0019040 msgr2=0x7f81c00328d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f81c0019040 0x7f81c00328d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3fccf0 msgr2=0x55aebb3ff1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3fccf0 0x55aebb3ff1b0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f81b00e0050 msgr2=0x7f81b00f8a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f81b00e0050 0x7f81b00f8a30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55aebb402f40 msgr2=0x55aebb405330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55aebb402f40 0x55aebb405330 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809003a100 msgr2=0x7f809003c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809003a100 0x7f809003c5c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81c000e3f0 tx=0x7f81c001b070 comp rx=0 tx=0).stop 2024-09-14T10:44:52.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c51f3640 1 -- 172.21.15.96:0/2524529362 reap_dead start 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 msgr2=0x55aebb3f1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3f1780 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f81b00ec6e0 tx=0x7f81b00ec5b0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 shutdown_connections 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2524529362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb3eb2b0 0x55aebb3f1780 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 >> 172.21.15.96:0/2524529362 conn(0x55aebb3e6670 msgr2=0x55aebb3e4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 shutdown_connections 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.819+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2524529362 wait complete. 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/1766511965 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809c03a140 msgr2=0x7f809c03c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/1766511965 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809c03a140 0x7f809c03c600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55aebb3cc230 tx=0x7f81c0003070 comp rx=0 tx=0).stop 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/1766511965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2474b0 msgr2=0x55aebb245d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/1766511965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2474b0 0x55aebb245d50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f81b0018f40 tx=0x7f81b00180b0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/1766511965 shutdown_connections 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/1766511965 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f809c03a140 0x7f809c03c600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/1766511965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2474b0 0x55aebb245d50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/1766511965 >> 172.21.15.96:0/1766511965 conn(0x55aebb3d11d0 msgr2=0x55aebb3d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/1766511965 shutdown_connections 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/1766511965 wait complete. 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3c8f10 msgr2=0x55aebb3cb300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3c8f10 0x55aebb3cb300 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f80ac03a1a0 msgr2=0x7f80ac03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f80ac03a1a0 0x7f80ac03c660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81b00ae000 tx=0x7f81b00a6000 comp rx=0 tx=0).stop 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 msgr2=0x55aebb3c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb3c3e50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x55aebb3bd1d0 tx=0x7f81b8001260 comp rx=0 tx=0).stop 2024-09-14T10:44:52.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 shutdown_connections 2024-09-14T10:44:52.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55aebb3c8f10 0x55aebb3cb300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f80ac03a1a0 0x7f80ac03c660 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 --2- 172.21.15.96:0/2786627126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aebb2d5130 0x55aebb3c3e50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 >> 172.21.15.96:0/2786627126 conn(0x55aebb2ccb00 msgr2=0x55aebb3bd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 shutdown_connections 2024-09-14T10:44:52.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.823+0000 7f81c76ed9c0 1 -- 172.21.15.96:0/2786627126 wait complete. 2024-09-14T10:44:52.833 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:52.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-14T10:44:52.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-14T10:44:52.833 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-14T10:44:52.914 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:52.914 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:52.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.915+0000 7ffb654809c0 1 Processor -- start 2024-09-14T10:44:52.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.915+0000 7ffb654809c0 1 -- start start 2024-09-14T10:44:52.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.915+0000 7ffb654809c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559f6da03e60 0x559f6da04240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.915+0000 7ffb654809c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f6d8ad7a0 con 0x559f6da07040 2024-09-14T10:44:52.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.915+0000 7ffb654809c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x559f6d9091b0 con 0x559f6da03e60 2024-09-14T10:44:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb62f86640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559f6da03e60 0x559f6da04240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb62785640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x559f6da07040 0x559f6da09430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:39256/0 (socket says 172.21.15.96:39256) 2024-09-14T10:44:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb62f86640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559f6da03e60 0x559f6da04240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38112/0 (socket says 172.21.15.96:38112) 2024-09-14T10:44:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb62785640 1 -- 172.21.15.96:0/42460300 learned_addr learned my addr 172.21.15.96:0/42460300 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb61f84640 1 -- 172.21.15.96:0/42460300 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496526258 0 0) 0x559f6d8ad7a0 con 0x559f6da07040 2024-09-14T10:44:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb61f84640 1 -- 172.21.15.96:0/42460300 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb50001e20 con 0x559f6da07040 2024-09-14T10:44:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb62f86640 1 -- 172.21.15.96:0/42460300 >> v1:172.21.15.70:6789/0 conn(0x559f6da07040 legacy=0x559f6da09430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb62f86640 1 -- 172.21.15.96:0/42460300 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6d887da0 con 0x559f6da03e60 2024-09-14T10:44:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb62f86640 1 --2- 172.21.15.96:0/42460300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6da04240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00a610 tx=0x7ffb5c01d140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8587d22b19d115f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb61f84640 1 -- 172.21.15.96:0/42460300 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c0b1070 con 0x559f6da03e60 2024-09-14T10:44:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb61f84640 1 -- 172.21.15.96:0/42460300 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c00a200 con 0x559f6da03e60 2024-09-14T10:44:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.919+0000 7ffb61f84640 1 -- 172.21.15.96:0/42460300 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c0085a0 con 0x559f6da03e60 2024-09-14T10:44:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.923+0000 7ffb654809c0 1 -- 172.21.15.96:0/42460300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 msgr2=0x559f6da04240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.923+0000 7ffb654809c0 1 --2- 172.21.15.96:0/42460300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6da04240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00a610 tx=0x7ffb5c01d140 comp rx=0 tx=0).stop 2024-09-14T10:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.923+0000 7ffb654809c0 1 -- 172.21.15.96:0/42460300 shutdown_connections 2024-09-14T10:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.923+0000 7ffb654809c0 1 --2- 172.21.15.96:0/42460300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6da04240 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.923+0000 7ffb654809c0 1 -- 172.21.15.96:0/42460300 >> 172.21.15.96:0/42460300 conn(0x559f6d9ff980 msgr2=0x559f6da01da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.923+0000 7ffb654809c0 1 -- 172.21.15.96:0/42460300 shutdown_connections 2024-09-14T10:44:52.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.923+0000 7ffb654809c0 1 -- 172.21.15.96:0/42460300 wait complete. 2024-09-14T10:44:52.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.935+0000 7ffb654809c0 1 Processor -- start 2024-09-14T10:44:52.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.935+0000 7ffb654809c0 1 -- start start 2024-09-14T10:44:52.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.935+0000 7ffb654809c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.935+0000 7ffb654809c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559f6d90cfc0 con 0x559f6da03e60 2024-09-14T10:44:52.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb62f86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb62f86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38124/0 (socket says 172.21.15.96:38124) 2024-09-14T10:44:52.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb62f86640 1 -- 172.21.15.96:0/848646464 learned_addr learned my addr 172.21.15.96:0/848646464 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb62f86640 1 -- 172.21.15.96:0/848646464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6daee710 con 0x559f6da03e60 2024-09-14T10:44:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb62f86640 1 --2- 172.21.15.96:0/848646464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daee120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c01cbb0 tx=0x7ffb5c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6ba9e78510f132 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffa50e09640 1 -- 172.21.15.96:0/848646464 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c0b1070 con 0x559f6da03e60 2024-09-14T10:44:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffa50e09640 1 -- 172.21.15.96:0/848646464 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0bb070 con 0x559f6da03e60 2024-09-14T10:44:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffa50e09640 1 -- 172.21.15.96:0/848646464 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c0086d0 con 0x559f6da03e60 2024-09-14T10:44:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 -- 172.21.15.96:0/848646464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 msgr2=0x559f6daee120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 --2- 172.21.15.96:0/848646464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daee120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c01cbb0 tx=0x7ffb5c003030 comp rx=0 tx=0).stop 2024-09-14T10:44:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 -- 172.21.15.96:0/848646464 shutdown_connections 2024-09-14T10:44:52.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 --2- 172.21.15.96:0/848646464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daee120 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 -- 172.21.15.96:0/848646464 >> 172.21.15.96:0/848646464 conn(0x559f6d9ff980 msgr2=0x559f6dae9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 -- 172.21.15.96:0/848646464 shutdown_connections 2024-09-14T10:44:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 -- 172.21.15.96:0/848646464 wait complete. 2024-09-14T10:44:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 Processor -- start 2024-09-14T10:44:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 -- start start 2024-09-14T10:44:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daf5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb654809c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559f6d8aea50 con 0x559f6da03e60 2024-09-14T10:44:52.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb62f86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daf5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb62f86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daf5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38132/0 (socket says 172.21.15.96:38132) 2024-09-14T10:44:52.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.939+0000 7ffb62f86640 1 -- 172.21.15.96:0/2324369857 learned_addr learned my addr 172.21.15.96:0/2324369857 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb62f86640 1 -- 172.21.15.96:0/2324369857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6daf5db0 con 0x559f6da03e60 2024-09-14T10:44:52.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb62f86640 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daf5850 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c000c10 tx=0x7ffb5c019ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffa4f606640 1 -- 172.21.15.96:0/2324369857 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c0ac800 con 0x559f6da03e60 2024-09-14T10:44:52.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffa4f606640 1 -- 172.21.15.96:0/2324369857 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0bb040 con 0x559f6da03e60 2024-09-14T10:44:52.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f6daf6040 con 0x559f6da03e60 2024-09-14T10:44:52.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffa4f606640 1 -- 172.21.15.96:0/2324369857 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c0acad0 con 0x559f6da03e60 2024-09-14T10:44:52.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6daf6a70 con 0x559f6da03e60 2024-09-14T10:44:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffa4f606640 1 -- 172.21.15.96:0/2324369857 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ffb5c0b6400 con 0x559f6da03e60 2024-09-14T10:44:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffa4f606640 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa4803a150 0x7ffa4803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffa4f606640 1 -- 172.21.15.96:0/2324369857 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffb5c0ed3c0 con 0x559f6da03e60 2024-09-14T10:44:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb62785640 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa4803a150 0x7ffa4803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6da07040 0x559f6dafc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6dafcf00 con 0x559f6da07040 2024-09-14T10:44:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb63787640 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6da07040 0x559f6dafc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb62785640 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa4803a150 0x7ffa4803c610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c001dc0 tx=0x7ffb4c001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb63787640 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6da07040 0x559f6dafc9c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb63787640 1 -- 172.21.15.96:0/2324369857 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb5400a4d0 con 0x559f6da07040 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6daf6d50 con 0x559f6da07040 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb63787640 1 -- 172.21.15.96:0/2324369857 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb5400a4d0 con 0x559f6da07040 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.943+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6dafec60 con 0x559f6da07040 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb63787640 1 -- 172.21.15.96:0/2324369857 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb5400a4d0 con 0x559f6da07040 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6dafdec0 con 0x559f6da07040 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb63787640 1 -- 172.21.15.96:0/2324369857 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb5400a4d0 con 0x559f6da07040 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6dafe310 con 0x559f6da07040 2024-09-14T10:44:52.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb63787640 1 -- 172.21.15.96:0/2324369857 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb5400a4d0 con 0x559f6da07040 2024-09-14T10:44:52.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb654809c0 1 Processor -- start 2024-09-14T10:44:52.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb654809c0 1 -- start start 2024-09-14T10:44:52.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb654809c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db0cfc0 0x559f6db0d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb654809c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559f6d919d80 con 0x559f6db0cfc0 2024-09-14T10:44:52.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb62785640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db0cfc0 0x559f6db0d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb62785640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db0cfc0 0x559f6db0d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38144/0 (socket says 172.21.15.96:38144) 2024-09-14T10:44:52.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb62785640 1 -- 172.21.15.96:0/2384429377 learned_addr learned my addr 172.21.15.96:0/2384429377 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb62785640 1 -- 172.21.15.96:0/2384429377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6db0da20 con 0x559f6db0cfc0 2024-09-14T10:44:52.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb62785640 1 --2- 172.21.15.96:0/2384429377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db0cfc0 0x559f6db0d3e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00d460 tx=0x7ffb4c00d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffa4ce01640 1 -- 172.21.15.96:0/2384429377 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c00c6b0 con 0x559f6db0cfc0 2024-09-14T10:44:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffa4ce01640 1 -- 172.21.15.96:0/2384429377 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c00c850 con 0x559f6db0cfc0 2024-09-14T10:44:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb654809c0 1 -- 172.21.15.96:0/2384429377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f6db0e280 con 0x559f6db0cfc0 2024-09-14T10:44:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffa4ce01640 1 -- 172.21.15.96:0/2384429377 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c00cb50 con 0x559f6db0cfc0 2024-09-14T10:44:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.947+0000 7ffb654809c0 1 -- 172.21.15.96:0/2384429377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6db0e7f0 con 0x559f6db0cfc0 2024-09-14T10:44:52.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffa4ce01640 1 -- 172.21.15.96:0/2384429377 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ffb4c023020 con 0x559f6db0cfc0 2024-09-14T10:44:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffa4ce01640 1 --2- 172.21.15.96:0/2384429377 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa3c03a150 0x7ffa3c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffa4ce01640 1 -- 172.21.15.96:0/2384429377 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffb4c021020 con 0x559f6db0cfc0 2024-09-14T10:44:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb63787640 1 --2- 172.21.15.96:0/2384429377 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa3c03a150 0x7ffa3c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 Processor -- start 2024-09-14T10:44:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 -- start start 2024-09-14T10:44:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb63787640 1 --2- 172.21.15.96:0/2384429377 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa3c03a150 0x7ffa3c03c610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x559f6dafd9e0 tx=0x7ffb54005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db19d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559f6daeea80 con 0x559f6db19940 2024-09-14T10:44:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb62785640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db19d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb62785640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db19d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38158/0 (socket says 172.21.15.96:38158) 2024-09-14T10:44:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb62785640 1 -- 172.21.15.96:0/2321242650 learned_addr learned my addr 172.21.15.96:0/2321242650 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb62785640 1 -- 172.21.15.96:0/2321242650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6db1a2f0 con 0x559f6db19940 2024-09-14T10:44:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb62785640 1 --2- 172.21.15.96:0/2321242650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db19d20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c051830 tx=0x7ffb4c044740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14b2d76980280fc server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffa467fc640 1 -- 172.21.15.96:0/2321242650 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c01bcc0 con 0x559f6db19940 2024-09-14T10:44:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffa467fc640 1 -- 172.21.15.96:0/2321242650 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c050270 con 0x559f6db19940 2024-09-14T10:44:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffa467fc640 1 -- 172.21.15.96:0/2321242650 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c01be60 con 0x559f6db19940 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 -- 172.21.15.96:0/2321242650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 msgr2=0x559f6db19d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2321242650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db19d20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c051830 tx=0x7ffb4c044740 comp rx=0 tx=0).stop 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 -- 172.21.15.96:0/2321242650 shutdown_connections 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2321242650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db19d20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 -- 172.21.15.96:0/2321242650 >> 172.21.15.96:0/2321242650 conn(0x559f6db15d70 msgr2=0x559f6db13fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 -- 172.21.15.96:0/2321242650 shutdown_connections 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 -- 172.21.15.96:0/2321242650 wait complete. 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 Processor -- start 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.951+0000 7ffb654809c0 1 -- start start 2024-09-14T10:44:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb654809c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db20eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb654809c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559f6db1a950 con 0x559f6db19940 2024-09-14T10:44:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb62785640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db20eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb62785640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db20eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38172/0 (socket says 172.21.15.96:38172) 2024-09-14T10:44:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 learned_addr learned my addr 172.21.15.96:0/3018290655 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6db21410 con 0x559f6db19940 2024-09-14T10:44:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb62785640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db20eb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009460 tx=0x7ffb4c051790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffa44ff9640 1 -- 172.21.15.96:0/3018290655 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c009b20 con 0x559f6db19940 2024-09-14T10:44:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f6db21410 con 0x559f6db19940 2024-09-14T10:44:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffa44ff9640 1 -- 172.21.15.96:0/3018290655 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c035070 con 0x559f6db19940 2024-09-14T10:44:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffa44ff9640 1 -- 172.21.15.96:0/3018290655 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c009df0 con 0x559f6db19940 2024-09-14T10:44:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6db21410 con 0x559f6db19940 2024-09-14T10:44:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffa44ff9640 1 -- 172.21.15.96:0/3018290655 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ffb4c0194e0 con 0x559f6db19940 2024-09-14T10:44:52.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffa44ff9640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa2c03a150 0x7ffa2c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffa44ff9640 1 -- 172.21.15.96:0/3018290655 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffb4c04a040 con 0x559f6db19940 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb63787640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa2c03a150 0x7ffa2c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb654809c0 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6db2c0b0 0x559f6db2e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db2ecc0 con 0x559f6db2c0b0 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb62f86640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6db2c0b0 0x559f6db2e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb63787640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa2c03a150 0x7ffa2c03c610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x559f6daf6c90 tx=0x7ffb5401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.955+0000 7ffb62f86640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6db2c0b0 0x559f6db2e570 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 realm 2024-09-14T10:44:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db2f0d0 con 0x559f6db2c0b0 2024-09-14T10:44:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db2f9a0 con 0x559f6db2c0b0 2024-09-14T10:44:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db2fd40 con 0x559f6db2c0b0 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db30590 con 0x559f6db2c0b0 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 20 searching for the correct realm 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559f6db32300 0x559f6db346f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62785640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559f6db32300 0x559f6db346f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62785640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559f6db32300 0x559f6db346f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62785640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffb4c046b80 0x7ffb4c044870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb4c046b80 2024-09-14T10:44:52.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb63787640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffb4c046b80 0x7ffb4c044870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb63787640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffb4c046b80 0x7ffb4c044870 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5401f070 con 0x7ffb4c046b80 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb63787640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffb54031040 0x7ffb54032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb54031040 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.959+0000 7ffb62f86640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffb54031040 0x7ffb54032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffb54031040 0x7ffb54032940 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db2c0b0 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db2c0b0 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb54031040 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb54031040 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb4c046b80 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5401f070 con 0x7ffb4c046b80 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db2c0b0 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb54031040 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.963+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db2c0b0 2024-09-14T10:44:52.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb4c046b80 2024-09-14T10:44:52.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb5401f070 con 0x7ffb4c046b80 2024-09-14T10:44:52.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb54031040 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db2c0b0 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db2c0b0 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb54031040 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.967+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb4c046b80 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5401f070 con 0x7ffb4c046b80 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db2c0b0 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb4c046b80 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5401f070 con 0x7ffb4c046b80 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb54031040 2024-09-14T10:44:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb4c046b80 2024-09-14T10:44:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5401f070 con 0x7ffb4c046b80 2024-09-14T10:44:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db32300 2024-09-14T10:44:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb54031040 2024-09-14T10:44:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x559f6db2c0b0 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f6db34c80 con 0x7ffb4c046b80 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb54040040 con 0x7ffb4c046b80 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb654809c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb654809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb654809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb654809c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb654809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb654809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.971+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db30f10 con 0x559f6db2c0b0 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db317b0 con 0x559f6db2c0b0 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db317b0 con 0x559f6db2c0b0 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 zone default found 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 4 Realm: () 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 zonegroup default 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db35100 con 0x7ffb4c046b80 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb54040040 con 0x7ffb4c046b80 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db37020 con 0x559f6db32300 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db37510 con 0x559f6db32300 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 started sync module instance, tier type = 2024-09-14T10:44:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db36330 con 0x7ffb4c046b80 2024-09-14T10:44:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb54040040 con 0x7ffb4c046b80 2024-09-14T10:44:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143228635216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db36330 con 0x7ffb4c046b80 2024-09-14T10:44:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.975+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db37fd0 con 0x559f6db2c0b0 2024-09-14T10:44:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.979+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94143228635216] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb54040040 con 0x7ffb4c046b80 2024-09-14T10:44:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.979+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.979+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143228639968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db36330 con 0x559f6db2c0b0 2024-09-14T10:44:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.979+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db389e0 con 0x559f6db32300 2024-09-14T10:44:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.979+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.979+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94143228642608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db39230 con 0x559f6db32300 2024-09-14T10:44:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.979+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db39c70 con 0x7ffb4c046b80 2024-09-14T10:44:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.979+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94143228639968] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.983+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb54040040 con 0x7ffb4c046b80 2024-09-14T10:44:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.983+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94143228647232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3a060 con 0x7ffb4c046b80 2024-09-14T10:44:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.983+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3aa20 con 0x559f6db2c0b0 2024-09-14T10:44:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.983+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94143228642608] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.983+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94143228647232] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb54040040 con 0x7ffb4c046b80 2024-09-14T10:44:52.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.983+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.983+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143228632704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3a570 con 0x559f6db2c0b0 2024-09-14T10:44:52.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.983+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3ae20 con 0x7ffb54031040 2024-09-14T10:44:52.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.987+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94143228632704] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.987+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.987+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94143228644736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3aa20 con 0x7ffb54031040 2024-09-14T10:44:52.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.987+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3b760 con 0x7ffb54031040 2024-09-14T10:44:52.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.987+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94143228644736] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.987+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.987+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94143228654096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3b940 con 0x7ffb54031040 2024-09-14T10:44:52.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.987+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3c190 con 0x7ffb54031040 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94143228656416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3c550 con 0x7ffb54031040 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 20 add_watcher() i=0 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 20 add_watcher() i=1 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 20 add_watcher() i=2 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 20 add_watcher() i=3 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 20 add_watcher() i=4 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 20 add_watcher() i=5 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94143228654096] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 20 add_watcher() i=6 2024-09-14T10:44:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94143228656416] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 20 add_watcher() i=7 2024-09-14T10:44:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3a570 con 0x559f6db2c0b0 2024-09-14T10:44:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.991+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94143228650864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db3ca60 con 0x559f6db2c0b0 2024-09-14T10:44:52.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94143228650864] v34'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffa197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:52.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:52.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 5 note: GC not initialized 2024-09-14T10:44:52.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ff993fff640 20 reqs_thread_entry: start 2024-09-14T10:44:52.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:52.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 20 Filter name: none 2024-09-14T10:44:52.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ff991ffb640 20 reqs_thread_entry: start 2024-09-14T10:44:52.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:52.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db62d40 con 0x559f6db2c0b0 2024-09-14T10:44:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 20 rados_obj.operate() r=0 bl.length=403 2024-09-14T10:44:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.995+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db69370 con 0x559f6db2c0b0 2024-09-14T10:44:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb654809c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb654809c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb654809c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:44:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94143228841440 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f6db67ec0 con 0x559f6db2c0b0 2024-09-14T10:44:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== watch-notify(notify (1) cookie 94143228632704 notify 146028888093 ret 0) ==== 609+0+0 (crc 0 0 0) 0x559f6daf6a70 con 0x559f6db2c0b0 2024-09-14T10:44:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffa467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94143228632704 notifier 4662 bl.length()=567 2024-09-14T10:44:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffa467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:44:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffa467fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(64 notify.4 [notify cookie 94143228841440 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffa467fc640 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ffa28003eb0 con 0x559f6db2c0b0 2024-09-14T10:44:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== watch-notify(notify_complete (2) cookie 94143228841440 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f6daf6040 con 0x559f6db2c0b0 2024-09-14T10:44:52.998 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:44:25.136145Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:44:25.136128Z","tags":[],"group_ids":[]} 2024-09-14T10:44:52.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffa197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:52.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94143228650864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db60910 con 0x559f6db2c0b0 2024-09-14T10:44:52.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94143228650864] v34'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:52.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:52.999+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94143228635216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db60910 con 0x7ffb4c046b80 2024-09-14T10:44:53.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.003+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94143228635216] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb54040040 con 0x7ffb4c046b80 2024-09-14T10:44:53.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.003+0000 7ffb654809c0 20 remove_watcher() i=0 2024-09-14T10:44:53.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.003+0000 7ffb654809c0 2 removed watcher, disabling cache 2024-09-14T10:44:53.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.003+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94143228639968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db60910 con 0x559f6db2c0b0 2024-09-14T10:44:53.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.003+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94143228639968] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:53.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.003+0000 7ffb654809c0 20 remove_watcher() i=1 2024-09-14T10:44:53.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.003+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94143228642608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db60910 con 0x559f6db32300 2024-09-14T10:44:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.007+0000 7ffb62785640 1 -- 172.21.15.96:0/3018290655 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94143228642608] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb4c051cc0 con 0x559f6db32300 2024-09-14T10:44:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.007+0000 7ffb654809c0 20 remove_watcher() i=2 2024-09-14T10:44:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.007+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94143228647232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db37ae0 con 0x7ffb4c046b80 2024-09-14T10:44:53.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.007+0000 7ffb63787640 1 -- 172.21.15.96:0/3018290655 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94143228647232] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb54040040 con 0x7ffb4c046b80 2024-09-14T10:44:53.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.007+0000 7ffb654809c0 20 remove_watcher() i=3 2024-09-14T10:44:53.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.007+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94143228632704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db37ae0 con 0x559f6db2c0b0 2024-09-14T10:44:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.011+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94143228632704] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x559f6db2c0b0 2024-09-14T10:44:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.011+0000 7ffb654809c0 20 remove_watcher() i=4 2024-09-14T10:44:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.011+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94143228644736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db35e80 con 0x7ffb54031040 2024-09-14T10:44:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.011+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94143228644736] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.011+0000 7ffb654809c0 20 remove_watcher() i=5 2024-09-14T10:44:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.011+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94143228654096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db37ae0 con 0x7ffb54031040 2024-09-14T10:44:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94143228654096] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 20 remove_watcher() i=6 2024-09-14T10:44:53.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94143228656416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f6db38d80 con 0x7ffb54031040 2024-09-14T10:44:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94143228656416] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb5c0b4070 con 0x7ffb54031040 2024-09-14T10:44:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 20 remove_watcher() i=7 2024-09-14T10:44:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffb54031040 msgr2=0x7ffb54032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7ffb54031040 0x7ffb54032940 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6db2c0b0 msgr2=0x559f6db2e570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6db2c0b0 0x559f6db2e570 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffb4c046b80 msgr2=0x7ffb4c044870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7ffb4c046b80 0x7ffb4c044870 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559f6db32300 msgr2=0x559f6db346f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.015+0000 7ffb654809c0 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559f6db32300 0x559f6db346f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa2c03a150 msgr2=0x7ffa2c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa2c03a150 0x7ffa2c03c610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x559f6daf6c90 tx=0x7ffb5401f000 comp rx=0 tx=0).stop 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 msgr2=0x559f6db20eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/3018290655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db19940 0x559f6db20eb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009460 tx=0x7ffb4c051790 comp rx=0 tx=0).stop 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 reap_dead start 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb62f86640 1 -- 172.21.15.96:0/3018290655 reap_dead start 2024-09-14T10:44:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 shutdown_connections 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 >> 172.21.15.96:0/3018290655 conn(0x559f6db15d70 msgr2=0x559f6db13f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 shutdown_connections 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/3018290655 wait complete. 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2384429377 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa3c03a150 msgr2=0x7ffa3c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2384429377 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa3c03a150 0x7ffa3c03c610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x559f6dafd9e0 tx=0x7ffb54005850 comp rx=0 tx=0).stop 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2384429377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db0cfc0 msgr2=0x559f6db0d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2384429377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db0cfc0 0x559f6db0d3e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00d460 tx=0x7ffb4c00d860 comp rx=0 tx=0).stop 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2384429377 shutdown_connections 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2384429377 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa3c03a150 0x7ffa3c03c610 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2384429377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6db0cfc0 0x559f6db0d3e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2384429377 >> 172.21.15.96:0/2384429377 conn(0x559f6db02970 msgr2=0x559f6db02d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2384429377 shutdown_connections 2024-09-14T10:44:53.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2384429377 wait complete. 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6da07040 msgr2=0x559f6dafc9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6da07040 0x559f6dafc9c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa4803a150 msgr2=0x7ffa4803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa4803a150 0x7ffa4803c610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c001dc0 tx=0x7ffb4c001320 comp rx=0 tx=0).stop 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 msgr2=0x559f6daf5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daf5850 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c000c10 tx=0x7ffb5c019ee0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 shutdown_connections 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559f6da07040 0x559f6dafc9c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ffa4803a150 0x7ffa4803c610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 --2- 172.21.15.96:0/2324369857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559f6da03e60 0x559f6daf5850 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 >> 172.21.15.96:0/2324369857 conn(0x559f6d9ff980 msgr2=0x559f6dae8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 shutdown_connections 2024-09-14T10:44:53.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.019+0000 7ffb654809c0 1 -- 172.21.15.96:0/2324369857 wait complete. 2024-09-14T10:44:53.028 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:44:25.136145Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:44:25.136128Z', 'tags': [], 'group_ids': []} 2024-09-14T10:44:53.044 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:53.045 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-14T10:44:53.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-14T10:44:53.045 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-14T10:44:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.111+0000 7f3e2cc489c0 1 Processor -- start 2024-09-14T10:44:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.111+0000 7f3e2cc489c0 1 -- start start 2024-09-14T10:44:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.111+0000 7f3e2cc489c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fbb0788250 0x55fbb0788630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.111+0000 7f3e2cc489c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fbb062e7a0 con 0x55fbb078b390 2024-09-14T10:44:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.111+0000 7f3e2cc489c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55fbb068a1b0 con 0x55fbb0788250 2024-09-14T10:44:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e2a74e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fbb0788250 0x55fbb0788630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e29f4d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55fbb078b390 0x55fbb078d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:39260/0 (socket says 172.21.15.96:39260) 2024-09-14T10:44:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e29f4d640 1 -- 172.21.15.96:0/2064709155 learned_addr learned my addr 172.21.15.96:0/2064709155 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:44:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e2a74e640 1 -- 172.21.15.96:0/2064709155 >> v1:172.21.15.70:6789/0 conn(0x55fbb078b390 legacy=0x55fbb078d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e2a74e640 1 -- 172.21.15.96:0/2064709155 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbb0608da0 con 0x55fbb0788250 2024-09-14T10:44:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e2a74e640 1 --2- 172.21.15.96:0/2064709155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb0788630 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00a480 tx=0x7f3e1c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbcf3da5f69a891 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e2974c640 1 -- 172.21.15.96:0/2064709155 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c0b0070 con 0x55fbb0788250 2024-09-14T10:44:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e2974c640 1 -- 172.21.15.96:0/2064709155 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0ab540 con 0x55fbb0788250 2024-09-14T10:44:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.115+0000 7f3e2974c640 1 -- 172.21.15.96:0/2064709155 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c0ab840 con 0x55fbb0788250 2024-09-14T10:44:53.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.119+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2064709155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 msgr2=0x55fbb0788630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.119+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2064709155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb0788630 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00a480 tx=0x7f3e1c01b280 comp rx=0 tx=0).stop 2024-09-14T10:44:53.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.119+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2064709155 shutdown_connections 2024-09-14T10:44:53.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.119+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2064709155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb0788630 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.119+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2064709155 >> 172.21.15.96:0/2064709155 conn(0x55fbb06fbb60 msgr2=0x55fbb06fbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.119+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2064709155 shutdown_connections 2024-09-14T10:44:53.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.119+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2064709155 wait complete. 2024-09-14T10:44:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.131+0000 7f3e2cc489c0 1 Processor -- start 2024-09-14T10:44:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- start start 2024-09-14T10:44:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb08735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fbb068dfc0 con 0x55fbb0788250 2024-09-14T10:44:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2a74e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb08735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2a74e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb08735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38196/0 (socket says 172.21.15.96:38196) 2024-09-14T10:44:53.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2a74e640 1 -- 172.21.15.96:0/2080331768 learned_addr learned my addr 172.21.15.96:0/2080331768 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2a74e640 1 -- 172.21.15.96:0/2080331768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbb0873bb0 con 0x55fbb0788250 2024-09-14T10:44:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2a74e640 1 --2- 172.21.15.96:0/2080331768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb08735c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c018eb0 tx=0x7f3e1c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212d8d25e665a2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3d18608640 1 -- 172.21.15.96:0/2080331768 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c0b0070 con 0x55fbb0788250 2024-09-14T10:44:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3d18608640 1 -- 172.21.15.96:0/2080331768 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0b1040 con 0x55fbb0788250 2024-09-14T10:44:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3d18608640 1 -- 172.21.15.96:0/2080331768 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c0ab6f0 con 0x55fbb0788250 2024-09-14T10:44:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2080331768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 msgr2=0x55fbb08735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2080331768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb08735c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c018eb0 tx=0x7f3e1c003030 comp rx=0 tx=0).stop 2024-09-14T10:44:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2080331768 shutdown_connections 2024-09-14T10:44:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2080331768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb08735c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2080331768 >> 172.21.15.96:0/2080331768 conn(0x55fbb06fbb60 msgr2=0x55fbb086f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2080331768 shutdown_connections 2024-09-14T10:44:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2080331768 wait complete. 2024-09-14T10:44:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 Processor -- start 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- start start 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb087adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2cc489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fbb062fa50 con 0x55fbb0788250 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.135+0000 7f3e2a74e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb087adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2a74e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb087adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38198/0 (socket says 172.21.15.96:38198) 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2a74e640 1 -- 172.21.15.96:0/2788660391 learned_addr learned my addr 172.21.15.96:0/2788660391 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2a74e640 1 -- 172.21.15.96:0/2788660391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbb087b320 con 0x55fbb0788250 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2a74e640 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb087adc0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0ab510 tx=0x7f3e1c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3d16e05640 1 -- 172.21.15.96:0/2788660391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c0c4070 con 0x55fbb0788250 2024-09-14T10:44:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbb087b5b0 con 0x55fbb0788250 2024-09-14T10:44:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3d16e05640 1 -- 172.21.15.96:0/2788660391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0b75b0 con 0x55fbb0788250 2024-09-14T10:44:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3d16e05640 1 -- 172.21.15.96:0/2788660391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e1c0b7890 con 0x55fbb0788250 2024-09-14T10:44:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbb087bf60 con 0x55fbb0788250 2024-09-14T10:44:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3d16e05640 1 -- 172.21.15.96:0/2788660391 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3e1c0c7070 con 0x55fbb0788250 2024-09-14T10:44:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3d16e05640 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d1003a150 0x7f3d1003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3d16e05640 1 -- 172.21.15.96:0/2788660391 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3e1c0bc070 con 0x55fbb0788250 2024-09-14T10:44:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e29f4d640 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d1003a150 0x7f3d1003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb078b390 0x55fbb0881f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb0882470 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb078b390 0x55fbb0881f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e29f4d640 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d1003a150 0x7f3d1003c610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001d80 tx=0x7f3e200012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.139+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb078b390 0x55fbb0881f30 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2af4f640 1 -- 172.21.15.96:0/2788660391 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e2400a4d0 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08828c0 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2af4f640 1 -- 172.21.15.96:0/2788660391 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e2400a4d0 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08841c0 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2af4f640 1 -- 172.21.15.96:0/2788660391 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e2400a4d0 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08833f0 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2af4f640 1 -- 172.21.15.96:0/2788660391 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e2400a4d0 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb0883840 con 0x55fbb078b390 2024-09-14T10:44:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2af4f640 1 -- 172.21.15.96:0/2788660391 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e2400a4d0 con 0x55fbb078b390 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 Processor -- start 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 -- start start 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0892580 0x55fbb08929a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fbb069ad80 con 0x55fbb0892580 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e29f4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0892580 0x55fbb08929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e29f4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0892580 0x55fbb08929a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38212/0 (socket says 172.21.15.96:38212) 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e29f4d640 1 -- 172.21.15.96:0/1932740664 learned_addr learned my addr 172.21.15.96:0/1932740664 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e29f4d640 1 -- 172.21.15.96:0/1932740664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbb0892fe0 con 0x55fbb0892580 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e29f4d640 1 --2- 172.21.15.96:0/1932740664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0892580 0x55fbb08929a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000d660 tx=0x7f3e2000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3d0ffff640 1 -- 172.21.15.96:0/1932740664 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e2000c6b0 con 0x55fbb0892580 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1932740664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbb0893840 con 0x55fbb0892580 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3d0ffff640 1 -- 172.21.15.96:0/1932740664 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2000c850 con 0x55fbb0892580 2024-09-14T10:44:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3d0ffff640 1 -- 172.21.15.96:0/1932740664 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e2000cb30 con 0x55fbb0892580 2024-09-14T10:44:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.143+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1932740664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbb0893db0 con 0x55fbb0892580 2024-09-14T10:44:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3d0ffff640 1 -- 172.21.15.96:0/1932740664 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3e20023020 con 0x55fbb0892580 2024-09-14T10:44:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3d0ffff640 1 --2- 172.21.15.96:0/1932740664 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d0403a140 0x7f3d0403c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3d0ffff640 1 -- 172.21.15.96:0/1932740664 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3e20021020 con 0x55fbb0892580 2024-09-14T10:44:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/1932740664 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d0403a140 0x7f3d0403c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 Processor -- start 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 -- start start 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb089f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/1932740664 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d0403a140 0x7f3d0403c600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55fbb0882f10 tx=0x7f3e24005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fbb0873f20 con 0x55fbb089eee0 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e29f4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb089f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e29f4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb089f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38220/0 (socket says 172.21.15.96:38220) 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e29f4d640 1 -- 172.21.15.96:0/1877644801 learned_addr learned my addr 172.21.15.96:0/1877644801 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e29f4d640 1 -- 172.21.15.96:0/1877644801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbb089f890 con 0x55fbb089eee0 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e29f4d640 1 --2- 172.21.15.96:0/1877644801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb089f2c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3e200517d0 tx=0x7f3e20044710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac047a6603f0511f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3d0dffb640 1 -- 172.21.15.96:0/1877644801 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e2001bcc0 con 0x55fbb089eee0 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3d0dffb640 1 -- 172.21.15.96:0/1877644801 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e20050270 con 0x55fbb089eee0 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3d0dffb640 1 -- 172.21.15.96:0/1877644801 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e2001be60 con 0x55fbb089eee0 2024-09-14T10:44:53.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1877644801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 msgr2=0x55fbb089f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/1877644801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb089f2c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3e200517d0 tx=0x7f3e20044710 comp rx=0 tx=0).stop 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1877644801 shutdown_connections 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/1877644801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb089f2c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1877644801 >> 172.21.15.96:0/1877644801 conn(0x55fbb089b310 msgr2=0x55fbb0899550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1877644801 shutdown_connections 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.147+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1877644801 wait complete. 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 1 Processor -- start 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 1 -- start start 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb08a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fbb089fef0 con 0x55fbb089eee0 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e29f4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb08a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e29f4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb08a6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:38224/0 (socket says 172.21.15.96:38224) 2024-09-14T10:44:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 learned_addr learned my addr 172.21.15.96:0/3456702682 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:44:53.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbb08a6970 con 0x55fbb089eee0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e29f4d640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb08a6410 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3e20023480 tx=0x7f3e20051760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3cfbfff640 1 -- 172.21.15.96:0/3456702682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e20019a70 con 0x55fbb089eee0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbb08a6c00 con 0x55fbb089eee0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3cfbfff640 1 -- 172.21.15.96:0/3456702682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e20035070 con 0x55fbb089eee0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3cfbfff640 1 -- 172.21.15.96:0/3456702682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200194e0 con 0x55fbb089eee0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbb08a6c00 con 0x55fbb089eee0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3cfbfff640 1 -- 172.21.15.96:0/3456702682 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3e20019680 con 0x55fbb089eee0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3cfbfff640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3cf403a150 0x7f3cf403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3cfbfff640 1 -- 172.21.15.96:0/3456702682 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3e2004a040 con 0x55fbb089eee0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3cf403a150 0x7f3cf403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb08b17d0 0x55fbb08b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08b43e0 con 0x55fbb08b17d0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.151+0000 7f3e2a74e640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb08b17d0 0x55fbb08b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3cf403a150 0x7f3cf403c610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55fbb087cf20 tx=0x7f3e2401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2a74e640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb08b17d0 0x55fbb08b3c90 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 realm 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08b47f0 con 0x55fbb08b17d0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08b50c0 con 0x55fbb08b17d0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08b5460 con 0x55fbb08b17d0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08b5cb0 con 0x55fbb08b17d0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:44:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 20 searching for the correct realm 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fbb08b7a20 0x55fbb08b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e29f4d640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fbb08b7a20 0x55fbb08b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e29f4d640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fbb08b7a20 0x55fbb08b9e10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e29f4d640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3e2001c070 0x7f3e2003f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e2001c070 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3e2001c070 0x7f3e2003f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3e2001c070 0x7f3e2003f200 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2401f070 con 0x7f3e2001c070 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2af4f640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3e24031040 0x7f3e24032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:44:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e24031040 2024-09-14T10:44:53.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.155+0000 7f3e2a74e640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3e24031040 0x7f3e24032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:44:53.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3e24031040 0x7f3e24032430 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:44:53.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b17d0 2024-09-14T10:44:53.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b17d0 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e24031040 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e24031040 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e2001c070 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2401f070 con 0x7f3e2001c070 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b17d0 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.159+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e24031040 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b17d0 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e2001c070 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e2401f070 con 0x7f3e2001c070 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e24031040 2024-09-14T10:44:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b17d0 2024-09-14T10:44:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b17d0 2024-09-14T10:44:53.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e24031040 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.163+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e2001c070 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2401f070 con 0x7f3e2001c070 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b17d0 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e2001c070 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2401f070 con 0x7f3e2001c070 2024-09-14T10:44:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e24031040 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e2001c070 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2401f070 con 0x7f3e2001c070 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e24031040 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x55fbb08b17d0 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.167+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba3a0 con 0x7f3e2001c070 2024-09-14T10:44:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08b6630 con 0x55fbb08b17d0 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08b6ed0 con 0x55fbb08b17d0 2024-09-14T10:44:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08b6ed0 con 0x55fbb08b17d0 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 zone default found 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 4 Realm: () 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 zonegroup default 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ba820 con 0x7f3e2001c070 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bc710 con 0x55fbb08b7a20 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bcbf0 con 0x55fbb08b7a20 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 started sync module instance, tier type = 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:44:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bba50 con 0x7f3e2001c070 2024-09-14T10:44:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539487100784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bba50 con 0x7f3e2001c070 2024-09-14T10:44:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.171+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bd6b0 con 0x55fbb08b17d0 2024-09-14T10:44:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.175+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539487100784] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.175+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.175+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539487105472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bba50 con 0x55fbb08b17d0 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.175+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08be0c0 con 0x55fbb08b7a20 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.175+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.175+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539487108112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08be910 con 0x55fbb08b7a20 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.175+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bf330 con 0x7f3e2001c070 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539487105472] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539487108112] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539487112736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bf720 con 0x7f3e2001c070 2024-09-14T10:44:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08be460 con 0x55fbb08b17d0 2024-09-14T10:44:53.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539487112736] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539487098272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08be460 con 0x55fbb08b17d0 2024-09-14T10:44:53.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.179+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c0590 con 0x7f3e24031040 2024-09-14T10:44:53.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.183+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539487098272] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.183+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.183+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539487116336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c0500 con 0x7f3e24031040 2024-09-14T10:44:53.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.183+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c0db0 con 0x7f3e24031040 2024-09-14T10:44:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.183+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539487116336] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.183+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.183+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539487117392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c0f90 con 0x7f3e24031040 2024-09-14T10:44:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.183+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c17e0 con 0x7f3e24031040 2024-09-14T10:44:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539487117392] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539487121296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c1860 con 0x7f3e24031040 2024-09-14T10:44:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 20 add_watcher() i=0 2024-09-14T10:44:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 20 add_watcher() i=1 2024-09-14T10:44:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 20 add_watcher() i=2 2024-09-14T10:44:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 20 add_watcher() i=3 2024-09-14T10:44:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 20 add_watcher() i=4 2024-09-14T10:44:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 20 add_watcher() i=5 2024-09-14T10:44:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 20 add_watcher() i=6 2024-09-14T10:44:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539487121296] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 20 add_watcher() i=7 2024-09-14T10:44:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:44:53.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.187+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c4b60 con 0x55fbb08b17d0 2024-09-14T10:44:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.191+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.191+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539487122720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c1df0 con 0x55fbb08b17d0 2024-09-14T10:44:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.191+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539487122720] v34'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.191+0000 7f3ce0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.191+0000 7f3e2cc489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:44:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.191+0000 7f3e2cc489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:44:53.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.191+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cd6d0 con 0x55fbb08b17d0 2024-09-14T10:44:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.191+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.195+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cdd20 con 0x7f3e24031040 2024-09-14T10:44:53.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.195+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.195+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cdc20 con 0x55fbb08b7a20 2024-09-14T10:44:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.195+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.195+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ce020 con 0x55fbb08b17d0 2024-09-14T10:44:53.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.199+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.199+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ccd70 con 0x7f3e2001c070 2024-09-14T10:44:53.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.199+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.199+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ce2a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.199+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.199+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c3830 con 0x55fbb08b17d0 2024-09-14T10:44:53.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.203+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.203+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c3830 con 0x7f3e24031040 2024-09-14T10:44:53.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.207+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.207+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c3830 con 0x7f3e2001c070 2024-09-14T10:44:53.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.207+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.207+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cec30 con 0x55fbb08b7a20 2024-09-14T10:44:53.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.207+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.207+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cec30 con 0x7f3e2001c070 2024-09-14T10:44:53.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.211+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.211+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf0e0 con 0x7f3e24031040 2024-09-14T10:44:53.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.211+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.211+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf0e0 con 0x7f3e2001c070 2024-09-14T10:44:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.215+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.215+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf340 con 0x7f3e24031040 2024-09-14T10:44:53.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.215+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.215+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf340 con 0x55fbb08b17d0 2024-09-14T10:44:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.215+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.215+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf340 con 0x55fbb08b7a20 2024-09-14T10:44:53.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.219+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.219+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf3d0 con 0x7f3e2001c070 2024-09-14T10:44:53.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.219+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.219+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf3d0 con 0x55fbb08b7a20 2024-09-14T10:44:53.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.223+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.223+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf3d0 con 0x55fbb08b17d0 2024-09-14T10:44:53.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.223+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.223+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf3d0 con 0x55fbb08b17d0 2024-09-14T10:44:53.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.227+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.227+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf5a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.227+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.227+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf5a0 con 0x7f3e2001c070 2024-09-14T10:44:53.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.227+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.227+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf5a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.231+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.231+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf9e0 con 0x55fbb08b7a20 2024-09-14T10:44:53.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.231+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.231+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf6a0 con 0x55fbb08b7a20 2024-09-14T10:44:53.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.231+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.231+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf680 con 0x55fbb08b7a20 2024-09-14T10:44:53.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.235+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.235+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf640 con 0x7f3e24031040 2024-09-14T10:44:53.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.235+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.235+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf640 con 0x55fbb08b7a20 2024-09-14T10:44:53.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.239+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.239+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf640 con 0x7f3e24031040 2024-09-14T10:44:53.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.239+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.239+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf640 con 0x55fbb08b7a20 2024-09-14T10:44:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.243+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.243+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf640 con 0x7f3e24031040 2024-09-14T10:44:53.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08cf640 con 0x7f3e2001c070 2024-09-14T10:44:53.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3c5b7fe640 20 reqs_thread_entry: start 2024-09-14T10:44:53.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 20 init_complete bucket index max shards: 11 2024-09-14T10:44:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 20 Filter name: none 2024-09-14T10:44:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3c597fa640 20 reqs_thread_entry: start 2024-09-14T10:44:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:44:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 20 rados->read ofs=0 len=0 2024-09-14T10:44:53.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ea730 con 0x55fbb08b17d0 2024-09-14T10:44:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:44:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:44:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:44:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:44:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.247+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08ea280 con 0x7f3e2001c070 2024-09-14T10:44:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.251+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv42 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.249 INFO:teuthology.orchestra.run.smithi096.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-14T10:44:53.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.251+0000 7f3ce0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:44:53.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.251+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539487122720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08eb170 con 0x55fbb08b17d0 2024-09-14T10:44:53.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.251+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94539487122720] v34'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.251+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539487100784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c1520 con 0x7f3e2001c070 2024-09-14T10:44:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.255+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94539487100784] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.255+0000 7f3e2cc489c0 20 remove_watcher() i=0 2024-09-14T10:44:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.255+0000 7f3e2cc489c0 2 removed watcher, disabling cache 2024-09-14T10:44:53.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.255+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539487105472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c1520 con 0x55fbb08b17d0 2024-09-14T10:44:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.255+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94539487105472] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.255+0000 7f3e2cc489c0 20 remove_watcher() i=1 2024-09-14T10:44:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.255+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539487108112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c1520 con 0x55fbb08b7a20 2024-09-14T10:44:53.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.259+0000 7f3e29f4d640 1 -- 172.21.15.96:0/3456702682 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94539487108112] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e20043700 con 0x55fbb08b7a20 2024-09-14T10:44:53.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.259+0000 7f3e2cc489c0 20 remove_watcher() i=2 2024-09-14T10:44:53.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.259+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539487112736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c1520 con 0x7f3e2001c070 2024-09-14T10:44:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.259+0000 7f3e2af4f640 1 -- 172.21.15.96:0/3456702682 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94539487112736] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e2001c070 2024-09-14T10:44:53.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.259+0000 7f3e2cc489c0 20 remove_watcher() i=3 2024-09-14T10:44:53.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.259+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539487098272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bee20 con 0x55fbb08b17d0 2024-09-14T10:44:53.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.263+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94539487098272] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x55fbb08b17d0 2024-09-14T10:44:53.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.263+0000 7f3e2cc489c0 20 remove_watcher() i=4 2024-09-14T10:44:53.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.263+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539487116336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c1520 con 0x7f3e24031040 2024-09-14T10:44:53.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.263+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94539487116336] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.263+0000 7f3e2cc489c0 20 remove_watcher() i=5 2024-09-14T10:44:53.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.263+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539487117392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08bb5a0 con 0x7f3e24031040 2024-09-14T10:44:53.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94539487117392] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 20 remove_watcher() i=6 2024-09-14T10:44:53.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539487121296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbb08c1520 con 0x7f3e24031040 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94539487121296] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e1c0d0070 con 0x7f3e24031040 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 20 remove_watcher() i=7 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3e24031040 msgr2=0x7f3e24032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3e24031040 0x7f3e24032430 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb08b17d0 msgr2=0x55fbb08b3c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb08b17d0 0x55fbb08b3c90 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3e2001c070 msgr2=0x7f3e2003f200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3e2001c070 0x7f3e2003f200 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.267+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fbb08b7a20 msgr2=0x55fbb08b9e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fbb08b7a20 0x55fbb08b9e10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3cf403a150 msgr2=0x7f3cf403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3cf403a150 0x7f3cf403c610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55fbb087cf20 tx=0x7f3e2401f000 comp rx=0 tx=0).stop 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 msgr2=0x55fbb08a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2a74e640 1 -- 172.21.15.96:0/3456702682 reap_dead start 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb08a6410 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3e20023480 tx=0x7f3e20051760 comp rx=0 tx=0).stop 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 shutdown_connections 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/3456702682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb089eee0 0x55fbb08a6410 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 >> 172.21.15.96:0/3456702682 conn(0x55fbb089b310 msgr2=0x55fbb0899520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 shutdown_connections 2024-09-14T10:44:53.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/3456702682 wait complete. 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1932740664 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d0403a140 msgr2=0x7f3d0403c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/1932740664 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d0403a140 0x7f3d0403c600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55fbb0882f10 tx=0x7f3e24005850 comp rx=0 tx=0).stop 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1932740664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0892580 msgr2=0x55fbb08929a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/1932740664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0892580 0x55fbb08929a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000d660 tx=0x7f3e2000da60 comp rx=0 tx=0).stop 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1932740664 shutdown_connections 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/1932740664 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d0403a140 0x7f3d0403c600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/1932740664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0892580 0x55fbb08929a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1932740664 >> 172.21.15.96:0/1932740664 conn(0x55fbb0887f30 msgr2=0x55fbb0888310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1932740664 shutdown_connections 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/1932740664 wait complete. 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb078b390 msgr2=0x55fbb0881f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb078b390 0x55fbb0881f30 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d1003a150 msgr2=0x7f3d1003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d1003a150 0x7f3d1003c610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001d80 tx=0x7f3e200012e0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 msgr2=0x55fbb087adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb087adc0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0ab510 tx=0x7f3e1c018020 comp rx=0 tx=0).stop 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 shutdown_connections 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fbb078b390 0x55fbb0881f30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3d1003a150 0x7f3d1003c610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 --2- 172.21.15.96:0/2788660391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbb0788250 0x55fbb087adc0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 >> 172.21.15.96:0/2788660391 conn(0x55fbb06fbb60 msgr2=0x55fbb086dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:44:53.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 shutdown_connections 2024-09-14T10:44:53.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:44:53.271+0000 7f3e2cc489c0 1 -- 172.21.15.96:0/2788660391 wait complete. 2024-09-14T10:44:53.281 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-14T10:44:53.303 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:44:53.350 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-14T10:45:28.351 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-14T10:45:28.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-14T10:45:28.352 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-14T10:45:28.393 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:28.394 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:28.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda8ae89c0 1 Processor -- start 2024-09-14T10:45:28.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda8ae89c0 1 -- start start 2024-09-14T10:45:28.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda8ae89c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559e024ba120 0x559e024bc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda8ae89c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e0235e7a0 con 0x559e024b5fd0 2024-09-14T10:45:28.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda8ae89c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x559e023ba1b0 con 0x559e024ba120 2024-09-14T10:45:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda5ded640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x559e024ba120 0x559e024bc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda65ee640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x559e024b5fd0 0x559e024b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:32978/0 (socket says 172.21.15.96:32978) 2024-09-14T10:45:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda65ee640 1 -- 172.21.15.96:0/1165604202 learned_addr learned my addr 172.21.15.96:0/1165604202 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:45:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda5ded640 1 -- 172.21.15.96:0/1165604202 >> v1:172.21.15.70:6789/0 conn(0x559e024b5fd0 legacy=0x559e024b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.394+0000 7fcda5ded640 1 -- 172.21.15.96:0/1165604202 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e02338da0 con 0x559e024ba120 2024-09-14T10:45:28.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda5ded640 1 --2- 172.21.15.96:0/1165604202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024ba120 0x559e024bc510 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000a480 tx=0x7fcd9001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4212cf86b9c9d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda55ec640 1 -- 172.21.15.96:0/1165604202 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd900aa570 con 0x559e024ba120 2024-09-14T10:45:28.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda55ec640 1 -- 172.21.15.96:0/1165604202 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd900af070 con 0x559e024ba120 2024-09-14T10:45:28.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda55ec640 1 -- 172.21.15.96:0/1165604202 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd900aa860 con 0x559e024ba120 2024-09-14T10:45:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1165604202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024ba120 msgr2=0x559e024bc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/1165604202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024ba120 0x559e024bc510 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000a480 tx=0x7fcd9001b310 comp rx=0 tx=0).stop 2024-09-14T10:45:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1165604202 shutdown_connections 2024-09-14T10:45:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/1165604202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024ba120 0x559e024bc510 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1165604202 >> 172.21.15.96:0/1165604202 conn(0x559e024b1af0 msgr2=0x559e024b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1165604202 shutdown_connections 2024-09-14T10:45:28.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.398+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1165604202 wait complete. 2024-09-14T10:45:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.414+0000 7fcda8ae89c0 1 Processor -- start 2024-09-14T10:45:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.414+0000 7fcda8ae89c0 1 -- start start 2024-09-14T10:45:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.414+0000 7fcda8ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e0242c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.414+0000 7fcda8ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559e023bdfc0 con 0x559e024b5fd0 2024-09-14T10:45:28.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.414+0000 7fcda65ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e0242c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.414+0000 7fcda65ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e0242c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36972/0 (socket says 172.21.15.96:36972) 2024-09-14T10:45:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.414+0000 7fcda65ee640 1 -- 172.21.15.96:0/1725818134 learned_addr learned my addr 172.21.15.96:0/1725818134 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.414+0000 7fcda65ee640 1 -- 172.21.15.96:0/1725818134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0242c950 con 0x559e024b5fd0 2024-09-14T10:45:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda65ee640 1 --2- 172.21.15.96:0/1725818134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e0242c360 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcd98001e00 tx=0x7fcd9800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31aae3fe4e11d950 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcc94608640 1 -- 172.21.15.96:0/1725818134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd98012020 con 0x559e024b5fd0 2024-09-14T10:45:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcc94608640 1 -- 172.21.15.96:0/1725818134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9800e690 con 0x559e024b5fd0 2024-09-14T10:45:28.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcc94608640 1 -- 172.21.15.96:0/1725818134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd9800ea10 con 0x559e024b5fd0 2024-09-14T10:45:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1725818134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 msgr2=0x559e0242c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/1725818134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e0242c360 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcd98001e00 tx=0x7fcd9800b6d0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1725818134 shutdown_connections 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/1725818134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e0242c360 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1725818134 >> 172.21.15.96:0/1725818134 conn(0x559e024b1af0 msgr2=0x559e0259d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1725818134 shutdown_connections 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1725818134 wait complete. 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 Processor -- start 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- start start 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e025aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559e0235fa50 con 0x559e024b5fd0 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda65ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e025aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda65ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e025aaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36982/0 (socket says 172.21.15.96:36982) 2024-09-14T10:45:28.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda65ee640 1 -- 172.21.15.96:0/3607537143 learned_addr learned my addr 172.21.15.96:0/3607537143 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda65ee640 1 -- 172.21.15.96:0/3607537143 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e025ab4f0 con 0x559e024b5fd0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda65ee640 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e025aaf90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x559e0242bec0 tx=0x7fcd98000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcc92e05640 1 -- 172.21.15.96:0/3607537143 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd98012030 con 0x559e024b5fd0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e025ab780 con 0x559e024b5fd0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcc92e05640 1 -- 172.21.15.96:0/3607537143 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9801a6d0 con 0x559e024b5fd0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcc92e05640 1 -- 172.21.15.96:0/3607537143 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd9801a9f0 con 0x559e024b5fd0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.418+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e025ac0e0 con 0x559e024b5fd0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcc92e05640 1 -- 172.21.15.96:0/3607537143 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fcd98015020 con 0x559e024b5fd0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcc92e05640 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8c03a1f0 0x7fcc8c03c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcc92e05640 1 -- 172.21.15.96:0/3607537143 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcd98020030 con 0x559e024b5fd0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda5ded640 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8c03a1f0 0x7fcc8c03c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e024ba120 0x559e025b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025b25f0 con 0x559e024ba120 2024-09-14T10:45:28.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda6def640 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e024ba120 0x559e025b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda5ded640 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8c03a1f0 0x7fcc8c03c6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcd900ae000 tx=0x7fcd900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda6def640 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e024ba120 0x559e025b20b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda6def640 1 -- 172.21.15.96:0/3607537143 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcda000a4d0 con 0x559e024ba120 2024-09-14T10:45:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025ac510 con 0x559e024ba120 2024-09-14T10:45:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda6def640 1 -- 172.21.15.96:0/3607537143 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcda000a4d0 con 0x559e024ba120 2024-09-14T10:45:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025b43d0 con 0x559e024ba120 2024-09-14T10:45:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda6def640 1 -- 172.21.15.96:0/3607537143 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcda000a4d0 con 0x559e024ba120 2024-09-14T10:45:28.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025b3600 con 0x559e024ba120 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda6def640 1 -- 172.21.15.96:0/3607537143 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcda000a4d0 con 0x559e024ba120 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025b3a50 con 0x559e024ba120 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.422+0000 7fcda6def640 1 -- 172.21.15.96:0/3607537143 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcda000a4d0 con 0x559e024ba120 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda8ae89c0 1 Processor -- start 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda8ae89c0 1 -- start start 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda8ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025c2790 0x559e025c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda8ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559e023cad80 con 0x559e025c2790 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda5ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025c2790 0x559e025c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda5ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025c2790 0x559e025c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:36988/0 (socket says 172.21.15.96:36988) 2024-09-14T10:45:28.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda5ded640 1 -- 172.21.15.96:0/1430802881 learned_addr learned my addr 172.21.15.96:0/1430802881 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda5ded640 1 -- 172.21.15.96:0/1430802881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e025c31f0 con 0x559e025c2790 2024-09-14T10:45:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda5ded640 1 --2- 172.21.15.96:0/1430802881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025c2790 0x559e025c2bb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcd900199c0 tx=0x7fcd900180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcc8bfff640 1 -- 172.21.15.96:0/1430802881 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd900c5030 con 0x559e025c2790 2024-09-14T10:45:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcc8bfff640 1 -- 172.21.15.96:0/1430802881 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd900b58e0 con 0x559e025c2790 2024-09-14T10:45:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1430802881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e025c3a50 con 0x559e025c2790 2024-09-14T10:45:28.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcc8bfff640 1 -- 172.21.15.96:0/1430802881 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd900b5bc0 con 0x559e025c2790 2024-09-14T10:45:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1430802881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e025c3fc0 con 0x559e025c2790 2024-09-14T10:45:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcc8bfff640 1 -- 172.21.15.96:0/1430802881 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fcd900c8030 con 0x559e025c2790 2024-09-14T10:45:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcc8bfff640 1 --2- 172.21.15.96:0/1430802881 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8003a190 0x7fcc8003c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.426+0000 7fcc8bfff640 1 -- 172.21.15.96:0/1430802881 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcd900c6070 con 0x559e025c2790 2024-09-14T10:45:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda6def640 1 --2- 172.21.15.96:0/1430802881 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8003a190 0x7fcc8003c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 Processor -- start 2024-09-14T10:45:28.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- start start 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda6def640 1 --2- 172.21.15.96:0/1430802881 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8003a190 0x7fcc8003c650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x559e025b3120 tx=0x7fcda0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559e0242ac60 con 0x559e025cffc0 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda5ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda5ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37002/0 (socket says 172.21.15.96:37002) 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda5ded640 1 -- 172.21.15.96:0/2972925131 learned_addr learned my addr 172.21.15.96:0/2972925131 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda5ded640 1 -- 172.21.15.96:0/2972925131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e025d09b0 con 0x559e025cffc0 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda5ded640 1 --2- 172.21.15.96:0/2972925131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d03c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcd900b4fd0 tx=0x7fcd900ec380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3d22f0308f47d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcc89ffb640 1 -- 172.21.15.96:0/2972925131 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd900c1e50 con 0x559e025cffc0 2024-09-14T10:45:28.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcc89ffb640 1 -- 172.21.15.96:0/2972925131 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd900d8020 con 0x559e025cffc0 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcc89ffb640 1 -- 172.21.15.96:0/2972925131 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd900b6170 con 0x559e025cffc0 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/2972925131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 msgr2=0x559e025d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/2972925131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d03c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcd900b4fd0 tx=0x7fcd900ec380 comp rx=0 tx=0).stop 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/2972925131 shutdown_connections 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/2972925131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d03c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/2972925131 >> 172.21.15.96:0/2972925131 conn(0x559e025cb3e0 msgr2=0x559e025c9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/2972925131 shutdown_connections 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/2972925131 wait complete. 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 Processor -- start 2024-09-14T10:45:28.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- start start 2024-09-14T10:45:28.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda8ae89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559e025cef10 con 0x559e025cffc0 2024-09-14T10:45:28.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda5ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda5ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37008/0 (socket says 172.21.15.96:37008) 2024-09-14T10:45:28.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.430+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 learned_addr learned my addr 172.21.15.96:0/3206157827 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e025d6a90 con 0x559e025cffc0 2024-09-14T10:45:28.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda5ded640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d6530 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcd900c9d80 tx=0x7fcd900ec060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcc77fff640 1 -- 172.21.15.96:0/3206157827 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd900c1e50 con 0x559e025cffc0 2024-09-14T10:45:28.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e025d6d20 con 0x559e025cffc0 2024-09-14T10:45:28.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcc77fff640 1 -- 172.21.15.96:0/3206157827 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd900f2070 con 0x559e025cffc0 2024-09-14T10:45:28.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcc77fff640 1 -- 172.21.15.96:0/3206157827 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd900d28e0 con 0x559e025cffc0 2024-09-14T10:45:28.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e025d76d0 con 0x559e025cffc0 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcc77fff640 1 -- 172.21.15.96:0/3206157827 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fcd900bf040 con 0x559e025cffc0 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcc77fff640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc7003a2f0 0x7fcc7003c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcc77fff640 1 -- 172.21.15.96:0/3206157827 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcd900d9030 con 0x559e025cffc0 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda6def640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc7003a2f0 0x7fcc7003c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e025e1a50 0x559e025e3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025e4630 con 0x559e025e1a50 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda65ee640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e025e1a50 0x559e025e3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda6def640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc7003a2f0 0x7fcc7003c7b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x559e025ac450 tx=0x7fcda001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda65ee640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e025e1a50 0x559e025e3ee0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 20 realm 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025e4a40 con 0x559e025e1a50 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025e5310 con 0x559e025e1a50 2024-09-14T10:45:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.434+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025e56b0 con 0x559e025e1a50 2024-09-14T10:45:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda8ae89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025e5f00 con 0x559e025e1a50 2024-09-14T10:45:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda8ae89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda8ae89c0 20 searching for the correct realm 2024-09-14T10:45:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559e025e7c70 0x559e025ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda5ded640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559e025e7c70 0x559e025ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda5ded640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559e025e7c70 0x559e025ea060 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda5ded640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fcd90009040 0x7fcd900dd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcd90009040 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda6def640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fcd90009040 0x7fcd900dd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda6def640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fcd90009040 0x7fcd900dd460 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcda001f070 con 0x7fcd90009040 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda6def640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fcda0031040 0x7fcda0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcda0031040 2024-09-14T10:45:28.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda65ee640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fcda0031040 0x7fcda0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.438+0000 7fcda65ee640 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fcda0031040 0x7fcda0032430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x7fcda0031040 2024-09-14T10:45:28.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e1a50 2024-09-14T10:45:28.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e1a50 2024-09-14T10:45:28.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcda0031040 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x7fcda0031040 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcda0031040 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x7fcda0031040 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcd90009040 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcda001f070 con 0x7fcd90009040 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e1a50 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcda0031040 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x7fcda0031040 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e1a50 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.442+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcd90009040 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcda001f070 con 0x7fcd90009040 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcda0031040 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x7fcda0031040 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e1a50 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98008030 con 0x559e025e1a50 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e1a50 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcda0031040 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcd90009040 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcda001f070 con 0x7fcd90009040 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.446+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e1a50 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcd90009040 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcda001f070 con 0x7fcd90009040 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcda0031040 2024-09-14T10:45:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcd90009040 2024-09-14T10:45:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcda001f070 con 0x7fcd90009040 2024-09-14T10:45:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e7c70 2024-09-14T10:45:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcda0031040 2024-09-14T10:45:28.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x559e025e1a50 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e025ea640 con 0x7fcd90009040 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:28.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025e68b0 con 0x559e025e1a50 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025e64f0 con 0x559e025e1a50 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.450+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025e6500 con 0x559e025e1a50 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 zone default found 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 4 Realm: () 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 zonegroup default 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025eaaa0 con 0x7fcd90009040 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025ecce0 con 0x559e025e7c70 2024-09-14T10:45:28.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025ed080 con 0x559e025e7c70 2024-09-14T10:45:28.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 started sync module instance, tier type = 2024-09-14T10:45:28.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:28.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ec120 con 0x7fcd90009040 2024-09-14T10:45:28.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94137132959312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ec120 con 0x7fcd90009040 2024-09-14T10:45:28.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025eda80 con 0x559e025e1a50 2024-09-14T10:45:28.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.454+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94137132959312] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.458+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.458+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94137132963216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ec120 con 0x559e025e1a50 2024-09-14T10:45:28.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.458+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ee490 con 0x559e025e7c70 2024-09-14T10:45:28.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.458+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94137132963216] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.458+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.458+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94137132956784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ec090 con 0x559e025e7c70 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.458+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ef190 con 0x7fcd90009040 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.462+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.462+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94137132969488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025efa30 con 0x7fcd90009040 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.462+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f0430 con 0x559e025e1a50 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.462+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94137132956784] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.462+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94137132969488] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.462+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.462+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94137132967984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ef580 con 0x559e025e1a50 2024-09-14T10:45:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.462+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f0cd0 con 0x7fcda0031040 2024-09-14T10:45:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.466+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94137132967984] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.466+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.466+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94137132973888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ef580 con 0x7fcda0031040 2024-09-14T10:45:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.466+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f1160 con 0x7fcda0031040 2024-09-14T10:45:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.466+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.466+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94137132977200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f15d0 con 0x7fcda0031040 2024-09-14T10:45:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.466+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94137132973888] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.466+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f0610 con 0x7fcda0031040 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94137132981136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f2080 con 0x7fcda0031040 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 20 add_watcher() i=0 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 20 add_watcher() i=1 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 20 add_watcher() i=2 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 20 add_watcher() i=3 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 20 add_watcher() i=4 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 20 add_watcher() i=5 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94137132977200] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 20 add_watcher() i=6 2024-09-14T10:45:28.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94137132981136] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 20 add_watcher() i=7 2024-09-14T10:45:28.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:28.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e025f1120 con 0x559e025e1a50 2024-09-14T10:45:28.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.470+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94137132978464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f24b0 con 0x559e025e1a50 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94137132978464] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcc5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 5 note: GC not initialized 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcbd77fe640 20 reqs_thread_entry: start 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 20 Filter name: none 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcbd57fa640 20 reqs_thread_entry: start 2024-09-14T10:45:28.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02618c80 con 0x559e025e1a50 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02618c80 con 0x7fcd90009040 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02618c40 con 0x559e025e1a50 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02618c40 con 0x559e025e7c70 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02619170 con 0x559e025e7c70 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02619580 con 0x559e025e7c70 2024-09-14T10:45:28.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02619990 con 0x559e025e1a50 2024-09-14T10:45:28.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.474+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02619990 con 0x559e025e1a50 2024-09-14T10:45:28.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02619990 con 0x559e025e7c70 2024-09-14T10:45:28.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02619990 con 0x559e025e7c70 2024-09-14T10:45:28.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e02619940 con 0x7fcda0031040 2024-09-14T10:45:28.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ae30 con 0x559e025e1a50 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ae30 con 0x7fcd90009040 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ae30 con 0x559e025e7c70 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ae30 con 0x7fcda0031040 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ade0 con 0x7fcda0031040 2024-09-14T10:45:28.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ade0 con 0x559e025e7c70 2024-09-14T10:45:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.478+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad90 con 0x7fcda0031040 2024-09-14T10:45:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e1a50 2024-09-14T10:45:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e7c70 2024-09-14T10:45:28.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x7fcda0031040 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x7fcd90009040 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x7fcda0031040 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e1a50 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e1a50 2024-09-14T10:45:28.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.482+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e7c70 2024-09-14T10:45:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e1a50 2024-09-14T10:45:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e1a50 2024-09-14T10:45:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e7c70 2024-09-14T10:45:28.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e7c70 2024-09-14T10:45:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x559e025e7c70 2024-09-14T10:45:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e0261ad30 con 0x7fcda0031040 2024-09-14T10:45:28.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcc5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.486+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94137132978464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f2d80 con 0x559e025e1a50 2024-09-14T10:45:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94137132978464] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94137132959312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025f1120 con 0x7fcd90009040 2024-09-14T10:45:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94137132959312] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda8ae89c0 20 remove_watcher() i=0 2024-09-14T10:45:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda8ae89c0 2 removed watcher, disabling cache 2024-09-14T10:45:28.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94137132963216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ec650 con 0x559e025e1a50 2024-09-14T10:45:28.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94137132963216] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda8ae89c0 20 remove_watcher() i=1 2024-09-14T10:45:28.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.490+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94137132956784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ec650 con 0x559e025e7c70 2024-09-14T10:45:28.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.494+0000 7fcda5ded640 1 -- 172.21.15.96:0/3206157827 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94137132956784] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd900d1070 con 0x559e025e7c70 2024-09-14T10:45:28.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.494+0000 7fcda8ae89c0 20 remove_watcher() i=2 2024-09-14T10:45:28.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.494+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94137132969488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ebc70 con 0x7fcd90009040 2024-09-14T10:45:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.494+0000 7fcda6def640 1 -- 172.21.15.96:0/3206157827 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94137132969488] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcda0040040 con 0x7fcd90009040 2024-09-14T10:45:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.494+0000 7fcda8ae89c0 20 remove_watcher() i=3 2024-09-14T10:45:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.494+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94137132967984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ec650 con 0x559e025e1a50 2024-09-14T10:45:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.498+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94137132967984] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x559e025e1a50 2024-09-14T10:45:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.498+0000 7fcda8ae89c0 20 remove_watcher() i=4 2024-09-14T10:45:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.498+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94137132973888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ebc70 con 0x7fcda0031040 2024-09-14T10:45:28.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.498+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94137132973888] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.498+0000 7fcda8ae89c0 20 remove_watcher() i=5 2024-09-14T10:45:28.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.498+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94137132977200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ee830 con 0x7fcda0031040 2024-09-14T10:45:28.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94137132977200] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 20 remove_watcher() i=6 2024-09-14T10:45:28.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94137132981136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e025ebc70 con 0x7fcda0031040 2024-09-14T10:45:28.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94137132981136] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd98053060 con 0x7fcda0031040 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 20 remove_watcher() i=7 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fcda0031040 msgr2=0x7fcda0032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fcda0031040 0x7fcda0032430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e025e1a50 msgr2=0x559e025e3ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e025e1a50 0x559e025e3ee0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fcd90009040 msgr2=0x7fcd900dd460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fcd90009040 0x7fcd900dd460 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559e025e7c70 msgr2=0x559e025ea060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x559e025e7c70 0x559e025ea060 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc7003a2f0 msgr2=0x7fcc7003c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc7003a2f0 0x7fcc7003c7b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x559e025ac450 tx=0x7fcda001f000 comp rx=0 tx=0).stop 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda65ee640 1 -- 172.21.15.96:0/3206157827 reap_dead start 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 msgr2=0x559e025d6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d6530 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcd900c9d80 tx=0x7fcd900ec060 comp rx=0 tx=0).stop 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 shutdown_connections 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3206157827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025cffc0 0x559e025d6530 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 >> 172.21.15.96:0/3206157827 conn(0x559e025cb3e0 msgr2=0x559e025c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 shutdown_connections 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.502+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3206157827 wait complete. 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1430802881 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8003a190 msgr2=0x7fcc8003c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/1430802881 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8003a190 0x7fcc8003c650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x559e025b3120 tx=0x7fcda0005850 comp rx=0 tx=0).stop 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1430802881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025c2790 msgr2=0x559e025c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/1430802881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025c2790 0x559e025c2bb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcd900199c0 tx=0x7fcd900180b0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1430802881 shutdown_connections 2024-09-14T10:45:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/1430802881 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8003a190 0x7fcc8003c650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/1430802881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e025c2790 0x559e025c2bb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1430802881 >> 172.21.15.96:0/1430802881 conn(0x559e025b8140 msgr2=0x559e025b8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1430802881 shutdown_connections 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/1430802881 wait complete. 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e024ba120 msgr2=0x559e025b20b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e024ba120 0x559e025b20b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8c03a1f0 msgr2=0x7fcc8c03c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8c03a1f0 0x7fcc8c03c6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcd900ae000 tx=0x7fcd900a6000 comp rx=0 tx=0).stop 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 msgr2=0x559e025aaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e025aaf90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x559e0242bec0 tx=0x7fcd98000bd0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 shutdown_connections 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559e024ba120 0x559e025b20b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fcc8c03a1f0 0x7fcc8c03c6b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 --2- 172.21.15.96:0/3607537143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e024b5fd0 0x559e025aaf90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 >> 172.21.15.96:0/3607537143 conn(0x559e024b1af0 msgr2=0x559e0259cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 shutdown_connections 2024-09-14T10:45:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.506+0000 7fcda8ae89c0 1 -- 172.21.15.96:0/3607537143 wait complete. 2024-09-14T10:45:28.515 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:45:28.516 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:45:28.516 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-14T10:45:28.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-14T10:45:28.516 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-14T10:45:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:28.590 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2afbfce9c0 1 Processor -- start 2024-09-14T10:45:28.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2afbfce9c0 1 -- start start 2024-09-14T10:45:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2afbfce9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555a09988240 0x555a09a16c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2afbfce9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a098bc7a0 con 0x555a09a171b0 2024-09-14T10:45:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2afbfce9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x555a099181b0 con 0x555a09988240 2024-09-14T10:45:28.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2af9ad4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555a09988240 0x555a09a16c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2af9ad4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555a09988240 0x555a09a16c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37010/0 (socket says 172.21.15.96:37010) 2024-09-14T10:45:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2af9ad4640 1 -- 172.21.15.96:0/1720239281 learned_addr learned my addr 172.21.15.96:0/1720239281 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.590+0000 7f2af92d3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x555a09a171b0 0x555a09a195a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:32994/0 (socket says 172.21.15.96:32994) 2024-09-14T10:45:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2af9ad4640 1 -- 172.21.15.96:0/1720239281 >> v1:172.21.15.70:6789/0 conn(0x555a09a171b0 legacy=0x555a09a195a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2af9ad4640 1 -- 172.21.15.96:0/1720239281 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a09896da0 con 0x555a09988240 2024-09-14T10:45:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2af9ad4640 1 --2- 172.21.15.96:0/1720239281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09a16c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00a4e0 tx=0x7f2aec01af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5919dcf6005d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2af8ad2640 1 -- 172.21.15.96:0/1720239281 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aec0a3d50 con 0x555a09988240 2024-09-14T10:45:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2af8ad2640 1 -- 172.21.15.96:0/1720239281 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aec0a7070 con 0x555a09988240 2024-09-14T10:45:28.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2af8ad2640 1 -- 172.21.15.96:0/1720239281 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aec0ab540 con 0x555a09988240 2024-09-14T10:45:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1720239281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 msgr2=0x555a09a16c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/1720239281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09a16c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00a4e0 tx=0x7f2aec01af20 comp rx=0 tx=0).stop 2024-09-14T10:45:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1720239281 shutdown_connections 2024-09-14T10:45:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/1720239281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09a16c70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1720239281 >> 172.21.15.96:0/1720239281 conn(0x555a09a0e960 msgr2=0x555a09a10d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1720239281 shutdown_connections 2024-09-14T10:45:28.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.594+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1720239281 wait complete. 2024-09-14T10:45:28.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.610+0000 7f2afbfce9c0 1 Processor -- start 2024-09-14T10:45:28.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.610+0000 7f2afbfce9c0 1 -- start start 2024-09-14T10:45:28.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.610+0000 7f2afbfce9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09aff530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.610+0000 7f2afbfce9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a0991bfc0 con 0x555a09988240 2024-09-14T10:45:28.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.610+0000 7f2af9ad4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09aff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.610+0000 7f2af9ad4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09aff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37018/0 (socket says 172.21.15.96:37018) 2024-09-14T10:45:28.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.610+0000 7f2af9ad4640 1 -- 172.21.15.96:0/1275783083 learned_addr learned my addr 172.21.15.96:0/1275783083 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2af9ad4640 1 -- 172.21.15.96:0/1275783083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a09affb20 con 0x555a09988240 2024-09-14T10:45:28.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2af9ad4640 1 --2- 172.21.15.96:0/1275783083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09aff530 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2aec000f90 tx=0x7f2aec0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b94a1b187ea885 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f29e7e07640 1 -- 172.21.15.96:0/1275783083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aec0ab410 con 0x555a09988240 2024-09-14T10:45:28.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f29e7e07640 1 -- 172.21.15.96:0/1275783083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aec0ab5b0 con 0x555a09988240 2024-09-14T10:45:28.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f29e7e07640 1 -- 172.21.15.96:0/1275783083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aec0ab8b0 con 0x555a09988240 2024-09-14T10:45:28.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1275783083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 msgr2=0x555a09aff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/1275783083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09aff530 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2aec000f90 tx=0x7f2aec0033b0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1275783083 shutdown_connections 2024-09-14T10:45:28.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/1275783083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09aff530 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1275783083 >> 172.21.15.96:0/1275783083 conn(0x555a09a0e960 msgr2=0x555a09afb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1275783083 shutdown_connections 2024-09-14T10:45:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/1275783083 wait complete. 2024-09-14T10:45:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 Processor -- start 2024-09-14T10:45:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- start start 2024-09-14T10:45:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09b06d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a098bda50 con 0x555a09988240 2024-09-14T10:45:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2af9ad4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09b06d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2af9ad4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09b06d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37020/0 (socket says 172.21.15.96:37020) 2024-09-14T10:45:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2af9ad4640 1 -- 172.21.15.96:0/412210707 learned_addr learned my addr 172.21.15.96:0/412210707 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2af9ad4640 1 -- 172.21.15.96:0/412210707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a09b07260 con 0x555a09988240 2024-09-14T10:45:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2af9ad4640 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09b06d00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2aec01b400 tx=0x7f2aec017cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f29e6604640 1 -- 172.21.15.96:0/412210707 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aec0c3020 con 0x555a09988240 2024-09-14T10:45:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a09b074f0 con 0x555a09988240 2024-09-14T10:45:28.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f29e6604640 1 -- 172.21.15.96:0/412210707 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aec0bf470 con 0x555a09988240 2024-09-14T10:45:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f29e6604640 1 -- 172.21.15.96:0/412210707 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aec0bf790 con 0x555a09988240 2024-09-14T10:45:28.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.614+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a09b07e80 con 0x555a09988240 2024-09-14T10:45:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f29e6604640 1 -- 172.21.15.96:0/412210707 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2aec0c6020 con 0x555a09988240 2024-09-14T10:45:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f29e6604640 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29e003a150 0x7f29e003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f29e6604640 1 -- 172.21.15.96:0/412210707 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2aec0ba040 con 0x555a09988240 2024-09-14T10:45:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2af92d3640 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29e003a150 0x7f29e003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09a171b0 0x555a09b0ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b0e310 con 0x555a09a171b0 2024-09-14T10:45:28.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09a171b0 0x555a09b0ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2af92d3640 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29e003a150 0x7f29e003c610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2af0001ec0 tx=0x7f2af00015c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09a171b0 0x555a09b0ddd0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afa2d5640 1 -- 172.21.15.96:0/412210707 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af40083f0 con 0x555a09a171b0 2024-09-14T10:45:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b08180 con 0x555a09a171b0 2024-09-14T10:45:28.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afa2d5640 1 -- 172.21.15.96:0/412210707 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2af40083f0 con 0x555a09a171b0 2024-09-14T10:45:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b100a0 con 0x555a09a171b0 2024-09-14T10:45:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afa2d5640 1 -- 172.21.15.96:0/412210707 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2af40083f0 con 0x555a09a171b0 2024-09-14T10:45:28.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b0f2d0 con 0x555a09a171b0 2024-09-14T10:45:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afa2d5640 1 -- 172.21.15.96:0/412210707 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2af40083f0 con 0x555a09a171b0 2024-09-14T10:45:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b0f6f0 con 0x555a09a171b0 2024-09-14T10:45:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.618+0000 7f2afa2d5640 1 -- 172.21.15.96:0/412210707 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2af40083f0 con 0x555a09a171b0 2024-09-14T10:45:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2afbfce9c0 1 Processor -- start 2024-09-14T10:45:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2afbfce9c0 1 -- start start 2024-09-14T10:45:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2afbfce9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09b1e540 0x555a09b1e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2afbfce9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a09928d80 con 0x555a09b1e540 2024-09-14T10:45:28.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2af92d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09b1e540 0x555a09b1e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2af92d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09b1e540 0x555a09b1e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37030/0 (socket says 172.21.15.96:37030) 2024-09-14T10:45:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2af92d3640 1 -- 172.21.15.96:0/541398355 learned_addr learned my addr 172.21.15.96:0/541398355 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2af92d3640 1 -- 172.21.15.96:0/541398355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a09b1efa0 con 0x555a09b1e540 2024-09-14T10:45:28.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2af92d3640 1 --2- 172.21.15.96:0/541398355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09b1e540 0x555a09b1e960 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e6f0 tx=0x7f2af000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f29df7fe640 1 -- 172.21.15.96:0/541398355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0022070 con 0x555a09b1e540 2024-09-14T10:45:28.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f29df7fe640 1 -- 172.21.15.96:0/541398355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af001b4b0 con 0x555a09b1e540 2024-09-14T10:45:28.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/541398355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a09b1f800 con 0x555a09b1e540 2024-09-14T10:45:28.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f29df7fe640 1 -- 172.21.15.96:0/541398355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af001b7d0 con 0x555a09b1e540 2024-09-14T10:45:28.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/541398355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a09b1fd70 con 0x555a09b1e540 2024-09-14T10:45:28.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f29df7fe640 1 -- 172.21.15.96:0/541398355 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2af0025070 con 0x555a09b1e540 2024-09-14T10:45:28.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f29df7fe640 1 --2- 172.21.15.96:0/541398355 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29d403a150 0x7f29d403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f29df7fe640 1 -- 172.21.15.96:0/541398355 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2af0052390 con 0x555a09b1e540 2024-09-14T10:45:28.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.622+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/541398355 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29d403a150 0x7f29d403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 Processor -- start 2024-09-14T10:45:28.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- start start 2024-09-14T10:45:28.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/541398355 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29d403a150 0x7f29d403c610 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x555a09b0f670 tx=0x7f2af4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09a13030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a09affe90 con 0x555a09a12c30 2024-09-14T10:45:28.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09a13030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09a13030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37032/0 (socket says 172.21.15.96:37032) 2024-09-14T10:45:28.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 -- 172.21.15.96:0/2478147683 learned_addr learned my addr 172.21.15.96:0/2478147683 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 -- 172.21.15.96:0/2478147683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a09a13570 con 0x555a09a12c30 2024-09-14T10:45:28.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 --2- 172.21.15.96:0/2478147683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09a13030 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2af0050710 tx=0x7f2af003ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fc492b545f75d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f29dd7fa640 1 -- 172.21.15.96:0/2478147683 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af004f2b0 con 0x555a09a12c30 2024-09-14T10:45:28.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f29dd7fa640 1 -- 172.21.15.96:0/2478147683 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af00520d0 con 0x555a09a12c30 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f29dd7fa640 1 -- 172.21.15.96:0/2478147683 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af00263b0 con 0x555a09a12c30 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/2478147683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 msgr2=0x555a09a13030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/2478147683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09a13030 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2af0050710 tx=0x7f2af003ff90 comp rx=0 tx=0).stop 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/2478147683 shutdown_connections 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/2478147683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09a13030 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/2478147683 >> 172.21.15.96:0/2478147683 conn(0x555a09b272f0 msgr2=0x555a09b25530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/2478147683 shutdown_connections 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/2478147683 wait complete. 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 Processor -- start 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- start start 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09b34790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2afbfce9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a09a13af0 con 0x555a09a12c30 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09b34790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09b34790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37040/0 (socket says 172.21.15.96:37040) 2024-09-14T10:45:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 learned_addr learned my addr 172.21.15.96:0/4040738643 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.626+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a09b34cf0 con 0x555a09a12c30 2024-09-14T10:45:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2af92d3640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09b34790 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2af000ebb0 tx=0x7f2af0050670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f29cb7fe640 1 -- 172.21.15.96:0/4040738643 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af00521a0 con 0x555a09a12c30 2024-09-14T10:45:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f29cb7fe640 1 -- 172.21.15.96:0/4040738643 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af001bb80 con 0x555a09a12c30 2024-09-14T10:45:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a09b34f80 con 0x555a09a12c30 2024-09-14T10:45:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f29cb7fe640 1 -- 172.21.15.96:0/4040738643 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0050820 con 0x555a09a12c30 2024-09-14T10:45:28.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a09b34f80 con 0x555a09a12c30 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f29cb7fe640 1 -- 172.21.15.96:0/4040738643 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2af0049d10 con 0x555a09a12c30 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f29cb7fe640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29c403a150 0x7f29c403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f29cb7fe640 1 -- 172.21.15.96:0/4040738643 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2af0045070 con 0x555a09a12c30 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29c403a150 0x7f29c403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09b3fa50 0x555a09b41ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b42630 con 0x555a09b3fa50 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2af9ad4640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09b3fa50 0x555a09b41ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29c403a150 0x7f29c403c610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2af400f010 tx=0x7f2af401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2af9ad4640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09b3fa50 0x555a09b41ee0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 realm 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b42a40 con 0x555a09b3fa50 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b43310 con 0x555a09b3fa50 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b436b0 con 0x555a09b3fa50 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.630+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b43b50 con 0x555a09b3fa50 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afbfce9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afbfce9c0 20 searching for the correct realm 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a09b45b50 0x555a09b47f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af92d3640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a09b45b50 0x555a09b47f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af92d3640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a09b45b50 0x555a09b47f60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af92d3640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2af0031030 0x7f2af000c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af0031030 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2af0031030 0x7f2af000c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2af0031030 0x7f2af000c9d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afa2d5640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2af4019040 0x7f2af4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af4019040 2024-09-14T10:45:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af9ad4640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2af4019040 0x7f2af4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af9ad4640 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2af4019040 0x7f2af4019930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b3fa50 2024-09-14T10:45:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.634+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b3fa50 2024-09-14T10:45:28.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af4019040 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af4019040 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af0031030 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b3fa50 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af4019040 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b3fa50 2024-09-14T10:45:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af0031030 2024-09-14T10:45:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.638+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af4019040 2024-09-14T10:45:28.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b3fa50 2024-09-14T10:45:28.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b3fa50 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af4019040 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af0031030 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b3fa50 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af0031030 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.642+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af4019040 2024-09-14T10:45:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af0031030 2024-09-14T10:45:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b45b50 2024-09-14T10:45:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af4019040 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x555a09b3fa50 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555a09b48630 con 0x7f2af0031030 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b44620 con 0x555a09b3fa50 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b44ec0 con 0x555a09b3fa50 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b44260 con 0x555a09b3fa50 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 zone default found 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 4 Realm: () 2024-09-14T10:45:28.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 zonegroup default 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b44ec0 con 0x7f2af0031030 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.646+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4a950 con 0x555a09b45b50 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4acf0 con 0x555a09b45b50 2024-09-14T10:45:28.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 20 started sync module instance, tier type = 2024-09-14T10:45:28.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:28.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b49de0 con 0x7f2af0031030 2024-09-14T10:45:28.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93845198250720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b49de0 con 0x7f2af0031030 2024-09-14T10:45:28.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4b6b0 con 0x555a09b3fa50 2024-09-14T10:45:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.650+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93845198250720] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93845198254928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b49de0 con 0x555a09b3fa50 2024-09-14T10:45:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4c0c0 con 0x555a09b45b50 2024-09-14T10:45:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93845198257168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4c960 con 0x555a09b45b50 2024-09-14T10:45:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93845198254928] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4d360 con 0x7f2af0031030 2024-09-14T10:45:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93845198248240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4d750 con 0x7f2af0031030 2024-09-14T10:45:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.654+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4e110 con 0x555a09b3fa50 2024-09-14T10:45:28.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.658+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93845198257168] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.658+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93845198248240] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.658+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.658+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93845198261872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4dc60 con 0x555a09b3fa50 2024-09-14T10:45:28.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.658+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4e9b0 con 0x7f2af4019040 2024-09-14T10:45:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.662+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93845198261872] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.662+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.662+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93845198259376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4e6d0 con 0x7f2af4019040 2024-09-14T10:45:28.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.662+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4ef20 con 0x7f2af4019040 2024-09-14T10:45:28.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.662+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93845198259376] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.662+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.662+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93845198267184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4ecc0 con 0x7f2af4019040 2024-09-14T10:45:28.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.662+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4f7b0 con 0x7f2af4019040 2024-09-14T10:45:28.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93845198267184] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93845198271104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4f770 con 0x7f2af4019040 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 20 add_watcher() i=0 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 20 add_watcher() i=1 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 20 add_watcher() i=2 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 20 add_watcher() i=3 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 20 add_watcher() i=4 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 20 add_watcher() i=5 2024-09-14T10:45:28.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 20 add_watcher() i=6 2024-09-14T10:45:28.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93845198271104] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 20 add_watcher() i=7 2024-09-14T10:45:28.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:28.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.666+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b52bd0 con 0x555a09b3fa50 2024-09-14T10:45:28.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93845198268240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b500c0 con 0x555a09b3fa50 2024-09-14T10:45:28.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93845198268240] v34'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f29ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:28.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 5 note: GC not initialized 2024-09-14T10:45:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f29aa7fc640 20 reqs_thread_entry: start 2024-09-14T10:45:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 20 Filter name: none 2024-09-14T10:45:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f291bfff640 20 reqs_thread_entry: start 2024-09-14T10:45:28.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b76810 con 0x555a09b3fa50 2024-09-14T10:45:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b76810 con 0x7f2af0031030 2024-09-14T10:45:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b76810 con 0x555a09b3fa50 2024-09-14T10:45:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b767d0 con 0x555a09b45b50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b76d20 con 0x555a09b45b50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.670+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77170 con 0x555a09b45b50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77170 con 0x555a09b3fa50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77170 con 0x555a09b3fa50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77170 con 0x555a09b45b50 2024-09-14T10:45:28.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77120 con 0x555a09b45b50 2024-09-14T10:45:28.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77120 con 0x7f2af4019040 2024-09-14T10:45:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b78680 con 0x555a09b3fa50 2024-09-14T10:45:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b78680 con 0x7f2af0031030 2024-09-14T10:45:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b78680 con 0x555a09b45b50 2024-09-14T10:45:28.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.674+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b78680 con 0x7f2af4019040 2024-09-14T10:45:28.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b78630 con 0x7f2af4019040 2024-09-14T10:45:28.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b78630 con 0x555a09b45b50 2024-09-14T10:45:28.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x7f2af4019040 2024-09-14T10:45:28.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b3fa50 2024-09-14T10:45:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b45b50 2024-09-14T10:45:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x7f2af4019040 2024-09-14T10:45:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x7f2af0031030 2024-09-14T10:45:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.678+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x7f2af4019040 2024-09-14T10:45:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b3fa50 2024-09-14T10:45:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b3fa50 2024-09-14T10:45:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b45b50 2024-09-14T10:45:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b3fa50 2024-09-14T10:45:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b3fa50 2024-09-14T10:45:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b45b50 2024-09-14T10:45:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b45b50 2024-09-14T10:45:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x555a09b45b50 2024-09-14T10:45:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555a09b785e0 con 0x7f2af4019040 2024-09-14T10:45:28.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.682+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.686+0000 7f29ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:28.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.686+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93845198268240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b39d60 con 0x555a09b3fa50 2024-09-14T10:45:28.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.686+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93845198268240] v34'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.686+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93845198250720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4e750 con 0x7f2af0031030 2024-09-14T10:45:28.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.686+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93845198250720] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.686+0000 7f2afbfce9c0 20 remove_watcher() i=0 2024-09-14T10:45:28.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.686+0000 7f2afbfce9c0 2 removed watcher, disabling cache 2024-09-14T10:45:28.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.686+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93845198254928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4a2e0 con 0x555a09b3fa50 2024-09-14T10:45:28.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.690+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93845198254928] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.690+0000 7f2afbfce9c0 20 remove_watcher() i=1 2024-09-14T10:45:28.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.690+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93845198257168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4a2e0 con 0x555a09b45b50 2024-09-14T10:45:28.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.690+0000 7f2af92d3640 1 -- 172.21.15.96:0/4040738643 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93845198257168] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af0037020 con 0x555a09b45b50 2024-09-14T10:45:28.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.690+0000 7f2afbfce9c0 20 remove_watcher() i=2 2024-09-14T10:45:28.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.690+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93845198248240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b4a2e0 con 0x7f2af0031030 2024-09-14T10:45:28.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.694+0000 7f2afa2d5640 1 -- 172.21.15.96:0/4040738643 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93845198248240] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af402f040 con 0x7f2af0031030 2024-09-14T10:45:28.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.694+0000 7f2afbfce9c0 20 remove_watcher() i=3 2024-09-14T10:45:28.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.694+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93845198261872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b49930 con 0x555a09b3fa50 2024-09-14T10:45:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.694+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93845198261872] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x555a09b3fa50 2024-09-14T10:45:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.694+0000 7f2afbfce9c0 20 remove_watcher() i=4 2024-09-14T10:45:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.694+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93845198259376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77120 con 0x7f2af4019040 2024-09-14T10:45:28.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.698+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93845198259376] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.698+0000 7f2afbfce9c0 20 remove_watcher() i=5 2024-09-14T10:45:28.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.698+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93845198267184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77120 con 0x7f2af4019040 2024-09-14T10:45:28.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.698+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93845198267184] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.698+0000 7f2afbfce9c0 20 remove_watcher() i=6 2024-09-14T10:45:28.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.698+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93845198271104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555a09b77120 con 0x7f2af4019040 2024-09-14T10:45:28.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93845198271104] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec0c8930 con 0x7f2af4019040 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 20 remove_watcher() i=7 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2af4019040 msgr2=0x7f2af4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2af4019040 0x7f2af4019930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09b3fa50 msgr2=0x555a09b41ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09b3fa50 0x555a09b41ee0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2af0031030 msgr2=0x7f2af000c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2af0031030 0x7f2af000c9d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a09b45b50 msgr2=0x555a09b47f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555a09b45b50 0x555a09b47f60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29c403a150 msgr2=0x7f29c403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29c403a150 0x7f29c403c610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2af400f010 tx=0x7f2af401b070 comp rx=0 tx=0).stop 2024-09-14T10:45:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2af9ad4640 1 -- 172.21.15.96:0/4040738643 reap_dead start 2024-09-14T10:45:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 msgr2=0x555a09b34790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09b34790 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2af000ebb0 tx=0x7f2af0050670 comp rx=0 tx=0).stop 2024-09-14T10:45:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 shutdown_connections 2024-09-14T10:45:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/4040738643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09a12c30 0x555a09b34790 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 >> 172.21.15.96:0/4040738643 conn(0x555a09b272f0 msgr2=0x555a09b25500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 shutdown_connections 2024-09-14T10:45:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/4040738643 wait complete. 2024-09-14T10:45:28.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/541398355 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29d403a150 msgr2=0x7f29d403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/541398355 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29d403a150 0x7f29d403c610 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x555a09b0f670 tx=0x7f2af4003070 comp rx=0 tx=0).stop 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/541398355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09b1e540 msgr2=0x555a09b1e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/541398355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09b1e540 0x555a09b1e960 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e6f0 tx=0x7f2af000e720 comp rx=0 tx=0).stop 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/541398355 shutdown_connections 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/541398355 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29d403a150 0x7f29d403c610 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/541398355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09b1e540 0x555a09b1e960 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/541398355 >> 172.21.15.96:0/541398355 conn(0x555a09b13ef0 msgr2=0x555a09b142d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/541398355 shutdown_connections 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/541398355 wait complete. 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09a171b0 msgr2=0x555a09b0ddd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09a171b0 0x555a09b0ddd0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29e003a150 msgr2=0x7f29e003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29e003a150 0x7f29e003c610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2af0001ec0 tx=0x7f2af00015c0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 msgr2=0x555a09b06d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09b06d00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2aec01b400 tx=0x7f2aec017cc0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 shutdown_connections 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555a09a171b0 0x555a09b0ddd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f29e003a150 0x7f29e003c610 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 --2- 172.21.15.96:0/412210707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a09988240 0x555a09b06d00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 >> 172.21.15.96:0/412210707 conn(0x555a09a0e960 msgr2=0x555a09b00890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.702+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 shutdown_connections 2024-09-14T10:45:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.706+0000 7f2afbfce9c0 1 -- 172.21.15.96:0/412210707 wait complete. 2024-09-14T10:45:28.715 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:45:28.716 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:45:28.716 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-14T10:45:28.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-14T10:45:28.716 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-14T10:45:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:28.797 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bfbf0f9c0 1 Processor -- start 2024-09-14T10:45:28.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bfbf0f9c0 1 -- start start 2024-09-14T10:45:28.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bfbf0f9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x561a38de03a0 0x561a38de2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bfbf0f9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a38c827a0 con 0x561a38ddc250 2024-09-14T10:45:28.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bfbf0f9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x561a38cde1b0 con 0x561a38de03a0 2024-09-14T10:45:28.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bf9214640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x561a38de03a0 0x561a38de2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bf9a15640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x561a38ddc250 0x561a38ddc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33010/0 (socket says 172.21.15.96:33010) 2024-09-14T10:45:28.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bf9214640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x561a38de03a0 0x561a38de2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37044/0 (socket says 172.21.15.96:37044) 2024-09-14T10:45:28.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bf9a15640 1 -- 172.21.15.96:0/1214096786 learned_addr learned my addr 172.21.15.96:0/1214096786 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:45:28.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bf9214640 1 -- 172.21.15.96:0/1214096786 >> v1:172.21.15.70:6789/0 conn(0x561a38ddc250 legacy=0x561a38ddc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.798+0000 7f3bf9214640 1 -- 172.21.15.96:0/1214096786 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a38c5cda0 con 0x561a38de03a0 2024-09-14T10:45:28.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bf9214640 1 --2- 172.21.15.96:0/1214096786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38de03a0 0x561a38de2790 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a480 tx=0x7f3bf001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afeee24018f08d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bf8a13640 1 -- 172.21.15.96:0/1214096786 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf00aa570 con 0x561a38de03a0 2024-09-14T10:45:28.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bf8a13640 1 -- 172.21.15.96:0/1214096786 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf00af070 con 0x561a38de03a0 2024-09-14T10:45:28.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bf8a13640 1 -- 172.21.15.96:0/1214096786 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf00aa860 con 0x561a38de03a0 2024-09-14T10:45:28.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1214096786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38de03a0 msgr2=0x561a38de2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1214096786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38de03a0 0x561a38de2790 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a480 tx=0x7f3bf001b310 comp rx=0 tx=0).stop 2024-09-14T10:45:28.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1214096786 shutdown_connections 2024-09-14T10:45:28.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1214096786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38de03a0 0x561a38de2790 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1214096786 >> 172.21.15.96:0/1214096786 conn(0x561a38d4fb60 msgr2=0x561a38d4ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1214096786 shutdown_connections 2024-09-14T10:45:28.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.802+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1214096786 wait complete. 2024-09-14T10:45:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.818+0000 7f3bfbf0f9c0 1 Processor -- start 2024-09-14T10:45:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.818+0000 7f3bfbf0f9c0 1 -- start start 2024-09-14T10:45:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.818+0000 7f3bfbf0f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38ec75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.818+0000 7f3bfbf0f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a38ce1fc0 con 0x561a38ddc250 2024-09-14T10:45:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.818+0000 7f3bf9a15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38ec75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.818+0000 7f3bf9a15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38ec75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37050/0 (socket says 172.21.15.96:37050) 2024-09-14T10:45:28.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.818+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2070984752 learned_addr learned my addr 172.21.15.96:0/2070984752 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2070984752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a38ec7b90 con 0x561a38ddc250 2024-09-14T10:45:28.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bf9a15640 1 --2- 172.21.15.96:0/2070984752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38ec75a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3bec001e00 tx=0x7f3bec00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49698e263c41daf server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3ae7e07640 1 -- 172.21.15.96:0/2070984752 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec012020 con 0x561a38ddc250 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3ae7e07640 1 -- 172.21.15.96:0/2070984752 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec00e690 con 0x561a38ddc250 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3ae7e07640 1 -- 172.21.15.96:0/2070984752 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec00ea10 con 0x561a38ddc250 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2070984752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 msgr2=0x561a38ec75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2070984752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38ec75a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3bec001e00 tx=0x7f3bec00b6d0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2070984752 shutdown_connections 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2070984752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38ec75a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2070984752 >> 172.21.15.96:0/2070984752 conn(0x561a38d4fb60 msgr2=0x561a38ec3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2070984752 shutdown_connections 2024-09-14T10:45:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2070984752 wait complete. 2024-09-14T10:45:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 Processor -- start 2024-09-14T10:45:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- start start 2024-09-14T10:45:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38eceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a38c83a50 con 0x561a38ddc250 2024-09-14T10:45:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bf9a15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38eceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bf9a15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38eceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37062/0 (socket says 172.21.15.96:37062) 2024-09-14T10:45:28.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bf9a15640 1 -- 172.21.15.96:0/1040031576 learned_addr learned my addr 172.21.15.96:0/1040031576 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bf9a15640 1 -- 172.21.15.96:0/1040031576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a38ecf440 con 0x561a38ddc250 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bf9a15640 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38eceee0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x561a38ec8560 tx=0x7f3bec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3ae6604640 1 -- 172.21.15.96:0/1040031576 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec012030 con 0x561a38ddc250 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3ae6604640 1 -- 172.21.15.96:0/1040031576 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec001460 con 0x561a38ddc250 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a38ecf6d0 con 0x561a38ddc250 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3ae6604640 1 -- 172.21.15.96:0/1040031576 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bec01a7a0 con 0x561a38ddc250 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.822+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a38ed0080 con 0x561a38ddc250 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3ae6604640 1 -- 172.21.15.96:0/1040031576 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3bec015020 con 0x561a38ddc250 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3ae6604640 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ae003a150 0x7f3ae003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3ae6604640 1 -- 172.21.15.96:0/1040031576 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3bec020030 con 0x561a38ddc250 2024-09-14T10:45:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bf9214640 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ae003a150 0x7f3ae003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38de03a0 0x561a38ed6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38ed6590 con 0x561a38de03a0 2024-09-14T10:45:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfa216640 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38de03a0 0x561a38ed6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bf9214640 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ae003a150 0x7f3ae003c610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00ae000 tx=0x7f3bf00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfa216640 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38de03a0 0x561a38ed6050 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfa216640 1 -- 172.21.15.96:0/1040031576 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bf400a4d0 con 0x561a38de03a0 2024-09-14T10:45:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38ed03f0 con 0x561a38de03a0 2024-09-14T10:45:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfa216640 1 -- 172.21.15.96:0/1040031576 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bf400a4d0 con 0x561a38de03a0 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38ed8370 con 0x561a38de03a0 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfa216640 1 -- 172.21.15.96:0/1040031576 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3bf400a4d0 con 0x561a38de03a0 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38ed75a0 con 0x561a38de03a0 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfa216640 1 -- 172.21.15.96:0/1040031576 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bf400a4d0 con 0x561a38de03a0 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38ed79f0 con 0x561a38de03a0 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.826+0000 7f3bfa216640 1 -- 172.21.15.96:0/1040031576 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3bf400a4d0 con 0x561a38de03a0 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bfbf0f9c0 1 Processor -- start 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bfbf0f9c0 1 -- start start 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bfbf0f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ee6730 0x561a38ee6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bfbf0f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a38ceed80 con 0x561a38ee6730 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bf9214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ee6730 0x561a38ee6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bf9214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ee6730 0x561a38ee6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37072/0 (socket says 172.21.15.96:37072) 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bf9214640 1 -- 172.21.15.96:0/1798676157 learned_addr learned my addr 172.21.15.96:0/1798676157 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bf9214640 1 -- 172.21.15.96:0/1798676157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a38ee7190 con 0x561a38ee6730 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bf9214640 1 --2- 172.21.15.96:0/1798676157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ee6730 0x561a38ee6b50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00199c0 tx=0x7f3bf00180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3adf7fe640 1 -- 172.21.15.96:0/1798676157 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf00c5030 con 0x561a38ee6730 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3adf7fe640 1 -- 172.21.15.96:0/1798676157 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf00b58e0 con 0x561a38ee6730 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3adf7fe640 1 -- 172.21.15.96:0/1798676157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf00b5bc0 con 0x561a38ee6730 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1798676157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a38ee79f0 con 0x561a38ee6730 2024-09-14T10:45:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1798676157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a38ee7f60 con 0x561a38ee6730 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3adf7fe640 1 -- 172.21.15.96:0/1798676157 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3bf00c8030 con 0x561a38ee6730 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3adf7fe640 1 --2- 172.21.15.96:0/1798676157 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ad403a190 0x7f3ad403c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3adf7fe640 1 -- 172.21.15.96:0/1798676157 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3bf00c6070 con 0x561a38ee6730 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.830+0000 7f3bfa216640 1 --2- 172.21.15.96:0/1798676157 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ad403a190 0x7f3ad403c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 Processor -- start 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- start start 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38ef3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfa216640 1 --2- 172.21.15.96:0/1798676157 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ad403a190 0x7f3ad403c650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x561a38ed70c0 tx=0x7f3bf4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a38ec7fc0 con 0x561a38ef2f70 2024-09-14T10:45:28.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38ef3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38ef3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37084/0 (socket says 172.21.15.96:37084) 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 -- 172.21.15.96:0/3486007052 learned_addr learned my addr 172.21.15.96:0/3486007052 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 -- 172.21.15.96:0/3486007052 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a38ef3920 con 0x561a38ef2f70 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 --2- 172.21.15.96:0/3486007052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38ef3350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0006fa0 tx=0x7f3bf00b5ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89daf788e643a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3add7fa640 1 -- 172.21.15.96:0/3486007052 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0000ee0 con 0x561a38ef2f70 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3add7fa640 1 -- 172.21.15.96:0/3486007052 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf00d8020 con 0x561a38ef2f70 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3add7fa640 1 -- 172.21.15.96:0/3486007052 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf00011b0 con 0x561a38ef2f70 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/3486007052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 msgr2=0x561a38ef3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/3486007052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38ef3350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0006fa0 tx=0x7f3bf00b5ed0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/3486007052 shutdown_connections 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/3486007052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38ef3350 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/3486007052 >> 172.21.15.96:0/3486007052 conn(0x561a38eef3a0 msgr2=0x561a38eed5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/3486007052 shutdown_connections 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/3486007052 wait complete. 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 Processor -- start 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- start start 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38efa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bfbf0f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a38ef3f80 con 0x561a38ef2f70 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38efa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38efa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37098/0 (socket says 172.21.15.96:37098) 2024-09-14T10:45:28.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 learned_addr learned my addr 172.21.15.96:0/2934618270 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a38efaa30 con 0x561a38ef2f70 2024-09-14T10:45:28.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.834+0000 7f3bf9214640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38efa4d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00b4550 tx=0x7f3bf00ec060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3acb7fe640 1 -- 172.21.15.96:0/2934618270 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf00d28e0 con 0x561a38ef2f70 2024-09-14T10:45:28.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3acb7fe640 1 -- 172.21.15.96:0/2934618270 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf00d2a80 con 0x561a38ef2f70 2024-09-14T10:45:28.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3acb7fe640 1 -- 172.21.15.96:0/2934618270 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf00d2d80 con 0x561a38ef2f70 2024-09-14T10:45:28.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a38efacc0 con 0x561a38ef2f70 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a38efb670 con 0x561a38ef2f70 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3acb7fe640 1 -- 172.21.15.96:0/2934618270 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3bf00f4030 con 0x561a38ef2f70 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3acb7fe640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ac403a150 0x7f3ac403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3acb7fe640 1 -- 172.21.15.96:0/2934618270 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3bf00f2070 con 0x561a38ef2f70 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfa216640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ac403a150 0x7f3ac403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38f059f0 0x561a38f07e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f085d0 con 0x561a38f059f0 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bf9a15640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38f059f0 0x561a38f07e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bf9a15640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38f059f0 0x561a38f07e80 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfa216640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ac403a150 0x7f3ac403c610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561a38ed0330 tx=0x7f3bf401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 realm 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f089e0 con 0x561a38f059f0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f092b0 con 0x561a38f059f0 2024-09-14T10:45:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f09650 con 0x561a38f059f0 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.838+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f09af0 con 0x561a38f059f0 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfbf0f9c0 20 searching for the correct realm 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a38f0baf0 0x561a38f0dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f0baf0 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9214640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a38f0baf0 0x561a38f0dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9214640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a38f0baf0 0x561a38f0dee0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9214640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3bf0009040 0x7f3bf00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf0009040 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfa216640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3bf0009040 0x7f3bf00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfa216640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3bf0009040 0x7f3bf00ca890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf401f070 con 0x7f3bf0009040 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfa216640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3bf4031040 0x7f3bf4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf4031040 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9a15640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3bf4031040 0x7f3bf4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9a15640 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3bf4031040 0x7f3bf4032430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x7f3bf4031040 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f059f0 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f059f0 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.842+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf4031040 2024-09-14T10:45:28.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x7f3bf4031040 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf4031040 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x7f3bf4031040 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf0009040 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf401f070 con 0x7f3bf0009040 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f0baf0 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f059f0 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf4031040 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x7f3bf4031040 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f059f0 2024-09-14T10:45:28.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf0009040 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3bf401f070 con 0x7f3bf0009040 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f0baf0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f0baf0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.846+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf4031040 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x7f3bf4031040 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f0baf0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f0baf0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f059f0 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f059f0 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3bec008030 con 0x561a38f059f0 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf4031040 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec008030 con 0x7f3bf4031040 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f0baf0 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf0009040 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf401f070 con 0x7f3bf0009040 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f059f0 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf0009040 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf401f070 con 0x7f3bf0009040 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x561a38f0baf0 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.850+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0e590 con 0x7f3bf4031040 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3bec038040 con 0x7f3bf0009040 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf401f070 con 0x7f3bf0009040 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3bec038040 con 0x561a38f0baf0 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3bec038040 con 0x7f3bf4031040 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3bec038040 con 0x561a38f059f0 2024-09-14T10:45:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3bec038040 con 0x7f3bf0009040 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf4040040 con 0x7f3bf0009040 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0a460 con 0x561a38f059f0 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0a850 con 0x561a38f059f0 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0a850 con 0x561a38f059f0 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 zone default found 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 4 Realm: () 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 zonegroup default 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0ac70 con 0x7f3bf0009040 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3bf4040040 con 0x7f3bf0009040 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.854+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f103e0 con 0x561a38f0baf0 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f10780 con 0x561a38f0baf0 2024-09-14T10:45:28.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:28.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 20 started sync module instance, tier type = 2024-09-14T10:45:28.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:28.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0f880 con 0x7f3bf0009040 2024-09-14T10:45:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf4040040 con 0x7f3bf0009040 2024-09-14T10:45:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94670624456064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0f880 con 0x7f3bf0009040 2024-09-14T10:45:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f112d0 con 0x561a38f059f0 2024-09-14T10:45:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.858+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94670624456064] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf4040040 con 0x7f3bf0009040 2024-09-14T10:45:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.862+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.862+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94670624460192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0f880 con 0x561a38f059f0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.862+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f11ce0 con 0x561a38f0baf0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.862+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94670624460192] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.862+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.862+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94670624453584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0f7f0 con 0x561a38f0baf0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.862+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f12ab0 con 0x7f3bf0009040 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.866+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf4040040 con 0x7f3bf0009040 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.866+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94670624466304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f13350 con 0x7f3bf0009040 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.866+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f13d90 con 0x561a38f059f0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.866+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94670624453584] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.866+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94670624466304] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf4040040 con 0x7f3bf0009040 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.866+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.866+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94670624471136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f12ea0 con 0x561a38f059f0 2024-09-14T10:45:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.866+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f14630 con 0x7f3bf4031040 2024-09-14T10:45:28.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.870+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.870+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94670624471136] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.870+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94670624472976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f12ea0 con 0x7f3bf4031040 2024-09-14T10:45:28.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.870+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f14ab0 con 0x7f3bf4031040 2024-09-14T10:45:28.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.870+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94670624472976] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.870+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.870+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94670624465104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f14ab0 con 0x7f3bf4031040 2024-09-14T10:45:28.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.870+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f15470 con 0x7f3bf4031040 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94670624477120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f15890 con 0x7f3bf4031040 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94670624465104] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 20 add_watcher() i=0 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 20 add_watcher() i=1 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 20 add_watcher() i=2 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 20 add_watcher() i=3 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 20 add_watcher() i=4 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 20 add_watcher() i=5 2024-09-14T10:45:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 20 add_watcher() i=6 2024-09-14T10:45:28.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94670624477120] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 20 add_watcher() i=7 2024-09-14T10:45:28.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:28.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f15890 con 0x561a38f059f0 2024-09-14T10:45:28.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.874+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94670624478176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f16160 con 0x561a38f059f0 2024-09-14T10:45:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94670624478176] v34'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3aab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:28.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 5 note: GC not initialized 2024-09-14T10:45:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3aaa7fc640 20 reqs_thread_entry: start 2024-09-14T10:45:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 20 Filter name: none 2024-09-14T10:45:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3a1bfff640 20 reqs_thread_entry: start 2024-09-14T10:45:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:28.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f3bbd0 con 0x561a38f059f0 2024-09-14T10:45:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:45:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561a38f3d120 con 0x7f3bf4031040 2024-09-14T10:45:28.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3aab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:28.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.878+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94670624478176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f16110 con 0x561a38f059f0 2024-09-14T10:45:28.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.882+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94670624478176] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.882+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94670624456064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f153e0 con 0x7f3bf0009040 2024-09-14T10:45:28.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.882+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94670624456064] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf4040040 con 0x7f3bf0009040 2024-09-14T10:45:28.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.882+0000 7f3bfbf0f9c0 20 remove_watcher() i=0 2024-09-14T10:45:28.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.882+0000 7f3bfbf0f9c0 2 removed watcher, disabling cache 2024-09-14T10:45:28.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.882+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94670624460192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f153e0 con 0x561a38f059f0 2024-09-14T10:45:28.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94670624460192] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bfbf0f9c0 20 remove_watcher() i=1 2024-09-14T10:45:28.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94670624453584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f10da0 con 0x561a38f0baf0 2024-09-14T10:45:28.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bf9214640 1 -- 172.21.15.96:0/2934618270 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94670624453584] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf00d1070 con 0x561a38f0baf0 2024-09-14T10:45:28.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bfbf0f9c0 20 remove_watcher() i=2 2024-09-14T10:45:28.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94670624466304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f153e0 con 0x7f3bf0009040 2024-09-14T10:45:28.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bfa216640 1 -- 172.21.15.96:0/2934618270 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94670624466304] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf4040040 con 0x7f3bf0009040 2024-09-14T10:45:28.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bfbf0f9c0 20 remove_watcher() i=3 2024-09-14T10:45:28.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.886+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94670624471136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0f3d0 con 0x561a38f059f0 2024-09-14T10:45:28.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.890+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94670624471136] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x561a38f059f0 2024-09-14T10:45:28.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.890+0000 7f3bfbf0f9c0 20 remove_watcher() i=4 2024-09-14T10:45:28.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.890+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94670624472976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f153e0 con 0x7f3bf4031040 2024-09-14T10:45:28.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.890+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94670624472976] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.890+0000 7f3bfbf0f9c0 20 remove_watcher() i=5 2024-09-14T10:45:28.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.890+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94670624465104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f13860 con 0x7f3bf4031040 2024-09-14T10:45:28.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94670624465104] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 20 remove_watcher() i=6 2024-09-14T10:45:28.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94670624477120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561a38f0f3d0 con 0x7f3bf4031040 2024-09-14T10:45:28.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94670624477120] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bec052040 con 0x7f3bf4031040 2024-09-14T10:45:28.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 20 remove_watcher() i=7 2024-09-14T10:45:28.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3bf4031040 msgr2=0x7f3bf4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3bf4031040 0x7f3bf4032430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38f059f0 msgr2=0x561a38f07e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38f059f0 0x561a38f07e80 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3bf0009040 msgr2=0x7f3bf00ca890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3bf0009040 0x7f3bf00ca890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a38f0baf0 msgr2=0x561a38f0dee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x561a38f0baf0 0x561a38f0dee0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ac403a150 msgr2=0x7f3ac403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ac403a150 0x7f3ac403c610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561a38ed0330 tx=0x7f3bf401f000 comp rx=0 tx=0).stop 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 msgr2=0x561a38efa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bf9a15640 1 -- 172.21.15.96:0/2934618270 reap_dead start 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38efa4d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00b4550 tx=0x7f3bf00ec060 comp rx=0 tx=0).stop 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 shutdown_connections 2024-09-14T10:45:28.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/2934618270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ef2f70 0x561a38efa4d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 >> 172.21.15.96:0/2934618270 conn(0x561a38eef3a0 msgr2=0x561a38eed5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 shutdown_connections 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.894+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/2934618270 wait complete. 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1798676157 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ad403a190 msgr2=0x7f3ad403c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1798676157 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ad403a190 0x7f3ad403c650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x561a38ed70c0 tx=0x7f3bf4005850 comp rx=0 tx=0).stop 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1798676157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ee6730 msgr2=0x561a38ee6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1798676157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ee6730 0x561a38ee6b50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00199c0 tx=0x7f3bf00180b0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1798676157 shutdown_connections 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1798676157 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ad403a190 0x7f3ad403c650 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1798676157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ee6730 0x561a38ee6b50 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1798676157 >> 172.21.15.96:0/1798676157 conn(0x561a38edc0e0 msgr2=0x561a38edc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1798676157 shutdown_connections 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1798676157 wait complete. 2024-09-14T10:45:28.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38de03a0 msgr2=0x561a38ed6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38de03a0 0x561a38ed6050 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ae003a150 msgr2=0x7f3ae003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ae003a150 0x7f3ae003c610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00ae000 tx=0x7f3bf00a6000 comp rx=0 tx=0).stop 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 msgr2=0x561a38eceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38eceee0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x561a38ec8560 tx=0x7f3bec000bd0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 shutdown_connections 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x561a38de03a0 0x561a38ed6050 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ae003a150 0x7f3ae003c610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 --2- 172.21.15.96:0/1040031576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a38ddc250 0x561a38eceee0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 >> 172.21.15.96:0/1040031576 conn(0x561a38d4fb60 msgr2=0x561a38ec89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 shutdown_connections 2024-09-14T10:45:28.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.898+0000 7f3bfbf0f9c0 1 -- 172.21.15.96:0/1040031576 wait complete. 2024-09-14T10:45:28.906 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:45:28.907 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:45:28.907 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-14T10:45:28.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-14T10:45:28.907 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-14T10:45:28.981 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:28.981 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:28.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f491597f9c0 1 Processor -- start 2024-09-14T10:45:28.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f491597f9c0 1 -- start start 2024-09-14T10:45:28.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f491597f9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x564965fc7260 0x564965fc7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:28.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f491597f9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564965e6d7a0 con 0x564965fca3a0 2024-09-14T10:45:28.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f491597f9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x564965ec91b0 con 0x564965fc7260 2024-09-14T10:45:28.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f4913485640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x564965fc7260 0x564965fc7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:28.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f4913485640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x564965fc7260 0x564965fc7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37102/0 (socket says 172.21.15.96:37102) 2024-09-14T10:45:28.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f4912c84640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x564965fca3a0 0x564965fcc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33018/0 (socket says 172.21.15.96:33018) 2024-09-14T10:45:28.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f4913485640 1 -- 172.21.15.96:0/3652428544 learned_addr learned my addr 172.21.15.96:0/3652428544 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:28.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f4913485640 1 -- 172.21.15.96:0/3652428544 >> v1:172.21.15.70:6789/0 conn(0x564965fca3a0 legacy=0x564965fcc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.982+0000 7f4913485640 1 -- 172.21.15.96:0/3652428544 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564965e47da0 con 0x564965fc7260 2024-09-14T10:45:28.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f4913485640 1 --2- 172.21.15.96:0/3652428544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x564965fc7640 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00a5c0 tx=0x7f48fc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5a4882d1345b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:28.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f4912483640 1 -- 172.21.15.96:0/3652428544 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48fc0a6070 con 0x564965fc7260 2024-09-14T10:45:28.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f4912483640 1 -- 172.21.15.96:0/3652428544 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc0af070 con 0x564965fc7260 2024-09-14T10:45:28.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f4912483640 1 -- 172.21.15.96:0/3652428544 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48fc0aa5c0 con 0x564965fc7260 2024-09-14T10:45:28.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f491597f9c0 1 -- 172.21.15.96:0/3652428544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 msgr2=0x564965fc7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:28.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3652428544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x564965fc7640 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00a5c0 tx=0x7f48fc01b340 comp rx=0 tx=0).stop 2024-09-14T10:45:28.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f491597f9c0 1 -- 172.21.15.96:0/3652428544 shutdown_connections 2024-09-14T10:45:28.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3652428544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x564965fc7640 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:28.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f491597f9c0 1 -- 172.21.15.96:0/3652428544 >> 172.21.15.96:0/3652428544 conn(0x564965f3ab70 msgr2=0x564965f3af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:28.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f491597f9c0 1 -- 172.21.15.96:0/3652428544 shutdown_connections 2024-09-14T10:45:28.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:28.986+0000 7f491597f9c0 1 -- 172.21.15.96:0/3652428544 wait complete. 2024-09-14T10:45:29.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 Processor -- start 2024-09-14T10:45:29.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- start start 2024-09-14T10:45:29.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564965eccfc0 con 0x564965fc7260 2024-09-14T10:45:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f4913485640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f4913485640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37116/0 (socket says 172.21.15.96:37116) 2024-09-14T10:45:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f4913485640 1 -- 172.21.15.96:0/3685494751 learned_addr learned my addr 172.21.15.96:0/3685494751 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f4913485640 1 -- 172.21.15.96:0/3685494751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649660b2bd0 con 0x564965fc7260 2024-09-14T10:45:29.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f4913485640 1 --2- 172.21.15.96:0/3685494751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b25e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0ac040 tx=0x7f48fc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1322cade55ded519 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f480160a640 1 -- 172.21.15.96:0/3685494751 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48fc0aa970 con 0x564965fc7260 2024-09-14T10:45:29.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f480160a640 1 -- 172.21.15.96:0/3685494751 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc0aab10 con 0x564965fc7260 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f480160a640 1 -- 172.21.15.96:0/3685494751 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48fc0aae30 con 0x564965fc7260 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- 172.21.15.96:0/3685494751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 msgr2=0x5649660b25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3685494751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b25e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0ac040 tx=0x7f48fc003030 comp rx=0 tx=0).stop 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- 172.21.15.96:0/3685494751 shutdown_connections 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3685494751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b25e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- 172.21.15.96:0/3685494751 >> 172.21.15.96:0/3685494751 conn(0x564965f3ab70 msgr2=0x5649660ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- 172.21.15.96:0/3685494751 shutdown_connections 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- 172.21.15.96:0/3685494751 wait complete. 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 Processor -- start 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- start start 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f491597f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564965e6ea50 con 0x564965fc7260 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f4913485640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f4913485640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37126/0 (socket says 172.21.15.96:37126) 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.002+0000 7f4913485640 1 -- 172.21.15.96:0/3195931345 learned_addr learned my addr 172.21.15.96:0/3195931345 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f4913485640 1 -- 172.21.15.96:0/3195931345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649660ba320 con 0x564965fc7260 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f4913485640 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b9dc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f48fc01b820 tx=0x7f48fc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f47ffe07640 1 -- 172.21.15.96:0/3195931345 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48fc0c6650 con 0x564965fc7260 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f47ffe07640 1 -- 172.21.15.96:0/3195931345 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc0c67f0 con 0x564965fc7260 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649660ba5b0 con 0x564965fc7260 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f47ffe07640 1 -- 172.21.15.96:0/3195931345 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48fc0c6ad0 con 0x564965fc7260 2024-09-14T10:45:29.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649660baf60 con 0x564965fc7260 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f47ffe07640 1 -- 172.21.15.96:0/3195931345 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f48fc0d0400 con 0x564965fc7260 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f47ffe07640 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47f803a150 0x7f47f803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f47ffe07640 1 -- 172.21.15.96:0/3195931345 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f48fc0ecaf0 con 0x564965fc7260 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f4912c84640 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47f803a150 0x7f47f803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564965fca3a0 0x5649660c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660c1470 con 0x564965fca3a0 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f4913c86640 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564965fca3a0 0x5649660c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f4912c84640 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47f803a150 0x7f47f803c610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f49040016b0 tx=0x7f49040066c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f4913c86640 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564965fca3a0 0x5649660c0f30 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f4913c86640 1 -- 172.21.15.96:0/3195931345 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f490c0083f0 con 0x564965fca3a0 2024-09-14T10:45:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660c18e0 con 0x564965fca3a0 2024-09-14T10:45:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f4913c86640 1 -- 172.21.15.96:0/3195931345 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f490c0083f0 con 0x564965fca3a0 2024-09-14T10:45:29.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.006+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660c31e0 con 0x564965fca3a0 2024-09-14T10:45:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f4913c86640 1 -- 172.21.15.96:0/3195931345 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f490c0083f0 con 0x564965fca3a0 2024-09-14T10:45:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660c2410 con 0x564965fca3a0 2024-09-14T10:45:29.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f4913c86640 1 -- 172.21.15.96:0/3195931345 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f490c0083f0 con 0x564965fca3a0 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660c2860 con 0x564965fca3a0 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f4913c86640 1 -- 172.21.15.96:0/3195931345 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f490c0083f0 con 0x564965fca3a0 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f491597f9c0 1 Processor -- start 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f491597f9c0 1 -- start start 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f491597f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660d1570 0x5649660d1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f491597f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564965ed9d80 con 0x5649660d1570 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f4912c84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660d1570 0x5649660d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f4912c84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660d1570 0x5649660d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37128/0 (socket says 172.21.15.96:37128) 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f4912c84640 1 -- 172.21.15.96:0/778878672 learned_addr learned my addr 172.21.15.96:0/778878672 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f4912c84640 1 -- 172.21.15.96:0/778878672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649660d1fd0 con 0x5649660d1570 2024-09-14T10:45:29.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f4912c84640 1 --2- 172.21.15.96:0/778878672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660d1570 0x5649660d1990 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4904004f90 tx=0x7f4904015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f47fd602640 1 -- 172.21.15.96:0/778878672 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4904011440 con 0x5649660d1570 2024-09-14T10:45:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f491597f9c0 1 -- 172.21.15.96:0/778878672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649660d2830 con 0x5649660d1570 2024-09-14T10:45:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f47fd602640 1 -- 172.21.15.96:0/778878672 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49040115e0 con 0x5649660d1570 2024-09-14T10:45:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f47fd602640 1 -- 172.21.15.96:0/778878672 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49040118c0 con 0x5649660d1570 2024-09-14T10:45:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.010+0000 7f491597f9c0 1 -- 172.21.15.96:0/778878672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649660d2da0 con 0x5649660d1570 2024-09-14T10:45:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f47fd602640 1 -- 172.21.15.96:0/778878672 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f4904011a60 con 0x5649660d1570 2024-09-14T10:45:29.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f47fd602640 1 --2- 172.21.15.96:0/778878672 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47ec03a150 0x7f47ec03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f47fd602640 1 -- 172.21.15.96:0/778878672 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f490401b030 con 0x5649660d1570 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4913c86640 1 --2- 172.21.15.96:0/778878672 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47ec03a150 0x7f47ec03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 Processor -- start 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- start start 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660de2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5649660b2f40 con 0x5649660dded0 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4913c86640 1 --2- 172.21.15.96:0/778878672 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47ec03a150 0x7f47ec03c610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e3f0 tx=0x7f490c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4912c84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660de2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4912c84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660de2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37136/0 (socket says 172.21.15.96:37136) 2024-09-14T10:45:29.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4912c84640 1 -- 172.21.15.96:0/1936939540 learned_addr learned my addr 172.21.15.96:0/1936939540 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4912c84640 1 -- 172.21.15.96:0/1936939540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649660de880 con 0x5649660dded0 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4912c84640 1 --2- 172.21.15.96:0/1936939540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660de2b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4904050b80 tx=0x7f490401d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1598fdd2081c2c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f47f6ffd640 1 -- 172.21.15.96:0/1936939540 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4904013cd0 con 0x5649660dded0 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f47f6ffd640 1 -- 172.21.15.96:0/1936939540 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490401f390 con 0x5649660dded0 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f47f6ffd640 1 -- 172.21.15.96:0/1936939540 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490401fcb0 con 0x5649660dded0 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- 172.21.15.96:0/1936939540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 msgr2=0x5649660de2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 --2- 172.21.15.96:0/1936939540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660de2b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4904050b80 tx=0x7f490401d960 comp rx=0 tx=0).stop 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- 172.21.15.96:0/1936939540 shutdown_connections 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 --2- 172.21.15.96:0/1936939540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660de2b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- 172.21.15.96:0/1936939540 >> 172.21.15.96:0/1936939540 conn(0x5649660da300 msgr2=0x5649660d8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- 172.21.15.96:0/1936939540 shutdown_connections 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- 172.21.15.96:0/1936939540 wait complete. 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 Processor -- start 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- start start 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f491597f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5649660deee0 con 0x5649660dded0 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4912c84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4912c84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37142/0 (socket says 172.21.15.96:37142) 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.014+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 learned_addr learned my addr 172.21.15.96:0/3907383301 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649660e59d0 con 0x5649660dded0 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4912c84640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660e5470 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f490401da40 tx=0x7f4904050ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f47f57fa640 1 -- 172.21.15.96:0/3907383301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4904011e10 con 0x5649660dded0 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f47f57fa640 1 -- 172.21.15.96:0/3907383301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490401fcb0 con 0x5649660dded0 2024-09-14T10:45:29.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649660e5c60 con 0x5649660dded0 2024-09-14T10:45:29.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f47f57fa640 1 -- 172.21.15.96:0/3907383301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490404f3d0 con 0x5649660dded0 2024-09-14T10:45:29.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649660e5c60 con 0x5649660dded0 2024-09-14T10:45:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f47f57fa640 1 -- 172.21.15.96:0/3907383301 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f490404f570 con 0x5649660dded0 2024-09-14T10:45:29.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f47f57fa640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47dc03a1a0 0x7f47dc03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f47f57fa640 1 -- 172.21.15.96:0/3907383301 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f490403e980 con 0x5649660dded0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4913c86640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47dc03a1a0 0x7f47dc03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649660f07d0 0x5649660f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f3370 con 0x5649660f07d0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4913485640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649660f07d0 0x5649660f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4913c86640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47dc03a1a0 0x7f47dc03c660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f490c00f010 tx=0x7f490c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4913485640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649660f07d0 0x5649660f2c20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 20 realm 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f3780 con 0x5649660f07d0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f4050 con 0x5649660f07d0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.018+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f43f0 con 0x5649660f07d0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f491597f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f4890 con 0x5649660f07d0 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f491597f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f491597f9c0 20 searching for the correct realm 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649660f6890 0x5649660f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4912c84640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649660f6890 0x5649660f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4912c84640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649660f6890 0x5649660f8c80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4912c84640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4904043830 0x7f4904010740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f4904043830 2024-09-14T10:45:29.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913c86640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4904043830 0x7f4904010740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913c86640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4904043830 0x7f4904010740 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913c86640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f490c019040 0x7f490c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f490c019040 2024-09-14T10:45:29.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913485640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f490c019040 0x7f490c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913485640 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f490c019040 0x7f490c019930 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f07d0 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.022+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f07d0 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f490c019040 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f490c019040 2024-09-14T10:45:29.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f4904043830 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f07d0 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f490c019040 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f07d0 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f4904043830 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.026+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f490c019040 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f07d0 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f07d0 2024-09-14T10:45:29.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f490c019040 2024-09-14T10:45:29.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f4904043830 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f07d0 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f4904043830 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.030+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f490c019040 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f4904043830 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f6890 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f490c019040 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x5649660f07d0 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649660f9330 con 0x7f4904043830 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f5330 con 0x5649660f07d0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f5bd0 con 0x5649660f07d0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f4f70 con 0x5649660f07d0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 zone default found 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 4 Realm: () 2024-09-14T10:45:29.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 zonegroup default 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660f5bd0 con 0x7f4904043830 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660fb630 con 0x5649660f6890 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660fb9d0 con 0x5649660f6890 2024-09-14T10:45:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 started sync module instance, tier type = 2024-09-14T10:45:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.034+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660faa70 con 0x7f4904043830 2024-09-14T10:45:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.038+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.038+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94873244905408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660faa70 con 0x7f4904043830 2024-09-14T10:45:29.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.038+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fc3d0 con 0x5649660f07d0 2024-09-14T10:45:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.038+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94873244905408] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.038+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.038+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94873244909280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660faa70 con 0x5649660f07d0 2024-09-14T10:45:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.038+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fcde0 con 0x5649660f6890 2024-09-14T10:45:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94873244909280] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94873244911920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fd1d0 con 0x5649660f6890 2024-09-14T10:45:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fdb90 con 0x7f4904043830 2024-09-14T10:45:29.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94873244915696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fe430 con 0x7f4904043830 2024-09-14T10:45:29.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fee30 con 0x5649660f07d0 2024-09-14T10:45:29.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94873244911920] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.042+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94873244915696] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.046+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.046+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94873244902848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fdf80 con 0x5649660f07d0 2024-09-14T10:45:29.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.046+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660ff6d0 con 0x7f490c019040 2024-09-14T10:45:29.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.046+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94873244902848] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.046+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.046+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94873244920128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fdf80 con 0x7f490c019040 2024-09-14T10:45:29.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.046+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660ffb60 con 0x7f490c019040 2024-09-14T10:45:29.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94873244923504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660ffad0 con 0x7f490c019040 2024-09-14T10:45:29.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564966100ad0 con 0x7f490c019040 2024-09-14T10:45:29.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94873244920128] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94873244923504] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94873244927392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564966100a90 con 0x7f490c019040 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 20 add_watcher() i=0 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 20 add_watcher() i=1 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 20 add_watcher() i=2 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 20 add_watcher() i=3 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 20 add_watcher() i=4 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 20 add_watcher() i=5 2024-09-14T10:45:29.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.050+0000 7f491597f9c0 20 add_watcher() i=6 2024-09-14T10:45:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94873244927392] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 20 add_watcher() i=7 2024-09-14T10:45:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649660fff30 con 0x5649660f07d0 2024-09-14T10:45:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94873244925744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649661011c0 con 0x5649660f07d0 2024-09-14T10:45:29.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94873244925744] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f47c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:29.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:29.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 5 note: GC not initialized 2024-09-14T10:45:29.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f47c8fe1640 20 reqs_thread_entry: start 2024-09-14T10:45:29.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:29.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 20 Filter name: none 2024-09-14T10:45:29.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f47427fc640 20 reqs_thread_entry: start 2024-09-14T10:45:29.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564966126d00 con 0x5649660f07d0 2024-09-14T10:45:29.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:45:29.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.054+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564966128250 con 0x7f490c019040 2024-09-14T10:45:29.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f47c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94873244925744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564966126620 con 0x5649660f07d0 2024-09-14T10:45:29.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94873244925744] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94873244905408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564966126620 con 0x7f4904043830 2024-09-14T10:45:29.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94873244905408] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f491597f9c0 20 remove_watcher() i=0 2024-09-14T10:45:29.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f491597f9c0 2 removed watcher, disabling cache 2024-09-14T10:45:29.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.058+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94873244909280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fafc0 con 0x5649660f07d0 2024-09-14T10:45:29.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94873244909280] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f491597f9c0 20 remove_watcher() i=1 2024-09-14T10:45:29.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94873244911920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fafc0 con 0x5649660f6890 2024-09-14T10:45:29.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f4912c84640 1 -- 172.21.15.96:0/3907383301 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94873244911920] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4904049070 con 0x5649660f6890 2024-09-14T10:45:29.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f491597f9c0 20 remove_watcher() i=2 2024-09-14T10:45:29.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94873244915696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fc930 con 0x7f4904043830 2024-09-14T10:45:29.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f4913c86640 1 -- 172.21.15.96:0/3907383301 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94873244915696] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c02f040 con 0x7f4904043830 2024-09-14T10:45:29.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f491597f9c0 20 remove_watcher() i=3 2024-09-14T10:45:29.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.062+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94873244902848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fc930 con 0x5649660f07d0 2024-09-14T10:45:29.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.066+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94873244902848] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x5649660f07d0 2024-09-14T10:45:29.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.066+0000 7f491597f9c0 20 remove_watcher() i=4 2024-09-14T10:45:29.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.066+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94873244920128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fa5c0 con 0x7f490c019040 2024-09-14T10:45:29.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.066+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94873244920128] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.066+0000 7f491597f9c0 20 remove_watcher() i=5 2024-09-14T10:45:29.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.066+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94873244923504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fc930 con 0x7f490c019040 2024-09-14T10:45:29.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94873244923504] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 20 remove_watcher() i=6 2024-09-14T10:45:29.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94873244927392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649660fc930 con 0x7f490c019040 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94873244927392] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48fc0cd020 con 0x7f490c019040 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 20 remove_watcher() i=7 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f490c019040 msgr2=0x7f490c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f490c019040 0x7f490c019930 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649660f07d0 msgr2=0x5649660f2c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5649660f07d0 0x5649660f2c20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4904043830 msgr2=0x7f4904010740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4904043830 0x7f4904010740 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649660f6890 msgr2=0x5649660f8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5649660f6890 0x5649660f8c80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47dc03a1a0 msgr2=0x7f47dc03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47dc03a1a0 0x7f47dc03c660 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f490c00f010 tx=0x7f490c01b070 comp rx=0 tx=0).stop 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f4913485640 1 -- 172.21.15.96:0/3907383301 reap_dead start 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 msgr2=0x5649660e5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660e5470 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f490401da40 tx=0x7f4904050ab0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 shutdown_connections 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3907383301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660dded0 0x5649660e5470 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 >> 172.21.15.96:0/3907383301 conn(0x5649660da300 msgr2=0x5649660d8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 shutdown_connections 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/3907383301 wait complete. 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/778878672 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47ec03a150 msgr2=0x7f47ec03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/778878672 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47ec03a150 0x7f47ec03c610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e3f0 tx=0x7f490c003070 comp rx=0 tx=0).stop 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/778878672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660d1570 msgr2=0x5649660d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/778878672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660d1570 0x5649660d1990 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4904004f90 tx=0x7f4904015820 comp rx=0 tx=0).stop 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 -- 172.21.15.96:0/778878672 shutdown_connections 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.070+0000 7f491597f9c0 1 --2- 172.21.15.96:0/778878672 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47ec03a150 0x7f47ec03c610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 --2- 172.21.15.96:0/778878672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5649660d1570 0x5649660d1990 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/778878672 >> 172.21.15.96:0/778878672 conn(0x5649660c6f20 msgr2=0x5649660c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/778878672 shutdown_connections 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/778878672 wait complete. 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564965fca3a0 msgr2=0x5649660c0f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564965fca3a0 0x5649660c0f30 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47f803a150 msgr2=0x7f47f803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47f803a150 0x7f47f803c610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f49040016b0 tx=0x7f49040066c0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 msgr2=0x5649660b9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b9dc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f48fc01b820 tx=0x7f48fc0180e0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 shutdown_connections 2024-09-14T10:45:29.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564965fca3a0 0x5649660c0f30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f47f803a150 0x7f47f803c610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 --2- 172.21.15.96:0/3195931345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564965fc7260 0x5649660b9dc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 >> 172.21.15.96:0/3195931345 conn(0x564965f3ab70 msgr2=0x5649660b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 shutdown_connections 2024-09-14T10:45:29.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.074+0000 7f491597f9c0 1 -- 172.21.15.96:0/3195931345 wait complete. 2024-09-14T10:45:29.082 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:45:29.082 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:45:29.082 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-14T10:45:29.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-14T10:45:29.082 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-14T10:45:29.159 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:29.159 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:29.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fb05a79c0 1 Processor -- start 2024-09-14T10:45:29.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fb05a79c0 1 -- start start 2024-09-14T10:45:29.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fb05a79c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x564b1c65f1b0 0x564b1c6615a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fb05a79c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b1c5037a0 con 0x564b1c65b010 2024-09-14T10:45:29.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fb05a79c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x564b1c55f1b0 con 0x564b1c65f1b0 2024-09-14T10:45:29.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fad8ac640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x564b1c65f1b0 0x564b1c6615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fae0ad640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x564b1c65b010 0x564b1c65b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33024/0 (socket says 172.21.15.96:33024) 2024-09-14T10:45:29.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fad8ac640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x564b1c65f1b0 0x564b1c6615a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37158/0 (socket says 172.21.15.96:37158) 2024-09-14T10:45:29.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fae0ad640 1 -- 172.21.15.96:0/62257397 learned_addr learned my addr 172.21.15.96:0/62257397 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:45:29.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fad8ac640 1 -- 172.21.15.96:0/62257397 >> v1:172.21.15.70:6789/0 conn(0x564b1c65b010 legacy=0x564b1c65b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fad8ac640 1 -- 172.21.15.96:0/62257397 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1c4ddda0 con 0x564b1c65f1b0 2024-09-14T10:45:29.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.162+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/62257397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65f1b0 0x564b1c6615a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800a480 tx=0x7f4f9801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b9613fb85e929 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fad0ab640 1 -- 172.21.15.96:0/62257397 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980aa570 con 0x564b1c65f1b0 2024-09-14T10:45:29.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fad0ab640 1 -- 172.21.15.96:0/62257397 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f980af070 con 0x564b1c65f1b0 2024-09-14T10:45:29.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fad0ab640 1 -- 172.21.15.96:0/62257397 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980aa860 con 0x564b1c65f1b0 2024-09-14T10:45:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/62257397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65f1b0 msgr2=0x564b1c6615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/62257397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65f1b0 0x564b1c6615a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800a480 tx=0x7f4f9801b310 comp rx=0 tx=0).stop 2024-09-14T10:45:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/62257397 shutdown_connections 2024-09-14T10:45:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/62257397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65f1b0 0x564b1c6615a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/62257397 >> 172.21.15.96:0/62257397 conn(0x564b1c656b30 msgr2=0x564b1c658f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/62257397 shutdown_connections 2024-09-14T10:45:29.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.166+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/62257397 wait complete. 2024-09-14T10:45:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fb05a79c0 1 Processor -- start 2024-09-14T10:45:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fb05a79c0 1 -- start start 2024-09-14T10:45:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fb05a79c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c7463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fb05a79c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564b1c562fc0 con 0x564b1c65b010 2024-09-14T10:45:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fae0ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c7463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fae0ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c7463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37170/0 (socket says 172.21.15.96:37170) 2024-09-14T10:45:29.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fae0ad640 1 -- 172.21.15.96:0/2020212142 learned_addr learned my addr 172.21.15.96:0/2020212142 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fae0ad640 1 -- 172.21.15.96:0/2020212142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1c7469e0 con 0x564b1c65b010 2024-09-14T10:45:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4fae0ad640 1 --2- 172.21.15.96:0/2020212142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c7463f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8001810 tx=0x7f4fa8001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831fc25fa7a76026 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4e9c608640 1 -- 172.21.15.96:0/2020212142 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa8004530 con 0x564b1c65b010 2024-09-14T10:45:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4e9c608640 1 -- 172.21.15.96:0/2020212142 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80046d0 con 0x564b1c65b010 2024-09-14T10:45:29.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.178+0000 7f4e9c608640 1 -- 172.21.15.96:0/2020212142 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa80049f0 con 0x564b1c65b010 2024-09-14T10:45:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/2020212142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 msgr2=0x564b1c7463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/2020212142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c7463f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8001810 tx=0x7f4fa8001cd0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/2020212142 shutdown_connections 2024-09-14T10:45:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/2020212142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c7463f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/2020212142 >> 172.21.15.96:0/2020212142 conn(0x564b1c656b30 msgr2=0x564b1c742030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/2020212142 shutdown_connections 2024-09-14T10:45:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/2020212142 wait complete. 2024-09-14T10:45:29.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 Processor -- start 2024-09-14T10:45:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- start start 2024-09-14T10:45:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c74dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564b1c504a50 con 0x564b1c65b010 2024-09-14T10:45:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fae0ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c74dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fae0ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c74dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37182/0 (socket says 172.21.15.96:37182) 2024-09-14T10:45:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fae0ad640 1 -- 172.21.15.96:0/3614767945 learned_addr learned my addr 172.21.15.96:0/3614767945 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fae0ad640 1 -- 172.21.15.96:0/3614767945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1c74e1a0 con 0x564b1c65b010 2024-09-14T10:45:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fae0ad640 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c74dc40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8000f90 tx=0x7f4fa8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4e9ae05640 1 -- 172.21.15.96:0/3614767945 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa8013820 con 0x564b1c65b010 2024-09-14T10:45:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4e9ae05640 1 -- 172.21.15.96:0/3614767945 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa80139c0 con 0x564b1c65b010 2024-09-14T10:45:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b1c74e430 con 0x564b1c65b010 2024-09-14T10:45:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4e9ae05640 1 -- 172.21.15.96:0/3614767945 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa8013ce0 con 0x564b1c65b010 2024-09-14T10:45:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b1c74ede0 con 0x564b1c65b010 2024-09-14T10:45:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.182+0000 7f4e9ae05640 1 -- 172.21.15.96:0/3614767945 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f4fa8010070 con 0x564b1c65b010 2024-09-14T10:45:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4e9ae05640 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e9403a1a0 0x7f4e9403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4e9ae05640 1 -- 172.21.15.96:0/3614767945 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4fa8018070 con 0x564b1c65b010 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e9403a1a0 0x7f4e9403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c65f1b0 0x564b1c754db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7552f0 con 0x564b1c65f1b0 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c65f1b0 0x564b1c754db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e9403a1a0 0x7f4e9403c660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ae000 tx=0x7f4f980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c65f1b0 0x564b1c754db0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fae8ae640 1 -- 172.21.15.96:0/3614767945 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa00083f0 con 0x564b1c65f1b0 2024-09-14T10:45:29.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c755720 con 0x564b1c65f1b0 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fae8ae640 1 -- 172.21.15.96:0/3614767945 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fa00083f0 con 0x564b1c65f1b0 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c757020 con 0x564b1c65f1b0 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fae8ae640 1 -- 172.21.15.96:0/3614767945 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4fa00083f0 con 0x564b1c65f1b0 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c756250 con 0x564b1c65f1b0 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fae8ae640 1 -- 172.21.15.96:0/3614767945 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fa00083f0 con 0x564b1c65f1b0 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7566a0 con 0x564b1c65f1b0 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fae8ae640 1 -- 172.21.15.96:0/3614767945 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4fa00083f0 con 0x564b1c65f1b0 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 Processor -- start 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 -- start start 2024-09-14T10:45:29.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c7653e0 0x564b1c765800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fb05a79c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564b1c56fd80 con 0x564b1c7653e0 2024-09-14T10:45:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fad8ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c7653e0 0x564b1c765800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fad8ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c7653e0 0x564b1c765800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37188/0 (socket says 172.21.15.96:37188) 2024-09-14T10:45:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fad8ac640 1 -- 172.21.15.96:0/1545290290 learned_addr learned my addr 172.21.15.96:0/1545290290 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.186+0000 7f4fad8ac640 1 -- 172.21.15.96:0/1545290290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1c765e40 con 0x564b1c7653e0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/1545290290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c7653e0 0x564b1c765800 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4f98018f40 tx=0x7f4f980180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e93fff640 1 -- 172.21.15.96:0/1545290290 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980c5030 con 0x564b1c7653e0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/1545290290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b1c7666a0 con 0x564b1c7653e0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e93fff640 1 -- 172.21.15.96:0/1545290290 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f980b5950 con 0x564b1c7653e0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e93fff640 1 -- 172.21.15.96:0/1545290290 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980b5c30 con 0x564b1c7653e0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/1545290290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b1c766c10 con 0x564b1c7653e0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e93fff640 1 -- 172.21.15.96:0/1545290290 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f4f980c8030 con 0x564b1c7653e0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e93fff640 1 --2- 172.21.15.96:0/1545290290 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e8803a140 0x7f4e8803c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e93fff640 1 -- 172.21.15.96:0/1545290290 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4f980c6070 con 0x564b1c7653e0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/1545290290 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e8803a140 0x7f4e8803c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fb05a79c0 1 Processor -- start 2024-09-14T10:45:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fb05a79c0 1 -- start start 2024-09-14T10:45:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/1545290290 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e8803a140 0x7f4e8803c600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x564b1c755d70 tx=0x7f4fa0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fb05a79c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c773010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fb05a79c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564b1c746e10 con 0x564b1c772c10 2024-09-14T10:45:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fad8ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c773010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fad8ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c773010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37204/0 (socket says 172.21.15.96:37204) 2024-09-14T10:45:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fad8ac640 1 -- 172.21.15.96:0/271069349 learned_addr learned my addr 172.21.15.96:0/271069349 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fad8ac640 1 -- 172.21.15.96:0/271069349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1c773600 con 0x564b1c772c10 2024-09-14T10:45:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/271069349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c773010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ccfd0 tx=0x7f4f980b5dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacc97cc50d4a57a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e91ffb640 1 -- 172.21.15.96:0/271069349 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980e9030 con 0x564b1c772c10 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e91ffb640 1 -- 172.21.15.96:0/271069349 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f98006390 con 0x564b1c772c10 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.190+0000 7f4e91ffb640 1 -- 172.21.15.96:0/271069349 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f98006710 con 0x564b1c772c10 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/271069349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 msgr2=0x564b1c773010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/271069349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c773010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ccfd0 tx=0x7f4f980b5dd0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/271069349 shutdown_connections 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/271069349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c773010 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/271069349 >> 172.21.15.96:0/271069349 conn(0x564b1c76e030 msgr2=0x564b1c76c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/271069349 shutdown_connections 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/271069349 wait complete. 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 Processor -- start 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- start start 2024-09-14T10:45:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c779140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564b1c771b60 con 0x564b1c772c10 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fad8ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c779140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fad8ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c779140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37208/0 (socket says 172.21.15.96:37208) 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 learned_addr learned my addr 172.21.15.96:0/546987654 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1c7796a0 con 0x564b1c772c10 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c779140 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4f980b5fd0 tx=0x7f4f980ec020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4e7ffff640 1 -- 172.21.15.96:0/546987654 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980f2070 con 0x564b1c772c10 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b1c779930 con 0x564b1c772c10 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4e7ffff640 1 -- 172.21.15.96:0/546987654 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f980b4790 con 0x564b1c772c10 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4e7ffff640 1 -- 172.21.15.96:0/546987654 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980b4a90 con 0x564b1c772c10 2024-09-14T10:45:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b1c77a2e0 con 0x564b1c772c10 2024-09-14T10:45:29.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4e7ffff640 1 -- 172.21.15.96:0/546987654 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f4f980f5070 con 0x564b1c772c10 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4e7ffff640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e7803a150 0x7f4e7803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4e7ffff640 1 -- 172.21.15.96:0/546987654 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4f980f8d60 con 0x564b1c772c10 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e7803a150 0x7f4e7803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c7846a0 0x564b1c786b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c787280 con 0x564b1c7846a0 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.194+0000 7f4fae0ad640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c7846a0 0x564b1c786b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e7803a150 0x7f4e7803c610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000f010 tx=0x7f4fa001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae0ad640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c7846a0 0x564b1c786b30 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 realm 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c787690 con 0x564b1c7846a0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c787f60 con 0x564b1c7846a0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c788300 con 0x564b1c7846a0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 20 searching for the correct realm 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564b1c78a7a0 0x564b1c78cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78d260 con 0x564b1c78a7a0 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564b1c78a7a0 0x564b1c78cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564b1c78a7a0 0x564b1c78cb90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fad8ac640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4f980f7060 0x7f4f980ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78d260 con 0x7f4f980f7060 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4f980f7060 0x7f4f980ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4f980f7060 0x7f4f980ca410 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae8ae640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4fa0019040 0x7f4fa0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78d260 con 0x7f4fa0019040 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae0ad640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4fa0019040 0x7f4fa0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.198+0000 7f4fae0ad640 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4fa0019040 0x7f4fa0019930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa801b030 con 0x7f4fa0019040 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4fa0019040 2024-09-14T10:45:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa801b030 con 0x7f4fa0019040 2024-09-14T10:45:29.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4fa0019040 2024-09-14T10:45:29.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa801b030 con 0x7f4fa0019040 2024-09-14T10:45:29.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4f980f7060 2024-09-14T10:45:29.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4fa0019040 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa801b030 con 0x7f4fa0019040 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4fa801b030 con 0x564b1c7846a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4f980f7060 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.202+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4fa0019040 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa801b030 con 0x7f4fa0019040 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4fa0019040 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4f980f7060 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4f980f7060 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.206+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4fa0019040 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4f980f7060 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4fa0019040 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x564b1c7846a0 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7887a0 con 0x7f4f980f7060 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:29.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c789110 con 0x564b1c7846a0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c789500 con 0x564b1c7846a0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c789500 con 0x564b1c7846a0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 zone default found 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 4 Realm: () 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 zonegroup default 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c789920 con 0x7f4f980f7060 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78f0d0 con 0x564b1c78a7a0 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78f4a0 con 0x564b1c78a7a0 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.210+0000 7f4fb05a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fb05a79c0 20 started sync module instance, tier type = 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fb05a79c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78e570 con 0x7f4f980f7060 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94880600222320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78e570 con 0x7f4f980f7060 2024-09-14T10:45:29.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78ffb0 con 0x564b1c7846a0 2024-09-14T10:45:29.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94880600222320] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94880600226432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78e570 con 0x564b1c7846a0 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.214+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7909c0 con 0x564b1c78a7a0 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94880600226432] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94880600219840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78e4e0 con 0x564b1c78a7a0 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c791700 con 0x7f4f980f7060 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94880600232464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c791fd0 con 0x7f4f980f7060 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c792990 con 0x564b1c7846a0 2024-09-14T10:45:29.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94880600219840] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.218+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94880600232464] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.222+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.222+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94880600234784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c792990 con 0x564b1c7846a0 2024-09-14T10:45:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.222+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c791f40 con 0x7f4fa0019040 2024-09-14T10:45:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.222+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94880600234784] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.222+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.222+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94880600237280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c792900 con 0x7f4fa0019040 2024-09-14T10:45:29.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.222+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c793700 con 0x7f4fa0019040 2024-09-14T10:45:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94880600237280] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94880600239456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c793630 con 0x7f4fa0019040 2024-09-14T10:45:29.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7940e0 con 0x7f4fa0019040 2024-09-14T10:45:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94880600239456] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94880600243136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7942c0 con 0x7f4fa0019040 2024-09-14T10:45:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 20 add_watcher() i=0 2024-09-14T10:45:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 20 add_watcher() i=1 2024-09-14T10:45:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 20 add_watcher() i=2 2024-09-14T10:45:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 20 add_watcher() i=3 2024-09-14T10:45:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 20 add_watcher() i=4 2024-09-14T10:45:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 20 add_watcher() i=5 2024-09-14T10:45:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.226+0000 7f4fb05a79c0 20 add_watcher() i=6 2024-09-14T10:45:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94880600243136] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 20 add_watcher() i=7 2024-09-14T10:45:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c797690 con 0x564b1c7846a0 2024-09-14T10:45:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94880600244656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c794a80 con 0x564b1c7846a0 2024-09-14T10:45:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94880600244656] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4e64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 5 note: GC not initialized 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4ddf7fe640 20 reqs_thread_entry: start 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 20 Filter name: none 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4ddd7fa640 20 reqs_thread_entry: start 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7ba810 con 0x564b1c7846a0 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:45:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.230+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7bbd60 con 0x7f4fa0019040 2024-09-14T10:45:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4e64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94880600244656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7ba130 con 0x564b1c7846a0 2024-09-14T10:45:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94880600244656] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94880600222320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7941b0 con 0x7f4f980f7060 2024-09-14T10:45:29.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94880600222320] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4fb05a79c0 20 remove_watcher() i=0 2024-09-14T10:45:29.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4fb05a79c0 2 removed watcher, disabling cache 2024-09-14T10:45:29.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.234+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94880600226432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7941b0 con 0x564b1c7846a0 2024-09-14T10:45:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.238+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94880600226432] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.238+0000 7f4fb05a79c0 20 remove_watcher() i=1 2024-09-14T10:45:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.238+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94880600219840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78fa80 con 0x564b1c78a7a0 2024-09-14T10:45:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.238+0000 7f4fad8ac640 1 -- 172.21.15.96:0/546987654 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94880600219840] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980f4030 con 0x564b1c78a7a0 2024-09-14T10:45:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.238+0000 7f4fb05a79c0 20 remove_watcher() i=2 2024-09-14T10:45:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.238+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94880600232464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7941b0 con 0x7f4f980f7060 2024-09-14T10:45:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.242+0000 7f4fae8ae640 1 -- 172.21.15.96:0/546987654 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94880600232464] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa002f040 con 0x7f4f980f7060 2024-09-14T10:45:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.242+0000 7f4fb05a79c0 20 remove_watcher() i=3 2024-09-14T10:45:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.242+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94880600234784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78e0c0 con 0x564b1c7846a0 2024-09-14T10:45:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.242+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94880600234784] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x564b1c7846a0 2024-09-14T10:45:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.242+0000 7f4fb05a79c0 20 remove_watcher() i=4 2024-09-14T10:45:29.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.242+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94880600237280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c7941b0 con 0x7f4fa0019040 2024-09-14T10:45:29.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.246+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94880600237280] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.246+0000 7f4fb05a79c0 20 remove_watcher() i=5 2024-09-14T10:45:29.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.246+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94880600239456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c791b20 con 0x7f4fa0019040 2024-09-14T10:45:29.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.246+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94880600239456] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.246+0000 7f4fb05a79c0 20 remove_watcher() i=6 2024-09-14T10:45:29.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.246+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94880600243136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b1c78e0c0 con 0x7f4fa0019040 2024-09-14T10:45:29.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94880600243136] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa8057040 con 0x7f4fa0019040 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 20 remove_watcher() i=7 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4fa0019040 msgr2=0x7f4fa0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4fa0019040 0x7f4fa0019930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c7846a0 msgr2=0x564b1c786b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c7846a0 0x564b1c786b30 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4f980f7060 msgr2=0x7f4f980ca410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4f980f7060 0x7f4f980ca410 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564b1c78a7a0 msgr2=0x564b1c78cb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x564b1c78a7a0 0x564b1c78cb90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e7803a150 msgr2=0x7f4e7803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e7803a150 0x7f4e7803c610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000f010 tx=0x7f4fa001b070 comp rx=0 tx=0).stop 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 msgr2=0x564b1c779140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/546987654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c772c10 0x564b1c779140 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4f980b5fd0 tx=0x7f4f980ec020 comp rx=0 tx=0).stop 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fae0ad640 1 -- 172.21.15.96:0/546987654 reap_dead start 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 shutdown_connections 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 >> 172.21.15.96:0/546987654 conn(0x564b1c76e030 msgr2=0x564b1c76c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 shutdown_connections 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/546987654 wait complete. 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/1545290290 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e8803a140 msgr2=0x7f4e8803c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/1545290290 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e8803a140 0x7f4e8803c600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x564b1c755d70 tx=0x7f4fa0003070 comp rx=0 tx=0).stop 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/1545290290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c7653e0 msgr2=0x564b1c765800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/1545290290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c7653e0 0x564b1c765800 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4f98018f40 tx=0x7f4f980180b0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/1545290290 shutdown_connections 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/1545290290 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e8803a140 0x7f4e8803c600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/1545290290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c7653e0 0x564b1c765800 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/1545290290 >> 172.21.15.96:0/1545290290 conn(0x564b1c75ad90 msgr2=0x564b1c75b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/1545290290 shutdown_connections 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/1545290290 wait complete. 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c65f1b0 msgr2=0x564b1c754db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c65f1b0 0x564b1c754db0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e9403a1a0 msgr2=0x7f4e9403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e9403a1a0 0x7f4e9403c660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ae000 tx=0x7f4f980a6000 comp rx=0 tx=0).stop 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 msgr2=0x564b1c74dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c74dc40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8000f90 tx=0x7f4fa8001260 comp rx=0 tx=0).stop 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 shutdown_connections 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x564b1c65f1b0 0x564b1c754db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f4e9403a1a0 0x7f4e9403c660 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 --2- 172.21.15.96:0/3614767945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564b1c65b010 0x564b1c74dc40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 >> 172.21.15.96:0/3614767945 conn(0x564b1c656b30 msgr2=0x564b1c747810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 shutdown_connections 2024-09-14T10:45:29.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.250+0000 7f4fb05a79c0 1 -- 172.21.15.96:0/3614767945 wait complete. 2024-09-14T10:45:29.259 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:45:29.260 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:45:29.260 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-14T10:45:29.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-14T10:45:29.260 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-14T10:45:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:29.340 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:29.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f449869c0 1 Processor -- start 2024-09-14T10:45:29.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f449869c0 1 -- start start 2024-09-14T10:45:29.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f449869c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55ad3ac81770 0x55ad3ac83b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f449869c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad3ab277a0 con 0x55ad3ac840a0 2024-09-14T10:45:29.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f449869c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55ad3ab831b0 con 0x55ad3ac81770 2024-09-14T10:45:29.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f4248c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55ad3ac81770 0x55ad3ac83b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f41c8b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55ad3ac840a0 0x55ad3ac86490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33030/0 (socket says 172.21.15.96:33030) 2024-09-14T10:45:29.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f41c8b640 1 -- 172.21.15.96:0/900797564 learned_addr learned my addr 172.21.15.96:0/900797564 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:45:29.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f4248c640 1 -- 172.21.15.96:0/900797564 >> v1:172.21.15.70:6789/0 conn(0x55ad3ac840a0 legacy=0x55ad3ac86490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.342+0000 7f3f4248c640 1 -- 172.21.15.96:0/900797564 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3ab01da0 con 0x55ad3ac81770 2024-09-14T10:45:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f4248c640 1 --2- 172.21.15.96:0/900797564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ac83b60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00a420 tx=0x7f3f3c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb01d5579eb6d284 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f4148a640 1 -- 172.21.15.96:0/900797564 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0af070 con 0x55ad3ac81770 2024-09-14T10:45:29.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f4148a640 1 -- 172.21.15.96:0/900797564 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3c0aa530 con 0x55ad3ac81770 2024-09-14T10:45:29.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f4148a640 1 -- 172.21.15.96:0/900797564 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0aa850 con 0x55ad3ac81770 2024-09-14T10:45:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f449869c0 1 -- 172.21.15.96:0/900797564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 msgr2=0x55ad3ac83b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f449869c0 1 --2- 172.21.15.96:0/900797564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ac83b60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00a420 tx=0x7f3f3c01afd0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f449869c0 1 -- 172.21.15.96:0/900797564 shutdown_connections 2024-09-14T10:45:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f449869c0 1 --2- 172.21.15.96:0/900797564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ac83b60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f449869c0 1 -- 172.21.15.96:0/900797564 >> 172.21.15.96:0/900797564 conn(0x55ad3abf4b00 msgr2=0x55ad3abf4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f449869c0 1 -- 172.21.15.96:0/900797564 shutdown_connections 2024-09-14T10:45:29.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.346+0000 7f3f449869c0 1 -- 172.21.15.96:0/900797564 wait complete. 2024-09-14T10:45:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f449869c0 1 Processor -- start 2024-09-14T10:45:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f449869c0 1 -- start start 2024-09-14T10:45:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f449869c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad6c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f449869c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad3ab86fc0 con 0x55ad3ac81770 2024-09-14T10:45:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f4248c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad6c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f4248c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad6c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37216/0 (socket says 172.21.15.96:37216) 2024-09-14T10:45:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f4248c640 1 -- 172.21.15.96:0/1233422746 learned_addr learned my addr 172.21.15.96:0/1233422746 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f4248c640 1 -- 172.21.15.96:0/1233422746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3ad6cb90 con 0x55ad3ac81770 2024-09-14T10:45:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3f4248c640 1 --2- 172.21.15.96:0/1233422746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad6c5a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0ad040 tx=0x7f3f3c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e0eebb6332c205 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3e30608640 1 -- 172.21.15.96:0/1233422746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0af050 con 0x55ad3ac81770 2024-09-14T10:45:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3e30608640 1 -- 172.21.15.96:0/1233422746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3c0b0040 con 0x55ad3ac81770 2024-09-14T10:45:29.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.358+0000 7f3e30608640 1 -- 172.21.15.96:0/1233422746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0aaad0 con 0x55ad3ac81770 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- 172.21.15.96:0/1233422746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 msgr2=0x55ad3ad6c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1233422746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad6c5a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0ad040 tx=0x7f3f3c0033b0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- 172.21.15.96:0/1233422746 shutdown_connections 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1233422746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad6c5a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- 172.21.15.96:0/1233422746 >> 172.21.15.96:0/1233422746 conn(0x55ad3abf4b00 msgr2=0x55ad3ad681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- 172.21.15.96:0/1233422746 shutdown_connections 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- 172.21.15.96:0/1233422746 wait complete. 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 Processor -- start 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- start start 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad73d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad3ab28a50 con 0x55ad3ac81770 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f4248c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad73d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f4248c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad73d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37230/0 (socket says 172.21.15.96:37230) 2024-09-14T10:45:29.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f4248c640 1 -- 172.21.15.96:0/1895802832 learned_addr learned my addr 172.21.15.96:0/1895802832 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f4248c640 1 -- 172.21.15.96:0/1895802832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3ad74290 con 0x55ad3ac81770 2024-09-14T10:45:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f4248c640 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad73d30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0aa500 tx=0x7f3f3c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3e2ee05640 1 -- 172.21.15.96:0/1895802832 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0b6c40 con 0x55ad3ac81770 2024-09-14T10:45:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad3ad74520 con 0x55ad3ac81770 2024-09-14T10:45:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3e2ee05640 1 -- 172.21.15.96:0/1895802832 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3c0b6de0 con 0x55ad3ac81770 2024-09-14T10:45:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3ad74e80 con 0x55ad3ac81770 2024-09-14T10:45:29.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3e2ee05640 1 -- 172.21.15.96:0/1895802832 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0cd060 con 0x55ad3ac81770 2024-09-14T10:45:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.362+0000 7f3e2ee05640 1 -- 172.21.15.96:0/1895802832 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3f3c0bf590 con 0x55ad3ac81770 2024-09-14T10:45:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3e2ee05640 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e2803a1a0 0x7f3e2803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3e2ee05640 1 -- 172.21.15.96:0/1895802832 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3f3c0bb070 con 0x55ad3ac81770 2024-09-14T10:45:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f41c8b640 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e2803a1a0 0x7f3e2803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3ac840a0 0x55ad3ad7ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3ad7b390 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3ac840a0 0x55ad3ad7ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f41c8b640 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e2803a1a0 0x7f3e2803c660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c004180 tx=0x7f3f2c001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3ac840a0 0x55ad3ad7ae50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f42c8d640 1 -- 172.21.15.96:0/1895802832 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f340083f0 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3ad7b730 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f42c8d640 1 -- 172.21.15.96:0/1895802832 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f340083f0 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3ad7cfe0 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f42c8d640 1 -- 172.21.15.96:0/1895802832 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f340083f0 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3ad7c150 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f42c8d640 1 -- 172.21.15.96:0/1895802832 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f340083f0 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3ad7c570 con 0x55ad3ac840a0 2024-09-14T10:45:29.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f42c8d640 1 -- 172.21.15.96:0/1895802832 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f340083f0 con 0x55ad3ac840a0 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 Processor -- start 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 -- start start 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad8b390 0x55ad3ad8b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f449869c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad3ab93d80 con 0x55ad3ad8b390 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f41c8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad8b390 0x55ad3ad8b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f41c8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad8b390 0x55ad3ad8b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37240/0 (socket says 172.21.15.96:37240) 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f41c8b640 1 -- 172.21.15.96:0/912252101 learned_addr learned my addr 172.21.15.96:0/912252101 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f41c8b640 1 -- 172.21.15.96:0/912252101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3ad8bdf0 con 0x55ad3ad8b390 2024-09-14T10:45:29.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.366+0000 7f3f41c8b640 1 --2- 172.21.15.96:0/912252101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad8b390 0x55ad3ad8b7b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00d660 tx=0x7f3f2c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e27fff640 1 -- 172.21.15.96:0/912252101 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c00c6b0 con 0x55ad3ad8b390 2024-09-14T10:45:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f449869c0 1 -- 172.21.15.96:0/912252101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad3ad8c650 con 0x55ad3ad8b390 2024-09-14T10:45:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e27fff640 1 -- 172.21.15.96:0/912252101 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00c850 con 0x55ad3ad8b390 2024-09-14T10:45:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e27fff640 1 -- 172.21.15.96:0/912252101 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c00cb30 con 0x55ad3ad8b390 2024-09-14T10:45:29.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f449869c0 1 -- 172.21.15.96:0/912252101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3ad8cbc0 con 0x55ad3ad8b390 2024-09-14T10:45:29.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e27fff640 1 -- 172.21.15.96:0/912252101 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3f2c023020 con 0x55ad3ad8b390 2024-09-14T10:45:29.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e27fff640 1 --2- 172.21.15.96:0/912252101 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e1c03a150 0x7f3e1c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e27fff640 1 -- 172.21.15.96:0/912252101 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3f2c021020 con 0x55ad3ad8b390 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/912252101 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e1c03a150 0x7f3e1c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f449869c0 1 Processor -- start 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f449869c0 1 -- start start 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f449869c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/912252101 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e1c03a150 0x7f3e1c03c610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55ad3ad7c4f0 tx=0x7f3f34003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f449869c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad3ad6cf00 con 0x55ad3ad97cf0 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f41c8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f41c8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37246/0 (socket says 172.21.15.96:37246) 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f41c8b640 1 -- 172.21.15.96:0/1881908226 learned_addr learned my addr 172.21.15.96:0/1881908226 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f41c8b640 1 -- 172.21.15.96:0/1881908226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3ad986a0 con 0x55ad3ad97cf0 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f41c8b640 1 --2- 172.21.15.96:0/1881908226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad980d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c051820 tx=0x7f3f2c044760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ad1f2584fc806f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e25ffb640 1 -- 172.21.15.96:0/1881908226 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c01bcc0 con 0x55ad3ad97cf0 2024-09-14T10:45:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e25ffb640 1 -- 172.21.15.96:0/1881908226 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c04ae50 con 0x55ad3ad97cf0 2024-09-14T10:45:29.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3e25ffb640 1 -- 172.21.15.96:0/1881908226 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c050270 con 0x55ad3ad97cf0 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.370+0000 7f3f449869c0 1 -- 172.21.15.96:0/1881908226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 msgr2=0x55ad3ad980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1881908226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad980d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c051820 tx=0x7f3f2c044760 comp rx=0 tx=0).stop 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- 172.21.15.96:0/1881908226 shutdown_connections 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1881908226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad980d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- 172.21.15.96:0/1881908226 >> 172.21.15.96:0/1881908226 conn(0x55ad3ad94120 msgr2=0x55ad3ad92360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- 172.21.15.96:0/1881908226 shutdown_connections 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- 172.21.15.96:0/1881908226 wait complete. 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 Processor -- start 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- start start 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad9f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad3ad98d00 con 0x55ad3ad97cf0 2024-09-14T10:45:29.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f41c8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad9f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f41c8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad9f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37260/0 (socket says 172.21.15.96:37260) 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 learned_addr learned my addr 172.21.15.96:0/4111532408 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3ad9f7e0 con 0x55ad3ad97cf0 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f41c8b640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad9f280 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c023850 tx=0x7f3f2c0517b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3e13fff640 1 -- 172.21.15.96:0/4111532408 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c043380 con 0x55ad3ad97cf0 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad3ad9fa70 con 0x55ad3ad97cf0 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3e13fff640 1 -- 172.21.15.96:0/4111532408 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c035070 con 0x55ad3ad97cf0 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3ad9fa70 con 0x55ad3ad97cf0 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3e13fff640 1 -- 172.21.15.96:0/4111532408 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2c019ba0 con 0x55ad3ad97cf0 2024-09-14T10:45:29.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3e13fff640 1 -- 172.21.15.96:0/4111532408 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3f2c0194e0 con 0x55ad3ad97cf0 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3e13fff640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e0c03a150 0x7f3e0c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3e13fff640 1 -- 172.21.15.96:0/4111532408 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3f2c050070 con 0x55ad3ad97cf0 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e0c03a150 0x7f3e0c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3adaa5c0 0x55ad3adaca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adad1a0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.374+0000 7f3f4248c640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3adaa5c0 0x55ad3adaca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e0c03a150 0x7f3e0c03c610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400f010 tx=0x7f3f3401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f4248c640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3adaa5c0 0x55ad3adaca50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 realm 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adad5b0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adade80 con 0x55ad3adaa5c0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adae220 con 0x55ad3adaa5c0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adae6c0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 20 searching for the correct realm 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ad3adb06c0 0x55ad3adb2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb3130 con 0x55ad3adb06c0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f41c8b640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ad3adb06c0 0x55ad3adb2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f41c8b640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ad3adb06c0 0x55ad3adb2ab0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f41c8b640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3f2c01a9f0 0x7f3f2c03f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb3130 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3f2c01a9f0 0x7f3f2c03f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3f2c01a9f0 0x7f3f2c03f850 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f42c8d640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3f34019040 0x7f3f34019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb3130 con 0x7f3f34019040 2024-09-14T10:45:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f4248c640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3f34019040 0x7f3f34019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.378+0000 7f3f4248c640 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3f34019040 0x7f3f34019930 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x7f3f34019040 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb3130 con 0x55ad3adaa5c0 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb3130 con 0x55ad3adaa5c0 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb3130 con 0x7f3f34019040 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x7f3f34019040 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb3130 con 0x7f3f34019040 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x7f3f34019040 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adb06c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f34019040 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x7f3f34019040 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.382+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adb06c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adb06c0 2024-09-14T10:45:29.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f34019040 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x7f3f34019040 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adb06c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adb06c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f3c0b2070 con 0x55ad3adaa5c0 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f34019040 2024-09-14T10:45:29.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adb06c0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adb06c0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.386+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f34019040 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adb06c0 2024-09-14T10:45:29.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f34019040 2024-09-14T10:45:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3f3c0e1040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adaf130 con 0x55ad3adaa5c0 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adaf9d0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adaed70 con 0x55ad3adaa5c0 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 zone default found 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 4 Realm: () 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 zonegroup default 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adaf9d0 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb5430 con 0x55ad3adb06c0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb57d0 con 0x55ad3adb06c0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 started sync module instance, tier type = 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.390+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb4870 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.394+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.394+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94202505151728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb4fd0 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.394+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb6210 con 0x55ad3adaa5c0 2024-09-14T10:45:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.394+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94202505151728] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.394+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.394+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94202505157856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb61d0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.394+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb6c20 con 0x55ad3adb06c0 2024-09-14T10:45:29.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94202505157856] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94202505160560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb6fc0 con 0x55ad3adb06c0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb7980 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94202505164256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb80d0 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb8bf0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94202505160560] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94202505164256] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94202505168576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb8bb0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.398+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb8fe0 con 0x7f3f34019040 2024-09-14T10:45:29.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.402+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94202505168576] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.402+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.402+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94202505153152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb8f70 con 0x7f3f34019040 2024-09-14T10:45:29.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.402+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb9930 con 0x7f3f34019040 2024-09-14T10:45:29.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.402+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94202505153152] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94202505165600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb9930 con 0x7f3f34019040 2024-09-14T10:45:29.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adba2f0 con 0x7f3f34019040 2024-09-14T10:45:29.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94202505174592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adba750 con 0x7f3f34019040 2024-09-14T10:45:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 20 add_watcher() i=0 2024-09-14T10:45:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 20 add_watcher() i=1 2024-09-14T10:45:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 20 add_watcher() i=2 2024-09-14T10:45:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 20 add_watcher() i=3 2024-09-14T10:45:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 20 add_watcher() i=4 2024-09-14T10:45:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 20 add_watcher() i=5 2024-09-14T10:45:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94202505165600] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.406+0000 7f3f449869c0 20 add_watcher() i=6 2024-09-14T10:45:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94202505174592] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 20 add_watcher() i=7 2024-09-14T10:45:29.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:29.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb9480 con 0x55ad3adaa5c0 2024-09-14T10:45:29.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94202505172096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adbac60 con 0x55ad3adaa5c0 2024-09-14T10:45:29.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94202505172096] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3df8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 5 note: GC not initialized 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3d737fe640 20 reqs_thread_entry: start 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 20 Filter name: none 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3d717fa640 20 reqs_thread_entry: start 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3ade0a80 con 0x55ad3adaa5c0 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:45:29.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ad3ade1fd0 con 0x7f3f34019040 2024-09-14T10:45:29.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.410+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.414+0000 7f3df8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.414+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94202505172096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3ade03a0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.414+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94202505172096] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.414+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94202505151728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb9480 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.414+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94202505151728] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.414+0000 7f3f449869c0 20 remove_watcher() i=0 2024-09-14T10:45:29.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.414+0000 7f3f449869c0 2 removed watcher, disabling cache 2024-09-14T10:45:29.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.414+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94202505157856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb9480 con 0x55ad3adaa5c0 2024-09-14T10:45:29.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94202505157856] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f449869c0 20 remove_watcher() i=1 2024-09-14T10:45:29.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94202505160560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb5ce0 con 0x55ad3adb06c0 2024-09-14T10:45:29.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f41c8b640 1 -- 172.21.15.96:0/4111532408 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94202505160560] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2c051cf0 con 0x55ad3adb06c0 2024-09-14T10:45:29.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f449869c0 20 remove_watcher() i=2 2024-09-14T10:45:29.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94202505164256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb5ce0 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f42c8d640 1 -- 172.21.15.96:0/4111532408 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94202505164256] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3402f040 con 0x7f3f2c01a9f0 2024-09-14T10:45:29.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f449869c0 20 remove_watcher() i=3 2024-09-14T10:45:29.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.418+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94202505168576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb75e0 con 0x55ad3adaa5c0 2024-09-14T10:45:29.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.422+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94202505168576] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x55ad3adaa5c0 2024-09-14T10:45:29.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.422+0000 7f3f449869c0 20 remove_watcher() i=4 2024-09-14T10:45:29.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.422+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94202505153152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb5ce0 con 0x7f3f34019040 2024-09-14T10:45:29.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.422+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94202505153152] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.422+0000 7f3f449869c0 20 remove_watcher() i=5 2024-09-14T10:45:29.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.422+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94202505165600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb75e0 con 0x7f3f34019040 2024-09-14T10:45:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94202505165600] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 20 remove_watcher() i=6 2024-09-14T10:45:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94202505174592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ad3adb5ce0 con 0x7f3f34019040 2024-09-14T10:45:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94202505174592] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3c0f2040 con 0x7f3f34019040 2024-09-14T10:45:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 20 remove_watcher() i=7 2024-09-14T10:45:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3f34019040 msgr2=0x7f3f34019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f3f34019040 0x7f3f34019930 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3adaa5c0 msgr2=0x55ad3adaca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3adaa5c0 0x55ad3adaca50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3f2c01a9f0 msgr2=0x7f3f2c03f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f3f2c01a9f0 0x7f3f2c03f850 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ad3adb06c0 msgr2=0x55ad3adb2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55ad3adb06c0 0x55ad3adb2ab0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e0c03a150 msgr2=0x7f3e0c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e0c03a150 0x7f3e0c03c610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400f010 tx=0x7f3f3401b070 comp rx=0 tx=0).stop 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 msgr2=0x55ad3ad9f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/4111532408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad97cf0 0x55ad3ad9f280 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c023850 tx=0x7f3f2c0517b0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f4248c640 1 -- 172.21.15.96:0/4111532408 reap_dead start 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 shutdown_connections 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 >> 172.21.15.96:0/4111532408 conn(0x55ad3ad94120 msgr2=0x55ad3ad92330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 shutdown_connections 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/4111532408 wait complete. 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/912252101 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e1c03a150 msgr2=0x7f3e1c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/912252101 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e1c03a150 0x7f3e1c03c610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55ad3ad7c4f0 tx=0x7f3f34003070 comp rx=0 tx=0).stop 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/912252101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad8b390 msgr2=0x55ad3ad8b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/912252101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad8b390 0x55ad3ad8b7b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00d660 tx=0x7f3f2c00da60 comp rx=0 tx=0).stop 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/912252101 shutdown_connections 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/912252101 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e1c03a150 0x7f3e1c03c610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/912252101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ad8b390 0x55ad3ad8b7b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/912252101 >> 172.21.15.96:0/912252101 conn(0x55ad3ad80d40 msgr2=0x55ad3ad81120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/912252101 shutdown_connections 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/912252101 wait complete. 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3ac840a0 msgr2=0x55ad3ad7ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.426+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3ac840a0 0x55ad3ad7ae50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e2803a1a0 msgr2=0x7f3e2803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e2803a1a0 0x7f3e2803c660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c004180 tx=0x7f3f2c001340 comp rx=0 tx=0).stop 2024-09-14T10:45:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 msgr2=0x55ad3ad73d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad73d30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0aa500 tx=0x7f3f3c017d70 comp rx=0 tx=0).stop 2024-09-14T10:45:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 shutdown_connections 2024-09-14T10:45:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55ad3ac840a0 0x55ad3ad7ae50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3e2803a1a0 0x7f3e2803c660 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 --2- 172.21.15.96:0/1895802832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad3ac81770 0x55ad3ad73d30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 >> 172.21.15.96:0/1895802832 conn(0x55ad3abf4b00 msgr2=0x55ad3ad6d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 shutdown_connections 2024-09-14T10:45:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.430+0000 7f3f449869c0 1 -- 172.21.15.96:0/1895802832 wait complete. 2024-09-14T10:45:29.437 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:45:29.437 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:45:29.438 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-14T10:45:29.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-14T10:45:29.438 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-14T10:45:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:29.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f216210c9c0 1 Processor -- start 2024-09-14T10:45:29.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f216210c9c0 1 -- start start 2024-09-14T10:45:29.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f216210c9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556f7be14260 0x556f7bea5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f216210c9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f7bd487a0 con 0x556f7be14640 2024-09-14T10:45:29.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f216210c9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x556f7bda41b0 con 0x556f7be14260 2024-09-14T10:45:29.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f215fc12640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556f7be14260 0x556f7bea5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f215fc12640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556f7be14260 0x556f7bea5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37270/0 (socket says 172.21.15.96:37270) 2024-09-14T10:45:29.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f215fc12640 1 -- 172.21.15.96:0/665166137 learned_addr learned my addr 172.21.15.96:0/665166137 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f215f411640 1 --1- 172.21.15.96:0/665166137 >> v1:172.21.15.70:6789/0 conn(0x556f7be14640 0x556f7bea75e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33046/0 (socket says 172.21.15.96:33046) 2024-09-14T10:45:29.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f215fc12640 1 -- 172.21.15.96:0/665166137 >> v1:172.21.15.70:6789/0 conn(0x556f7be14640 legacy=0x556f7bea75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.510+0000 7f215fc12640 1 -- 172.21.15.96:0/665166137 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7bd22da0 con 0x556f7be14260 2024-09-14T10:45:29.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f215fc12640 1 --2- 172.21.15.96:0/665166137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bea5090 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f215400a5c0 tx=0x7f215401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6556b4f0ad1178 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f215ec10640 1 -- 172.21.15.96:0/665166137 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21540a6070 con 0x556f7be14260 2024-09-14T10:45:29.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f215ec10640 1 -- 172.21.15.96:0/665166137 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21540af070 con 0x556f7be14260 2024-09-14T10:45:29.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f215ec10640 1 -- 172.21.15.96:0/665166137 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21540aa5c0 con 0x556f7be14260 2024-09-14T10:45:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f216210c9c0 1 -- 172.21.15.96:0/665166137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 msgr2=0x556f7bea5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f216210c9c0 1 --2- 172.21.15.96:0/665166137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bea5090 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f215400a5c0 tx=0x7f215401b340 comp rx=0 tx=0).stop 2024-09-14T10:45:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f216210c9c0 1 -- 172.21.15.96:0/665166137 shutdown_connections 2024-09-14T10:45:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f216210c9c0 1 --2- 172.21.15.96:0/665166137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bea5090 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f216210c9c0 1 -- 172.21.15.96:0/665166137 >> 172.21.15.96:0/665166137 conn(0x556f7be9a980 msgr2=0x556f7be9cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f216210c9c0 1 -- 172.21.15.96:0/665166137 shutdown_connections 2024-09-14T10:45:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.514+0000 7f216210c9c0 1 -- 172.21.15.96:0/665166137 wait complete. 2024-09-14T10:45:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.526+0000 7f216210c9c0 1 Processor -- start 2024-09-14T10:45:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.526+0000 7f216210c9c0 1 -- start start 2024-09-14T10:45:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.526+0000 7f216210c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf8d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f7bda7fc0 con 0x556f7be14260 2024-09-14T10:45:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf8d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf8d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37282/0 (socket says 172.21.15.96:37282) 2024-09-14T10:45:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 -- 172.21.15.96:0/3184898652 learned_addr learned my addr 172.21.15.96:0/3184898652 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 -- 172.21.15.96:0/3184898652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7bf8dc10 con 0x556f7be14260 2024-09-14T10:45:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 --2- 172.21.15.96:0/3184898652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf8d620 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2154018f70 tx=0x7f2154003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c823425e652ae899 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f204de0b640 1 -- 172.21.15.96:0/3184898652 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21540aa9e0 con 0x556f7be14260 2024-09-14T10:45:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f204de0b640 1 -- 172.21.15.96:0/3184898652 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21540aab80 con 0x556f7be14260 2024-09-14T10:45:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f204de0b640 1 -- 172.21.15.96:0/3184898652 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21540aae60 con 0x556f7be14260 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 -- 172.21.15.96:0/3184898652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 msgr2=0x556f7bf8d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 --2- 172.21.15.96:0/3184898652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf8d620 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2154018f70 tx=0x7f2154003030 comp rx=0 tx=0).stop 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 -- 172.21.15.96:0/3184898652 shutdown_connections 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 --2- 172.21.15.96:0/3184898652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf8d620 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 -- 172.21.15.96:0/3184898652 >> 172.21.15.96:0/3184898652 conn(0x556f7be9a980 msgr2=0x556f7bf891f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 -- 172.21.15.96:0/3184898652 shutdown_connections 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 -- 172.21.15.96:0/3184898652 wait complete. 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 Processor -- start 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 -- start start 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf94da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f216210c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f7bd49a50 con 0x556f7be14260 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf94da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf94da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37294/0 (socket says 172.21.15.96:37294) 2024-09-14T10:45:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 -- 172.21.15.96:0/2224198520 learned_addr learned my addr 172.21.15.96:0/2224198520 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 -- 172.21.15.96:0/2224198520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7bf95300 con 0x556f7be14260 2024-09-14T10:45:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.530+0000 7f215fc12640 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf94da0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2154000c10 tx=0x7f21540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2047fff640 1 -- 172.21.15.96:0/2224198520 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21540c6750 con 0x556f7be14260 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f7bf95590 con 0x556f7be14260 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2047fff640 1 -- 172.21.15.96:0/2224198520 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21540c68f0 con 0x556f7be14260 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f7bf95f40 con 0x556f7be14260 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2047fff640 1 -- 172.21.15.96:0/2224198520 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21540c6bd0 con 0x556f7be14260 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2047fff640 1 -- 172.21.15.96:0/2224198520 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f21540ce030 con 0x556f7be14260 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2047fff640 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f204803a1a0 0x7f204803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2047fff640 1 -- 172.21.15.96:0/2224198520 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f21540cc020 con 0x556f7be14260 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f215f411640 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f204803a1a0 0x7f204803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7be14640 0x556f7bf9bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bf9c450 con 0x556f7be14640 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2160413640 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7be14640 0x556f7bf9bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f215f411640 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f204803a1a0 0x7f204803c660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2150001e40 tx=0x7f21500013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2160413640 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7be14640 0x556f7bf9bf10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2160413640 1 -- 172.21.15.96:0/2224198520 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f215800a4d0 con 0x556f7be14640 2024-09-14T10:45:29.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bf9c830 con 0x556f7be14640 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2160413640 1 -- 172.21.15.96:0/2224198520 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f215800a4d0 con 0x556f7be14640 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bf9e130 con 0x556f7be14640 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2160413640 1 -- 172.21.15.96:0/2224198520 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f215800a4d0 con 0x556f7be14640 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bf9d360 con 0x556f7be14640 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2160413640 1 -- 172.21.15.96:0/2224198520 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f215800a4d0 con 0x556f7be14640 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bf9d780 con 0x556f7be14640 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.534+0000 7f2160413640 1 -- 172.21.15.96:0/2224198520 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f215800a4d0 con 0x556f7be14640 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 Processor -- start 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 -- start start 2024-09-14T10:45:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfac510 0x556f7bfac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f7bdb4d80 con 0x556f7bfac510 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f215f411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfac510 0x556f7bfac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f215f411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfac510 0x556f7bfac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37306/0 (socket says 172.21.15.96:37306) 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f215f411640 1 -- 172.21.15.96:0/3762051084 learned_addr learned my addr 172.21.15.96:0/3762051084 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f215f411640 1 -- 172.21.15.96:0/3762051084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7bfacf70 con 0x556f7bfac510 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f215f411640 1 --2- 172.21.15.96:0/3762051084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfac510 0x556f7bfac930 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f215000e670 tx=0x7f215000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f20457fa640 1 -- 172.21.15.96:0/3762051084 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2150022070 con 0x556f7bfac510 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 -- 172.21.15.96:0/3762051084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f7bfad7d0 con 0x556f7bfac510 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f20457fa640 1 -- 172.21.15.96:0/3762051084 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215000d660 con 0x556f7bfac510 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 -- 172.21.15.96:0/3762051084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f7bfadd40 con 0x556f7bfac510 2024-09-14T10:45:29.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f20457fa640 1 -- 172.21.15.96:0/3762051084 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2150006070 con 0x556f7bfac510 2024-09-14T10:45:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f20457fa640 1 -- 172.21.15.96:0/3762051084 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2150025070 con 0x556f7bfac510 2024-09-14T10:45:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f20457fa640 1 --2- 172.21.15.96:0/3762051084 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f203803a1a0 0x7f203803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f20457fa640 1 -- 172.21.15.96:0/3762051084 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f21500523d0 con 0x556f7bfac510 2024-09-14T10:45:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f2160413640 1 --2- 172.21.15.96:0/3762051084 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f203803a1a0 0x7f203803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 Processor -- start 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 -- start start 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f2160413640 1 --2- 172.21.15.96:0/3762051084 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f203803a1a0 0x7f203803c660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x556f7bf9d700 tx=0x7f2158005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.538+0000 7f216210c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f7bf8df80 con 0x556f7bfb9ee0 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfba2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37314/0 (socket says 172.21.15.96:37314) 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 -- 172.21.15.96:0/2374932620 learned_addr learned my addr 172.21.15.96:0/2374932620 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 -- 172.21.15.96:0/2374932620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7bfba8d0 con 0x556f7bfb9ee0 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 --2- 172.21.15.96:0/2374932620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfba2e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f215000ef50 tx=0x7f2150026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d9591cd56ea3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f203effd640 1 -- 172.21.15.96:0/2374932620 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215004f280 con 0x556f7bfb9ee0 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f203effd640 1 -- 172.21.15.96:0/2374932620 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2150025c80 con 0x556f7bfb9ee0 2024-09-14T10:45:29.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f203effd640 1 -- 172.21.15.96:0/2374932620 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215000c2b0 con 0x556f7bfb9ee0 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- 172.21.15.96:0/2374932620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 msgr2=0x556f7bfba2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2374932620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfba2e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f215000ef50 tx=0x7f2150026680 comp rx=0 tx=0).stop 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- 172.21.15.96:0/2374932620 shutdown_connections 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2374932620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfba2e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- 172.21.15.96:0/2374932620 >> 172.21.15.96:0/2374932620 conn(0x556f7bfb5300 msgr2=0x556f7bfb3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- 172.21.15.96:0/2374932620 shutdown_connections 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- 172.21.15.96:0/2374932620 wait complete. 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 Processor -- start 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- start start 2024-09-14T10:45:29.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfc03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f7bfb8e30 con 0x556f7bfb9ee0 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfc03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfc03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37316/0 (socket says 172.21.15.96:37316) 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 learned_addr learned my addr 172.21.15.96:0/2132370698 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7bfc0950 con 0x556f7bfb9ee0 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f215f411640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfc03f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f215000cfd0 tx=0x7f21500506b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f203d7fa640 1 -- 172.21.15.96:0/2132370698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215000c540 con 0x556f7bfb9ee0 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f7bfc0be0 con 0x556f7bfb9ee0 2024-09-14T10:45:29.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f7bfc0be0 con 0x556f7bfb9ee0 2024-09-14T10:45:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f203d7fa640 1 -- 172.21.15.96:0/2132370698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215000c6e0 con 0x556f7bfb9ee0 2024-09-14T10:45:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.542+0000 7f203d7fa640 1 -- 172.21.15.96:0/2132370698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2150039060 con 0x556f7bfb9ee0 2024-09-14T10:45:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f203d7fa640 1 -- 172.21.15.96:0/2132370698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f215001a320 con 0x556f7bfb9ee0 2024-09-14T10:45:29.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f203d7fa640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f202803a150 0x7f202803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f203d7fa640 1 -- 172.21.15.96:0/2132370698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f215002fac0 con 0x556f7bfb9ee0 2024-09-14T10:45:29.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f2160413640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f202803a150 0x7f202803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7bfcb740 0x556f7bfcdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfce320 con 0x556f7bfcb740 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215fc12640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7bfcb740 0x556f7bfcdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f2160413640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f202803a150 0x7f202803c610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x556f7bf9ce80 tx=0x7f215801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215fc12640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7bfcb740 0x556f7bfcdbd0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 realm 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfce730 con 0x556f7bfcb740 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfcf000 con 0x556f7bfcb740 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfcf3a0 con 0x556f7bfcb740 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfcf840 con 0x556f7bfcb740 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:29.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 20 searching for the correct realm 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556f7bfd1840 0x556f7bfd3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215f411640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556f7bfd1840 0x556f7bfd3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215f411640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556f7bfd1840 0x556f7bfd3c30 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215003b070 con 0x556f7bfd1840 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215f411640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2150027060 0x7f2150049200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2150027060 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.546+0000 7f2160413640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2150027060 0x7f2150049200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f2160413640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2150027060 0x7f2150049200 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215801f070 con 0x7f2150027060 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f2160413640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2158031040 0x7f2158032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2158031040 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2158031040 0x7f2158032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2158031040 0x7f2158032940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfcb740 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfcb740 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2158031040 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2158031040 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2150027060 2024-09-14T10:45:29.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215801f070 con 0x7f2150027060 2024-09-14T10:45:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.550+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215003b070 con 0x556f7bfd1840 2024-09-14T10:45:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfcb740 2024-09-14T10:45:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2158031040 2024-09-14T10:45:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfcb740 2024-09-14T10:45:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2150027060 2024-09-14T10:45:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f215801f070 con 0x7f2150027060 2024-09-14T10:45:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2158031040 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfcb740 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfcb740 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.554+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2158031040 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2150027060 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215801f070 con 0x7f2150027060 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfcb740 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2150027060 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215801f070 con 0x7f2150027060 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2158031040 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2150027060 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215801f070 con 0x7f2150027060 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfd1840 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2158031040 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x556f7bfcb740 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd42e0 con 0x7f2150027060 2024-09-14T10:45:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2158040040 con 0x7f2150027060 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd0310 con 0x556f7bfcb740 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.558+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd0bb0 con 0x556f7bfcb740 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfcff50 con 0x556f7bfcb740 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 zone default found 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 4 Realm: () 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 zonegroup default 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd0bb0 con 0x7f2150027060 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2158040040 con 0x7f2150027060 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd65e0 con 0x556f7bfd1840 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd6980 con 0x556f7bfd1840 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 started sync module instance, tier type = 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:29.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd5a70 con 0x7f2150027060 2024-09-14T10:45:29.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2158040040 con 0x7f2150027060 2024-09-14T10:45:29.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93937309933456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd5a70 con 0x7f2150027060 2024-09-14T10:45:29.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd73f0 con 0x556f7bfcb740 2024-09-14T10:45:29.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.562+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93937309933456] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2158040040 con 0x7f2150027060 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.566+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.566+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93937309937344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd5a70 con 0x556f7bfcb740 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.566+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd7e00 con 0x556f7bfd1840 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.566+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93937309937344] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.566+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.566+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93937309940048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd81a0 con 0x556f7bfd1840 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.566+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd8b60 con 0x7f2150027060 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.570+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2158040040 con 0x7f2150027060 2024-09-14T10:45:29.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.570+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93937309943776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd9400 con 0x7f2150027060 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.570+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd9e20 con 0x556f7bfcb740 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.570+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93937309940048] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.570+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93937309943776] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2158040040 con 0x7f2150027060 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.570+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.570+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93937309948176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd8f50 con 0x556f7bfcb740 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.570+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfda6c0 con 0x7f2158031040 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.574+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93937309948176] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.574+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.574+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93937309930944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd8f50 con 0x7f2158031040 2024-09-14T10:45:29.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.574+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfdab70 con 0x7f2158031040 2024-09-14T10:45:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.574+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93937309930944] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.574+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.574+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93937309951584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfdab30 con 0x7f2158031040 2024-09-14T10:45:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.574+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfdb530 con 0x7f2158031040 2024-09-14T10:45:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93937309951584] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93937309949936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfdb4f0 con 0x7f2158031040 2024-09-14T10:45:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 20 add_watcher() i=0 2024-09-14T10:45:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 20 add_watcher() i=1 2024-09-14T10:45:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 20 add_watcher() i=2 2024-09-14T10:45:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 20 add_watcher() i=3 2024-09-14T10:45:29.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 20 add_watcher() i=4 2024-09-14T10:45:29.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 20 add_watcher() i=5 2024-09-14T10:45:29.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 20 add_watcher() i=6 2024-09-14T10:45:29.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93937309949936] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 20 add_watcher() i=7 2024-09-14T10:45:29.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:29.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.578+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfde950 con 0x556f7bfcb740 2024-09-14T10:45:29.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93937309954576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfdbe70 con 0x556f7bfcb740 2024-09-14T10:45:29.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93937309954576] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f2015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:29.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 5 note: GC not initialized 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f2014fe1640 20 reqs_thread_entry: start 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 20 Filter name: none 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f1f8e7fc640 20 reqs_thread_entry: start 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7c001ca0 con 0x556f7bfcb740 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f7c0031f0 con 0x7f2158031040 2024-09-14T10:45:29.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.582+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.586+0000 7f2015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.586+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93937309954576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7c0015c0 con 0x556f7bfcb740 2024-09-14T10:45:29.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.586+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93937309954576] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.586+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93937309933456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7c0015c0 con 0x7f2150027060 2024-09-14T10:45:29.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.586+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93937309933456] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2158040040 con 0x7f2150027060 2024-09-14T10:45:29.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.586+0000 7f216210c9c0 20 remove_watcher() i=0 2024-09-14T10:45:29.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.586+0000 7f216210c9c0 2 removed watcher, disabling cache 2024-09-14T10:45:29.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.586+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93937309937344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd5f90 con 0x556f7bfcb740 2024-09-14T10:45:29.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93937309937344] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f216210c9c0 20 remove_watcher() i=1 2024-09-14T10:45:29.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93937309940048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd5f90 con 0x556f7bfd1840 2024-09-14T10:45:29.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f215f411640 1 -- 172.21.15.96:0/2132370698 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93937309940048] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f215005f040 con 0x556f7bfd1840 2024-09-14T10:45:29.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f216210c9c0 20 remove_watcher() i=2 2024-09-14T10:45:29.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93937309943776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd7950 con 0x7f2150027060 2024-09-14T10:45:29.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f2160413640 1 -- 172.21.15.96:0/2132370698 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93937309943776] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2158040040 con 0x7f2150027060 2024-09-14T10:45:29.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f216210c9c0 20 remove_watcher() i=3 2024-09-14T10:45:29.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.590+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93937309948176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd7950 con 0x556f7bfcb740 2024-09-14T10:45:29.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.594+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93937309948176] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x556f7bfcb740 2024-09-14T10:45:29.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.594+0000 7f216210c9c0 20 remove_watcher() i=4 2024-09-14T10:45:29.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.594+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93937309930944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd7950 con 0x7f2158031040 2024-09-14T10:45:29.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.594+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93937309930944] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.594+0000 7f216210c9c0 20 remove_watcher() i=5 2024-09-14T10:45:29.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.594+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93937309951584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd7950 con 0x7f2158031040 2024-09-14T10:45:29.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93937309951584] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 20 remove_watcher() i=6 2024-09-14T10:45:29.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93937309949936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f7bfd7950 con 0x7f2158031040 2024-09-14T10:45:29.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93937309949936] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21540c6d70 con 0x7f2158031040 2024-09-14T10:45:29.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 20 remove_watcher() i=7 2024-09-14T10:45:29.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2158031040 msgr2=0x7f2158032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2158031040 0x7f2158032940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7bfcb740 msgr2=0x556f7bfcdbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7bfcb740 0x556f7bfcdbd0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2150027060 msgr2=0x7f2150049200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2150027060 0x7f2150049200 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556f7bfd1840 msgr2=0x556f7bfd3c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556f7bfd1840 0x556f7bfd3c30 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f202803a150 msgr2=0x7f202803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f202803a150 0x7f202803c610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x556f7bf9ce80 tx=0x7f215801f000 comp rx=0 tx=0).stop 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f215fc12640 1 -- 172.21.15.96:0/2132370698 reap_dead start 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 msgr2=0x556f7bfc03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfc03f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f215000cfd0 tx=0x7f21500506b0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 shutdown_connections 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2132370698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfb9ee0 0x556f7bfc03f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 >> 172.21.15.96:0/2132370698 conn(0x556f7bfb5300 msgr2=0x556f7bfb3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 shutdown_connections 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2132370698 wait complete. 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/3762051084 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f203803a1a0 msgr2=0x7f203803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/3762051084 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f203803a1a0 0x7f203803c660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x556f7bf9d700 tx=0x7f2158005850 comp rx=0 tx=0).stop 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/3762051084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfac510 msgr2=0x556f7bfac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/3762051084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfac510 0x556f7bfac930 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f215000e670 tx=0x7f215000ea70 comp rx=0 tx=0).stop 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/3762051084 shutdown_connections 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/3762051084 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f203803a1a0 0x7f203803c660 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/3762051084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7bfac510 0x556f7bfac930 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/3762051084 >> 172.21.15.96:0/3762051084 conn(0x556f7bfa1ec0 msgr2=0x556f7bfa22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/3762051084 shutdown_connections 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/3762051084 wait complete. 2024-09-14T10:45:29.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7be14640 msgr2=0x556f7bf9bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.598+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7be14640 0x556f7bf9bf10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f204803a1a0 msgr2=0x7f204803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f204803a1a0 0x7f204803c660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2150001e40 tx=0x7f21500013a0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 msgr2=0x556f7bf94da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf94da0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2154000c10 tx=0x7f21540180e0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 shutdown_connections 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556f7be14640 0x556f7bf9bf10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f204803a1a0 0x7f204803c660 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 --2- 172.21.15.96:0/2224198520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f7be14260 0x556f7bf94da0 secure :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2154000c10 tx=0x7f21540180e0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 >> 172.21.15.96:0/2224198520 conn(0x556f7be9a980 msgr2=0x556f7bf8e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 shutdown_connections 2024-09-14T10:45:29.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.602+0000 7f216210c9c0 1 -- 172.21.15.96:0/2224198520 wait complete. 2024-09-14T10:45:29.609 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:45:29.609 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:45:29.610 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-14T10:45:29.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-14T10:45:29.610 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-14T10:45:29.700 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:29.700 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:29.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d7b829c0 1 Processor -- start 2024-09-14T10:45:29.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d7b829c0 1 -- start start 2024-09-14T10:45:29.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d7b829c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55afd4b547a0 0x55afd4b56b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d7b829c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55afd49fa7a0 con 0x55afd4b570d0 2024-09-14T10:45:29.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d7b829c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55afd4a561b0 con 0x55afd4b547a0 2024-09-14T10:45:29.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d5688640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55afd4b547a0 0x55afd4b56b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d4e87640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55afd4b570d0 0x55afd4b594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33060/0 (socket says 172.21.15.96:33060) 2024-09-14T10:45:29.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d4e87640 1 -- 172.21.15.96:0/1853301024 learned_addr learned my addr 172.21.15.96:0/1853301024 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:45:29.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d5688640 1 -- 172.21.15.96:0/1853301024 >> v1:172.21.15.70:6789/0 conn(0x55afd4b570d0 legacy=0x55afd4b594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d5688640 1 -- 172.21.15.96:0/1853301024 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afd49d4da0 con 0x55afd4b547a0 2024-09-14T10:45:29.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.702+0000 7f88d5688640 1 --2- 172.21.15.96:0/1853301024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4b56b90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f88c800a480 tx=0x7f88c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70760e5ceb7bbb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88c7fff640 1 -- 172.21.15.96:0/1853301024 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c80b0070 con 0x55afd4b547a0 2024-09-14T10:45:29.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88c7fff640 1 -- 172.21.15.96:0/1853301024 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c80ab540 con 0x55afd4b547a0 2024-09-14T10:45:29.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88c7fff640 1 -- 172.21.15.96:0/1853301024 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c80ab840 con 0x55afd4b547a0 2024-09-14T10:45:29.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1853301024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 msgr2=0x55afd4b56b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1853301024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4b56b90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f88c800a480 tx=0x7f88c801b280 comp rx=0 tx=0).stop 2024-09-14T10:45:29.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1853301024 shutdown_connections 2024-09-14T10:45:29.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1853301024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4b56b90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1853301024 >> 172.21.15.96:0/1853301024 conn(0x55afd4ac7b30 msgr2=0x55afd4ac7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1853301024 shutdown_connections 2024-09-14T10:45:29.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.706+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1853301024 wait complete. 2024-09-14T10:45:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d7b829c0 1 Processor -- start 2024-09-14T10:45:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d7b829c0 1 -- start start 2024-09-14T10:45:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d7b829c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c3f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d7b829c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afd4a59fc0 con 0x55afd4b547a0 2024-09-14T10:45:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d5688640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c3f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d5688640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c3f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37338/0 (socket says 172.21.15.96:37338) 2024-09-14T10:45:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d5688640 1 -- 172.21.15.96:0/1831147211 learned_addr learned my addr 172.21.15.96:0/1831147211 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d5688640 1 -- 172.21.15.96:0/1831147211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afd4c3fc00 con 0x55afd4b547a0 2024-09-14T10:45:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d5688640 1 --2- 172.21.15.96:0/1831147211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c3f610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f88c8018eb0 tx=0x7f88c8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723dc30b20aabf9b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f87c3606640 1 -- 172.21.15.96:0/1831147211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c80b0040 con 0x55afd4b547a0 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f87c3606640 1 -- 172.21.15.96:0/1831147211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c80bb070 con 0x55afd4b547a0 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f87c3606640 1 -- 172.21.15.96:0/1831147211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c80ab6f0 con 0x55afd4b547a0 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1831147211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 msgr2=0x55afd4c3f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.718+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1831147211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c3f610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f88c8018eb0 tx=0x7f88c8003030 comp rx=0 tx=0).stop 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1831147211 shutdown_connections 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1831147211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c3f610 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1831147211 >> 172.21.15.96:0/1831147211 conn(0x55afd4ac7b30 msgr2=0x55afd4c3b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1831147211 shutdown_connections 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1831147211 wait complete. 2024-09-14T10:45:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 Processor -- start 2024-09-14T10:45:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 -- start start 2024-09-14T10:45:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c46d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afd49fba50 con 0x55afd4b547a0 2024-09-14T10:45:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d5688640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c46d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d5688640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c46d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37340/0 (socket says 172.21.15.96:37340) 2024-09-14T10:45:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d5688640 1 -- 172.21.15.96:0/1713988886 learned_addr learned my addr 172.21.15.96:0/1713988886 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d5688640 1 -- 172.21.15.96:0/1713988886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afd4c472e0 con 0x55afd4b547a0 2024-09-14T10:45:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d5688640 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c46d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b8040 tx=0x7f88c8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f87c1e03640 1 -- 172.21.15.96:0/1713988886 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c80b0030 con 0x55afd4b547a0 2024-09-14T10:45:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afd4c47570 con 0x55afd4b547a0 2024-09-14T10:45:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afd4c47f20 con 0x55afd4b547a0 2024-09-14T10:45:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f87c1e03640 1 -- 172.21.15.96:0/1713988886 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c80bb070 con 0x55afd4b547a0 2024-09-14T10:45:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f87c1e03640 1 -- 172.21.15.96:0/1713988886 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c80b68e0 con 0x55afd4b547a0 2024-09-14T10:45:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f87c1e03640 1 -- 172.21.15.96:0/1713988886 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f88c80b6a80 con 0x55afd4b547a0 2024-09-14T10:45:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f87c1e03640 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87bc03a150 0x7f87bc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f87c1e03640 1 -- 172.21.15.96:0/1713988886 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f88c80a8070 con 0x55afd4b547a0 2024-09-14T10:45:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d4e87640 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87bc03a150 0x7f87bc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.722+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4b570d0 0x55afd4c4def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c4e430 con 0x55afd4b570d0 2024-09-14T10:45:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d5e89640 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4b570d0 0x55afd4c4def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d4e87640 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87bc03a150 0x7f87bc03c610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f88cc004180 tx=0x7f88cc001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d5e89640 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4b570d0 0x55afd4c4def0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d5e89640 1 -- 172.21.15.96:0/1713988886 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88d000a4d0 con 0x55afd4b570d0 2024-09-14T10:45:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c4e810 con 0x55afd4b570d0 2024-09-14T10:45:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d5e89640 1 -- 172.21.15.96:0/1713988886 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88d000a4d0 con 0x55afd4b570d0 2024-09-14T10:45:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c50110 con 0x55afd4b570d0 2024-09-14T10:45:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d5e89640 1 -- 172.21.15.96:0/1713988886 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f88d000a4d0 con 0x55afd4b570d0 2024-09-14T10:45:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c4f340 con 0x55afd4b570d0 2024-09-14T10:45:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d5e89640 1 -- 172.21.15.96:0/1713988886 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88d000a4d0 con 0x55afd4b570d0 2024-09-14T10:45:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c4f760 con 0x55afd4b570d0 2024-09-14T10:45:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d5e89640 1 -- 172.21.15.96:0/1713988886 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f88d000a4d0 con 0x55afd4b570d0 2024-09-14T10:45:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 Processor -- start 2024-09-14T10:45:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 -- start start 2024-09-14T10:45:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c5e4f0 0x55afd4c5e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d7b829c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afd4a66d80 con 0x55afd4c5e4f0 2024-09-14T10:45:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d4e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c5e4f0 0x55afd4c5e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d4e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c5e4f0 0x55afd4c5e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37348/0 (socket says 172.21.15.96:37348) 2024-09-14T10:45:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d4e87640 1 -- 172.21.15.96:0/382080538 learned_addr learned my addr 172.21.15.96:0/382080538 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d4e87640 1 -- 172.21.15.96:0/382080538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afd4c5ef50 con 0x55afd4c5e4f0 2024-09-14T10:45:29.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f88d4e87640 1 --2- 172.21.15.96:0/382080538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c5e4f0 0x55afd4c5e910 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00d660 tx=0x7f88cc00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.726+0000 7f87baffd640 1 -- 172.21.15.96:0/382080538 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc00c6b0 con 0x55afd4c5e4f0 2024-09-14T10:45:29.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 -- 172.21.15.96:0/382080538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afd4c5f7b0 con 0x55afd4c5e4f0 2024-09-14T10:45:29.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f87baffd640 1 -- 172.21.15.96:0/382080538 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc00c850 con 0x55afd4c5e4f0 2024-09-14T10:45:29.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 -- 172.21.15.96:0/382080538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afd4c5fd20 con 0x55afd4c5e4f0 2024-09-14T10:45:29.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f87baffd640 1 -- 172.21.15.96:0/382080538 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc00cb30 con 0x55afd4c5e4f0 2024-09-14T10:45:29.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f87baffd640 1 -- 172.21.15.96:0/382080538 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f88cc023020 con 0x55afd4c5e4f0 2024-09-14T10:45:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f87baffd640 1 --2- 172.21.15.96:0/382080538 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87ac03a150 0x7f87ac03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f87baffd640 1 -- 172.21.15.96:0/382080538 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f88cc021020 con 0x55afd4c5e4f0 2024-09-14T10:45:29.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d5e89640 1 --2- 172.21.15.96:0/382080538 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87ac03a150 0x7f87ac03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 Processor -- start 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 -- start start 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d5e89640 1 --2- 172.21.15.96:0/382080538 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87ac03a150 0x7f87ac03c610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55afd4c4f6e0 tx=0x7f88d0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c6c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afd4c3ff70 con 0x55afd4c6bf20 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d4e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c6c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d4e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c6c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37356/0 (socket says 172.21.15.96:37356) 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d4e87640 1 -- 172.21.15.96:0/423209865 learned_addr learned my addr 172.21.15.96:0/423209865 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d4e87640 1 -- 172.21.15.96:0/423209865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afd4c6c8f0 con 0x55afd4c6bf20 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d4e87640 1 --2- 172.21.15.96:0/423209865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c6c300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0517e0 tx=0x7f88cc0193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebfc76d067e160 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f87b8ff9640 1 -- 172.21.15.96:0/423209865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc0502d0 con 0x55afd4c6bf20 2024-09-14T10:45:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f87b8ff9640 1 -- 172.21.15.96:0/423209865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc04e020 con 0x55afd4c6bf20 2024-09-14T10:45:29.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f87b8ff9640 1 -- 172.21.15.96:0/423209865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc01bcc0 con 0x55afd4c6bf20 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 -- 172.21.15.96:0/423209865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 msgr2=0x55afd4c6c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/423209865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c6c300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0517e0 tx=0x7f88cc0193e0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 -- 172.21.15.96:0/423209865 shutdown_connections 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/423209865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c6c300 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 -- 172.21.15.96:0/423209865 >> 172.21.15.96:0/423209865 conn(0x55afd4c672e0 msgr2=0x55afd4c65520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.730+0000 7f88d7b829c0 1 -- 172.21.15.96:0/423209865 shutdown_connections 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 -- 172.21.15.96:0/423209865 wait complete. 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 Processor -- start 2024-09-14T10:45:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 -- start start 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afd4c6ae10 con 0x55afd4c6bf20 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d4e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d4e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37368/0 (socket says 172.21.15.96:37368) 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 learned_addr learned my addr 172.21.15.96:0/3060215014 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afd4c72940 con 0x55afd4c6bf20 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d4e87640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c723e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0517e0 tx=0x7f88cc051770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f87aaffd640 1 -- 172.21.15.96:0/3060215014 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc033020 con 0x55afd4c6bf20 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afd4c72bd0 con 0x55afd4c6bf20 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f87aaffd640 1 -- 172.21.15.96:0/3060215014 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc023dd0 con 0x55afd4c6bf20 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f87aaffd640 1 -- 172.21.15.96:0/3060215014 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88cc019ba0 con 0x55afd4c6bf20 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afd4c72bd0 con 0x55afd4c6bf20 2024-09-14T10:45:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f87aaffd640 1 -- 172.21.15.96:0/3060215014 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f88cc036020 con 0x55afd4c6bf20 2024-09-14T10:45:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f87aaffd640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87a003a150 0x7f87a003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f87aaffd640 1 -- 172.21.15.96:0/3060215014 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f88cc04f030 con 0x55afd4c6bf20 2024-09-14T10:45:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d5e89640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87a003a150 0x7f87a003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4c7d790 0x55afd4c7fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c80370 con 0x55afd4c7d790 2024-09-14T10:45:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.734+0000 7f88d5688640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4c7d790 0x55afd4c7fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5e89640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87a003a150 0x7f87a003c610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55afd4c4ee60 tx=0x7f88d001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5688640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4c7d790 0x55afd4c7fc20 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 realm 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c80780 con 0x55afd4c7d790 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c81050 con 0x55afd4c7d790 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c813f0 con 0x55afd4c7d790 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c81c40 con 0x55afd4c7d790 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 20 searching for the correct realm 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55afd4c839b0 0x55afd4c85da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d4e87640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55afd4c839b0 0x55afd4c85da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d4e87640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55afd4c839b0 0x55afd4c85da0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d4e87640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f88cc038020 0x7f88cc02f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88cc038020 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5e89640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f88cc038020 0x7f88cc02f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5e89640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f88cc038020 0x7f88cc02f690 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d001f070 con 0x7f88cc038020 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5e89640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f88d0031040 0x7f88d0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88d0031040 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5688640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f88d0031040 0x7f88d0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.738+0000 7f88d5688640 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f88d0031040 0x7f88d0032940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c7d790 2024-09-14T10:45:29.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c7d790 2024-09-14T10:45:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88d0031040 2024-09-14T10:45:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88d0031040 2024-09-14T10:45:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88cc038020 2024-09-14T10:45:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d001f070 con 0x7f88cc038020 2024-09-14T10:45:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c7d790 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88d0031040 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c7d790 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88cc038020 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88d001f070 con 0x7f88cc038020 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.742+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88d0031040 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c7d790 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c7d790 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88d0031040 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88cc038020 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d001f070 con 0x7f88cc038020 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c7d790 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88cc038020 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d001f070 con 0x7f88cc038020 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.746+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88d0031040 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88cc038020 2024-09-14T10:45:29.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d001f070 con 0x7f88cc038020 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c839b0 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88d0031040 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x55afd4c7d790 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86330 con 0x7f88cc038020 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0040040 con 0x7f88cc038020 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:29.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c825f0 con 0x55afd4c7d790 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c82e90 con 0x55afd4c7d790 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c82e90 con 0x55afd4c7d790 2024-09-14T10:45:29.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 zone default found 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 4 Realm: () 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 zonegroup default 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c86790 con 0x7f88cc038020 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f88d0040040 con 0x7f88cc038020 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c886b0 con 0x55afd4c839b0 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c88bf0 con 0x55afd4c839b0 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 started sync module instance, tier type = 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:29.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.750+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c879c0 con 0x7f88cc038020 2024-09-14T10:45:29.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.754+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0040040 con 0x7f88cc038020 2024-09-14T10:45:29.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.754+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94213677547232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c879c0 con 0x7f88cc038020 2024-09-14T10:45:29.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.754+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c896b0 con 0x55afd4c7d790 2024-09-14T10:45:29.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.754+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94213677547232] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0040040 con 0x7f88cc038020 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.754+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.754+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94213677552064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c879c0 con 0x55afd4c7d790 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.754+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8a0c0 con 0x55afd4c839b0 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94213677552064] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94213677544720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c87930 con 0x55afd4c839b0 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8ae50 con 0x7f88cc038020 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0040040 con 0x7f88cc038020 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94213677558112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8b6f0 con 0x7f88cc038020 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8c130 con 0x55afd4c7d790 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94213677544720] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94213677558112] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0040040 con 0x7f88cc038020 2024-09-14T10:45:29.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94213677562880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8b240 con 0x55afd4c7d790 2024-09-14T10:45:29.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.758+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8c9d0 con 0x7f88d0031040 2024-09-14T10:45:29.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.762+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94213677562880] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.762+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.762+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94213677556912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8c6f0 con 0x7f88d0031040 2024-09-14T10:45:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.762+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8cf40 con 0x7f88d0031040 2024-09-14T10:45:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.762+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94213677556912] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.762+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.762+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94213677564752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8cd40 con 0x7f88d0031040 2024-09-14T10:45:29.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.762+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8d860 con 0x7f88d0031040 2024-09-14T10:45:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94213677564752] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94213677568816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8d820 con 0x7f88d0031040 2024-09-14T10:45:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 20 add_watcher() i=0 2024-09-14T10:45:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 20 add_watcher() i=1 2024-09-14T10:45:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 20 add_watcher() i=2 2024-09-14T10:45:29.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 20 add_watcher() i=3 2024-09-14T10:45:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 20 add_watcher() i=4 2024-09-14T10:45:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 20 add_watcher() i=5 2024-09-14T10:45:29.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 20 add_watcher() i=6 2024-09-14T10:45:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94213677568816] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 20 add_watcher() i=7 2024-09-14T10:45:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c90c80 con 0x55afd4c7d790 2024-09-14T10:45:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.766+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94213677565872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c8e1a0 con 0x55afd4c7d790 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94213677565872] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f878b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 5 note: GC not initialized 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f878a7e4640 20 reqs_thread_entry: start 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 20 Filter name: none 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f86fbfff640 20 reqs_thread_entry: start 2024-09-14T10:45:29.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-14T10:45:29.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb4510 con 0x7f88d0031040 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb2a50 con 0x55afd4c7d790 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-14T10:45:29.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:45:29.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T10:45:29.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T10:45:29.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.770+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb35c0 con 0x7f88d0031040 2024-09-14T10:45:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-14T10:45:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:45:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-14T10:45:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94213677724176 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb7ff0 con 0x7f88d0031040 2024-09-14T10:45:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== watch-notify(notify (1) cookie 94213677568816 notify 146028888084 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55afd4cb2e70 con 0x7f88d0031040 2024-09-14T10:45:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f87b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94213677568816 notifier 4725 bl.length()=556 2024-09-14T10:45:29.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f87b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-14T10:45:29.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f87b8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:45:29.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f87b8ff9640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8798003eb0 con 0x7f88d0031040 2024-09-14T10:45:29.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(65 notify.7 [notify cookie 94213677724176 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== watch-notify(notify_complete (2) cookie 94213677724176 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f88c80df040 con 0x7f88d0031040 2024-09-14T10:45:29.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb3210 con 0x55afd4c7d790 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'5 uv5 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.774+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94213677724176 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb8440 con 0x7f88d0031040 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== watch-notify(notify (1) cookie 94213677556912 notify 146028888085 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f88c80df040 con 0x7f88d0031040 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f87abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94213677556912 notifier 4725 bl.length()=177 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(68 notify.5 [notify cookie 94213677724176 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f87abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f87abfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:45:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f87abfff640 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8708003410 con 0x7f88d0031040 2024-09-14T10:45:29.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== watch-notify(notify_complete (2) cookie 94213677724176 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55afd4c47f20 con 0x7f88d0031040 2024-09-14T10:45:29.778 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-14T10:45:29.775594Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:45:29.775582Z","tags":[],"group_ids":[]} 2024-09-14T10:45:29.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f878b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94213677565872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb2080 con 0x55afd4c7d790 2024-09-14T10:45:29.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94213677565872] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.778+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94213677547232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb2080 con 0x7f88cc038020 2024-09-14T10:45:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.782+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94213677547232] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0040040 con 0x7f88cc038020 2024-09-14T10:45:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.782+0000 7f88d7b829c0 20 remove_watcher() i=0 2024-09-14T10:45:29.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.782+0000 7f88d7b829c0 2 removed watcher, disabling cache 2024-09-14T10:45:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.782+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94213677552064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb2080 con 0x55afd4c7d790 2024-09-14T10:45:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.782+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94213677552064] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.782+0000 7f88d7b829c0 20 remove_watcher() i=1 2024-09-14T10:45:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.782+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94213677544720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4cb2080 con 0x55afd4c839b0 2024-09-14T10:45:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d4e87640 1 -- 172.21.15.96:0/3060215014 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94213677544720] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88cc01a5b0 con 0x55afd4c839b0 2024-09-14T10:45:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d7b829c0 20 remove_watcher() i=2 2024-09-14T10:45:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94213677558112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c891c0 con 0x7f88cc038020 2024-09-14T10:45:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d5e89640 1 -- 172.21.15.96:0/3060215014 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94213677558112] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0040040 con 0x7f88cc038020 2024-09-14T10:45:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d7b829c0 20 remove_watcher() i=3 2024-09-14T10:45:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94213677562880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c87510 con 0x55afd4c7d790 2024-09-14T10:45:29.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94213677562880] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x55afd4c7d790 2024-09-14T10:45:29.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d7b829c0 20 remove_watcher() i=4 2024-09-14T10:45:29.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.786+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94213677556912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c891c0 con 0x7f88d0031040 2024-09-14T10:45:29.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.790+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94213677556912] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.790+0000 7f88d7b829c0 20 remove_watcher() i=5 2024-09-14T10:45:29.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.790+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94213677564752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c87510 con 0x7f88d0031040 2024-09-14T10:45:29.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.790+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94213677564752] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.790+0000 7f88d7b829c0 20 remove_watcher() i=6 2024-09-14T10:45:29.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.790+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94213677568816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55afd4c891c0 con 0x7f88d0031040 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94213677568816] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c80b3040 con 0x7f88d0031040 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 20 remove_watcher() i=7 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f88d0031040 msgr2=0x7f88d0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f88d0031040 0x7f88d0032940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4c7d790 msgr2=0x55afd4c7fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4c7d790 0x55afd4c7fc20 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f88cc038020 msgr2=0x7f88cc02f690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f88cc038020 0x7f88cc02f690 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55afd4c839b0 msgr2=0x55afd4c85da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55afd4c839b0 0x55afd4c85da0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87a003a150 msgr2=0x7f87a003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87a003a150 0x7f87a003c610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55afd4c4ee60 tx=0x7f88d001f000 comp rx=0 tx=0).stop 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 msgr2=0x55afd4c723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d5688640 1 -- 172.21.15.96:0/3060215014 reap_dead start 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c723e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0517e0 tx=0x7f88cc051770 comp rx=0 tx=0).stop 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 shutdown_connections 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/3060215014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c6bf20 0x55afd4c723e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 >> 172.21.15.96:0/3060215014 conn(0x55afd4c672e0 msgr2=0x55afd4c654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 shutdown_connections 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/3060215014 wait complete. 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/382080538 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87ac03a150 msgr2=0x7f87ac03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/382080538 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87ac03a150 0x7f87ac03c610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55afd4c4f6e0 tx=0x7f88d0005850 comp rx=0 tx=0).stop 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/382080538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c5e4f0 msgr2=0x55afd4c5e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/382080538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c5e4f0 0x55afd4c5e910 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00d660 tx=0x7f88cc00da60 comp rx=0 tx=0).stop 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/382080538 shutdown_connections 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/382080538 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87ac03a150 0x7f87ac03c610 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/382080538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4c5e4f0 0x55afd4c5e910 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/382080538 >> 172.21.15.96:0/382080538 conn(0x55afd4c53ea0 msgr2=0x55afd4c54280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/382080538 shutdown_connections 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/382080538 wait complete. 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4b570d0 msgr2=0x55afd4c4def0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4b570d0 0x55afd4c4def0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87bc03a150 msgr2=0x7f87bc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87bc03a150 0x7f87bc03c610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f88cc004180 tx=0x7f88cc001340 comp rx=0 tx=0).stop 2024-09-14T10:45:29.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 msgr2=0x55afd4c46d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c46d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b8040 tx=0x7f88c8018020 comp rx=0 tx=0).stop 2024-09-14T10:45:29.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 shutdown_connections 2024-09-14T10:45:29.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55afd4b570d0 0x55afd4c4def0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f87bc03a150 0x7f87bc03c610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 --2- 172.21.15.96:0/1713988886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afd4b547a0 0x55afd4c46d80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 >> 172.21.15.96:0/1713988886 conn(0x55afd4ac7b30 msgr2=0x55afd4c40990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 shutdown_connections 2024-09-14T10:45:29.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.794+0000 7f88d7b829c0 1 -- 172.21.15.96:0/1713988886 wait complete. 2024-09-14T10:45:29.804 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-14T10:45:29.775594Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:45:29.775582Z', 'tags': [], 'group_ids': []} 2024-09-14T10:45:29.820 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:45:29.826 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-14T10:45:29.826 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-14T10:45:29.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-14T10:45:29.826 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-14T10:45:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:29.879 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.878+0000 7fd9142999c0 1 Processor -- start 2024-09-14T10:45:29.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.878+0000 7fd9142999c0 1 -- start start 2024-09-14T10:45:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd9142999c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5637b237cb50 0x5637b237cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd9142999c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5637b22ae7a0 con 0x5637b237b550 2024-09-14T10:45:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd9142999c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5637b230a1b0 con 0x5637b237cb50 2024-09-14T10:45:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd911d9f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5637b237cb50 0x5637b237cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd91159e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5637b237b550 0x5637b237b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:33066/0 (socket says 172.21.15.96:33066) 2024-09-14T10:45:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd91159e640 1 -- 172.21.15.96:0/666279000 learned_addr learned my addr 172.21.15.96:0/666279000 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:45:29.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd911d9f640 1 -- 172.21.15.96:0/666279000 >> v1:172.21.15.70:6789/0 conn(0x5637b237b550 legacy=0x5637b237b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd911d9f640 1 -- 172.21.15.96:0/666279000 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b2288da0 con 0x5637b237cb50 2024-09-14T10:45:29.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd911d9f640 1 --2- 172.21.15.96:0/666279000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237cb50 0x5637b237cf30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd90400a480 tx=0x7fd90401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e622546019e564 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd910d9d640 1 -- 172.21.15.96:0/666279000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9040af070 con 0x5637b237cb50 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd910d9d640 1 -- 172.21.15.96:0/666279000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9040aa530 con 0x5637b237cb50 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.882+0000 7fd910d9d640 1 -- 172.21.15.96:0/666279000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9040aa830 con 0x5637b237cb50 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.886+0000 7fd9142999c0 1 -- 172.21.15.96:0/666279000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237cb50 msgr2=0x5637b237cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.886+0000 7fd9142999c0 1 --2- 172.21.15.96:0/666279000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237cb50 0x5637b237cf30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd90400a480 tx=0x7fd90401b280 comp rx=0 tx=0).stop 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.886+0000 7fd9142999c0 1 -- 172.21.15.96:0/666279000 shutdown_connections 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.886+0000 7fd9142999c0 1 --2- 172.21.15.96:0/666279000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237cb50 0x5637b237cf30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.886+0000 7fd9142999c0 1 -- 172.21.15.96:0/666279000 >> 172.21.15.96:0/666279000 conn(0x5637b2401b30 msgr2=0x5637b2403f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.886+0000 7fd9142999c0 1 -- 172.21.15.96:0/666279000 shutdown_connections 2024-09-14T10:45:29.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.886+0000 7fd9142999c0 1 -- 172.21.15.96:0/666279000 wait complete. 2024-09-14T10:45:29.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 Processor -- start 2024-09-14T10:45:29.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- start start 2024-09-14T10:45:29.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5637b230dfc0 con 0x5637b237b550 2024-09-14T10:45:29.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd911d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd911d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24f7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37384/0 (socket says 172.21.15.96:37384) 2024-09-14T10:45:29.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd911d9f640 1 -- 172.21.15.96:0/2480614197 learned_addr learned my addr 172.21.15.96:0/2480614197 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd911d9f640 1 -- 172.21.15.96:0/2480614197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b24f8510 con 0x5637b237b550 2024-09-14T10:45:29.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd911d9f640 1 --2- 172.21.15.96:0/2480614197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24f7f20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd904018eb0 tx=0x7fd904003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110c525fbbb7013e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd7ffe07640 1 -- 172.21.15.96:0/2480614197 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9040af040 con 0x5637b237b550 2024-09-14T10:45:29.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd7ffe07640 1 -- 172.21.15.96:0/2480614197 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9040aa6e0 con 0x5637b237b550 2024-09-14T10:45:29.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd7ffe07640 1 -- 172.21.15.96:0/2480614197 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9040aa9c0 con 0x5637b237b550 2024-09-14T10:45:29.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- 172.21.15.96:0/2480614197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 msgr2=0x5637b24f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2480614197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24f7f20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd904018eb0 tx=0x7fd904003030 comp rx=0 tx=0).stop 2024-09-14T10:45:29.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- 172.21.15.96:0/2480614197 shutdown_connections 2024-09-14T10:45:29.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2480614197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24f7f20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- 172.21.15.96:0/2480614197 >> 172.21.15.96:0/2480614197 conn(0x5637b2401b30 msgr2=0x5637b24f3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- 172.21.15.96:0/2480614197 shutdown_connections 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- 172.21.15.96:0/2480614197 wait complete. 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 Processor -- start 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- start start 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.898+0000 7fd9142999c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5637b22afa50 con 0x5637b237b550 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd911d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd911d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24ff590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37394/0 (socket says 172.21.15.96:37394) 2024-09-14T10:45:29.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd911d9f640 1 -- 172.21.15.96:0/2789458131 learned_addr learned my addr 172.21.15.96:0/2789458131 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd911d9f640 1 -- 172.21.15.96:0/2789458131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b24ffaf0 con 0x5637b237b550 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd911d9f640 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24ff590 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd90401bb20 tx=0x7fd904018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd7fe604640 1 -- 172.21.15.96:0/2789458131 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9040c3020 con 0x5637b237b550 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637b24ffd80 con 0x5637b237b550 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd7fe604640 1 -- 172.21.15.96:0/2789458131 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9040b5970 con 0x5637b237b550 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b2500730 con 0x5637b237b550 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd7fe604640 1 -- 172.21.15.96:0/2789458131 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9040af070 con 0x5637b237b550 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd7fe604640 1 -- 172.21.15.96:0/2789458131 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd9040c6020 con 0x5637b237b550 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd7fe604640 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7f803a150 0x7fd7f803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd7fe604640 1 -- 172.21.15.96:0/2789458131 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd9040ba070 con 0x5637b237b550 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd91159e640 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7f803a150 0x7fd7f803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b237cb50 0x5637b2506700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2506c40 con 0x5637b237cb50 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd9125a0640 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b237cb50 0x5637b2506700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd91159e640 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7f803a150 0x7fd7f803c610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd908001d80 tx=0x7fd9080012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd9125a0640 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b237cb50 0x5637b2506700 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.902+0000 7fd9125a0640 1 -- 172.21.15.96:0/2789458131 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd90c00a4d0 con 0x5637b237cb50 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2507090 con 0x5637b237cb50 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9125a0640 1 -- 172.21.15.96:0/2789458131 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd90c00a4d0 con 0x5637b237cb50 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2508990 con 0x5637b237cb50 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9125a0640 1 -- 172.21.15.96:0/2789458131 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd90c00a4d0 con 0x5637b237cb50 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2507bc0 con 0x5637b237cb50 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9125a0640 1 -- 172.21.15.96:0/2789458131 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd90c00a4d0 con 0x5637b237cb50 2024-09-14T10:45:29.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2507fe0 con 0x5637b237cb50 2024-09-14T10:45:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9125a0640 1 -- 172.21.15.96:0/2789458131 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd90c00a4d0 con 0x5637b237cb50 2024-09-14T10:45:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 Processor -- start 2024-09-14T10:45:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 -- start start 2024-09-14T10:45:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b2516d80 0x5637b25171a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5637b231ad80 con 0x5637b2516d80 2024-09-14T10:45:29.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd91159e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b2516d80 0x5637b25171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd91159e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b2516d80 0x5637b25171a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37410/0 (socket says 172.21.15.96:37410) 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd91159e640 1 -- 172.21.15.96:0/1007906902 learned_addr learned my addr 172.21.15.96:0/1007906902 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd91159e640 1 -- 172.21.15.96:0/1007906902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b25177e0 con 0x5637b2516d80 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd91159e640 1 --2- 172.21.15.96:0/1007906902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b2516d80 0x5637b25171a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd90800d660 tx=0x7fd90800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd7f77fe640 1 -- 172.21.15.96:0/1007906902 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90800c6b0 con 0x5637b2516d80 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd7f77fe640 1 -- 172.21.15.96:0/1007906902 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90800c850 con 0x5637b2516d80 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd7f77fe640 1 -- 172.21.15.96:0/1007906902 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90800cb30 con 0x5637b2516d80 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 -- 172.21.15.96:0/1007906902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637b2518040 con 0x5637b2516d80 2024-09-14T10:45:29.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.906+0000 7fd9142999c0 1 -- 172.21.15.96:0/1007906902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b25185b0 con 0x5637b2516d80 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd7f77fe640 1 -- 172.21.15.96:0/1007906902 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd908023020 con 0x5637b2516d80 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd7f77fe640 1 --2- 172.21.15.96:0/1007906902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7ec03a1a0 0x7fd7ec03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd7f77fe640 1 -- 172.21.15.96:0/1007906902 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd908021020 con 0x5637b2516d80 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9125a0640 1 --2- 172.21.15.96:0/1007906902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7ec03a1a0 0x7fd7ec03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 Processor -- start 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 -- start start 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9125a0640 1 --2- 172.21.15.96:0/1007906902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7ec03a1a0 0x7fd7ec03c660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5637b2507f60 tx=0x7fd90c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b2524af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5637b24f8880 con 0x5637b25246f0 2024-09-14T10:45:29.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd91159e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b2524af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd91159e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b2524af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37416/0 (socket says 172.21.15.96:37416) 2024-09-14T10:45:29.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd91159e640 1 -- 172.21.15.96:0/1825003059 learned_addr learned my addr 172.21.15.96:0/1825003059 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd91159e640 1 -- 172.21.15.96:0/1825003059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b25250e0 con 0x5637b25246f0 2024-09-14T10:45:29.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd91159e640 1 --2- 172.21.15.96:0/1825003059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b2524af0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd9080517d0 tx=0x7fd908044710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2560d79edc5518f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd7f57fa640 1 -- 172.21.15.96:0/1825003059 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90801bcc0 con 0x5637b25246f0 2024-09-14T10:45:29.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd7f57fa640 1 -- 172.21.15.96:0/1825003059 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd908050270 con 0x5637b25246f0 2024-09-14T10:45:29.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd7f57fa640 1 -- 172.21.15.96:0/1825003059 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd90801be60 con 0x5637b25246f0 2024-09-14T10:45:29.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 -- 172.21.15.96:0/1825003059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 msgr2=0x5637b2524af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 --2- 172.21.15.96:0/1825003059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b2524af0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd9080517d0 tx=0x7fd908044710 comp rx=0 tx=0).stop 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 -- 172.21.15.96:0/1825003059 shutdown_connections 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 --2- 172.21.15.96:0/1825003059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b2524af0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 -- 172.21.15.96:0/1825003059 >> 172.21.15.96:0/1825003059 conn(0x5637b251fb10 msgr2=0x5637b251dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 -- 172.21.15.96:0/1825003059 shutdown_connections 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.910+0000 7fd9142999c0 1 -- 172.21.15.96:0/1825003059 wait complete. 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 1 Processor -- start 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 1 -- start start 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b252aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5637b2523640 con 0x5637b25246f0 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd91159e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b252aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd91159e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b252aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:37418/0 (socket says 172.21.15.96:37418) 2024-09-14T10:45:29.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 learned_addr learned my addr 172.21.15.96:0/195330161 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b252b100 con 0x5637b25246f0 2024-09-14T10:45:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd91159e640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b252aba0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd9080517d0 tx=0x7fd908051760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd7e37fe640 1 -- 172.21.15.96:0/195330161 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd908043380 con 0x5637b25246f0 2024-09-14T10:45:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd7e37fe640 1 -- 172.21.15.96:0/195330161 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd908035070 con 0x5637b25246f0 2024-09-14T10:45:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637b252b390 con 0x5637b25246f0 2024-09-14T10:45:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd7e37fe640 1 -- 172.21.15.96:0/195330161 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd908019ba0 con 0x5637b25246f0 2024-09-14T10:45:29.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b252b390 con 0x5637b25246f0 2024-09-14T10:45:29.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd7e37fe640 1 -- 172.21.15.96:0/195330161 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd9080194e0 con 0x5637b25246f0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd7e37fe640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7dc03a150 0x7fd7dc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd7e37fe640 1 -- 172.21.15.96:0/195330161 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd90804a040 con 0x5637b25246f0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9125a0640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7dc03a150 0x7fd7dc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b2535fa0 0x5637b2538430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2538b80 con 0x5637b2535fa0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd911d9f640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b2535fa0 0x5637b2538430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd9125a0640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7dc03a150 0x7fd7dc03c610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5637b25076e0 tx=0x7fd90c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.914+0000 7fd911d9f640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b2535fa0 0x5637b2538430 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 realm 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2538f90 con 0x5637b2535fa0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2539860 con 0x5637b2535fa0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2539c00 con 0x5637b2535fa0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b253a450 con 0x5637b2535fa0 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 20 searching for the correct realm 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5637b253c1c0 0x5637b253e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd91159e640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5637b253c1c0 0x5637b253e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd91159e640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5637b253c1c0 0x5637b253e5b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd91159e640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd9080247a0 0x7fd908044840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd9080247a0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9125a0640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd9080247a0 0x7fd908044840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9125a0640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd9080247a0 0x7fd908044840 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c01f070 con 0x7fd9080247a0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9125a0640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd90c031040 0x7fd90c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd90c031040 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd911d9f640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd90c031040 0x7fd90c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.918+0000 7fd911d9f640 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd90c031040 0x7fd90c032940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b2535fa0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b2535fa0 2024-09-14T10:45:29.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd90c031040 2024-09-14T10:45:29.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd90c031040 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd9080247a0 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c01f070 con 0x7fd9080247a0 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b2535fa0 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd90c031040 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b2535fa0 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd9080247a0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd90c01f070 con 0x7fd9080247a0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.922+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd90c031040 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b2535fa0 2024-09-14T10:45:29.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b2535fa0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd90c031040 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd9080247a0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c01f070 con 0x7fd9080247a0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b2535fa0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd9080247a0 2024-09-14T10:45:29.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c01f070 con 0x7fd9080247a0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.926+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd90c031040 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd9080247a0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c01f070 con 0x7fd9080247a0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b253c1c0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd90c031040 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x5637b2535fa0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5637b253eb90 con 0x7fd9080247a0 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b253ae00 con 0x5637b2535fa0 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b253b1f0 con 0x5637b2535fa0 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b253b1f0 con 0x5637b2535fa0 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 zone default found 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 4 Realm: () 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 zonegroup default 2024-09-14T10:45:29.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b253b610 con 0x7fd9080247a0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2540b00 con 0x5637b253c1c0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2540fc0 con 0x5637b253c1c0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 started sync module instance, tier type = 2024-09-14T10:45:29.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:29.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.930+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b253fea0 con 0x7fd9080247a0 2024-09-14T10:45:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.934+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.934+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94797215040448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b253fea0 con 0x7fd9080247a0 2024-09-14T10:45:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.934+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2541aa0 con 0x5637b2535fa0 2024-09-14T10:45:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.934+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94797215040448] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.934+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.934+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94797215045008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b253fea0 con 0x5637b2535fa0 2024-09-14T10:45:29.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.934+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b25424b0 con 0x5637b253c1c0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.938+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94797215045008] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.938+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.938+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94797215037936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b253fe10 con 0x5637b253c1c0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.938+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b25431b0 con 0x7fd9080247a0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.938+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.938+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94797215051312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2543a50 con 0x7fd9080247a0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.938+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2544450 con 0x5637b2535fa0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.938+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94797215037936] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.942+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94797215051312] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.942+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.942+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94797215049808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b25435a0 con 0x5637b2535fa0 2024-09-14T10:45:29.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.942+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2544cf0 con 0x7fd90c031040 2024-09-14T10:45:29.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.942+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94797215049808] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.942+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.942+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94797215055712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b25435a0 con 0x7fd90c031040 2024-09-14T10:45:29.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.942+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b25451c0 con 0x7fd90c031040 2024-09-14T10:45:29.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94797215055712] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94797215059088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2545180 con 0x7fd90c031040 2024-09-14T10:45:29.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2545b80 con 0x7fd90c031040 2024-09-14T10:45:29.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94797215061648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2545fa0 con 0x7fd90c031040 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 20 add_watcher() i=0 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 20 add_watcher() i=1 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 20 add_watcher() i=2 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 20 add_watcher() i=3 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 20 add_watcher() i=4 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 20 add_watcher() i=5 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94797215059088] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.946+0000 7fd9142999c0 20 add_watcher() i=6 2024-09-14T10:45:29.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94797215061648] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 20 add_watcher() i=7 2024-09-14T10:45:29.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:29.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2544670 con 0x5637b2535fa0 2024-09-14T10:45:29.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94797215057520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b25464e0 con 0x5637b2535fa0 2024-09-14T10:45:29.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94797215057520] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd7c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 5 note: GC not initialized 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd7c27fc640 20 reqs_thread_entry: start 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 20 Filter name: none 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd733fff640 20 reqs_thread_entry: start 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.950+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b256c7a0 con 0x7fd90c031040 2024-09-14T10:45:29.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:45:29.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-14T10:45:29.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:45:29.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:45:29.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2570d80 con 0x7fd9080247a0 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94797215234848 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25719b0 con 0x7fd90c031040 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== watch-notify(notify (1) cookie 94797215055712 notify 146028888087 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7fd9040d9040 con 0x7fd90c031040 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd7f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94797215055712 notifier 4732 bl.length()=382 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd7f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd7f57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd7f57fa640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd7d4003eb0 con 0x7fd90c031040 2024-09-14T10:45:29.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(64 notify.5 [notify cookie 94797215234848 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== watch-notify(notify_complete (2) cookie 94797215234848 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5637b2500730 con 0x7fd90c031040 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571930 con 0x5637b2535fa0 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 : miss 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.954+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 8.3 8:c2bdefda:root::.bucket.meta.myfoo6%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b256f2e0 con 0x5637b2535fa0 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(67 .bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-14T10:45:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 info.flags=0x17 2024-09-14T10:45:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 to cache LRU end 2024-09-14T10:45:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:45:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:45:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 2024-09-14T10:45:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 8.3 8:c2bdefda:root::.bucket.meta.myfoo6%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b25789d0 con 0x5637b2535fa0 2024-09-14T10:45:29.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 .bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 info.flags=0x17 2024-09-14T10:45:29.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 to cache LRU end 2024-09-14T10:45:29.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:45:29.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9, ofs0, ns] 2024-09-14T10:45:29.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.9 7:93e5b521:::notify.7:head [notify cookie 94797215232592 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2572df0 con 0x7fd90c031040 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== watch-notify(notify (1) cookie 94797215061648 notify 146028888088 ret 0) ==== 798+0+0 (crc 0 0 0) 0x5637b256eae0 con 0x7fd90c031040 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(69 notify.7 [notify cookie 94797215232592 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd7f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94797215061648 notifier 4732 bl.length()=756 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd7f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 info.flags=0x17 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd7f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 to cache LRU end 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd7f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.958+0000 7fd7f4ff9640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd73c003540 con 0x7fd90c031040 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== watch-notify(notify_complete (2) cookie 94797215232592 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd9040fe040 con 0x7fd90c031040 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(70 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 20 handle_bi_update(): bucket=:myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]): orig_sources= new_sources= 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 20 handle_bi_update(): bucket=:myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]): potential sources added=[] removed=[] 2024-09-14T10:45:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 20 handle_bi_update(): bucket=:myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]): orig_dests= new_dests= 2024-09-14T10:45:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 20 handle_bi_update(): bucket=:myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]): potential dests added=[] removed=[] 2024-09-14T10:45:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b256f200 con 0x5637b2535fa0 2024-09-14T10:45:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(71 bud.buckets [call] v34'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b256f200 con 0x5637b2535fa0 2024-09-14T10:45:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(72 bud.buckets [call] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b256f200 con 0x5637b2535fa0 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.962+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94797215232512 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2573050 con 0x7fd9080247a0 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== watch-notify(notify (1) cookie 94797215051312 notify 146028888081 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7fd90c024850 con 0x7fd9080247a0 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94797215051312 notifier 4732 bl.length()=316 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f4ff9640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd73c003570 con 0x7fd9080247a0 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(74 notify.3 [notify cookie 94797215232512 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== watch-notify(notify_complete (2) cookie 94797215232512 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd90c024a20 con 0x7fd9080247a0 2024-09-14T10:45:29.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9142999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 : hit (requested=0x17, cached=0x17) 2024-09-14T10:45:29.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9142999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 2024-09-14T10:45:29.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 8.3 8:c2bdefda:root::.bucket.meta.myfoo6%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b25760a0 con 0x5637b2535fa0 2024-09-14T10:45:29.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(76 .bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9142999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 info.flags=0x17 2024-09-14T10:45:29.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9142999c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 to cache LRU end 2024-09-14T10:45:29.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9142999c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:45:29.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9142999c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9, ofs0, ns] 2024-09-14T10:45:29.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94797215232352 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2576760 con 0x7fd90c031040 2024-09-14T10:45:29.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== watch-notify(notify (1) cookie 94797215061648 notify 146028888089 ret 0) ==== 798+0+0 (crc 0 0 0) 0x5637b2570d20 con 0x7fd90c031040 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94797215061648 notifier 4732 bl.length()=756 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(77 notify.7 [notify cookie 94797215232352 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 info.flags=0x17 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 to cache LRU end 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.966+0000 7fd7f57fa640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd7d4003eb0 con 0x7fd90c031040 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== watch-notify(notify_complete (2) cookie 94797215232352 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd9040fe040 con 0x7fd90c031040 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 20 handle_bi_update(): bucket=:myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]): orig_sources= new_sources= 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 20 handle_bi_update(): bucket=:myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]): potential sources added=[] removed=[] 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 20 handle_bi_update(): bucket=:myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]): orig_dests= new_dests= 2024-09-14T10:45:29.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 20 handle_bi_update(): bucket=:myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]): potential dests added=[] removed=[] 2024-09-14T10:45:29.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:79 4.26 4:65065dde:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2576740 con 0x7fd90c031040 2024-09-14T10:45:29.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(79 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 4.c 4:3019b81f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2576740 con 0x5637b2535fa0 2024-09-14T10:45:29.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(80 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:81 4.3b 4:dedad413:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2576740 con 0x5637b253c1c0 2024-09-14T10:45:29.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(81 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:82 4.7 4:e131a36b:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x7fd90c031040 2024-09-14T10:45:29.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(82 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.970+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:83 4.21 4:84ac6dda:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x7fd90c031040 2024-09-14T10:45:29.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(83 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:84 4.e 4:70a44412:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x7fd9080247a0 2024-09-14T10:45:29.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(84 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:85 4.3d 4:bfde325a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x7fd9080247a0 2024-09-14T10:45:29.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(85 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:86 4.2c 4:35b9f0c3:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x5637b2535fa0 2024-09-14T10:45:29.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(86 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:87 4.37 4:ef6efac0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x7fd90c031040 2024-09-14T10:45:29.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(87 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:88 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x7fd9080247a0 2024-09-14T10:45:29.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(88 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [call out=381b] v0'0 uv9 ondisk = 0) ==== 194+0+381 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 10 cls_bucket_list_unordered: got thirteen 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:89 4.19 4:9aecc622:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x7fd9080247a0 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(89 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 get_obj_state: octx=0x7fd9040a9df0 obj=myfoo6:thirteen state=0x5637b2571f58 s->prefetch_data=0 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:90 3.2es0 3:74e68bcb:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b25771b0 con 0x7fd9080247a0 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(90 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9_thirteen [call out=24b,getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 280+0+894 (crc 0 0 0) 0x7fd90c040040 con 0x7fd9080247a0 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 10 manifest: total_size = 8 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 get_obj_state: setting s->obj_tag to 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9728444946924900735 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 Read xattr rgw_rados: user.rgw.acl 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 Read xattr rgw_rados: user.rgw.etag 2024-09-14T10:45:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 get_obj_state: octx=0x7fd9040a9df0 obj=myfoo6:thirteen state=0x5637b2571f58 s->prefetch_data=0 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 : hit (requested=0x17, cached=0x17) 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 2024-09-14T10:45:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.974+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:91 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b257c120 con 0x7fd9080247a0 2024-09-14T10:45:29.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.978+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(91 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd90c04d040 con 0x7fd9080247a0 2024-09-14T10:45:29.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.978+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:92 3.2es0 3:74e68bcb:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b257a5b0 con 0x7fd9080247a0 2024-09-14T10:45:29.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.978+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(92 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fd90c04d040 con 0x7fd9080247a0 2024-09-14T10:45:29.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.978+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b257bba0 con 0x7fd9080247a0 2024-09-14T10:45:29.979 INFO:teuthology.orchestra.run.smithi096.stderr:1 objects processed in :myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9]). Next marker thirteen 2024-09-14T10:45:29.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.978+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd9080247a0 2024-09-14T10:45:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(93 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fd90c04d040 con 0x7fd9080247a0 2024-09-14T10:45:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd7f57fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-14T10:45:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd90c04d040 con 0x7fd9080247a0 2024-09-14T10:45:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-14T10:45:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:45:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-14T10:45:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94797215278448 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd90c031040 2024-09-14T10:45:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== watch-notify(notify (1) cookie 94797215055712 notify 146028888090 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7fd9040fe040 con 0x7fd90c031040 2024-09-14T10:45:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd7f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94797215055712 notifier 4732 bl.length()=556 2024-09-14T10:45:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd7f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-14T10:45:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd7f4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:45:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd7f4ff9640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd73c0030a0 con 0x7fd90c031040 2024-09-14T10:45:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== osd_op_reply(95 notify.5 [notify cookie 94797215278448 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== watch-notify(notify_complete (2) cookie 94797215278448 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5637b2500730 con 0x7fd90c031040 2024-09-14T10:45:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x5637b2535fa0 2024-09-14T10:45:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T10:45:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:45:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T10:45:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.982+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94797215278448 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd90c031040 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== watch-notify(notify (1) cookie 94797215055712 notify 146028888091 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5637b2500730 con 0x7fd90c031040 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd7f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94797215055712 notifier 4732 bl.length()=177 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd7f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd7f57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd7f57fa640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd7d4003eb0 con 0x7fd90c031040 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== osd_op_reply(98 notify.5 [notify cookie 94797215278448 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== watch-notify(notify_complete (2) cookie 94797215278448 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5637b24ffd80 con 0x7fd90c031040 2024-09-14T10:45:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd9142999c0 10 removing user index: bar 2024-09-14T10:45:29.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd90c031040 2024-09-14T10:45:29.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 40 ==== osd_op_reply(100 bar [delete] v34'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd9142999c0 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-14T10:45:29.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd9142999c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-14T10:45:29.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94797215278448 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd90c031040 2024-09-14T10:45:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 41 ==== watch-notify(notify (1) cookie 94797215061648 notify 146028888092 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5637b24ffd80 con 0x7fd90c031040 2024-09-14T10:45:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd7f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94797215061648 notifier 4732 bl.length()=152 2024-09-14T10:45:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd7f4ff9640 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd73c0030a0 con 0x7fd90c031040 2024-09-14T10:45:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 42 ==== osd_op_reply(101 notify.7 [notify cookie 94797215278448 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.986+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 43 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:29.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 44 ==== watch-notify(notify_complete (2) cookie 94797215278448 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5637b24ffaf0 con 0x7fd90c031040 2024-09-14T10:45:29.988 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-14T10:45:29.775594Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:45:29.775582Z","tags":[],"group_ids":[]} 2024-09-14T10:45:29.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd7c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:29.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94797215057520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x5637b2535fa0 2024-09-14T10:45:29.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94797215057520] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94797215040448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd9080247a0 2024-09-14T10:45:29.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94797215040448] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c04d040 con 0x7fd9080247a0 2024-09-14T10:45:29.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd9142999c0 20 remove_watcher() i=0 2024-09-14T10:45:29.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd9142999c0 2 removed watcher, disabling cache 2024-09-14T10:45:29.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.990+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94797215045008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x5637b2535fa0 2024-09-14T10:45:29.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.994+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94797215045008] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.994+0000 7fd9142999c0 20 remove_watcher() i=1 2024-09-14T10:45:29.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.994+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94797215037936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x5637b253c1c0 2024-09-14T10:45:29.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.994+0000 7fd91159e640 1 -- 172.21.15.96:0/195330161 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94797215037936] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90801b7a0 con 0x5637b253c1c0 2024-09-14T10:45:29.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.994+0000 7fd9142999c0 20 remove_watcher() i=2 2024-09-14T10:45:29.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.994+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94797215051312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd9080247a0 2024-09-14T10:45:29.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.998+0000 7fd9125a0640 1 -- 172.21.15.96:0/195330161 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94797215051312] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd90c04d040 con 0x7fd9080247a0 2024-09-14T10:45:29.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.998+0000 7fd9142999c0 20 remove_watcher() i=3 2024-09-14T10:45:29.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.998+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94797215049808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x5637b2535fa0 2024-09-14T10:45:29.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.998+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94797215049808] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x5637b2535fa0 2024-09-14T10:45:29.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.998+0000 7fd9142999c0 20 remove_watcher() i=4 2024-09-14T10:45:29.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:29.998+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94797215055712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd90c031040 2024-09-14T10:45:30.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.002+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 45 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94797215055712] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:30.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.002+0000 7fd9142999c0 20 remove_watcher() i=5 2024-09-14T10:45:30.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.002+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94797215059088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd90c031040 2024-09-14T10:45:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.002+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 46 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94797215059088] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.002+0000 7fd9142999c0 20 remove_watcher() i=6 2024-09-14T10:45:30.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.002+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94797215061648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5637b2571380 con 0x7fd90c031040 2024-09-14T10:45:30.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 <== osd.0 v2:172.21.15.70:6800/3481052616 47 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94797215061648] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9040b2040 con 0x7fd90c031040 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 20 remove_watcher() i=7 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd90c031040 msgr2=0x7fd90c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd90c031040 0x7fd90c032940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b2535fa0 msgr2=0x5637b2538430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b2535fa0 0x5637b2538430 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd9080247a0 msgr2=0x7fd908044840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd9080247a0 0x7fd908044840 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5637b253c1c0 msgr2=0x5637b253e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5637b253c1c0 0x5637b253e5b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7dc03a150 msgr2=0x7fd7dc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7dc03a150 0x7fd7dc03c610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5637b25076e0 tx=0x7fd90c01f000 comp rx=0 tx=0).stop 2024-09-14T10:45:30.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd911d9f640 1 -- 172.21.15.96:0/195330161 reap_dead start 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 msgr2=0x5637b252aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b252aba0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd9080517d0 tx=0x7fd908051760 comp rx=0 tx=0).stop 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 shutdown_connections 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/195330161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b25246f0 0x5637b252aba0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 >> 172.21.15.96:0/195330161 conn(0x5637b251fb10 msgr2=0x5637b251dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 shutdown_connections 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/195330161 wait complete. 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/1007906902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7ec03a1a0 msgr2=0x7fd7ec03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/1007906902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7ec03a1a0 0x7fd7ec03c660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5637b2507f60 tx=0x7fd90c005850 comp rx=0 tx=0).stop 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/1007906902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b2516d80 msgr2=0x5637b25171a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/1007906902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b2516d80 0x5637b25171a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd90800d660 tx=0x7fd90800da60 comp rx=0 tx=0).stop 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/1007906902 shutdown_connections 2024-09-14T10:45:30.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/1007906902 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7ec03a1a0 0x7fd7ec03c660 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/1007906902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b2516d80 0x5637b25171a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/1007906902 >> 172.21.15.96:0/1007906902 conn(0x5637b250c730 msgr2=0x5637b250cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/1007906902 shutdown_connections 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/1007906902 wait complete. 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b237cb50 msgr2=0x5637b2506700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b237cb50 0x5637b2506700 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7f803a150 msgr2=0x7fd7f803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7f803a150 0x7fd7f803c610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd908001d80 tx=0x7fd9080012e0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 msgr2=0x5637b24ff590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24ff590 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd90401bb20 tx=0x7fd904018020 comp rx=0 tx=0).stop 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 shutdown_connections 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5637b237cb50 0x5637b2506700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd7f803a150 0x7fd7f803c610 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 --2- 172.21.15.96:0/2789458131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637b237b550 0x5637b24ff590 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 >> 172.21.15.96:0/2789458131 conn(0x5637b2401b30 msgr2=0x5637b24f2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 shutdown_connections 2024-09-14T10:45:30.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:30.006+0000 7fd9142999c0 1 -- 172.21.15.96:0/2789458131 wait complete. 2024-09-14T10:45:30.016 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-14T10:45:29.775594Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:45:29.775582Z', 'tags': [], 'group_ids': []} 2024-09-14T10:45:35.028 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:45:35.028 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-14T10:45:35.028 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-14T10:45:35.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-14T10:45:35.028 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-14T10:45:35.078 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:35.078 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:35.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39bb23c9c0 1 Processor -- start 2024-09-14T10:45:35.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39bb23c9c0 1 -- start start 2024-09-14T10:45:35.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39bb23c9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562e098bf840 0x562e098be410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39bb23c9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e097f17a0 con 0x562e098bf310 2024-09-14T10:45:35.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39bb23c9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x562e0984d1b0 con 0x562e098bf840 2024-09-14T10:45:35.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39b8541640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562e098bf840 0x562e098be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39b8541640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562e098bf840 0x562e098be410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41752/0 (socket says 172.21.15.96:41752) 2024-09-14T10:45:35.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39b8d42640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x562e098bf310 0x562e098bdd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:49232/0 (socket says 172.21.15.96:49232) 2024-09-14T10:45:35.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.078+0000 7f39b8541640 1 -- 172.21.15.96:0/2519504604 learned_addr learned my addr 172.21.15.96:0/2519504604 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39b8541640 1 -- 172.21.15.96:0/2519504604 >> v1:172.21.15.70:6789/0 conn(0x562e098bf310 legacy=0x562e098bdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39b8541640 1 -- 172.21.15.96:0/2519504604 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e097cbda0 con 0x562e098bf840 2024-09-14T10:45:35.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39b8541640 1 --2- 172.21.15.96:0/2519504604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf840 0x562e098be410 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00a5c0 tx=0x7f39ac01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2b75bd8bd36438 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39b7d40640 1 -- 172.21.15.96:0/2519504604 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0b0070 con 0x562e098bf840 2024-09-14T10:45:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39b7d40640 1 -- 172.21.15.96:0/2519504604 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac0ab540 con 0x562e098bf840 2024-09-14T10:45:35.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39b7d40640 1 -- 172.21.15.96:0/2519504604 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0ab840 con 0x562e098bf840 2024-09-14T10:45:35.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2519504604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf840 msgr2=0x562e098be410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2519504604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf840 0x562e098be410 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00a5c0 tx=0x7f39ac01b280 comp rx=0 tx=0).stop 2024-09-14T10:45:35.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2519504604 shutdown_connections 2024-09-14T10:45:35.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2519504604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf840 0x562e098be410 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2519504604 >> 172.21.15.96:0/2519504604 conn(0x562e09944b30 msgr2=0x562e09946f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2519504604 shutdown_connections 2024-09-14T10:45:35.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.082+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2519504604 wait complete. 2024-09-14T10:45:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.098+0000 7f39bb23c9c0 1 Processor -- start 2024-09-14T10:45:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.098+0000 7f39bb23c9c0 1 -- start start 2024-09-14T10:45:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.098+0000 7f39bb23c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a3b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.098+0000 7f39bb23c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e09850fc0 con 0x562e098bf310 2024-09-14T10:45:35.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.098+0000 7f39b8d42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a3b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.098+0000 7f39b8d42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a3b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41754/0 (socket says 172.21.15.96:41754) 2024-09-14T10:45:35.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.098+0000 7f39b8d42640 1 -- 172.21.15.96:0/1417085349 learned_addr learned my addr 172.21.15.96:0/1417085349 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39b8d42640 1 -- 172.21.15.96:0/1417085349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e09a3b770 con 0x562e098bf310 2024-09-14T10:45:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39b8d42640 1 --2- 172.21.15.96:0/1417085349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a3b180 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f39a8001ec0 tx=0x7f39a800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac3a20b787968fd server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f38a6e0d640 1 -- 172.21.15.96:0/1417085349 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39a800e5d0 con 0x562e098bf310 2024-09-14T10:45:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f38a6e0d640 1 -- 172.21.15.96:0/1417085349 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a800e770 con 0x562e098bf310 2024-09-14T10:45:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f38a6e0d640 1 -- 172.21.15.96:0/1417085349 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39a800ea70 con 0x562e098bf310 2024-09-14T10:45:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1417085349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 msgr2=0x562e09a3b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/1417085349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a3b180 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f39a8001ec0 tx=0x7f39a800b6d0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1417085349 shutdown_connections 2024-09-14T10:45:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/1417085349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a3b180 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1417085349 >> 172.21.15.96:0/1417085349 conn(0x562e09944b30 msgr2=0x562e09a36d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1417085349 shutdown_connections 2024-09-14T10:45:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1417085349 wait complete. 2024-09-14T10:45:35.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 Processor -- start 2024-09-14T10:45:35.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- start start 2024-09-14T10:45:35.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a42a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e097f2a50 con 0x562e098bf310 2024-09-14T10:45:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39b8d42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a42a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39b8d42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a42a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41766/0 (socket says 172.21.15.96:41766) 2024-09-14T10:45:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39b8d42640 1 -- 172.21.15.96:0/2524096832 learned_addr learned my addr 172.21.15.96:0/2524096832 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39b8d42640 1 -- 172.21.15.96:0/2524096832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e09a42f80 con 0x562e098bf310 2024-09-14T10:45:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39b8d42640 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a42a20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x562e09a3c140 tx=0x7f39a8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f38a560a640 1 -- 172.21.15.96:0/2524096832 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39a800f8e0 con 0x562e098bf310 2024-09-14T10:45:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e09a43210 con 0x562e098bf310 2024-09-14T10:45:35.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f38a560a640 1 -- 172.21.15.96:0/2524096832 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a800fa80 con 0x562e098bf310 2024-09-14T10:45:35.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f38a560a640 1 -- 172.21.15.96:0/2524096832 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39a800fda0 con 0x562e098bf310 2024-09-14T10:45:35.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.102+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e09a43bc0 con 0x562e098bf310 2024-09-14T10:45:35.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f38a560a640 1 -- 172.21.15.96:0/2524096832 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f39a8017070 con 0x562e098bf310 2024-09-14T10:45:35.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f38a560a640 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38a003a1a0 0x7f38a003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f38a560a640 1 -- 172.21.15.96:0/2524096832 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39a8015020 con 0x562e098bf310 2024-09-14T10:45:35.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b8541640 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38a003a1a0 0x7f38a003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e098bf840 0x562e09a49b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a4a0d0 con 0x562e098bf840 2024-09-14T10:45:35.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b9543640 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e098bf840 0x562e09a49b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b9543640 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e098bf840 0x562e09a49b90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b8541640 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38a003a1a0 0x7f38a003c660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0ad000 tx=0x7f39ac0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b9543640 1 -- 172.21.15.96:0/2524096832 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39b000a4d0 con 0x562e098bf840 2024-09-14T10:45:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a43f20 con 0x562e098bf840 2024-09-14T10:45:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b9543640 1 -- 172.21.15.96:0/2524096832 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39b000a4d0 con 0x562e098bf840 2024-09-14T10:45:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a4beb0 con 0x562e098bf840 2024-09-14T10:45:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b9543640 1 -- 172.21.15.96:0/2524096832 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39b000a4d0 con 0x562e098bf840 2024-09-14T10:45:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a4b110 con 0x562e098bf840 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b9543640 1 -- 172.21.15.96:0/2524096832 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39b000a4d0 con 0x562e098bf840 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a4b560 con 0x562e098bf840 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.106+0000 7f39b9543640 1 -- 172.21.15.96:0/2524096832 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f39b000a4d0 con 0x562e098bf840 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39bb23c9c0 1 Processor -- start 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39bb23c9c0 1 -- start start 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39bb23c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a5a1f0 0x562e09a5a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39bb23c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e0985dd80 con 0x562e09a5a1f0 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39b8541640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a5a1f0 0x562e09a5a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39b8541640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a5a1f0 0x562e09a5a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41776/0 (socket says 172.21.15.96:41776) 2024-09-14T10:45:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39b8541640 1 -- 172.21.15.96:0/1418934412 learned_addr learned my addr 172.21.15.96:0/1418934412 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39b8541640 1 -- 172.21.15.96:0/1418934412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e09a5ac50 con 0x562e09a5a1f0 2024-09-14T10:45:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39b8541640 1 --2- 172.21.15.96:0/1418934412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a5a1f0 0x562e09a5a610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f39ac01b2c0 tx=0x7f39ac018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f389e7fc640 1 -- 172.21.15.96:0/1418934412 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0b0040 con 0x562e09a5a1f0 2024-09-14T10:45:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1418934412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e09a5b4b0 con 0x562e09a5a1f0 2024-09-14T10:45:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f389e7fc640 1 -- 172.21.15.96:0/1418934412 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac0c6070 con 0x562e09a5a1f0 2024-09-14T10:45:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f389e7fc640 1 -- 172.21.15.96:0/1418934412 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0abde0 con 0x562e09a5a1f0 2024-09-14T10:45:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1418934412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e09a5b9c0 con 0x562e09a5a1f0 2024-09-14T10:45:35.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f389e7fc640 1 -- 172.21.15.96:0/1418934412 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f39ac0cb460 con 0x562e09a5a1f0 2024-09-14T10:45:35.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f389e7fc640 1 --2- 172.21.15.96:0/1418934412 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f389003a150 0x7f389003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f389e7fc640 1 -- 172.21.15.96:0/1418934412 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39ac0a8070 con 0x562e09a5a1f0 2024-09-14T10:45:35.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.110+0000 7f39b9543640 1 --2- 172.21.15.96:0/1418934412 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f389003a150 0x7f389003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 Processor -- start 2024-09-14T10:45:35.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- start start 2024-09-14T10:45:35.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b9543640 1 --2- 172.21.15.96:0/1418934412 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f389003a150 0x7f389003c610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562e09a4ac30 tx=0x7f39b0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a67e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e09a3bba0 con 0x562e09a67a40 2024-09-14T10:45:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a67e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a67e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41784/0 (socket says 172.21.15.96:41784) 2024-09-14T10:45:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 -- 172.21.15.96:0/44946995 learned_addr learned my addr 172.21.15.96:0/44946995 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 -- 172.21.15.96:0/44946995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e09a68430 con 0x562e09a67a40 2024-09-14T10:45:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 --2- 172.21.15.96:0/44946995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a67e40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0b7040 tx=0x7f39ac0b5ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fd06c79f9d6bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f388ffff640 1 -- 172.21.15.96:0/44946995 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0cbc70 con 0x562e09a67a40 2024-09-14T10:45:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f388ffff640 1 -- 172.21.15.96:0/44946995 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac0cab20 con 0x562e09a67a40 2024-09-14T10:45:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f388ffff640 1 -- 172.21.15.96:0/44946995 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0cbe10 con 0x562e09a67a40 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/44946995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 msgr2=0x562e09a67e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/44946995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a67e40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0b7040 tx=0x7f39ac0b5ab0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/44946995 shutdown_connections 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/44946995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a67e40 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/44946995 >> 172.21.15.96:0/44946995 conn(0x562e09a62e60 msgr2=0x562e09a610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/44946995 shutdown_connections 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/44946995 wait complete. 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 Processor -- start 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- start start 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a6dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39bb23c9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e09a66990 con 0x562e09a67a40 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a6dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a6dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41792/0 (socket says 172.21.15.96:41792) 2024-09-14T10:45:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 learned_addr learned my addr 172.21.15.96:0/2373058807 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.114+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e09a6e530 con 0x562e09a67a40 2024-09-14T10:45:35.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b8541640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a6dfd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0cd030 tx=0x7f39ac0ebd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f388e7fc640 1 -- 172.21.15.96:0/2373058807 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0e5070 con 0x562e09a67a40 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e09a6e7c0 con 0x562e09a67a40 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e09a6f170 con 0x562e09a67a40 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f388e7fc640 1 -- 172.21.15.96:0/2373058807 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac006a50 con 0x562e09a67a40 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f388e7fc640 1 -- 172.21.15.96:0/2373058807 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ac0f2060 con 0x562e09a67a40 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f388e7fc640 1 -- 172.21.15.96:0/2373058807 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f39ac006d30 con 0x562e09a67a40 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f388e7fc640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f388403a150 0x7f388403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f388e7fc640 1 -- 172.21.15.96:0/2373058807 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39ac0dc030 con 0x562e09a67a40 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b9543640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f388403a150 0x7f388403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e09a795a0 0x562e09a7ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a7c180 con 0x562e09a795a0 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b8d42640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e09a795a0 0x562e09a7ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b9543640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f388403a150 0x7f388403c610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x562e09a43e70 tx=0x7f39b001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b8d42640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e09a795a0 0x562e09a7ba30 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39a802e070 con 0x562e09a795a0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 realm 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a7c590 con 0x562e09a795a0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39a802e070 con 0x562e09a795a0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a7ce60 con 0x562e09a795a0 2024-09-14T10:45:35.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39a802e070 con 0x562e09a795a0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a7d200 con 0x562e09a795a0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39a802e070 con 0x562e09a795a0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.118+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a7da50 con 0x562e09a795a0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39a802e070 con 0x562e09a795a0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39bb23c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39bb23c9c0 20 searching for the correct realm 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e09a7f7c0 0x562e09a81bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8541640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e09a7f7c0 0x562e09a81bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8541640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e09a7f7c0 0x562e09a81bb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8541640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39ac0ab030 0x7f39ac006390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39ac0ab030 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b9543640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39ac0ab030 0x7f39ac006390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b9543640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39ac0ab030 0x7f39ac006390 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39b001f070 con 0x7f39ac0ab030 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b9543640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39b0031040 0x7f39b0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39b0031040 2024-09-14T10:45:35.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8d42640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39b0031040 0x7f39b0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8d42640 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39b0031040 0x7f39b0032430 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a802e070 con 0x7f39b0031040 2024-09-14T10:45:35.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a795a0 2024-09-14T10:45:35.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a802e070 con 0x562e09a795a0 2024-09-14T10:45:35.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.122+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a795a0 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39b0031040 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39b0031040 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39ac0ab030 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39b001f070 con 0x7f39ac0ab030 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a795a0 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39b0031040 2024-09-14T10:45:35.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a795a0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39ac0ab030 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f39b001f070 con 0x7f39ac0ab030 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.126+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39b0031040 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a795a0 2024-09-14T10:45:35.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a795a0 2024-09-14T10:45:35.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39b0031040 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39ac0ab030 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39b001f070 con 0x7f39ac0ab030 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a795a0 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39ac0ab030 2024-09-14T10:45:35.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39b001f070 con 0x7f39ac0ab030 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.130+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39b0031040 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39ac0ab030 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39b001f070 con 0x7f39ac0ab030 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a7f7c0 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39b0031040 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x562e09a795a0 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e09a82140 con 0x7f39ac0ab030 2024-09-14T10:45:35.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39b0040040 con 0x7f39ac0ab030 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a7e400 con 0x562e09a795a0 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a7eca0 con 0x562e09a795a0 2024-09-14T10:45:35.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a7eca0 con 0x562e09a795a0 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 zone default found 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 4 Realm: () 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 zonegroup default 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a825a0 con 0x7f39ac0ab030 2024-09-14T10:45:35.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f39b0040040 con 0x7f39ac0ab030 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a847e0 con 0x562e09a7f7c0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.134+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a84b80 con 0x562e09a7f7c0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39bb23c9c0 20 started sync module instance, tier type = 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39bb23c9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:35.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a83c20 con 0x7f39ac0ab030 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39b0040040 con 0x7f39ac0ab030 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94755730506064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a83c20 con 0x7f39ac0ab030 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a85410 con 0x562e09a795a0 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94755730506064] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39b0040040 con 0x7f39ac0ab030 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94755730509600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a83c20 con 0x562e09a795a0 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.138+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a85e50 con 0x562e09a7f7c0 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.142+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94755730509600] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.142+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.142+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94755730503536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a83b90 con 0x562e09a7f7c0 2024-09-14T10:45:35.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.142+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a86b50 con 0x7f39ac0ab030 2024-09-14T10:45:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.142+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39b0040040 con 0x7f39ac0ab030 2024-09-14T10:45:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.142+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94755730515920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a873f0 con 0x7f39ac0ab030 2024-09-14T10:45:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.142+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a87db0 con 0x562e09a795a0 2024-09-14T10:45:35.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.146+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94755730503536] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.146+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94755730515920] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39b0040040 con 0x7f39ac0ab030 2024-09-14T10:45:35.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.146+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.146+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94755730517824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a87db0 con 0x562e09a795a0 2024-09-14T10:45:35.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.146+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a87360 con 0x7f39b0031040 2024-09-14T10:45:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.146+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94755730517824] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.146+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.146+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94755730520320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a881d0 con 0x7f39b0031040 2024-09-14T10:45:35.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.150+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a88ac0 con 0x7f39b0031040 2024-09-14T10:45:35.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.150+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94755730520320] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.150+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.150+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94755730521376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a88ca0 con 0x7f39b0031040 2024-09-14T10:45:35.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.150+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a894f0 con 0x7f39b0031040 2024-09-14T10:45:35.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.150+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94755730521376] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94755730525344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a89570 con 0x7f39b0031040 2024-09-14T10:45:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 20 add_watcher() i=0 2024-09-14T10:45:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 20 add_watcher() i=1 2024-09-14T10:45:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 20 add_watcher() i=2 2024-09-14T10:45:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 20 add_watcher() i=3 2024-09-14T10:45:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 20 add_watcher() i=4 2024-09-14T10:45:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 20 add_watcher() i=5 2024-09-14T10:45:35.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 20 add_watcher() i=6 2024-09-14T10:45:35.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94755730525344] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 20 add_watcher() i=7 2024-09-14T10:45:35.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:35.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09a8c890 con 0x562e09a795a0 2024-09-14T10:45:35.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94755730526768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a89b00 con 0x562e09a795a0 2024-09-14T10:45:35.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94755730526768] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.154+0000 7f386efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 5 note: GC not initialized 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f386dfe3640 20 reqs_thread_entry: start 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 20 Filter name: none 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f37df7fe640 20 reqs_thread_entry: start 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09ab0210 con 0x7f39b0031040 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09aae750 con 0x7f39b0031040 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-14T10:45:35.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:45:35.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:45:35.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:45:35.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.158+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09aaf2f0 con 0x7f39b0031040 2024-09-14T10:45:35.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39bb23c9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-14T10:45:35.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39bb23c9c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:45:35.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39bb23c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-14T10:45:35.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94755730681152 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09ab3cf0 con 0x7f39b0031040 2024-09-14T10:45:35.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== watch-notify(notify (1) cookie 94755730520320 notify 146028888093 ret 0) ==== 598+0+0 (crc 0 0 0) 0x562e09aaeb70 con 0x7f39b0031040 2024-09-14T10:45:35.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f388ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94755730520320 notifier 4739 bl.length()=556 2024-09-14T10:45:35.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f388ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-14T10:45:35.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f388ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:45:35.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f388ffff640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f387c003eb0 con 0x7f39b0031040 2024-09-14T10:45:35.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(65 notify.5 [notify cookie 94755730681152 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== watch-notify(notify_complete (2) cookie 94755730681152 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e09a43bc0 con 0x7f39b0031040 2024-09-14T10:45:35.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.162+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09aaed40 con 0x7f39b0031040 2024-09-14T10:45:35.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39bb23c9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:45:35.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39bb23c9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:45:35.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39bb23c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:45:35.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94755730681152 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e09ab3cf0 con 0x562e09a7f7c0 2024-09-14T10:45:35.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== watch-notify(notify (1) cookie 94755730503536 notify 146028888070 ret 0) ==== 219+0+0 (crc 0 0 0) 0x562e09a6e7c0 con 0x562e09a7f7c0 2024-09-14T10:45:35.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f388f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94755730503536 notifier 4739 bl.length()=177 2024-09-14T10:45:35.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f388f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:45:35.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f388f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:45:35.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(68 notify.2 [notify cookie 94755730681152 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f388f7fe640 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f37ec003410 con 0x562e09a7f7c0 2024-09-14T10:45:35.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== watch-notify(notify_complete (2) cookie 94755730681152 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e09a6e530 con 0x562e09a7f7c0 2024-09-14T10:45:35.167 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:45:35.162843Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:45:35.162831Z","tags":[],"group_ids":[]} 2024-09-14T10:45:35.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f386efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:35.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.166+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94755730526768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09aadd50 con 0x562e09a795a0 2024-09-14T10:45:35.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94755730526768] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94755730506064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09aadd50 con 0x7f39ac0ab030 2024-09-14T10:45:35.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94755730506064] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39b0040040 con 0x7f39ac0ab030 2024-09-14T10:45:35.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39bb23c9c0 20 remove_watcher() i=0 2024-09-14T10:45:35.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39bb23c9c0 2 removed watcher, disabling cache 2024-09-14T10:45:35.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94755730509600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a84150 con 0x562e09a795a0 2024-09-14T10:45:35.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94755730509600] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39bb23c9c0 20 remove_watcher() i=1 2024-09-14T10:45:35.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.170+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94755730503536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09aadd50 con 0x562e09a7f7c0 2024-09-14T10:45:35.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.174+0000 7f39b8541640 1 -- 172.21.15.96:0/2373058807 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94755730503536] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ac0b3040 con 0x562e09a7f7c0 2024-09-14T10:45:35.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.174+0000 7f39bb23c9c0 20 remove_watcher() i=2 2024-09-14T10:45:35.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.174+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94755730515920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a84f20 con 0x7f39ac0ab030 2024-09-14T10:45:35.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.174+0000 7f39b9543640 1 -- 172.21.15.96:0/2373058807 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94755730515920] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39b0040040 con 0x7f39ac0ab030 2024-09-14T10:45:35.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.174+0000 7f39bb23c9c0 20 remove_watcher() i=3 2024-09-14T10:45:35.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.174+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94755730517824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a83770 con 0x562e09a795a0 2024-09-14T10:45:35.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.178+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94755730517824] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x562e09a795a0 2024-09-14T10:45:35.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.178+0000 7f39bb23c9c0 20 remove_watcher() i=4 2024-09-14T10:45:35.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.178+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94755730520320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09aadd50 con 0x7f39b0031040 2024-09-14T10:45:35.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.178+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94755730520320] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.178+0000 7f39bb23c9c0 20 remove_watcher() i=5 2024-09-14T10:45:35.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.178+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94755730521376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a84f20 con 0x7f39b0031040 2024-09-14T10:45:35.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94755730521376] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 20 remove_watcher() i=6 2024-09-14T10:45:35.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94755730525344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e09a86f40 con 0x7f39b0031040 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94755730525344] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39a803d040 con 0x7f39b0031040 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 20 remove_watcher() i=7 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39b0031040 msgr2=0x7f39b0032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f39b0031040 0x7f39b0032430 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e09a795a0 msgr2=0x562e09a7ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e09a795a0 0x562e09a7ba30 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39ac0ab030 msgr2=0x7f39ac006390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f39ac0ab030 0x7f39ac006390 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e09a7f7c0 msgr2=0x562e09a81bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562e09a7f7c0 0x562e09a81bb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f388403a150 msgr2=0x7f388403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f388403a150 0x7f388403c610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x562e09a43e70 tx=0x7f39b001f000 comp rx=0 tx=0).stop 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 msgr2=0x562e09a6dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2373058807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a67a40 0x562e09a6dfd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0cd030 tx=0x7f39ac0ebd40 comp rx=0 tx=0).stop 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 reap_dead start 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39b8d42640 1 -- 172.21.15.96:0/2373058807 reap_dead start 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 shutdown_connections 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 >> 172.21.15.96:0/2373058807 conn(0x562e09a62e60 msgr2=0x562e09a61070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 shutdown_connections 2024-09-14T10:45:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.182+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2373058807 wait complete. 2024-09-14T10:45:35.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1418934412 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f389003a150 msgr2=0x7f389003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/1418934412 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f389003a150 0x7f389003c610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562e09a4ac30 tx=0x7f39b0005850 comp rx=0 tx=0).stop 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1418934412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a5a1f0 msgr2=0x562e09a5a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/1418934412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a5a1f0 0x562e09a5a610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f39ac01b2c0 tx=0x7f39ac018020 comp rx=0 tx=0).stop 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1418934412 shutdown_connections 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/1418934412 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f389003a150 0x7f389003c610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/1418934412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e09a5a1f0 0x562e09a5a610 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1418934412 >> 172.21.15.96:0/1418934412 conn(0x562e09a4fba0 msgr2=0x562e09a4ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1418934412 shutdown_connections 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/1418934412 wait complete. 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e098bf840 msgr2=0x562e09a49b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e098bf840 0x562e09a49b90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38a003a1a0 msgr2=0x7f38a003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38a003a1a0 0x7f38a003c660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0ad000 tx=0x7f39ac0a5040 comp rx=0 tx=0).stop 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 msgr2=0x562e09a42a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a42a20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x562e09a3c140 tx=0x7f39a8000bd0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 shutdown_connections 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562e098bf840 0x562e09a49b90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f38a003a1a0 0x7f38a003c660 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 --2- 172.21.15.96:0/2524096832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e098bf310 0x562e09a42a20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 >> 172.21.15.96:0/2524096832 conn(0x562e09944b30 msgr2=0x562e09a3c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 shutdown_connections 2024-09-14T10:45:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.186+0000 7f39bb23c9c0 1 -- 172.21.15.96:0/2524096832 wait complete. 2024-09-14T10:45:35.196 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:45:35.162843Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:45:35.162831Z', 'tags': [], 'group_ids': []} 2024-09-14T10:45:35.213 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:45:35.219 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-14T10:45:35.219 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-14T10:45:35.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-14T10:45:35.220 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-14T10:45:35.253 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:35.253 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:35.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041c1469c0 1 Processor -- start 2024-09-14T10:45:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041c1469c0 1 -- start start 2024-09-14T10:45:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041c1469c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e632ead640 0x55e632f417c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041c1469c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e632de17a0 con 0x55e632ead260 2024-09-14T10:45:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041c1469c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55e632e3d1b0 con 0x55e632ead640 2024-09-14T10:45:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041944b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e632ead640 0x55e632f417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041944b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55e632ead640 0x55e632f417c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41804/0 (socket says 172.21.15.96:41804) 2024-09-14T10:45:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f0419c4c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55e632ead260 0x55e632f3e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:49244/0 (socket says 172.21.15.96:49244) 2024-09-14T10:45:35.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041944b640 1 -- 172.21.15.96:0/2778979786 learned_addr learned my addr 172.21.15.96:0/2778979786 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041944b640 1 -- 172.21.15.96:0/2778979786 >> v1:172.21.15.70:6789/0 conn(0x55e632ead260 legacy=0x55e632f3e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.254+0000 7f041944b640 1 -- 172.21.15.96:0/2778979786 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e632dbbda0 con 0x55e632ead640 2024-09-14T10:45:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f041944b640 1 --2- 172.21.15.96:0/2778979786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e632f417c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f040400a5c0 tx=0x7f040401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1705be649844754 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f0418c4a640 1 -- 172.21.15.96:0/2778979786 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04040a6070 con 0x55e632ead640 2024-09-14T10:45:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f0418c4a640 1 -- 172.21.15.96:0/2778979786 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04040af070 con 0x55e632ead640 2024-09-14T10:45:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f0418c4a640 1 -- 172.21.15.96:0/2778979786 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04040aa5c0 con 0x55e632ead640 2024-09-14T10:45:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f041c1469c0 1 -- 172.21.15.96:0/2778979786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 msgr2=0x55e632f417c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2778979786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e632f417c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f040400a5c0 tx=0x7f040401b340 comp rx=0 tx=0).stop 2024-09-14T10:45:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f041c1469c0 1 -- 172.21.15.96:0/2778979786 shutdown_connections 2024-09-14T10:45:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2778979786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e632f417c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f041c1469c0 1 -- 172.21.15.96:0/2778979786 >> 172.21.15.96:0/2778979786 conn(0x55e632f33980 msgr2=0x55e632f35da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f041c1469c0 1 -- 172.21.15.96:0/2778979786 shutdown_connections 2024-09-14T10:45:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.258+0000 7f041c1469c0 1 -- 172.21.15.96:0/2778979786 wait complete. 2024-09-14T10:45:35.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f041c1469c0 1 Processor -- start 2024-09-14T10:45:35.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f041c1469c0 1 -- start start 2024-09-14T10:45:35.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f041c1469c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead260 0x55e6330265e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f041c1469c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e632e40fc0 con 0x55e632ead260 2024-09-14T10:45:35.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f0419c4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead260 0x55e6330265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f0419c4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead260 0x55e6330265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41820/0 (socket says 172.21.15.96:41820) 2024-09-14T10:45:35.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f0419c4c640 1 -- 172.21.15.96:0/959107478 learned_addr learned my addr 172.21.15.96:0/959107478 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f0419c4c640 1 -- 172.21.15.96:0/959107478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e633026bd0 con 0x55e632ead260 2024-09-14T10:45:35.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f0419c4c640 1 --2- 172.21.15.96:0/959107478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead260 0x55e6330265e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0414001680 tx=0x7f0414001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e3f348b96575de server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f0307e07640 1 -- 172.21.15.96:0/959107478 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0414013420 con 0x55e632ead260 2024-09-14T10:45:35.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f0307e07640 1 -- 172.21.15.96:0/959107478 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04140135c0 con 0x55e632ead260 2024-09-14T10:45:35.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.274+0000 7f0307e07640 1 -- 172.21.15.96:0/959107478 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04140138e0 con 0x55e632ead260 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- 172.21.15.96:0/959107478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead260 msgr2=0x55e6330265e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 --2- 172.21.15.96:0/959107478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead260 0x55e6330265e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0414001680 tx=0x7f0414001b40 comp rx=0 tx=0).stop 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- 172.21.15.96:0/959107478 shutdown_connections 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 --2- 172.21.15.96:0/959107478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead260 0x55e6330265e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- 172.21.15.96:0/959107478 >> 172.21.15.96:0/959107478 conn(0x55e632f33980 msgr2=0x55e6330221d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- 172.21.15.96:0/959107478 shutdown_connections 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- 172.21.15.96:0/959107478 wait complete. 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 Processor -- start 2024-09-14T10:45:35.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- start start 2024-09-14T10:45:35.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e63302e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e632de2a50 con 0x55e632ead640 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0419c4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e63302e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0419c4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e63302e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41830/0 (socket says 172.21.15.96:41830) 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0419c4c640 1 -- 172.21.15.96:0/2958808389 learned_addr learned my addr 172.21.15.96:0/2958808389 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0419c4c640 1 -- 172.21.15.96:0/2958808389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e63302e730 con 0x55e632ead640 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0419c4c640 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e63302e1d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x55e6330275a0 tx=0x7f0414000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0306604640 1 -- 172.21.15.96:0/2958808389 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0414013630 con 0x55e632ead640 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e63302e9c0 con 0x55e632ead640 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0306604640 1 -- 172.21.15.96:0/2958808389 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0414023070 con 0x55e632ead640 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e63302f280 con 0x55e632ead640 2024-09-14T10:45:35.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0306604640 1 -- 172.21.15.96:0/2958808389 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04140137d0 con 0x55e632ead640 2024-09-14T10:45:35.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.278+0000 7f0306604640 1 -- 172.21.15.96:0/2958808389 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0414010070 con 0x55e632ead640 2024-09-14T10:45:35.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f0306604640 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030003a1a0 0x7f030003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f0306604640 1 -- 172.21.15.96:0/2958808389 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0414050a20 con 0x55e632ead640 2024-09-14T10:45:35.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041944b640 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030003a1a0 0x7f030003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633033240 0x55e633035630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633035b70 con 0x55e633033240 2024-09-14T10:45:35.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041a44d640 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633033240 0x55e633035630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041944b640 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030003a1a0 0x7f030003c660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04040ae000 tx=0x7f04040a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041a44d640 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633033240 0x55e633035630 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041a44d640 1 -- 172.21.15.96:0/2958808389 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c0083f0 con 0x55e633033240 2024-09-14T10:45:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633035f80 con 0x55e633033240 2024-09-14T10:45:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041a44d640 1 -- 172.21.15.96:0/2958808389 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f040c0083f0 con 0x55e633033240 2024-09-14T10:45:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633037880 con 0x55e633033240 2024-09-14T10:45:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041a44d640 1 -- 172.21.15.96:0/2958808389 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f040c0083f0 con 0x55e633033240 2024-09-14T10:45:35.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633036ab0 con 0x55e633033240 2024-09-14T10:45:35.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041a44d640 1 -- 172.21.15.96:0/2958808389 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f040c0083f0 con 0x55e633033240 2024-09-14T10:45:35.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633036f00 con 0x55e633033240 2024-09-14T10:45:35.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041a44d640 1 -- 172.21.15.96:0/2958808389 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f040c0083f0 con 0x55e633033240 2024-09-14T10:45:35.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 Processor -- start 2024-09-14T10:45:35.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 -- start start 2024-09-14T10:45:35.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633045c20 0x55e633046040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041c1469c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e632e4dd80 con 0x55e633045c20 2024-09-14T10:45:35.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041944b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633045c20 0x55e633046040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041944b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633045c20 0x55e633046040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41834/0 (socket says 172.21.15.96:41834) 2024-09-14T10:45:35.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.282+0000 7f041944b640 1 -- 172.21.15.96:0/1706121968 learned_addr learned my addr 172.21.15.96:0/1706121968 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041944b640 1 -- 172.21.15.96:0/1706121968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e633046680 con 0x55e633045c20 2024-09-14T10:45:35.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041944b640 1 --2- 172.21.15.96:0/1706121968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633045c20 0x55e633046040 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0404000c10 tx=0x7f04040180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f02ff7fe640 1 -- 172.21.15.96:0/1706121968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04040b3b90 con 0x55e633045c20 2024-09-14T10:45:35.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041c1469c0 1 -- 172.21.15.96:0/1706121968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e633046ee0 con 0x55e633045c20 2024-09-14T10:45:35.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f02ff7fe640 1 -- 172.21.15.96:0/1706121968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04040b3d30 con 0x55e633045c20 2024-09-14T10:45:35.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f02ff7fe640 1 -- 172.21.15.96:0/1706121968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04040c8560 con 0x55e633045c20 2024-09-14T10:45:35.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041c1469c0 1 -- 172.21.15.96:0/1706121968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6330473f0 con 0x55e633045c20 2024-09-14T10:45:35.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f02ff7fe640 1 -- 172.21.15.96:0/1706121968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f04040d1440 con 0x55e633045c20 2024-09-14T10:45:35.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f02ff7fe640 1 --2- 172.21.15.96:0/1706121968 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f02ff7fe640 1 -- 172.21.15.96:0/1706121968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f04040ee3f0 con 0x55e633045c20 2024-09-14T10:45:35.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041a44d640 1 --2- 172.21.15.96:0/1706121968 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041c1469c0 1 Processor -- start 2024-09-14T10:45:35.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041a44d640 1 --2- 172.21.15.96:0/1706121968 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55e6330365d0 tx=0x7f040c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041c1469c0 1 -- start start 2024-09-14T10:45:35.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041c1469c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e633053870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041c1469c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e633027000 con 0x55e633053470 2024-09-14T10:45:35.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041944b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e633053870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041944b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e633053870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41842/0 (socket says 172.21.15.96:41842) 2024-09-14T10:45:35.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041944b640 1 -- 172.21.15.96:0/1768352985 learned_addr learned my addr 172.21.15.96:0/1768352985 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.286+0000 7f041944b640 1 -- 172.21.15.96:0/1768352985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e633053e60 con 0x55e633053470 2024-09-14T10:45:35.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041944b640 1 --2- 172.21.15.96:0/1768352985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e633053870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f04040ec740 tx=0x7f04040bd8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfd253d353eb079 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f02fd7fa640 1 -- 172.21.15.96:0/1768352985 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04040be410 con 0x55e633053470 2024-09-14T10:45:35.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f02fd7fa640 1 -- 172.21.15.96:0/1768352985 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04040bcc80 con 0x55e633053470 2024-09-14T10:45:35.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f02fd7fa640 1 -- 172.21.15.96:0/1768352985 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04040be5b0 con 0x55e633053470 2024-09-14T10:45:35.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- 172.21.15.96:0/1768352985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 msgr2=0x55e633053870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 --2- 172.21.15.96:0/1768352985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e633053870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f04040ec740 tx=0x7f04040bd8a0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- 172.21.15.96:0/1768352985 shutdown_connections 2024-09-14T10:45:35.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 --2- 172.21.15.96:0/1768352985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e633053870 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- 172.21.15.96:0/1768352985 >> 172.21.15.96:0/1768352985 conn(0x55e63304e890 msgr2=0x55e63304cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- 172.21.15.96:0/1768352985 shutdown_connections 2024-09-14T10:45:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- 172.21.15.96:0/1768352985 wait complete. 2024-09-14T10:45:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 Processor -- start 2024-09-14T10:45:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- start start 2024-09-14T10:45:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e6330599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e6330523c0 con 0x55e633053470 2024-09-14T10:45:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041944b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e6330599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041944b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e6330599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41848/0 (socket says 172.21.15.96:41848) 2024-09-14T10:45:35.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 learned_addr learned my addr 172.21.15.96:0/970322935 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e633059f30 con 0x55e633053470 2024-09-14T10:45:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041944b640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e6330599d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f04040b37e0 tx=0x7f04040ec6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f02eb7fe640 1 -- 172.21.15.96:0/970322935 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04040bdc40 con 0x55e633053470 2024-09-14T10:45:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f02eb7fe640 1 -- 172.21.15.96:0/970322935 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04040c7ae0 con 0x55e633053470 2024-09-14T10:45:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e63305a1c0 con 0x55e633053470 2024-09-14T10:45:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f02eb7fe640 1 -- 172.21.15.96:0/970322935 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04040c7dc0 con 0x55e633053470 2024-09-14T10:45:35.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.290+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e63305a1c0 con 0x55e633053470 2024-09-14T10:45:35.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f02eb7fe640 1 -- 172.21.15.96:0/970322935 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f04040f5060 con 0x55e633053470 2024-09-14T10:45:35.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f02eb7fe640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e403a150 0x7f02e403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f02eb7fe640 1 -- 172.21.15.96:0/970322935 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f04040e2070 con 0x55e633053470 2024-09-14T10:45:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041a44d640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e403a150 0x7f02e403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633064d30 0x55e6330671f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633067940 con 0x55e633064d30 2024-09-14T10:45:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f0419c4c640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633064d30 0x55e6330671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041a44d640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e403a150 0x7f02e403c610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f040c00f010 tx=0x7f040c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f0419c4c640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633064d30 0x55e6330671f0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 realm 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633067d50 con 0x55e633064d30 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:35.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633068620 con 0x55e633064d30 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6330689c0 con 0x55e633064d30 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633069210 con 0x55e633064d30 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 20 searching for the correct realm 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e63306af80 0x55e63306d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041944b640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e63306af80 0x55e63306d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.294+0000 7f041944b640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e63306af80 0x55e63306d370 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f041944b640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0404009040 0x7f04040caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f0404009040 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f041a44d640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0404009040 0x7f04040caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f041a44d640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0404009040 0x7f04040caaa0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f041a44d640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f040c019040 0x7f040c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f040c019040 2024-09-14T10:45:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f040c019040 0x7f040c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f040c019040 0x7f040c019930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x7f040c019040 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e633064d30 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e633064d30 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f040c019040 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x7f040c019040 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.298+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f040c019040 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x7f040c019040 2024-09-14T10:45:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f0404009040 2024-09-14T10:45:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e633064d30 2024-09-14T10:45:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f040c019040 2024-09-14T10:45:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x7f040c019040 2024-09-14T10:45:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e633064d30 2024-09-14T10:45:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f0404009040 2024-09-14T10:45:35.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.302+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f040c019040 2024-09-14T10:45:35.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x7f040c019040 2024-09-14T10:45:35.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e633064d30 2024-09-14T10:45:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e633064d30 2024-09-14T10:45:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f040c019040 2024-09-14T10:45:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041400f030 con 0x7f040c019040 2024-09-14T10:45:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f0404009040 2024-09-14T10:45:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e633064d30 2024-09-14T10:45:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f041400f030 con 0x55e633064d30 2024-09-14T10:45:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f0404009040 2024-09-14T10:45:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.306+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f040c019040 2024-09-14T10:45:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f0404009040 2024-09-14T10:45:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e63306af80 2024-09-14T10:45:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f040c019040 2024-09-14T10:45:35.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x55e633064d30 2024-09-14T10:45:35.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e63306d9a0 con 0x7f0404009040 2024-09-14T10:45:35.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:35.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633069bc0 con 0x55e633064d30 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e63306a460 con 0x55e633064d30 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:35.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e63306a460 con 0x55e633064d30 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 zone default found 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 4 Realm: () 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 zonegroup default 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.310+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e63306de00 con 0x7f0404009040 2024-09-14T10:45:35.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e63306fc90 con 0x55e63306af80 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633070150 con 0x55e63306af80 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 20 started sync module instance, tier type = 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:35.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e63306f030 con 0x7f0404009040 2024-09-14T10:45:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94447186933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e63306f030 con 0x7f0404009040 2024-09-14T10:45:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633070bd0 con 0x55e633064d30 2024-09-14T10:45:35.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.314+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94447186933120] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.318+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.318+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94447186937968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e63306f030 con 0x55e633064d30 2024-09-14T10:45:35.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.318+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633071610 con 0x55e63306af80 2024-09-14T10:45:35.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.318+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94447186937968] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.318+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.318+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94447186930560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e63306efa0 con 0x55e63306af80 2024-09-14T10:45:35.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.318+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633072310 con 0x7f0404009040 2024-09-14T10:45:35.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.322+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.322+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94447186943888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633072bb0 con 0x7f0404009040 2024-09-14T10:45:35.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.322+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330735b0 con 0x55e633064d30 2024-09-14T10:45:35.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.322+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94447186930560] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.322+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94447186943888] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.322+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.322+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94447186942384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330730c0 con 0x55e633064d30 2024-09-14T10:45:35.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.322+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633073a80 con 0x7f040c019040 2024-09-14T10:45:35.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.326+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94447186942384] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.326+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.326+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94447186945792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633073a80 con 0x7f040c019040 2024-09-14T10:45:35.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.326+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633074310 con 0x7f040c019040 2024-09-14T10:45:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.326+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94447186945792] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.326+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.326+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94447186950064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330741e0 con 0x7f040c019040 2024-09-14T10:45:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.326+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633074d00 con 0x7f040c019040 2024-09-14T10:45:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94447186954192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633075170 con 0x7f040c019040 2024-09-14T10:45:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 20 add_watcher() i=0 2024-09-14T10:45:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 20 add_watcher() i=1 2024-09-14T10:45:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 20 add_watcher() i=2 2024-09-14T10:45:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 20 add_watcher() i=3 2024-09-14T10:45:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 20 add_watcher() i=4 2024-09-14T10:45:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 20 add_watcher() i=5 2024-09-14T10:45:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94447186950064] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 20 add_watcher() i=6 2024-09-14T10:45:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94447186954192] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 20 add_watcher() i=7 2024-09-14T10:45:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e633073c70 con 0x55e633064d30 2024-09-14T10:45:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.330+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94447186951216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e633075680 con 0x55e633064d30 2024-09-14T10:45:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94447186951216] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f02cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:35.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 5 note: GC not initialized 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f02ca7fc640 20 reqs_thread_entry: start 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 20 Filter name: none 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f023bfff640 20 reqs_thread_entry: start 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e63309b920 con 0x7f0404009040 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:45:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e63309ff00 con 0x7f040c019040 2024-09-14T10:45:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.334+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.336 INFO:teuthology.orchestra.run.smithi096.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-14T10:45:35.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.338+0000 7f02cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.338+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94447186951216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330994f0 con 0x55e633064d30 2024-09-14T10:45:35.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.338+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94447186951216] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.338+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94447186933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330994f0 con 0x7f0404009040 2024-09-14T10:45:35.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.338+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94447186933120] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.338+0000 7f041c1469c0 20 remove_watcher() i=0 2024-09-14T10:45:35.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.338+0000 7f041c1469c0 2 removed watcher, disabling cache 2024-09-14T10:45:35.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.338+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94447186937968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330994f0 con 0x55e633064d30 2024-09-14T10:45:35.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.342+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94447186937968] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.342+0000 7f041c1469c0 20 remove_watcher() i=1 2024-09-14T10:45:35.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.342+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94447186930560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330994f0 con 0x55e63306af80 2024-09-14T10:45:35.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.342+0000 7f041944b640 1 -- 172.21.15.96:0/970322935 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94447186930560] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0404100040 con 0x55e63306af80 2024-09-14T10:45:35.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.342+0000 7f041c1469c0 20 remove_watcher() i=2 2024-09-14T10:45:35.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.342+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94447186943888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e63306eb80 con 0x7f0404009040 2024-09-14T10:45:35.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.346+0000 7f041a44d640 1 -- 172.21.15.96:0/970322935 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94447186943888] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c02f040 con 0x7f0404009040 2024-09-14T10:45:35.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.346+0000 7f041c1469c0 20 remove_watcher() i=3 2024-09-14T10:45:35.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.346+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94447186942384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e63306eb80 con 0x55e633064d30 2024-09-14T10:45:35.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.346+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94447186942384] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x55e633064d30 2024-09-14T10:45:35.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.346+0000 7f041c1469c0 20 remove_watcher() i=4 2024-09-14T10:45:35.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.346+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94447186945792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330719b0 con 0x7f040c019040 2024-09-14T10:45:35.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.350+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94447186945792] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.350+0000 7f041c1469c0 20 remove_watcher() i=5 2024-09-14T10:45:35.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.350+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94447186950064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e63306eb80 con 0x7f040c019040 2024-09-14T10:45:35.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.350+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94447186950064] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.350+0000 7f041c1469c0 20 remove_watcher() i=6 2024-09-14T10:45:35.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.350+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94447186954192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6330719b0 con 0x7f040c019040 2024-09-14T10:45:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94447186954192] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041405f040 con 0x7f040c019040 2024-09-14T10:45:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 20 remove_watcher() i=7 2024-09-14T10:45:35.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f040c019040 msgr2=0x7f040c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f040c019040 0x7f040c019930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633064d30 msgr2=0x55e6330671f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633064d30 0x55e6330671f0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0404009040 msgr2=0x7f04040caaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0404009040 0x7f04040caaa0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e63306af80 msgr2=0x55e63306d370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55e63306af80 0x55e63306d370 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e403a150 msgr2=0x7f02e403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02e403a150 0x7f02e403c610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f040c00f010 tx=0x7f040c01b070 comp rx=0 tx=0).stop 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 msgr2=0x55e6330599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/970322935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633053470 0x55e6330599d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f04040b37e0 tx=0x7f04040ec6d0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f0419c4c640 1 -- 172.21.15.96:0/970322935 reap_dead start 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 shutdown_connections 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 >> 172.21.15.96:0/970322935 conn(0x55e63304e890 msgr2=0x55e63304caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 shutdown_connections 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/970322935 wait complete. 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/1706121968 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 msgr2=0x7f02f403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/1706121968 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55e6330365d0 tx=0x7f040c003070 comp rx=0 tx=0).stop 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/1706121968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633045c20 msgr2=0x55e633046040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/1706121968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633045c20 0x55e633046040 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0404000c10 tx=0x7f04040180e0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/1706121968 shutdown_connections 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/1706121968 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f02f403a150 0x7f02f403c610 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/1706121968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e633045c20 0x55e633046040 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/1706121968 >> 172.21.15.96:0/1706121968 conn(0x55e63303b5d0 msgr2=0x55e63303b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/1706121968 shutdown_connections 2024-09-14T10:45:35.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/1706121968 wait complete. 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633033240 msgr2=0x55e633035630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633033240 0x55e633035630 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030003a1a0 msgr2=0x7f030003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030003a1a0 0x7f030003c660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04040ae000 tx=0x7f04040a6000 comp rx=0 tx=0).stop 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 msgr2=0x55e63302e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e63302e1d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x55e6330275a0 tx=0x7f0414000f50 comp rx=0 tx=0).stop 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 shutdown_connections 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55e633033240 0x55e633035630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f030003a1a0 0x7f030003c660 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 --2- 172.21.15.96:0/2958808389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e632ead640 0x55e63302e1d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 >> 172.21.15.96:0/2958808389 conn(0x55e632f33980 msgr2=0x55e633027ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 shutdown_connections 2024-09-14T10:45:35.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.354+0000 7f041c1469c0 1 -- 172.21.15.96:0/2958808389 wait complete. 2024-09-14T10:45:35.365 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-14T10:45:35.370 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:45:35.370 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-14T10:45:35.375 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:45:35.375 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-14T10:45:35.376 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-14T10:45:35.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-14T10:45:35.376 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-14T10:45:35.441 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:35.441 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:35.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f02142689c0 1 Processor -- start 2024-09-14T10:45:35.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f02142689c0 1 -- start start 2024-09-14T10:45:35.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f02142689c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5568ad403b50 0x5568ad403f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f02142689c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568ad3357a0 con 0x5568ad402550 2024-09-14T10:45:35.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f02142689c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5568ad3911b0 con 0x5568ad403b50 2024-09-14T10:45:35.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f0211d6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5568ad403b50 0x5568ad403f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f0211d6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5568ad403b50 0x5568ad403f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41864/0 (socket says 172.21.15.96:41864) 2024-09-14T10:45:35.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f021156d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5568ad402550 0x5568ad402960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:49260/0 (socket says 172.21.15.96:49260) 2024-09-14T10:45:35.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f0211d6e640 1 -- 172.21.15.96:0/3178781703 learned_addr learned my addr 172.21.15.96:0/3178781703 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f0211d6e640 1 -- 172.21.15.96:0/3178781703 >> v1:172.21.15.70:6789/0 conn(0x5568ad402550 legacy=0x5568ad402960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.442+0000 7f0211d6e640 1 -- 172.21.15.96:0/3178781703 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ad30fda0 con 0x5568ad403b50 2024-09-14T10:45:35.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f0211d6e640 1 --2- 172.21.15.96:0/3178781703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad403b50 0x5568ad403f30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a4e0 tx=0x7f01fc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3baab6369a979167 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f0210d6c640 1 -- 172.21.15.96:0/3178781703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc0aa540 con 0x5568ad403b50 2024-09-14T10:45:35.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f0210d6c640 1 -- 172.21.15.96:0/3178781703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc0aa6e0 con 0x5568ad403b50 2024-09-14T10:45:35.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f0210d6c640 1 -- 172.21.15.96:0/3178781703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc0aaa40 con 0x5568ad403b50 2024-09-14T10:45:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f02142689c0 1 -- 172.21.15.96:0/3178781703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad403b50 msgr2=0x5568ad403f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f02142689c0 1 --2- 172.21.15.96:0/3178781703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad403b50 0x5568ad403f30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a4e0 tx=0x7f01fc01b090 comp rx=0 tx=0).stop 2024-09-14T10:45:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f02142689c0 1 -- 172.21.15.96:0/3178781703 shutdown_connections 2024-09-14T10:45:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f02142689c0 1 --2- 172.21.15.96:0/3178781703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad403b50 0x5568ad403f30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f02142689c0 1 -- 172.21.15.96:0/3178781703 >> 172.21.15.96:0/3178781703 conn(0x5568ad488b30 msgr2=0x5568ad48af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f02142689c0 1 -- 172.21.15.96:0/3178781703 shutdown_connections 2024-09-14T10:45:35.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.446+0000 7f02142689c0 1 -- 172.21.15.96:0/3178781703 wait complete. 2024-09-14T10:45:35.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f02142689c0 1 Processor -- start 2024-09-14T10:45:35.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f02142689c0 1 -- start start 2024-09-14T10:45:35.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f02142689c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad57a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f02142689c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5568ad394fc0 con 0x5568ad402550 2024-09-14T10:45:35.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f0211d6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad57a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f0211d6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad57a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41878/0 (socket says 172.21.15.96:41878) 2024-09-14T10:45:35.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f0211d6e640 1 -- 172.21.15.96:0/3374411666 learned_addr learned my addr 172.21.15.96:0/3374411666 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f0211d6e640 1 -- 172.21.15.96:0/3374411666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ad57ae20 con 0x5568ad402550 2024-09-14T10:45:35.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f0211d6e640 1 --2- 172.21.15.96:0/3374411666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad57a830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ac040 tx=0x7f01fc003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec623a09181b2635 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.462+0000 7f00fee15640 1 -- 172.21.15.96:0/3374411666 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc0aaa80 con 0x5568ad402550 2024-09-14T10:45:35.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f00fee15640 1 -- 172.21.15.96:0/3374411666 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc0aac20 con 0x5568ad402550 2024-09-14T10:45:35.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f00fee15640 1 -- 172.21.15.96:0/3374411666 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc0b4460 con 0x5568ad402550 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- 172.21.15.96:0/3374411666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 msgr2=0x5568ad57a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 --2- 172.21.15.96:0/3374411666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad57a830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ac040 tx=0x7f01fc003340 comp rx=0 tx=0).stop 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- 172.21.15.96:0/3374411666 shutdown_connections 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 --2- 172.21.15.96:0/3374411666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad57a830 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- 172.21.15.96:0/3374411666 >> 172.21.15.96:0/3374411666 conn(0x5568ad488b30 msgr2=0x5568ad576470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- 172.21.15.96:0/3374411666 shutdown_connections 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- 172.21.15.96:0/3374411666 wait complete. 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 Processor -- start 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- start start 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad582090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5568ad336a50 con 0x5568ad402550 2024-09-14T10:45:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f0211d6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad582090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f0211d6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad582090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41888/0 (socket says 172.21.15.96:41888) 2024-09-14T10:45:35.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f0211d6e640 1 -- 172.21.15.96:0/1707142782 learned_addr learned my addr 172.21.15.96:0/1707142782 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f0211d6e640 1 -- 172.21.15.96:0/1707142782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ad5825f0 con 0x5568ad402550 2024-09-14T10:45:35.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f0211d6e640 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad582090 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f01fc01b0d0 tx=0x5568ad403490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f00fd612640 1 -- 172.21.15.96:0/1707142782 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc0b4860 con 0x5568ad402550 2024-09-14T10:45:35.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ad582880 con 0x5568ad402550 2024-09-14T10:45:35.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f00fd612640 1 -- 172.21.15.96:0/1707142782 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc0c1070 con 0x5568ad402550 2024-09-14T10:45:35.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f00fd612640 1 -- 172.21.15.96:0/1707142782 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc0b4b30 con 0x5568ad402550 2024-09-14T10:45:35.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.466+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ad583230 con 0x5568ad402550 2024-09-14T10:45:35.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f00fd612640 1 -- 172.21.15.96:0/1707142782 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f01fc0b4cd0 con 0x5568ad402550 2024-09-14T10:45:35.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f00fd612640 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00f803a150 0x7f00f803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f00fd612640 1 -- 172.21.15.96:0/1707142782 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f01fc0ebc50 con 0x5568ad402550 2024-09-14T10:45:35.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021156d640 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00f803a150 0x7f00f803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad403b50 0x5568ad589200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad589740 con 0x5568ad403b50 2024-09-14T10:45:35.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021256f640 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad403b50 0x5568ad589200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021156d640 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00f803a150 0x7f00f803c610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0204001e40 tx=0x7f02040013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021256f640 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad403b50 0x5568ad589200 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021256f640 1 -- 172.21.15.96:0/1707142782 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f020c0083f0 con 0x5568ad403b50 2024-09-14T10:45:35.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad589b20 con 0x5568ad403b50 2024-09-14T10:45:35.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021256f640 1 -- 172.21.15.96:0/1707142782 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f020c0083f0 con 0x5568ad403b50 2024-09-14T10:45:35.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad58b420 con 0x5568ad403b50 2024-09-14T10:45:35.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021256f640 1 -- 172.21.15.96:0/1707142782 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f020c0083f0 con 0x5568ad403b50 2024-09-14T10:45:35.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad58a650 con 0x5568ad403b50 2024-09-14T10:45:35.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021256f640 1 -- 172.21.15.96:0/1707142782 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f020c0083f0 con 0x5568ad403b50 2024-09-14T10:45:35.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad58aa70 con 0x5568ad403b50 2024-09-14T10:45:35.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f021256f640 1 -- 172.21.15.96:0/1707142782 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f020c0083f0 con 0x5568ad403b50 2024-09-14T10:45:35.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 Processor -- start 2024-09-14T10:45:35.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 -- start start 2024-09-14T10:45:35.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad599800 0x5568ad599c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.470+0000 7f02142689c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5568ad3a1d80 con 0x5568ad599800 2024-09-14T10:45:35.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f021156d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad599800 0x5568ad599c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f021156d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad599800 0x5568ad599c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41898/0 (socket says 172.21.15.96:41898) 2024-09-14T10:45:35.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f021156d640 1 -- 172.21.15.96:0/3798319989 learned_addr learned my addr 172.21.15.96:0/3798319989 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f021156d640 1 -- 172.21.15.96:0/3798319989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ad59a260 con 0x5568ad599800 2024-09-14T10:45:35.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f021156d640 1 --2- 172.21.15.96:0/3798319989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad599800 0x5568ad599c20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f020400e670 tx=0x7f020400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f00f67fc640 1 -- 172.21.15.96:0/3798319989 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0204022070 con 0x5568ad599800 2024-09-14T10:45:35.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f02142689c0 1 -- 172.21.15.96:0/3798319989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ad59aac0 con 0x5568ad599800 2024-09-14T10:45:35.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f00f67fc640 1 -- 172.21.15.96:0/3798319989 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020400d660 con 0x5568ad599800 2024-09-14T10:45:35.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f00f67fc640 1 -- 172.21.15.96:0/3798319989 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0204006070 con 0x5568ad599800 2024-09-14T10:45:35.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f02142689c0 1 -- 172.21.15.96:0/3798319989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ad59b030 con 0x5568ad599800 2024-09-14T10:45:35.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f00f67fc640 1 -- 172.21.15.96:0/3798319989 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0204025070 con 0x5568ad599800 2024-09-14T10:45:35.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f00f67fc640 1 --2- 172.21.15.96:0/3798319989 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00e803a150 0x7f00e803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f00f67fc640 1 -- 172.21.15.96:0/3798319989 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0204052440 con 0x5568ad599800 2024-09-14T10:45:35.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f021256f640 1 --2- 172.21.15.96:0/3798319989 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00e803a150 0x7f00e803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f02142689c0 1 Processor -- start 2024-09-14T10:45:35.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f02142689c0 1 -- start start 2024-09-14T10:45:35.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f021256f640 1 --2- 172.21.15.96:0/3798319989 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00e803a150 0x7f00e803c610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5568ad58a9f0 tx=0x7f020c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f02142689c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.474+0000 7f02142689c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5568ad57b1f0 con 0x5568ad5a71d0 2024-09-14T10:45:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5a75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41910/0 (socket says 172.21.15.96:41910) 2024-09-14T10:45:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 -- 172.21.15.96:0/3914165158 learned_addr learned my addr 172.21.15.96:0/3914165158 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 -- 172.21.15.96:0/3914165158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ad5a7ba0 con 0x5568ad5a71d0 2024-09-14T10:45:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 --2- 172.21.15.96:0/3914165158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5a75b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f02040507c0 tx=0x7f0204024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6c4d0060ba313 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f00e7fff640 1 -- 172.21.15.96:0/3914165158 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f020400dcc0 con 0x5568ad5a71d0 2024-09-14T10:45:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f00e7fff640 1 -- 172.21.15.96:0/3914165158 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020404f220 con 0x5568ad5a71d0 2024-09-14T10:45:35.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f00e7fff640 1 -- 172.21.15.96:0/3914165158 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f020400de60 con 0x5568ad5a71d0 2024-09-14T10:45:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 -- 172.21.15.96:0/3914165158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 msgr2=0x5568ad5a75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 --2- 172.21.15.96:0/3914165158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5a75b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f02040507c0 tx=0x7f0204024c90 comp rx=0 tx=0).stop 2024-09-14T10:45:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 -- 172.21.15.96:0/3914165158 shutdown_connections 2024-09-14T10:45:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 --2- 172.21.15.96:0/3914165158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5a75b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 -- 172.21.15.96:0/3914165158 >> 172.21.15.96:0/3914165158 conn(0x5568ad5a2590 msgr2=0x5568ad5a07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 -- 172.21.15.96:0/3914165158 shutdown_connections 2024-09-14T10:45:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 -- 172.21.15.96:0/3914165158 wait complete. 2024-09-14T10:45:35.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 Processor -- start 2024-09-14T10:45:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 -- start start 2024-09-14T10:45:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f02142689c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5568ad5a60c0 con 0x5568ad5a71d0 2024-09-14T10:45:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41916/0 (socket says 172.21.15.96:41916) 2024-09-14T10:45:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 learned_addr learned my addr 172.21.15.96:0/98625097 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ad5adc60 con 0x5568ad5a71d0 2024-09-14T10:45:35.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.478+0000 7f021156d640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5ad700 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0204024d20 tx=0x7f0204050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f00e67fc640 1 -- 172.21.15.96:0/98625097 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0204025c80 con 0x5568ad5a71d0 2024-09-14T10:45:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f00e67fc640 1 -- 172.21.15.96:0/98625097 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0204025e20 con 0x5568ad5a71d0 2024-09-14T10:45:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f00e67fc640 1 -- 172.21.15.96:0/98625097 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f020401a450 con 0x5568ad5a71d0 2024-09-14T10:45:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ad5adef0 con 0x5568ad5a71d0 2024-09-14T10:45:35.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ad5adef0 con 0x5568ad5a71d0 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f00e67fc640 1 -- 172.21.15.96:0/98625097 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0204033070 con 0x5568ad5a71d0 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f00e67fc640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00dc03a1a0 0x7f00dc03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f00e67fc640 1 -- 172.21.15.96:0/98625097 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0204045070 con 0x5568ad5a71d0 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f021256f640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00dc03a1a0 0x7f00dc03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad5b8ab0 0x5568ad5baf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5bb690 con 0x5568ad5b8ab0 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f0211d6e640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad5b8ab0 0x5568ad5baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f021256f640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00dc03a1a0 0x7f00dc03c660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f020c00f010 tx=0x7f020c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f0211d6e640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad5b8ab0 0x5568ad5baf40 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 20 realm 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5bbaf0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5bc3c0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.482+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5bc760 con 0x5568ad5b8ab0 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f02142689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5bcfb0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f02142689c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f02142689c0 20 searching for the correct realm 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5568ad5bed20 0x5568ad5c1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021156d640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5568ad5bed20 0x5568ad5c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021156d640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5568ad5bed20 0x5568ad5c1110 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020403c070 con 0x5568ad5bed20 2024-09-14T10:45:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021156d640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0204035070 0x7f0204027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f0204035070 2024-09-14T10:45:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021256f640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0204035070 0x7f0204027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021256f640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0204035070 0x7f0204027440 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021256f640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f020c019040 0x7f020c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f020c019040 2024-09-14T10:45:35.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f0211d6e640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f020c019040 0x7f020c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f0211d6e640 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f020c019040 0x7f020c019930 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x7f020c019040 2024-09-14T10:45:35.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.486+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f020c019040 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x7f020c019040 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f020c019040 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x7f020c019040 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f0204035070 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020403c070 con 0x5568ad5bed20 2024-09-14T10:45:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f020c019040 2024-09-14T10:45:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x7f020c019040 2024-09-14T10:45:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f0204035070 2024-09-14T10:45:35.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.490+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f020c019040 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x7f020c019040 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f020c019040 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x7f020c019040 2024-09-14T10:45:35.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f0204035070 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f01fc0cf070 con 0x5568ad5b8ab0 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f0204035070 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.494+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f020c019040 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x7f020c019040 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f0204035070 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5bed20 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f020c019040 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01fc0cf070 con 0x7f020c019040 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c16f0 con 0x7f0204035070 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5bd930 con 0x5568ad5b8ab0 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5be1d0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c1b70 con 0x5568ad5b8ab0 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 zone default found 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 4 Realm: () 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 zonegroup default 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.498+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c1b70 con 0x7f0204035070 2024-09-14T10:45:35.504 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c3e50 con 0x5568ad5bed20 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c4240 con 0x5568ad5bed20 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 20 started sync module instance, tier type = 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c32e0 con 0x7f0204035070 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93908073461760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c32e0 con 0x7f0204035070 2024-09-14T10:45:35.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c4d40 con 0x5568ad5b8ab0 2024-09-14T10:45:35.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.502+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93908073461760] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93908073465872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c32e0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c5750 con 0x5568ad5bed20 2024-09-14T10:45:35.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93908073465872] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93908073459248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c3250 con 0x5568ad5bed20 2024-09-14T10:45:35.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c64e0 con 0x7f0204035070 2024-09-14T10:45:35.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93908073471984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c6d80 con 0x7f0204035070 2024-09-14T10:45:35.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.506+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c77a0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93908073471984] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93908073459248] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93908073476752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c68d0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c8040 con 0x7f020c019040 2024-09-14T10:45:35.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93908073476752] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93908073470784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c68d0 con 0x7f020c019040 2024-09-14T10:45:35.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.510+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c8490 con 0x7f020c019040 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.514+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.514+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93908073480096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c88b0 con 0x7f020c019040 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.514+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c93d0 con 0x7f020c019040 2024-09-14T10:45:35.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.514+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93908073470784] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93908073483936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c9390 con 0x7f020c019040 2024-09-14T10:45:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 add_watcher() i=0 2024-09-14T10:45:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 add_watcher() i=1 2024-09-14T10:45:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 add_watcher() i=2 2024-09-14T10:45:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 add_watcher() i=3 2024-09-14T10:45:35.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 add_watcher() i=4 2024-09-14T10:45:35.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 add_watcher() i=5 2024-09-14T10:45:35.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93908073480096] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 add_watcher() i=6 2024-09-14T10:45:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93908073483936] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 add_watcher() i=7 2024-09-14T10:45:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c83c0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93908073481152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5c9800 con 0x5568ad5b8ab0 2024-09-14T10:45:35.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93908073481152] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f00c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:35.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:35.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:35.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.518+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d4d70 con 0x5568ad5b8ab0 2024-09-14T10:45:35.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.522+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.522+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d5400 con 0x7f020c019040 2024-09-14T10:45:35.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.522+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.522+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d5400 con 0x5568ad5bed20 2024-09-14T10:45:35.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.526+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.526+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d57a0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.526+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.526+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d57a0 con 0x7f0204035070 2024-09-14T10:45:35.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.526+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.526+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d5e70 con 0x5568ad5bed20 2024-09-14T10:45:35.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.526+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.526+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d62a0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.530+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.530+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d6330 con 0x7f020c019040 2024-09-14T10:45:35.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.530+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.530+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d6330 con 0x7f0204035070 2024-09-14T10:45:35.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.534+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.534+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d68c0 con 0x5568ad5bed20 2024-09-14T10:45:35.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.534+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.534+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d6c60 con 0x7f0204035070 2024-09-14T10:45:35.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.538+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.538+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d71d0 con 0x7f020c019040 2024-09-14T10:45:35.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.538+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.538+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d71d0 con 0x7f0204035070 2024-09-14T10:45:35.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.542+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.542+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d7110 con 0x7f020c019040 2024-09-14T10:45:35.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.542+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.542+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d70d0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.542+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.542+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d70d0 con 0x5568ad5bed20 2024-09-14T10:45:35.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.546+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.546+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d70d0 con 0x7f0204035070 2024-09-14T10:45:35.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.546+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.546+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d71d0 con 0x5568ad5bed20 2024-09-14T10:45:35.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.546+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.546+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d71d0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.550+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.550+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d71d0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.550+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.550+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d71d0 con 0x5568ad5bed20 2024-09-14T10:45:35.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d7210 con 0x7f0204035070 2024-09-14T10:45:35.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d72e0 con 0x5568ad5bed20 2024-09-14T10:45:35.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d72e0 con 0x5568ad5bed20 2024-09-14T10:45:35.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d7320 con 0x5568ad5bed20 2024-09-14T10:45:35.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.554+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.558+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d7320 con 0x5568ad5bed20 2024-09-14T10:45:35.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.558+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.558+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d7360 con 0x7f020c019040 2024-09-14T10:45:35.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.558+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.558+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d73a0 con 0x5568ad5bed20 2024-09-14T10:45:35.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.562+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.562+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d73a0 con 0x7f020c019040 2024-09-14T10:45:35.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.562+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.562+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d73a0 con 0x5568ad5bed20 2024-09-14T10:45:35.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.566+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.566+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d73a0 con 0x7f020c019040 2024-09-14T10:45:35.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.566+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.566+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d73c0 con 0x7f0204035070 2024-09-14T10:45:35.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f00c5fe3640 20 reqs_thread_entry: start 2024-09-14T10:45:35.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:35.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 20 Filter name: none 2024-09-14T10:45:35.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f00377fe640 20 reqs_thread_entry: start 2024-09-14T10:45:35.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-14T10:45:35.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5d4730 con 0x7f0204035070 2024-09-14T10:45:35.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:45:35.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-14T10:45:35.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:45:35.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:45:35.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f4fd0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 : miss 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 8.3 8:c2bdefda:root::.bucket.meta.myfoo6%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f4d00 con 0x5568ad5b8ab0 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(96 .bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv4 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 info.flags=0x17 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 to cache LRU end 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.570+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:97 4.26 4:65065dde:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672270 con 0x7f020c019040 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(97 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:98 4.c 4:3019b81f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672270 con 0x5568ad5b8ab0 2024-09-14T10:45:35.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(98 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:99 4.3b 4:dedad413:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672750 con 0x5568ad5bed20 2024-09-14T10:45:35.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(99 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 4.7 4:e131a36b:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672750 con 0x7f020c019040 2024-09-14T10:45:35.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(100 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:101 4.21 4:84ac6dda:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672750 con 0x7f020c019040 2024-09-14T10:45:35.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(101 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:102 4.e 4:70a44412:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672700 con 0x7f0204035070 2024-09-14T10:45:35.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(102 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:103 4.3d 4:bfde325a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672700 con 0x7f0204035070 2024-09-14T10:45:35.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(103 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.574+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:104 4.2c 4:35b9f0c3:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad6726e0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(104 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:105 4.37 4:ef6efac0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad6726e0 con 0x7f020c019040 2024-09-14T10:45:35.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(105 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:106 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672690 con 0x7f0204035070 2024-09-14T10:45:35.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(106 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [call out=349b] v0'0 uv11 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 10 cls_bucket_list_unordered: got thirteen 2024-09-14T10:45:35.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:107 4.19 4:9aecc622:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad672690 con 0x7f0204035070 2024-09-14T10:45:35.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(107 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 20 get_obj_state: octx=0x7f01fc005dd0 obj=myfoo6:thirteen state=0x5568ad670718 s->prefetch_data=0 2024-09-14T10:45:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:108 3.2es0 3:74e68bcb:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f5870 con 0x7f0204035070 2024-09-14T10:45:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(108 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9_thirteen [call out=24b,getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 280+0+859 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 10 manifest: total_size = 8 2024-09-14T10:45:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 20 get_obj_state: setting s->obj_tag to _Bnv6Pxi_Y97alc6g1zlC8nHIfoC6L2P 2024-09-14T10:45:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 20 get_obj_state: octx=0x7f01fc005dd0 obj=myfoo6:thirteen state=0x5568ad670718 s->prefetch_data=0 2024-09-14T10:45:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 20 prepare_atomic_modification: state is not atomic. state=0x5568ad670718 2024-09-14T10:45:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 2024-09-14T10:45:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.578+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:109 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f9460 con 0x7f0204035070 2024-09-14T10:45:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(109 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:110 3.2es0 3:74e68bcb:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f9460 con 0x7f0204035070 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(110 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9_thirteen [call] v34'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:111 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f9aa0 con 0x7f0204035070 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 20 list_objects_ordered: starting attempt 1 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:112 4.26 4:65065dde:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f9aa0 con 0x7f020c019040 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:113 4.c 4:3019b81f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad6709e0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:114 4.3b 4:dedad413:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad6008e0 con 0x5568ad5bed20 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:115 4.7 4:e131a36b:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad603380 con 0x7f020c019040 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:116 4.21 4:84ac6dda:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad6008e0 con 0x7f020c019040 2024-09-14T10:45:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:117 4.e 4:70a44412:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad608620 con 0x7f0204035070 2024-09-14T10:45:35.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:118 4.3d 4:bfde325a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60b4a0 con 0x7f0204035070 2024-09-14T10:45:35.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:119 4.2c 4:35b9f0c3:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x5568ad5b8ab0 2024-09-14T10:45:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:120 4.37 4:ef6efac0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad611150 con 0x7f020c019040 2024-09-14T10:45:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:121 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad608620 con 0x7f0204035070 2024-09-14T10:45:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:122 4.19 4:9aecc622:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad6709e0 con 0x7f0204035070 2024-09-14T10:45:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(114 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(117 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 29 ==== osd_op_reply(122 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 30 ==== osd_op_reply(118 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(112 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(113 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(119 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(115 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(116 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.582+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(120 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 31 ==== osd_op_reply(111 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f00e7fff640 20 handle_completion(): completion ok for obj=thirteen 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 32 ==== osd_op_reply(121 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [call out=128b] v0'0 uv13 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9])"; uploads.size()=0; is_truncated=0 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:123 4.26 4:65065dde:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x7f020c019040 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:124 4.c 4:3019b81f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60ae50 con 0x5568ad5b8ab0 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:125 4.3b 4:dedad413:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad6709e0 con 0x5568ad5bed20 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:126 4.7 4:e131a36b:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60ae50 con 0x7f020c019040 2024-09-14T10:45:35.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:127 4.21 4:84ac6dda:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x7f020c019040 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:128 4.e 4:70a44412:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60ae50 con 0x7f0204035070 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:129 4.3d 4:bfde325a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60d970 con 0x7f0204035070 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:130 4.2c 4:35b9f0c3:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad6709e0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:131 4.37 4:ef6efac0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60ae50 con 0x7f020c019040 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:132 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60d970 con 0x7f0204035070 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:133 4.19 4:9aecc622:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x7f0204035070 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(124 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(130 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 33 ==== osd_op_reply(128 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(125 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 34 ==== osd_op_reply(129 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 35 ==== osd_op_reply(132 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [call out=128b] v0'0 uv13 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 36 ==== osd_op_reply(133 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(123 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(127 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(131 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== osd_op_reply(126 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x5568ad5b8ab0 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(134 bud.buckets [call] v34'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x5568ad5b8ab0 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 38 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 20 rados_obj.operate() r=0 bl.length=166 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-14T10:45:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x5568ad5b8ab0 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 39 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.586+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93908074169648 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x7f0204035070 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 37 ==== watch-notify(notify (1) cookie 93908073471984 notify 146028888083 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5568ad5adc60 con 0x7f0204035070 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f00e7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 93908073471984 notifier 4753 bl.length()=150 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f00e7fff640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f00d4003d70 con 0x7f0204035070 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 38 ==== osd_op_reply(137 notify.3 [notify cookie 93908074169648 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 39 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 40 ==== watch-notify(notify_complete (2) cookie 93908074169648 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568ad5d57a0 con 0x7f0204035070 2024-09-14T10:45:35.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:139 8.3 8:c2bdefda:root::.bucket.meta.myfoo6%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x5568ad5b8ab0 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 40 ==== osd_op_reply(139 .bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 [call,call,delete] v34'5 uv5 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f02142689c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 from cache 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f02142689c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9, ofs0, ns] 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 93908074169648 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x7f020c019040 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== watch-notify(notify (1) cookie 93908073483936 notify 146028888095 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5568ad5f42e0 con 0x7f020c019040 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(140 notify.7 [notify cookie 93908074169648 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f00e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 93908073483936 notifier 4753 bl.length()=207 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.590+0000 7f00e77fe640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f00440032d0 con 0x7f020c019040 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== watch-notify(notify_complete (2) cookie 93908074169648 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568ad5ce3b0 con 0x7f020c019040 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:142 4.26 4:65065dde:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x7f020c019040 2024-09-14T10:45:35.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:143 4.c 4:3019b81f:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f4c70 con 0x5568ad5b8ab0 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:144 4.3b 4:dedad413:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad610e50 con 0x5568ad5bed20 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:145 4.7 4:e131a36b:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x7f020c019040 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:146 4.21 4:84ac6dda:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f3ad0 con 0x7f020c019040 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:147 4.e 4:70a44412:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f4c70 con 0x7f0204035070 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:148 4.3d 4:bfde325a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad610e50 con 0x7f0204035070 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:149 4.2c 4:35b9f0c3:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x5568ad5b8ab0 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:150 4.37 4:ef6efac0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e7f0 con 0x7f020c019040 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:151 4.a 4:51859d6e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f4c70 con 0x7f0204035070 2024-09-14T10:45:35.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:152 4.19 4:9aecc622:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60e320 con 0x7f0204035070 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 41 ==== osd_op_reply(148 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 42 ==== osd_op_reply(151 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.9 [delete] v34'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 43 ==== osd_op_reply(147 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.5 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 41 ==== osd_op_reply(143 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.1 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(144 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.2 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(142 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.0 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(146 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.4 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 40 ==== osd_op_reply(145 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 42 ==== osd_op_reply(149 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.7 [delete] v34'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.594+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 41 ==== osd_op_reply(150 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.8 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 44 ==== osd_op_reply(152 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9.10 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 : miss 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:153 6.3 6:c0632593:::pubsub..bucket.myfoo6%2f67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad610e50 con 0x7f0204035070 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 45 ==== osd_op_reply(153 pubsub..bucket.myfoo6/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 info.flags=0x0 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 10 adding default.rgw.log++pubsub..bucket.myfoo6/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 to cache LRU end 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:154 6.3 6:c0632593:::pubsub..bucket.myfoo6%2f67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60b020 con 0x7f0204035070 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 46 ==== osd_op_reply(154 pubsub..bucket.myfoo6/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.9 [delete] v34'71 uv55 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60b020 con 0x5568ad5b8ab0 2024-09-14T10:45:35.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 43 ==== osd_op_reply(155 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-14T10:45:35.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60b020 con 0x5568ad5b8ab0 2024-09-14T10:45:35.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 44 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T10:45:35.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.598+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 93908073754656 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f4c70 con 0x7f020c019040 2024-09-14T10:45:35.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 42 ==== watch-notify(notify (1) cookie 93908073470784 notify 146028888096 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5568ad5ce3b0 con 0x7f020c019040 2024-09-14T10:45:35.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f00e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 93908073470784 notifier 4753 bl.length()=170 2024-09-14T10:45:35.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 43 ==== osd_op_reply(157 notify.5 [notify cookie 93908073754656 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f00e77fe640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f00440032b0 con 0x7f020c019040 2024-09-14T10:45:35.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 44 ==== watch-notify(notify_complete (2) cookie 93908073754656 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568ad583230 con 0x7f020c019040 2024-09-14T10:45:35.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 45 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f02142689c0 10 removing email index: 2024-09-14T10:45:35.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f02142689c0 10 removing user buckets index 2024-09-14T10:45:35.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60b020 con 0x5568ad5b8ab0 2024-09-14T10:45:35.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 45 ==== osd_op_reply(159 bud.buckets [delete] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f02142689c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-14T10:45:35.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93908073754656 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad670530 con 0x7f020c019040 2024-09-14T10:45:35.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 46 ==== watch-notify(notify (1) cookie 93908073480096 notify 146028888097 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5568ad583230 con 0x7f020c019040 2024-09-14T10:45:35.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f00e7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 93908073480096 notifier 4753 bl.length()=160 2024-09-14T10:45:35.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.602+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 47 ==== osd_op_reply(160 notify.6 [notify cookie 93908073754656 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f00e7fff640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f00d4003d70 con 0x7f020c019040 2024-09-14T10:45:35.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 48 ==== watch-notify(notify_complete (2) cookie 93908073754656 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568ad582880 con 0x7f020c019040 2024-09-14T10:45:35.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 49 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f02142689c0 10 removing user index: bud 2024-09-14T10:45:35.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad60b020 con 0x7f0204035070 2024-09-14T10:45:35.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 47 ==== osd_op_reply(162 bud [call,call,delete] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f02142689c0 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-14T10:45:35.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f02142689c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-14T10:45:35.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93908073754656 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568ad670530 con 0x7f020c019040 2024-09-14T10:45:35.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 50 ==== watch-notify(notify (1) cookie 93908073470784 notify 146028888098 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5568ad582880 con 0x7f020c019040 2024-09-14T10:45:35.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f00e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 93908073470784 notifier 4753 bl.length()=152 2024-09-14T10:45:35.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f00e77fe640 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f00440032b0 con 0x7f020c019040 2024-09-14T10:45:35.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 51 ==== osd_op_reply(163 notify.5 [notify cookie 93908073754656 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 52 ==== watch-notify(notify_complete (2) cookie 93908073754656 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5568ad5825f0 con 0x7f020c019040 2024-09-14T10:45:35.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.606+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 53 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.610+0000 7f00c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:35.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.610+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93908073481152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.610+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 46 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93908073481152] v34'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.610+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93908073461760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x7f0204035070 2024-09-14T10:45:35.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.610+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 48 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93908073461760] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.610+0000 7f02142689c0 20 remove_watcher() i=0 2024-09-14T10:45:35.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.610+0000 7f02142689c0 2 removed watcher, disabling cache 2024-09-14T10:45:35.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.610+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93908073465872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.614+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 47 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93908073465872] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.614+0000 7f02142689c0 20 remove_watcher() i=1 2024-09-14T10:45:35.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.614+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93908073459248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x5568ad5bed20 2024-09-14T10:45:35.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.614+0000 7f021156d640 1 -- 172.21.15.96:0/98625097 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93908073459248] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020405f040 con 0x5568ad5bed20 2024-09-14T10:45:35.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.614+0000 7f02142689c0 20 remove_watcher() i=2 2024-09-14T10:45:35.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.614+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93908073471984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x7f0204035070 2024-09-14T10:45:35.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.618+0000 7f021256f640 1 -- 172.21.15.96:0/98625097 <== osd.2 v2:172.21.15.96:6816/2312202642 49 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93908073471984] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f020c02f040 con 0x7f0204035070 2024-09-14T10:45:35.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.618+0000 7f02142689c0 20 remove_watcher() i=3 2024-09-14T10:45:35.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.618+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93908073476752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x5568ad5b8ab0 2024-09-14T10:45:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.618+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.1 v2:172.21.15.96:6808/2339799699 48 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93908073476752] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x5568ad5b8ab0 2024-09-14T10:45:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.618+0000 7f02142689c0 20 remove_watcher() i=4 2024-09-14T10:45:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.618+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93908073470784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x7f020c019040 2024-09-14T10:45:35.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.622+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 54 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93908073470784] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.622+0000 7f02142689c0 20 remove_watcher() i=5 2024-09-14T10:45:35.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.622+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93908073480096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x7f020c019040 2024-09-14T10:45:35.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.622+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 55 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93908073480096] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.622+0000 7f02142689c0 20 remove_watcher() i=6 2024-09-14T10:45:35.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.622+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93908073483936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568ad5f57c0 con 0x7f020c019040 2024-09-14T10:45:35.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 <== osd.0 v2:172.21.15.70:6800/3481052616 56 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93908073483936] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01fc0f2080 con 0x7f020c019040 2024-09-14T10:45:35.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 20 remove_watcher() i=7 2024-09-14T10:45:35.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f020c019040 msgr2=0x7f020c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f020c019040 0x7f020c019930 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad5b8ab0 msgr2=0x5568ad5baf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad5b8ab0 0x5568ad5baf40 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0204035070 msgr2=0x7f0204027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0204035070 0x7f0204027440 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5568ad5bed20 msgr2=0x5568ad5c1110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5568ad5bed20 0x5568ad5c1110 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00dc03a1a0 msgr2=0x7f00dc03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00dc03a1a0 0x7f00dc03c660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f020c00f010 tx=0x7f020c01b070 comp rx=0 tx=0).stop 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 msgr2=0x5568ad5ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5ad700 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0204024d20 tx=0x7f0204050720 comp rx=0 tx=0).stop 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f0211d6e640 1 -- 172.21.15.96:0/98625097 reap_dead start 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 shutdown_connections 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/98625097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad5a71d0 0x5568ad5ad700 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 >> 172.21.15.96:0/98625097 conn(0x5568ad5a2590 msgr2=0x5568ad5a07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 shutdown_connections 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/98625097 wait complete. 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/3798319989 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00e803a150 msgr2=0x7f00e803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/3798319989 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00e803a150 0x7f00e803c610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5568ad58a9f0 tx=0x7f020c003070 comp rx=0 tx=0).stop 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/3798319989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad599800 msgr2=0x5568ad599c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/3798319989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad599800 0x5568ad599c20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f020400e670 tx=0x7f020400ea70 comp rx=0 tx=0).stop 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/3798319989 shutdown_connections 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/3798319989 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00e803a150 0x7f00e803c610 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/3798319989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad599800 0x5568ad599c20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/3798319989 >> 172.21.15.96:0/3798319989 conn(0x5568ad58f1b0 msgr2=0x5568ad58f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/3798319989 shutdown_connections 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/3798319989 wait complete. 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad403b50 msgr2=0x5568ad589200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad403b50 0x5568ad589200 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00f803a150 msgr2=0x7f00f803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00f803a150 0x7f00f803c610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0204001e40 tx=0x7f02040013a0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 msgr2=0x5568ad582090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad582090 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f01fc01b0d0 tx=0x5568ad403490 comp rx=0 tx=0).stop 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 shutdown_connections 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5568ad403b50 0x5568ad589200 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f00f803a150 0x7f00f803c610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 --2- 172.21.15.96:0/1707142782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5568ad402550 0x5568ad582090 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 >> 172.21.15.96:0/1707142782 conn(0x5568ad488b30 msgr2=0x5568ad57bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 shutdown_connections 2024-09-14T10:45:35.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.626+0000 7f02142689c0 1 -- 172.21.15.96:0/1707142782 wait complete. 2024-09-14T10:45:35.639 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-14T10:45:35.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-14T10:45:35.639 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-14T10:45:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:35.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f218ec9c0 1 Processor -- start 2024-09-14T10:45:35.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f218ec9c0 1 -- start start 2024-09-14T10:45:35.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f218ec9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c5b109a050 0x55c5b109c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f218ec9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5b0f3f7a0 con 0x55c5b1095e60 2024-09-14T10:45:35.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f218ec9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55c5b0f9b1b0 con 0x55c5b109a050 2024-09-14T10:45:35.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f1ebf1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c5b109a050 0x55c5b109c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f1ebf1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c5b109a050 0x55c5b109c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41924/0 (socket says 172.21.15.96:41924) 2024-09-14T10:45:35.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f1f3f2640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55c5b1095e60 0x55c5b1096240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:49276/0 (socket says 172.21.15.96:49276) 2024-09-14T10:45:35.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/734564552 learned_addr learned my addr 172.21.15.96:0/734564552 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/734564552 >> v1:172.21.15.70:6789/0 conn(0x55c5b1095e60 legacy=0x55c5b1096240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.718+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/734564552 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5b0f19da0 con 0x55c5b109a050 2024-09-14T10:45:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/734564552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b109c440 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800a750 tx=0x7f2f0801d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317ce80f38db7765 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f1e3f0640 1 -- 172.21.15.96:0/734564552 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0800a200 con 0x55c5b109a050 2024-09-14T10:45:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f1e3f0640 1 -- 172.21.15.96:0/734564552 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0800a3a0 con 0x55c5b109a050 2024-09-14T10:45:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f1e3f0640 1 -- 172.21.15.96:0/734564552 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f080086f0 con 0x55c5b109a050 2024-09-14T10:45:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/734564552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 msgr2=0x55c5b109c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/734564552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b109c440 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800a750 tx=0x7f2f0801d290 comp rx=0 tx=0).stop 2024-09-14T10:45:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/734564552 shutdown_connections 2024-09-14T10:45:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/734564552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b109c440 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/734564552 >> 172.21.15.96:0/734564552 conn(0x55c5b1091980 msgr2=0x55c5b1093da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/734564552 shutdown_connections 2024-09-14T10:45:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.722+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/734564552 wait complete. 2024-09-14T10:45:35.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.734+0000 7f2f218ec9c0 1 Processor -- start 2024-09-14T10:45:35.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.734+0000 7f2f218ec9c0 1 -- start start 2024-09-14T10:45:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.734+0000 7f2f218ec9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b1095e60 0x55c5b1184590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.734+0000 7f2f218ec9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c5b0f9efc0 con 0x55c5b1095e60 2024-09-14T10:45:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b1095e60 0x55c5b1184590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b1095e60 0x55c5b1184590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41928/0 (socket says 172.21.15.96:41928) 2024-09-14T10:45:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/3024807447 learned_addr learned my addr 172.21.15.96:0/3024807447 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/3024807447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5b1184b80 con 0x55c5b1095e60 2024-09-14T10:45:35.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 --2- 172.21.15.96:0/3024807447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b1095e60 0x55c5b1184590 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001680 tx=0x7f2f10001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a89bbd5a6f03154 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2e0d60a640 1 -- 172.21.15.96:0/3024807447 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10013420 con 0x55c5b1095e60 2024-09-14T10:45:35.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2e0d60a640 1 -- 172.21.15.96:0/3024807447 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f100135c0 con 0x55c5b1095e60 2024-09-14T10:45:35.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2e0d60a640 1 -- 172.21.15.96:0/3024807447 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f100138e0 con 0x55c5b1095e60 2024-09-14T10:45:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3024807447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b1095e60 msgr2=0x55c5b1184590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/3024807447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b1095e60 0x55c5b1184590 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001680 tx=0x7f2f10001b40 comp rx=0 tx=0).stop 2024-09-14T10:45:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3024807447 shutdown_connections 2024-09-14T10:45:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/3024807447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b1095e60 0x55c5b1184590 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3024807447 >> 172.21.15.96:0/3024807447 conn(0x55c5b1091980 msgr2=0x55c5b117bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3024807447 shutdown_connections 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3024807447 wait complete. 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 Processor -- start 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 -- start start 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b118c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f218ec9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c5b0f40a50 con 0x55c5b109a050 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b118c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b118c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41938/0 (socket says 172.21.15.96:41938) 2024-09-14T10:45:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/1172417855 learned_addr learned my addr 172.21.15.96:0/1172417855 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.738+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/1172417855 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5b118c6f0 con 0x55c5b109a050 2024-09-14T10:45:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f1f3f2640 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b118c190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001b80 tx=0x7f2f10000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2e0be07640 1 -- 172.21.15.96:0/1172417855 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10013630 con 0x55c5b109a050 2024-09-14T10:45:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2e0be07640 1 -- 172.21.15.96:0/1172417855 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f10023070 con 0x55c5b109a050 2024-09-14T10:45:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5b118c980 con 0x55c5b109a050 2024-09-14T10:45:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2e0be07640 1 -- 172.21.15.96:0/1172417855 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10013960 con 0x55c5b109a050 2024-09-14T10:45:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5b118d290 con 0x55c5b109a050 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2e0be07640 1 -- 172.21.15.96:0/1172417855 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2f10010070 con 0x55c5b109a050 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2e0be07640 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2e0403a150 0x7f2e0403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2e0be07640 1 -- 172.21.15.96:0/1172417855 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f10050a20 con 0x55c5b109a050 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2e0403a150 0x7f2e0403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b1191250 0x55c5b1193640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1193b80 con 0x55c5b1191250 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b1191250 0x55c5b1193640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2e0403a150 0x7f2e0403c610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f080ad000 tx=0x7f2f080a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b1191250 0x55c5b1193640 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/1172417855 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f180083f0 con 0x55c5b1191250 2024-09-14T10:45:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1193fa0 con 0x55c5b1191250 2024-09-14T10:45:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/1172417855 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f180083f0 con 0x55c5b1191250 2024-09-14T10:45:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11958a0 con 0x55c5b1191250 2024-09-14T10:45:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/1172417855 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f180083f0 con 0x55c5b1191250 2024-09-14T10:45:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.742+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11949e0 con 0x55c5b1191250 2024-09-14T10:45:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/1172417855 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f180083f0 con 0x55c5b1191250 2024-09-14T10:45:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1194e40 con 0x55c5b1191250 2024-09-14T10:45:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/1172417855 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f180083f0 con 0x55c5b1191250 2024-09-14T10:45:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f218ec9c0 1 Processor -- start 2024-09-14T10:45:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f218ec9c0 1 -- start start 2024-09-14T10:45:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f218ec9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11a3c70 0x55c5b11a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f218ec9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c5b0fabd80 con 0x55c5b11a3c70 2024-09-14T10:45:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f1ebf1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11a3c70 0x55c5b11a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f1ebf1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11a3c70 0x55c5b11a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41952/0 (socket says 172.21.15.96:41952) 2024-09-14T10:45:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/3260806878 learned_addr learned my addr 172.21.15.96:0/3260806878 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/3260806878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5b11a46d0 con 0x55c5b11a3c70 2024-09-14T10:45:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/3260806878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11a3c70 0x55c5b11a4090 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2f08019ea0 tx=0x7f2f0801a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2e09602640 1 -- 172.21.15.96:0/3260806878 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f080c7070 con 0x55c5b11a3c70 2024-09-14T10:45:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2e09602640 1 -- 172.21.15.96:0/3260806878 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f08007db0 con 0x55c5b11a3c70 2024-09-14T10:45:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3260806878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5b11a4f30 con 0x55c5b11a3c70 2024-09-14T10:45:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2e09602640 1 -- 172.21.15.96:0/3260806878 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f080c2530 con 0x55c5b11a3c70 2024-09-14T10:45:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.746+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3260806878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5b11a54a0 con 0x55c5b11a3c70 2024-09-14T10:45:35.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2e09602640 1 -- 172.21.15.96:0/3260806878 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2f080ac3f0 con 0x55c5b11a3c70 2024-09-14T10:45:35.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2e09602640 1 --2- 172.21.15.96:0/3260806878 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2df803a1a0 0x7f2df803c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2e09602640 1 -- 172.21.15.96:0/3260806878 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f080b2040 con 0x55c5b11a3c70 2024-09-14T10:45:35.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/3260806878 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2df803a1a0 0x7f2df803c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 Processor -- start 2024-09-14T10:45:35.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- start start 2024-09-14T10:45:35.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/3260806878 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2df803a1a0 0x7f2df803c660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55c5b1194d80 tx=0x7f2f18003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c5b1184fb0 con 0x55c5b11b14e0 2024-09-14T10:45:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1ebf1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1ebf1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41958/0 (socket says 172.21.15.96:41958) 2024-09-14T10:45:35.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/811175763 learned_addr learned my addr 172.21.15.96:0/811175763 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/811175763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5b11b1ed0 con 0x55c5b11b14e0 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/811175763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b18e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2f08007840 tx=0x7f2f080b6650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b199d7e1100b686 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2e02ffd640 1 -- 172.21.15.96:0/811175763 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f080cabd0 con 0x55c5b11b14e0 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2e02ffd640 1 -- 172.21.15.96:0/811175763 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f080ea250 con 0x55c5b11b14e0 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2e02ffd640 1 -- 172.21.15.96:0/811175763 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f080abca0 con 0x55c5b11b14e0 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/811175763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 msgr2=0x55c5b11b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/811175763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b18e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2f08007840 tx=0x7f2f080b6650 comp rx=0 tx=0).stop 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/811175763 shutdown_connections 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/811175763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b18e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/811175763 >> 172.21.15.96:0/811175763 conn(0x55c5b11ac900 msgr2=0x55c5b11aab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/811175763 shutdown_connections 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/811175763 wait complete. 2024-09-14T10:45:35.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 Processor -- start 2024-09-14T10:45:35.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- start start 2024-09-14T10:45:35.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f218ec9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c5b11b0430 con 0x55c5b11b14e0 2024-09-14T10:45:35.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1ebf1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1ebf1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:41974/0 (socket says 172.21.15.96:41974) 2024-09-14T10:45:35.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.750+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 learned_addr learned my addr 172.21.15.96:0/523307493 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:45:35.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5b11b7f60 con 0x55c5b11b14e0 2024-09-14T10:45:35.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b7a00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2f080cadb0 tx=0x7f2f080eb730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2e017fa640 1 -- 172.21.15.96:0/523307493 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f080cabd0 con 0x55c5b11b14e0 2024-09-14T10:45:35.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5b11b81f0 con 0x55c5b11b14e0 2024-09-14T10:45:35.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5b11b8ba0 con 0x55c5b11b14e0 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2e017fa640 1 -- 172.21.15.96:0/523307493 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f080df030 con 0x55c5b11b14e0 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2e017fa640 1 -- 172.21.15.96:0/523307493 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f080aca20 con 0x55c5b11b14e0 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2e017fa640 1 -- 172.21.15.96:0/523307493 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2f080c13a0 con 0x55c5b11b14e0 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2e017fa640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2de803a150 0x7f2de803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2de803a150 0x7f2de803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2e017fa640 1 -- 172.21.15.96:0/523307493 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f080ea050 con 0x55c5b11b14e0 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b11c2fc0 0x55c5b11c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c5ba0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1f3f2640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b11c2fc0 0x55c5b11c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2de803a150 0x7f2de803c610 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800f010 tx=0x7f2f1801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1f3f2640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b11c2fc0 0x55c5b11c5450 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 20 realm 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c5fb0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c6880 con 0x55c5b11c2fc0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.754+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c6c20 con 0x55c5b11c2fc0 2024-09-14T10:45:35.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f218ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c7470 con 0x55c5b11c2fc0 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f218ec9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f218ec9c0 20 searching for the correct realm 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5b11c91e0 0x55c5b11cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cbbb0 con 0x55c5b11c91e0 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5b11c91e0 0x55c5b11cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5b11c91e0 0x55c5b11cb5d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1ebf1640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2f080db040 0x7f2f080d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cbbb0 con 0x7f2f080db040 2024-09-14T10:45:35.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2f080db040 0x7f2f080d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2f080db040 0x7f2f080d09f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1fbf3640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2f18019040 0x7f2f18019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:45:35.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cbbb0 con 0x7f2f18019040 2024-09-14T10:45:35.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2f18019040 0x7f2f18019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:45:35.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2f18019040 0x7f2f18019930 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:45:35.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.758+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f18019040 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f18019040 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f080db040 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c91e0 2024-09-14T10:45:35.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f18019040 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f080db040 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c91e0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c91e0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.762+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f18019040 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c91e0 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c91e0 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f18019040 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c91e0 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f080db040 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f080db040 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c91e0 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.766+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f18019040 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f080db040 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c91e0 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f18019040 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f2f10033040 con 0x7f2f080db040 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:45:35.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c7cc0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c80b0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:35.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c80b0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 zone default found 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 4 Realm: () 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 zonegroup default 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11c7840 con 0x7f2f080db040 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cdb20 con 0x55c5b11c91e0 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ce030 con 0x55c5b11c91e0 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 started sync module instance, tier type = 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.770+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ccec0 con 0x7f2f080db040 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.774+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.774+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94307568374752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ccec0 con 0x7f2f080db040 2024-09-14T10:45:35.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.774+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ceaf0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.774+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94307568374752] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.774+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.774+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94307568379392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ccec0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.774+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cf500 con 0x55c5b11c91e0 2024-09-14T10:45:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94307568379392] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94307568372240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cce30 con 0x55c5b11c91e0 2024-09-14T10:45:35.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d0290 con 0x7f2f080db040 2024-09-14T10:45:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94307568385440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d0b30 con 0x7f2f080db040 2024-09-14T10:45:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d1550 con 0x55c5b11c2fc0 2024-09-14T10:45:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94307568372240] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.778+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94307568385440] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.782+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.782+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94307568390208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d0680 con 0x55c5b11c2fc0 2024-09-14T10:45:35.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.782+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d1e20 con 0x7f2f18019040 2024-09-14T10:45:35.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.782+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94307568390208] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.782+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.782+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94307568384240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d0680 con 0x7f2f18019040 2024-09-14T10:45:35.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.782+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d22c0 con 0x7f2f18019040 2024-09-14T10:45:35.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94307568384240] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94307568393648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d2280 con 0x7f2f18019040 2024-09-14T10:45:35.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d2ca0 con 0x7f2f18019040 2024-09-14T10:45:35.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94307568396176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d3110 con 0x7f2f18019040 2024-09-14T10:45:35.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 20 add_watcher() i=0 2024-09-14T10:45:35.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 20 add_watcher() i=1 2024-09-14T10:45:35.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 20 add_watcher() i=2 2024-09-14T10:45:35.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 20 add_watcher() i=3 2024-09-14T10:45:35.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 20 add_watcher() i=4 2024-09-14T10:45:35.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 20 add_watcher() i=5 2024-09-14T10:45:35.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94307568393648] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.786+0000 7f2f218ec9c0 20 add_watcher() i=6 2024-09-14T10:45:35.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94307568396176] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f218ec9c0 20 add_watcher() i=7 2024-09-14T10:45:35.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f218ec9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:35.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d3110 con 0x55c5b11c2fc0 2024-09-14T10:45:35.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94307568397408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11d3080 con 0x55c5b11c2fc0 2024-09-14T10:45:35.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94307568397408] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2dd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:35.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f218ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:35.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f218ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:35.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.790+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11debb0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.794+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.794+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11df280 con 0x7f2f18019040 2024-09-14T10:45:35.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.794+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.794+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11df280 con 0x55c5b11c91e0 2024-09-14T10:45:35.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.794+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.794+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11df620 con 0x55c5b11c2fc0 2024-09-14T10:45:35.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.798+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.798+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11df6c0 con 0x7f2f080db040 2024-09-14T10:45:35.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.798+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'72 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.798+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11dfcf0 con 0x55c5b11c91e0 2024-09-14T10:45:35.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.798+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.798+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e00d0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.802+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.802+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e00b0 con 0x7f2f18019040 2024-09-14T10:45:35.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.802+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'49 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.802+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0090 con 0x7f2f080db040 2024-09-14T10:45:35.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.806+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.806+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0640 con 0x55c5b11c91e0 2024-09-14T10:45:35.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.806+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.806+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0620 con 0x7f2f080db040 2024-09-14T10:45:35.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.806+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.806+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0b90 con 0x7f2f18019040 2024-09-14T10:45:35.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.810+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.810+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0b90 con 0x7f2f080db040 2024-09-14T10:45:35.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.810+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.810+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0df0 con 0x7f2f18019040 2024-09-14T10:45:35.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.810+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.810+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0dc0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.814+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.814+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0c90 con 0x55c5b11c91e0 2024-09-14T10:45:35.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.814+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.814+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0c90 con 0x7f2f080db040 2024-09-14T10:45:35.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.814+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.814+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e10f0 con 0x55c5b11c91e0 2024-09-14T10:45:35.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.818+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.818+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e10f0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.818+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.818+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e10f0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.818+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.818+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ff0 con 0x55c5b11c91e0 2024-09-14T10:45:35.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.822+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.822+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0dc0 con 0x7f2f080db040 2024-09-14T10:45:35.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.822+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.822+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x55c5b11c91e0 2024-09-14T10:45:35.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.822+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.822+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x55c5b11c91e0 2024-09-14T10:45:35.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.826+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.826+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x55c5b11c91e0 2024-09-14T10:45:35.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.826+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.826+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x55c5b11c91e0 2024-09-14T10:45:35.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.826+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.826+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x7f2f18019040 2024-09-14T10:45:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.830+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.830+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x55c5b11c91e0 2024-09-14T10:45:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.830+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.830+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x7f2f18019040 2024-09-14T10:45:35.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.834+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'50 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.834+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x55c5b11c91e0 2024-09-14T10:45:35.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.834+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.834+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x7f2f18019040 2024-09-14T10:45:35.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.838+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.838+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11e0ec0 con 0x7f2f080db040 2024-09-14T10:45:35.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.838+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.838+0000 7f2dd4fe1640 20 reqs_thread_entry: start 2024-09-14T10:45:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:45:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 20 Filter name: none 2024-09-14T10:45:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2d4e7fc640 20 reqs_thread_entry: start 2024-09-14T10:45:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:45:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11de5a0 con 0x7f2f18019040 2024-09-14T10:45:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:45:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:45:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:45:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:45:35.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fec90 con 0x7f2f18019040 2024-09-14T10:45:35.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f2f1000f030 con 0x7f2f18019040 2024-09-14T10:45:35.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 : miss 2024-09-14T10:45:35.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:96 8.c 8:359abea2:root::.bucket.meta.myfoo7%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fe8d0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(96 .bucket.meta.myfoo7:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 20 rados_obj.operate() r=0 bl.length=390 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 info.flags=0x17 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 to cache LRU end 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:97 4.3c 4:3e51e878:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127bdc0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(97 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1000f030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:98 4.22 4:465cc4af:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127bdc0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(98 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.842+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:99 4.21 4:85989ee0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be00 con 0x7f2f18019040 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(99 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:100 4.27 4:e572a0c8:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be00 con 0x55c5b11c2fc0 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(100 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:101 4.10 4:09f90843:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be00 con 0x55c5b11c91e0 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(101 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:102 4.3d 4:bde06422:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be40 con 0x7f2f080db040 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(102 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5 [call out=382b] v0'0 uv7 ondisk = 0) ==== 195+0+382 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 10 cls_bucket_list_unordered: got fourteen 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 4.33 4:cefe99cc:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be80 con 0x7f2f18019040 2024-09-14T10:45:35.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(103 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:104 4.e 4:71fcd68a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be80 con 0x7f2f080db040 2024-09-14T10:45:35.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(104 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:105 4.30 4:0e67bceb:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be80 con 0x55c5b11c91e0 2024-09-14T10:45:35.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(105 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:106 4.3d 4:bf63cd3d:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be80 con 0x7f2f080db040 2024-09-14T10:45:35.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(106 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.846+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:107 4.2d 4:b4829371:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127be80 con 0x7f2f18019040 2024-09-14T10:45:35.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(107 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 20 get_obj_state: octx=0x7f2f10011e80 obj=myfoo7:fourteen state=0x55c5b127a288 s->prefetch_data=0 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:108 3.1cs0 3:3b5ed28c:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10_fourteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ff420 con 0x55c5b11c2fc0 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(108 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10_fourteen [call out=24b,getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 281+0+898 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 10 manifest: total_size = 8 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 20 get_obj_state: setting s->obj_tag to 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.15360020370860765306 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 20 get_obj_state: octx=0x7f2f10011e80 obj=myfoo7:fourteen state=0x55c5b127a288 s->prefetch_data=0 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 20 prepare_atomic_modification: state is not atomic. state=0x55c5b127a288 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:109 4.3d 4:bde06422:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1203030 con 0x7f2f080db040 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(109 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.850+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:110 3.1cs0 3:3b5ed28c:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1203030 con 0x55c5b11c2fc0 2024-09-14T10:45:35.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(110 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:111 4.3d 4:bde06422:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1203ac0 con 0x7f2f080db040 2024-09-14T10:45:35.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 20 list_objects_ordered: starting attempt 1 2024-09-14T10:45:35.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T10:45:35.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:112 4.3c 4:3e51e878:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1203ac0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:113 4.22 4:465cc4af:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a550 con 0x55c5b11c2fc0 2024-09-14T10:45:35.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:114 4.21 4:85989ee0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1203ac0 con 0x7f2f18019040 2024-09-14T10:45:35.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:115 4.27 4:e572a0c8:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1203ac0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:116 4.10 4:09f90843:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b120f150 con 0x55c5b11c91e0 2024-09-14T10:45:35.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:117 4.3d 4:bde06422:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1211a20 con 0x7f2f080db040 2024-09-14T10:45:35.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(113 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:118 4.33 4:cefe99cc:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1214520 con 0x7f2f18019040 2024-09-14T10:45:35.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(112 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:119 4.e 4:71fcd68a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a100 con 0x7f2f080db040 2024-09-14T10:45:35.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:120 4.30 4:0e67bceb:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1207d80 con 0x55c5b11c91e0 2024-09-14T10:45:35.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:121 4.3d 4:bf63cd3d:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a100 con 0x7f2f080db040 2024-09-14T10:45:35.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(115 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:122 4.2d 4:b4829371:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1217da0 con 0x7f2f18019040 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(116 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(114 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(120 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(121 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(119 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(111 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2e027fc640 20 handle_completion(): completion ok for obj=fourteen 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(122 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(118 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(117 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5 [call out=128b] v0'0 uv10 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10])"; uploads.size()=0; is_truncated=0 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:123 4.3c 4:3e51e878:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:124 4.22 4:465cc4af:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b120eb00 con 0x55c5b11c2fc0 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:125 4.21 4:85989ee0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1211f40 con 0x7f2f18019040 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:126 4.27 4:e572a0c8:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:127 4.10 4:09f90843:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1206d10 con 0x55c5b11c91e0 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:128 4.3d 4:bde06422:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1211f40 con 0x7f2f080db040 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:129 4.33 4:cefe99cc:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x7f2f18019040 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:130 4.e 4:71fcd68a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1206d10 con 0x7f2f080db040 2024-09-14T10:45:35.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 38 ==== osd_op_reply(123 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(128 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5 [call out=128b] v0'0 uv10 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(127 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:131 4.30 4:0e67bceb:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1211f40 con 0x55c5b11c91e0 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 39 ==== osd_op_reply(124 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 40 ==== osd_op_reply(126 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:132 4.3d 4:bf63cd3d:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1206d10 con 0x7f2f080db040 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(125 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.2 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(129 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.854+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:133 4.2d 4:b4829371:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b1207a90 con 0x7f2f18019040 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 29 ==== osd_op_reply(130 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 30 ==== osd_op_reply(132 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 31 ==== osd_op_reply(131 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(133 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x7f2f18019040 2024-09-14T10:45:35.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== osd_op_reply(134 fud.buckets [call] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f218ec9c0 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x7f2f080db040 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 31 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv45 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f218ec9c0 20 rados_obj.operate() r=0 bl.length=168 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f218ec9c0 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f218ec9c0 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.858+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x7f2f080db040 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 32 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'46 uv46 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f218ec9c0 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f218ec9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94307568596336 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x7f2f080db040 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 33 ==== watch-notify(notify (1) cookie 94307568385440 notify 146028888084 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55c5b11e13b0 con 0x7f2f080db040 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2e02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94307568385440 notifier 4760 bl.length()=150 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 34 ==== osd_op_reply(137 notify.3 [notify cookie 94307568596336 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2e02ffd640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2de4003d70 con 0x7f2f080db040 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 35 ==== watch-notify(notify_complete (2) cookie 94307568596336 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5b11df680 con 0x7f2f080db040 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 36 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:139 8.c 8:359abea2:root::.bucket.meta.myfoo7%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 41 ==== osd_op_reply(139 .bucket.meta.myfoo7:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 [call,call,delete] v34'7 uv7 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f218ec9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 from cache 2024-09-14T10:45:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f218ec9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10, ofs0, ns] 2024-09-14T10:45:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94307568576576 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x7f2f18019040 2024-09-14T10:45:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== watch-notify(notify (1) cookie 94307568393648 notify 146028888099 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55c5b11fde40 con 0x7f2f18019040 2024-09-14T10:45:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2e02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94307568393648 notifier 4760 bl.length()=208 2024-09-14T10:45:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(140 notify.6 [notify cookie 94307568576576 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.862+0000 7f2e02ffd640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2de4003d70 con 0x7f2f18019040 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== watch-notify(notify_complete (2) cookie 94307568576576 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5b11d81f0 con 0x7f2f18019040 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:142 4.3c 4:3e51e878:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:143 4.22 4:465cc4af:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a4c0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:144 4.21 4:85989ee0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b12075c0 con 0x7f2f18019040 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:145 4.27 4:e572a0c8:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fce30 con 0x55c5b11c2fc0 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:146 4.10 4:09f90843:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x55c5b11c91e0 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:147 4.3d 4:bde06422:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fd6c0 con 0x7f2f080db040 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:148 4.33 4:cefe99cc:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fdaa0 con 0x7f2f18019040 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:149 4.e 4:71fcd68a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fce30 con 0x7f2f080db040 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:150 4.30 4:0e67bceb:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b12075c0 con 0x55c5b11c91e0 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:151 4.3d 4:bf63cd3d:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127b0b0 con 0x7f2f080db040 2024-09-14T10:45:35.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:152 4.2d 4:b4829371:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b127a0a0 con 0x7f2f18019040 2024-09-14T10:45:35.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(144 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.2 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 42 ==== osd_op_reply(143 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.1 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 43 ==== osd_op_reply(142 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.0 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 37 ==== osd_op_reply(147 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.5 [delete] v34'11 uv11 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(152 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.10 [delete] v34'8 uv8 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.866+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 32 ==== osd_op_reply(146 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.4 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 33 ==== osd_op_reply(150 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.8 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 40 ==== osd_op_reply(148 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.6 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 38 ==== osd_op_reply(151 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.9 [delete] v34'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 39 ==== osd_op_reply(149 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.7 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 44 ==== osd_op_reply(145 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10.3 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f218ec9c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 : miss 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f218ec9c0 20 rados->read ofs=0 len=0 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:153 6.11 6:8d555b59:::pubsub..bucket.myfoo7%2f67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fd6c0 con 0x55c5b11c91e0 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 34 ==== osd_op_reply(153 pubsub..bucket.myfoo7/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f218ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f218ec9c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 info.flags=0x0 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f218ec9c0 10 adding default.rgw.log++pubsub..bucket.myfoo7/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 to cache LRU end 2024-09-14T10:45:35.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.870+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:154 6.11 6:8d555b59:::pubsub..bucket.myfoo7%2f67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fce30 con 0x55c5b11c91e0 2024-09-14T10:45:35.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.874+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 35 ==== osd_op_reply(154 pubsub..bucket.myfoo7/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.10 [delete] v34'30 uv23 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.874+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fce30 con 0x7f2f18019040 2024-09-14T10:45:35.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.874+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 41 ==== osd_op_reply(155 fud.buckets [call] v34'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.874+0000 7f2f218ec9c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-14T10:45:35.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.874+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b12079e0 con 0x7f2f18019040 2024-09-14T10:45:35.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 42 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f218ec9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:45:35.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94307568596336 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fe810 con 0x55c5b11c91e0 2024-09-14T10:45:35.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 36 ==== watch-notify(notify (1) cookie 94307568372240 notify 146028888071 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c5b11d83c0 con 0x55c5b11c91e0 2024-09-14T10:45:35.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2e027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94307568372240 notifier 4760 bl.length()=170 2024-09-14T10:45:35.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 37 ==== osd_op_reply(157 notify.2 [notify cookie 94307568596336 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2e027fc640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2d540032d0 con 0x55c5b11c91e0 2024-09-14T10:45:35.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 38 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 39 ==== watch-notify(notify_complete (2) cookie 94307568596336 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5b11b7f60 con 0x55c5b11c91e0 2024-09-14T10:45:35.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f218ec9c0 10 removing email index: 2024-09-14T10:45:35.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f218ec9c0 10 removing user buckets index 2024-09-14T10:45:35.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fe810 con 0x7f2f18019040 2024-09-14T10:45:35.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 43 ==== osd_op_reply(159 fud.buckets [delete] v34'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f218ec9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-14T10:45:35.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.878+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94307568596336 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b12079e0 con 0x7f2f18019040 2024-09-14T10:45:35.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 44 ==== watch-notify(notify (1) cookie 94307568393648 notify 146028888100 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c5b11d81f0 con 0x7f2f18019040 2024-09-14T10:45:35.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2e027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94307568393648 notifier 4760 bl.length()=160 2024-09-14T10:45:35.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2e027fc640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2d540032d0 con 0x7f2f18019040 2024-09-14T10:45:35.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 45 ==== osd_op_reply(160 notify.6 [notify cookie 94307568596336 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 46 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 47 ==== watch-notify(notify_complete (2) cookie 94307568596336 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5b118d290 con 0x7f2f18019040 2024-09-14T10:45:35.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f218ec9c0 10 removing user index: fud 2024-09-14T10:45:35.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11fe810 con 0x7f2f18019040 2024-09-14T10:45:35.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 48 ==== osd_op_reply(162 fud [call,call,delete] v34'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f218ec9c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-14T10:45:35.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f218ec9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-14T10:45:35.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.882+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94307568596336 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5b12079e0 con 0x7f2f18019040 2024-09-14T10:45:35.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 49 ==== watch-notify(notify (1) cookie 94307568384240 notify 146028888101 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c5b118d290 con 0x7f2f18019040 2024-09-14T10:45:35.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2e02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94307568384240 notifier 4760 bl.length()=152 2024-09-14T10:45:35.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2e02ffd640 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2de4003d70 con 0x7f2f18019040 2024-09-14T10:45:35.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 50 ==== osd_op_reply(163 notify.5 [notify cookie 94307568596336 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 51 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 52 ==== watch-notify(notify_complete (2) cookie 94307568596336 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c5b118c980 con 0x7f2f18019040 2024-09-14T10:45:35.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2dd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:35.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94307568397408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11da5c0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 45 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94307568397408] v34'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.886+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94307568374752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11da5c0 con 0x7f2f080db040 2024-09-14T10:45:35.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.890+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 40 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94307568374752] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.890+0000 7f2f218ec9c0 20 remove_watcher() i=0 2024-09-14T10:45:35.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.890+0000 7f2f218ec9c0 2 removed watcher, disabling cache 2024-09-14T10:45:35.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.890+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94307568379392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11da5c0 con 0x55c5b11c2fc0 2024-09-14T10:45:35.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.890+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 46 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94307568379392] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.890+0000 7f2f218ec9c0 20 remove_watcher() i=1 2024-09-14T10:45:35.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.890+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94307568372240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ce600 con 0x55c5b11c91e0 2024-09-14T10:45:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.894+0000 7f2f1ebf1640 1 -- 172.21.15.96:0/523307493 <== osd.3 v2:172.21.15.96:6800/3683402699 40 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94307568372240] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f080f4070 con 0x55c5b11c91e0 2024-09-14T10:45:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.894+0000 7f2f218ec9c0 20 remove_watcher() i=2 2024-09-14T10:45:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.894+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94307568385440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cca10 con 0x7f2f080db040 2024-09-14T10:45:35.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.894+0000 7f2f1fbf3640 1 -- 172.21.15.96:0/523307493 <== osd.2 v2:172.21.15.96:6816/2312202642 41 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94307568385440] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1802f040 con 0x7f2f080db040 2024-09-14T10:45:35.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.894+0000 7f2f218ec9c0 20 remove_watcher() i=3 2024-09-14T10:45:35.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.894+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94307568390208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ce600 con 0x55c5b11c2fc0 2024-09-14T10:45:35.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.898+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.1 v2:172.21.15.96:6808/2339799699 47 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94307568390208] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x55c5b11c2fc0 2024-09-14T10:45:35.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.898+0000 7f2f218ec9c0 20 remove_watcher() i=4 2024-09-14T10:45:35.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.898+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94307568384240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cca10 con 0x7f2f18019040 2024-09-14T10:45:35.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.898+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 53 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94307568384240] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.898+0000 7f2f218ec9c0 20 remove_watcher() i=5 2024-09-14T10:45:35.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.898+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94307568393648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11ce600 con 0x7f2f18019040 2024-09-14T10:45:35.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 54 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94307568393648] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 20 remove_watcher() i=6 2024-09-14T10:45:35.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94307568396176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5b11cca10 con 0x7f2f18019040 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 <== osd.0 v2:172.21.15.70:6800/3481052616 55 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94307568396176] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1005e040 con 0x7f2f18019040 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 20 remove_watcher() i=7 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2f18019040 msgr2=0x7f2f18019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2f18019040 0x7f2f18019930 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b11c2fc0 msgr2=0x55c5b11c5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b11c2fc0 0x55c5b11c5450 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2f080db040 msgr2=0x7f2f080d09f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f2f080db040 0x7f2f080d09f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5b11c91e0 msgr2=0x55c5b11cb5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5b11c91e0 0x55c5b11cb5d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2de803a150 msgr2=0x7f2de803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2de803a150 0x7f2de803c610 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800f010 tx=0x7f2f1801b070 comp rx=0 tx=0).stop 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f1f3f2640 1 -- 172.21.15.96:0/523307493 reap_dead start 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 msgr2=0x55c5b11b7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b7a00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2f080cadb0 tx=0x7f2f080eb730 comp rx=0 tx=0).stop 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 shutdown_connections 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/523307493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11b14e0 0x55c5b11b7a00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 >> 172.21.15.96:0/523307493 conn(0x55c5b11ac900 msgr2=0x55c5b11aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 shutdown_connections 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/523307493 wait complete. 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3260806878 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2df803a1a0 msgr2=0x7f2df803c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/3260806878 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2df803a1a0 0x7f2df803c660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55c5b1194d80 tx=0x7f2f18003070 comp rx=0 tx=0).stop 2024-09-14T10:45:35.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3260806878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11a3c70 msgr2=0x55c5b11a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/3260806878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11a3c70 0x55c5b11a4090 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2f08019ea0 tx=0x7f2f0801a030 comp rx=0 tx=0).stop 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3260806878 shutdown_connections 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/3260806878 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2df803a1a0 0x7f2df803c660 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/3260806878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b11a3c70 0x55c5b11a4090 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3260806878 >> 172.21.15.96:0/3260806878 conn(0x55c5b1199620 msgr2=0x55c5b1199a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.902+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3260806878 shutdown_connections 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/3260806878 wait complete. 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b1191250 msgr2=0x55c5b1193640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b1191250 0x55c5b1193640 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2e0403a150 msgr2=0x7f2e0403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2e0403a150 0x7f2e0403c610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f080ad000 tx=0x7f2f080a7000 comp rx=0 tx=0).stop 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 msgr2=0x55c5b118c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b118c190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2f10001b80 tx=0x7f2f10000f50 comp rx=0 tx=0).stop 2024-09-14T10:45:35.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 shutdown_connections 2024-09-14T10:45:35.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5b1191250 0x55c5b1193640 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2e0403a150 0x7f2e0403c610 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 --2- 172.21.15.96:0/1172417855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5b109a050 0x55c5b118c190 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:45:35.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 >> 172.21.15.96:0/1172417855 conn(0x55c5b1091980 msgr2=0x55c5b1185a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:45:35.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 shutdown_connections 2024-09-14T10:45:35.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:45:35.906+0000 7f2f218ec9c0 1 -- 172.21.15.96:0/1172417855 wait complete. 2024-09-14T10:46:15.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-14T10:46:15.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-14T10:46:15.918 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-14T10:46:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:15.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b88819c0 1 Processor -- start 2024-09-14T10:46:15.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b88819c0 1 -- start start 2024-09-14T10:46:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b88819c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556cf3fb73a0 0x556cf3fb9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b88819c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556cf3e597a0 con 0x556cf3fb3250 2024-09-14T10:46:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b88819c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x556cf3eb51b0 con 0x556cf3fb73a0 2024-09-14T10:46:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b5b86640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556cf3fb73a0 0x556cf3fb9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b6387640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x556cf3fb3250 0x556cf3fb3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38192/0 (socket says 172.21.15.96:38192) 2024-09-14T10:46:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b6387640 1 -- 172.21.15.96:0/530729671 learned_addr learned my addr 172.21.15.96:0/530729671 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:46:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b5b86640 1 -- 172.21.15.96:0/530729671 >> v1:172.21.15.70:6789/0 conn(0x556cf3fb3250 legacy=0x556cf3fb3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b5b86640 1 -- 172.21.15.96:0/530729671 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf3e33da0 con 0x556cf3fb73a0 2024-09-14T10:46:15.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.961+0000 7f48b5b86640 1 --2- 172.21.15.96:0/530729671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb73a0 0x556cf3fb9790 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00a480 tx=0x7f48ac01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73369f4a4187d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:15.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b5385640 1 -- 172.21.15.96:0/530729671 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0aa570 con 0x556cf3fb73a0 2024-09-14T10:46:15.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b5385640 1 -- 172.21.15.96:0/530729671 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac0af070 con 0x556cf3fb73a0 2024-09-14T10:46:15.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b5385640 1 -- 172.21.15.96:0/530729671 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0aa860 con 0x556cf3fb73a0 2024-09-14T10:46:15.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b88819c0 1 -- 172.21.15.96:0/530729671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb73a0 msgr2=0x556cf3fb9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:15.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b88819c0 1 --2- 172.21.15.96:0/530729671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb73a0 0x556cf3fb9790 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00a480 tx=0x7f48ac01b310 comp rx=0 tx=0).stop 2024-09-14T10:46:15.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b88819c0 1 -- 172.21.15.96:0/530729671 shutdown_connections 2024-09-14T10:46:15.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b88819c0 1 --2- 172.21.15.96:0/530729671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb73a0 0x556cf3fb9790 secure :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00a480 tx=0x7f48ac01b310 comp rx=0 tx=0).stop 2024-09-14T10:46:15.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b88819c0 1 -- 172.21.15.96:0/530729671 >> 172.21.15.96:0/530729671 conn(0x556cf3f26b60 msgr2=0x556cf3f26f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:15.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b88819c0 1 -- 172.21.15.96:0/530729671 shutdown_connections 2024-09-14T10:46:15.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.965+0000 7f48b88819c0 1 -- 172.21.15.96:0/530729671 wait complete. 2024-09-14T10:46:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 Processor -- start 2024-09-14T10:46:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- start start 2024-09-14T10:46:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf409e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556cf3eb8fc0 con 0x556cf3fb3250 2024-09-14T10:46:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b6387640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf409e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:15.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b6387640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf409e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50834/0 (socket says 172.21.15.96:50834) 2024-09-14T10:46:15.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b6387640 1 -- 172.21.15.96:0/2518135336 learned_addr learned my addr 172.21.15.96:0/2518135336 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b6387640 1 -- 172.21.15.96:0/2518135336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf409ecd0 con 0x556cf3fb3250 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b6387640 1 --2- 172.21.15.96:0/2518135336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf409e6e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f48b00017b0 tx=0x7f48b0001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a9cb789e37f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f47a4608640 1 -- 172.21.15.96:0/2518135336 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b00044f0 con 0x556cf3fb3250 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f47a4608640 1 -- 172.21.15.96:0/2518135336 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b00046b0 con 0x556cf3fb3250 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f47a4608640 1 -- 172.21.15.96:0/2518135336 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0004a10 con 0x556cf3fb3250 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- 172.21.15.96:0/2518135336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 msgr2=0x556cf409e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2518135336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf409e6e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f48b00017b0 tx=0x7f48b0001c70 comp rx=0 tx=0).stop 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- 172.21.15.96:0/2518135336 shutdown_connections 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2518135336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf409e6e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- 172.21.15.96:0/2518135336 >> 172.21.15.96:0/2518135336 conn(0x556cf3f26b60 msgr2=0x556cf409a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- 172.21.15.96:0/2518135336 shutdown_connections 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- 172.21.15.96:0/2518135336 wait complete. 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 Processor -- start 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- start start 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf40a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.981+0000 7f48b88819c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556cf3e5aa50 con 0x556cf3fb3250 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b6387640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf40a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b6387640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf40a5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50844/0 (socket says 172.21.15.96:50844) 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b6387640 1 -- 172.21.15.96:0/2862434714 learned_addr learned my addr 172.21.15.96:0/2862434714 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b6387640 1 -- 172.21.15.96:0/2862434714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf40a6540 con 0x556cf3fb3250 2024-09-14T10:46:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b6387640 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf40a5fe0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f48b00012f0 tx=0x7f48b0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:15.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f47a2e05640 1 -- 172.21.15.96:0/2862434714 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0013820 con 0x556cf3fb3250 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f47a2e05640 1 -- 172.21.15.96:0/2862434714 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b00139c0 con 0x556cf3fb3250 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f47a2e05640 1 -- 172.21.15.96:0/2862434714 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b0013ca0 con 0x556cf3fb3250 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cf40a67d0 con 0x556cf3fb3250 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cf40a7180 con 0x556cf3fb3250 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f47a2e05640 1 -- 172.21.15.96:0/2862434714 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f48b0010070 con 0x556cf3fb3250 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f47a2e05640 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479c03a150 0x7f479c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f47a2e05640 1 -- 172.21.15.96:0/2862434714 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f48b0018070 con 0x556cf3fb3250 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b5b86640 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479c03a150 0x7f479c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40ab140 0x556cf40ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ada70 con 0x556cf40ab140 2024-09-14T10:46:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.985+0000 7f48b6b88640 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40ab140 0x556cf40ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b5b86640 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479c03a150 0x7f479c03c610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0ae000 tx=0x7f48ac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b6b88640 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40ab140 0x556cf40ad530 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b6b88640 1 -- 172.21.15.96:0/2862434714 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a80083f0 con 0x556cf40ab140 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40a74f0 con 0x556cf40ab140 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b6b88640 1 -- 172.21.15.96:0/2862434714 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48a80083f0 con 0x556cf40ab140 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40af850 con 0x556cf40ab140 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b6b88640 1 -- 172.21.15.96:0/2862434714 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f48a80083f0 con 0x556cf40ab140 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40aea80 con 0x556cf40ab140 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b6b88640 1 -- 172.21.15.96:0/2862434714 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48a80083f0 con 0x556cf40ab140 2024-09-14T10:46:15.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40aeed0 con 0x556cf40ab140 2024-09-14T10:46:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b6b88640 1 -- 172.21.15.96:0/2862434714 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48a80083f0 con 0x556cf40ab140 2024-09-14T10:46:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b88819c0 1 Processor -- start 2024-09-14T10:46:15.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b88819c0 1 -- start start 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b88819c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40bdc10 0x556cf40be030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b88819c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556cf3ec5d80 con 0x556cf40bdc10 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b5b86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40bdc10 0x556cf40be030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b5b86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40bdc10 0x556cf40be030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50850/0 (socket says 172.21.15.96:50850) 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b5b86640 1 -- 172.21.15.96:0/2244078616 learned_addr learned my addr 172.21.15.96:0/2244078616 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.989+0000 7f48b5b86640 1 -- 172.21.15.96:0/2244078616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf40be670 con 0x556cf40bdc10 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b5b86640 1 --2- 172.21.15.96:0/2244078616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40bdc10 0x556cf40be030 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0ac040 tx=0x7f48ac0180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f479bfff640 1 -- 172.21.15.96:0/2244078616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0c5030 con 0x556cf40bdc10 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f479bfff640 1 -- 172.21.15.96:0/2244078616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac0b5830 con 0x556cf40bdc10 2024-09-14T10:46:15.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f479bfff640 1 -- 172.21.15.96:0/2244078616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0b5b50 con 0x556cf40bdc10 2024-09-14T10:46:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b88819c0 1 -- 172.21.15.96:0/2244078616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cf40beed0 con 0x556cf40bdc10 2024-09-14T10:46:15.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b88819c0 1 -- 172.21.15.96:0/2244078616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cf40bf440 con 0x556cf40bdc10 2024-09-14T10:46:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f479bfff640 1 -- 172.21.15.96:0/2244078616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f48ac0c8030 con 0x556cf40bdc10 2024-09-14T10:46:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f479bfff640 1 --2- 172.21.15.96:0/2244078616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479003a140 0x7f479003c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f479bfff640 1 -- 172.21.15.96:0/2244078616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f48ac0c6070 con 0x556cf40bdc10 2024-09-14T10:46:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b6b88640 1 --2- 172.21.15.96:0/2244078616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479003a140 0x7f479003c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b88819c0 1 Processor -- start 2024-09-14T10:46:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b88819c0 1 -- start start 2024-09-14T10:46:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b88819c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40ca490 0x556cf40ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b6b88640 1 --2- 172.21.15.96:0/2244078616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479003a140 0x7f479003c600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f48a800e3f0 tx=0x7f48a8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b88819c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556cf409f100 con 0x556cf40ca490 2024-09-14T10:46:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b5b86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40ca490 0x556cf40ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b5b86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40ca490 0x556cf40ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50860/0 (socket says 172.21.15.96:50860) 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b5b86640 1 -- 172.21.15.96:0/777401340 learned_addr learned my addr 172.21.15.96:0/777401340 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b5b86640 1 -- 172.21.15.96:0/777401340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf40cae40 con 0x556cf40ca490 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.993+0000 7f48b5b86640 1 --2- 172.21.15.96:0/777401340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40ca490 0x556cf40ca870 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0ec010 tx=0x7f48ac0c9e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64456e9903abf253 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f4799ffb640 1 -- 172.21.15.96:0/777401340 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0c1440 con 0x556cf40ca490 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f4799ffb640 1 -- 172.21.15.96:0/777401340 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac006390 con 0x556cf40ca490 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f4799ffb640 1 -- 172.21.15.96:0/777401340 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0c15e0 con 0x556cf40ca490 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- 172.21.15.96:0/777401340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40ca490 msgr2=0x556cf40ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 --2- 172.21.15.96:0/777401340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40ca490 0x556cf40ca870 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0ec010 tx=0x7f48ac0c9e70 comp rx=0 tx=0).stop 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- 172.21.15.96:0/777401340 shutdown_connections 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 --2- 172.21.15.96:0/777401340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40ca490 0x556cf40ca870 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- 172.21.15.96:0/777401340 >> 172.21.15.96:0/777401340 conn(0x556cf40c68c0 msgr2=0x556cf40c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- 172.21.15.96:0/777401340 shutdown_connections 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- 172.21.15.96:0/777401340 wait complete. 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 Processor -- start 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- start start 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40d1c20 0x556cf40d2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556cf40cb4a0 con 0x556cf40d1c20 2024-09-14T10:46:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b5b86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40d1c20 0x556cf40d2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b5b86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40d1c20 0x556cf40d2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50876/0 (socket says 172.21.15.96:50876) 2024-09-14T10:46:16.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 learned_addr learned my addr 172.21.15.96:0/3021672836 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf40d25a0 con 0x556cf40d1c20 2024-09-14T10:46:16.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b5b86640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40d1c20 0x556cf40d2040 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f48ac006bb0 tx=0x7f48ac0ebfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f4787fff640 1 -- 172.21.15.96:0/3021672836 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0f3070 con 0x556cf40d1c20 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f4787fff640 1 -- 172.21.15.96:0/3021672836 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac006390 con 0x556cf40d1c20 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f4787fff640 1 -- 172.21.15.96:0/3021672836 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48ac0d2550 con 0x556cf40d1c20 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cf40d2830 con 0x556cf40d1c20 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:15.997+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cf40d3140 con 0x556cf40d1c20 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f4787fff640 1 -- 172.21.15.96:0/3021672836 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f48ac0f6070 con 0x556cf40d1c20 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f4787fff640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f478003a150 0x7f478003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f4787fff640 1 -- 172.21.15.96:0/3021672836 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f48ac0e3070 con 0x556cf40d1c20 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6b88640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f478003a150 0x7f478003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40dd800 0x556cf40dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e03e0 con 0x556cf40dd800 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6387640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40dd800 0x556cf40dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6b88640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f478003a150 0x7f478003c610 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48a800f010 tx=0x7f48a801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6387640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40dd800 0x556cf40dfc90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 realm 2024-09-14T10:46:16.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e07f0 con 0x556cf40dd800 2024-09-14T10:46:16.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:16.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e10c0 con 0x556cf40dd800 2024-09-14T10:46:16.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1460 con 0x556cf40dd800 2024-09-14T10:46:16.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:16.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:16.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 20 searching for the correct realm 2024-09-14T10:46:16.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556cf40e3a20 0x556cf40e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e63f0 con 0x556cf40e3a20 2024-09-14T10:46:16.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b5b86640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556cf40e3a20 0x556cf40e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b5b86640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556cf40e3a20 0x556cf40e5e10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b5b86640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f48ac0f8060 0x7f48ac0e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e63f0 con 0x7f48ac0f8060 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.001+0000 7f48b6b88640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f48ac0f8060 0x7f48ac0e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6b88640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f48ac0f8060 0x7f48ac0e89c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6b88640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f48a8019040 0x7f48a8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e63f0 con 0x7f48a8019040 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f48a8019040 0x7f48a8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f48a8019040 0x7f48a8019930 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48a8019040 2024-09-14T10:46:16.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.005+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48a8019040 2024-09-14T10:46:16.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48ac0f8060 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40e3a20 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48a8019040 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48ac0f8060 2024-09-14T10:46:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40e3a20 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40e3a20 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.009+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48a8019040 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40e3a20 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40e3a20 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48a8019040 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40e3a20 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48ac0f8060 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48ac0f8060 2024-09-14T10:46:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40e3a20 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.013+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48a8019040 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48ac0f8060 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40e3a20 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48a8019040 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x556cf40dd800 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e1cb0 con 0x7f48ac0f8060 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e2500 con 0x556cf40dd800 2024-09-14T10:46:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e28f0 con 0x556cf40dd800 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e28f0 con 0x556cf40dd800 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 zone default found 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 4 Realm: () 2024-09-14T10:46:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 zonegroup default 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.017+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e2080 con 0x7f48ac0f8060 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e8360 con 0x556cf40e3a20 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e88d0 con 0x556cf40e3a20 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 20 started sync module instance, tier type = 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e7700 con 0x7f48ac0f8060 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93926439418912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e7700 con 0x7f48ac0f8060 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e9390 con 0x556cf40dd800 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.021+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93926439418912] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.025+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.025+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93926439423648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e7700 con 0x556cf40dd800 2024-09-14T10:46:16.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.025+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e9da0 con 0x556cf40e3a20 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.025+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93926439423648] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.025+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.025+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93926439416400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e7670 con 0x556cf40e3a20 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.025+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40eaae0 con 0x7f48ac0f8060 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.029+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.029+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93926439429616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40eb380 con 0x7f48ac0f8060 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.029+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ebdc0 con 0x556cf40dd800 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.029+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93926439416400] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.029+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93926439429616] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.029+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.029+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93926439434384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40eaed0 con 0x556cf40dd800 2024-09-14T10:46:16.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.029+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ec660 con 0x7f48a8019040 2024-09-14T10:46:16.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.033+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93926439434384] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.033+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.033+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93926439428416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ec380 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.033+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ecbd0 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.033+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.033+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93926439428416] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.033+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93926439437456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ecf40 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.033+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ebef0 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93926439437456] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93926439436016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ed530 con 0x7f48a8019040 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 20 add_watcher() i=0 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 20 add_watcher() i=1 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 20 add_watcher() i=2 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 20 add_watcher() i=3 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 20 add_watcher() i=4 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 20 add_watcher() i=5 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 20 add_watcher() i=6 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93926439436016] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 20 add_watcher() i=7 2024-09-14T10:46:16.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.037+0000 7f48b88819c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf40f0a10 con 0x556cf40dd800 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93926439441712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40ede30 con 0x556cf40dd800 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93926439441712] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f476cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 5 note: GC not initialized 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f46e77fe640 20 reqs_thread_entry: start 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 20 Filter name: none 2024-09-14T10:46:16.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f46e57fa640 20 reqs_thread_entry: start 2024-09-14T10:46:16.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:46:16.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556cf41141a0 con 0x556cf40dd800 2024-09-14T10:46:16.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:46:16.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:46:16.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:46:16.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:16.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.041+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf4113b80 con 0x7f48a8019040 2024-09-14T10:46:16.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.045+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 usage.10 [call] v34'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.045+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf4113b80 con 0x7f48a8019040 2024-09-14T10:46:16.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.045+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(64 usage.10 [call] v34'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.049+0000 7f476cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:16.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.049+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93926439441712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf4113b80 con 0x556cf40dd800 2024-09-14T10:46:16.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.049+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93926439441712] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.049+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93926439418912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf4113b80 con 0x7f48ac0f8060 2024-09-14T10:46:16.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.049+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93926439418912] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.049+0000 7f48b88819c0 20 remove_watcher() i=0 2024-09-14T10:46:16.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.049+0000 7f48b88819c0 2 removed watcher, disabling cache 2024-09-14T10:46:16.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.049+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93926439423648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf4113b80 con 0x556cf40dd800 2024-09-14T10:46:16.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.053+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93926439423648] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.053+0000 7f48b88819c0 20 remove_watcher() i=1 2024-09-14T10:46:16.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.053+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93926439416400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e7c20 con 0x556cf40e3a20 2024-09-14T10:46:16.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.053+0000 7f48b5b86640 1 -- 172.21.15.96:0/3021672836 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93926439416400] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ac0f5030 con 0x556cf40e3a20 2024-09-14T10:46:16.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.053+0000 7f48b88819c0 20 remove_watcher() i=2 2024-09-14T10:46:16.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.053+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93926439429616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e8ea0 con 0x7f48ac0f8060 2024-09-14T10:46:16.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.057+0000 7f48b6b88640 1 -- 172.21.15.96:0/3021672836 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93926439429616] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48a802f040 con 0x7f48ac0f8060 2024-09-14T10:46:16.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.057+0000 7f48b88819c0 20 remove_watcher() i=3 2024-09-14T10:46:16.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.057+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93926439434384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e7250 con 0x556cf40dd800 2024-09-14T10:46:16.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.057+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93926439434384] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x556cf40dd800 2024-09-14T10:46:16.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.057+0000 7f48b88819c0 20 remove_watcher() i=4 2024-09-14T10:46:16.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.057+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93926439428416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e8ea0 con 0x7f48a8019040 2024-09-14T10:46:16.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.061+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93926439428416] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.061+0000 7f48b88819c0 20 remove_watcher() i=5 2024-09-14T10:46:16.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.061+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93926439437456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40eb890 con 0x7f48a8019040 2024-09-14T10:46:16.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.061+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93926439437456] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.061+0000 7f48b88819c0 20 remove_watcher() i=6 2024-09-14T10:46:16.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.061+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93926439436016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556cf40e7250 con 0x7f48a8019040 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93926439436016] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b001b030 con 0x7f48a8019040 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 20 remove_watcher() i=7 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f48a8019040 msgr2=0x7f48a8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f48a8019040 0x7f48a8019930 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40dd800 msgr2=0x556cf40dfc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40dd800 0x556cf40dfc90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f48ac0f8060 msgr2=0x7f48ac0e89c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f48ac0f8060 0x7f48ac0e89c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556cf40e3a20 msgr2=0x556cf40e5e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556cf40e3a20 0x556cf40e5e10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f478003a150 msgr2=0x7f478003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f478003a150 0x7f478003c610 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48a800f010 tx=0x7f48a801b070 comp rx=0 tx=0).stop 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40d1c20 msgr2=0x556cf40d2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b6387640 1 -- 172.21.15.96:0/3021672836 reap_dead start 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40d1c20 0x556cf40d2040 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f48ac006bb0 tx=0x7f48ac0ebfa0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 shutdown_connections 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/3021672836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40d1c20 0x556cf40d2040 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 >> 172.21.15.96:0/3021672836 conn(0x556cf40c68c0 msgr2=0x556cf40c4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 shutdown_connections 2024-09-14T10:46:16.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/3021672836 wait complete. 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2244078616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479003a140 msgr2=0x7f479003c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2244078616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479003a140 0x7f479003c600 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f48a800e3f0 tx=0x7f48a8003070 comp rx=0 tx=0).stop 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2244078616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40bdc10 msgr2=0x556cf40be030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2244078616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40bdc10 0x556cf40be030 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0ac040 tx=0x7f48ac0180b0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2244078616 shutdown_connections 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2244078616 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479003a140 0x7f479003c600 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2244078616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf40bdc10 0x556cf40be030 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2244078616 >> 172.21.15.96:0/2244078616 conn(0x556cf40b35c0 msgr2=0x556cf40b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2244078616 shutdown_connections 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2244078616 wait complete. 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40ab140 msgr2=0x556cf40ad530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40ab140 0x556cf40ad530 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479c03a150 msgr2=0x7f479c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479c03a150 0x7f479c03c610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0ae000 tx=0x7f48ac0a6000 comp rx=0 tx=0).stop 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 msgr2=0x556cf40a5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf40a5fe0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f48b00012f0 tx=0x7f48b0000f50 comp rx=0 tx=0).stop 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 shutdown_connections 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556cf40ab140 0x556cf40ad530 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f479c03a150 0x7f479c03c610 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 --2- 172.21.15.96:0/2862434714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556cf3fb3250 0x556cf40a5fe0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 >> 172.21.15.96:0/2862434714 conn(0x556cf3f26b60 msgr2=0x556cf409fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 shutdown_connections 2024-09-14T10:46:16.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.065+0000 7f48b88819c0 1 -- 172.21.15.96:0/2862434714 wait complete. 2024-09-14T10:46:16.078 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-14T10:46:16.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-14T10:46:16.079 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-14T10:46:16.162 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:16.162 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:16.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce3af39c0 1 Processor -- start 2024-09-14T10:46:16.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce3af39c0 1 -- start start 2024-09-14T10:46:16.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce3af39c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556bff2ede50 0x556bff2ee230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce3af39c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556bff1977a0 con 0x556bff2f1030 2024-09-14T10:46:16.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce3af39c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x556bff1f31b0 con 0x556bff2ede50 2024-09-14T10:46:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce15f9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556bff2ede50 0x556bff2ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce15f9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556bff2ede50 0x556bff2ee230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50886/0 (socket says 172.21.15.96:50886) 2024-09-14T10:46:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce0df8640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x556bff2f1030 0x556bff2f3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38198/0 (socket says 172.21.15.96:38198) 2024-09-14T10:46:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.161+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4281399567 learned_addr learned my addr 172.21.15.96:0/4281399567 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.165+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4281399567 >> v1:172.21.15.70:6789/0 conn(0x556bff2f1030 legacy=0x556bff2f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.165+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4281399567 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bff171da0 con 0x556bff2ede50 2024-09-14T10:46:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.165+0000 7f0ce15f9640 1 --2- 172.21.15.96:0/4281399567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff2ee230 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400a5c0 tx=0x7f0cd401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17d91352f9d6f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.165+0000 7f0cdbfff640 1 -- 172.21.15.96:0/4281399567 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd40a6070 con 0x556bff2ede50 2024-09-14T10:46:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.165+0000 7f0cdbfff640 1 -- 172.21.15.96:0/4281399567 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd40af070 con 0x556bff2ede50 2024-09-14T10:46:16.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.165+0000 7f0cdbfff640 1 -- 172.21.15.96:0/4281399567 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd40aa5c0 con 0x556bff2ede50 2024-09-14T10:46:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.165+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4281399567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 msgr2=0x556bff2ee230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.165+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4281399567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff2ee230 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400a5c0 tx=0x7f0cd401b340 comp rx=0 tx=0).stop 2024-09-14T10:46:16.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.169+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4281399567 shutdown_connections 2024-09-14T10:46:16.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.169+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4281399567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff2ee230 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.169+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4281399567 >> 172.21.15.96:0/4281399567 conn(0x556bff2e9970 msgr2=0x556bff2ebd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.169+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4281399567 shutdown_connections 2024-09-14T10:46:16.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.169+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4281399567 wait complete. 2024-09-14T10:46:16.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.181+0000 7f0ce3af39c0 1 Processor -- start 2024-09-14T10:46:16.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- start start 2024-09-14T10:46:16.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3da3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556bff1f6fc0 con 0x556bff2ede50 2024-09-14T10:46:16.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce15f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3da3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce15f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3da3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50898/0 (socket says 172.21.15.96:50898) 2024-09-14T10:46:16.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4202737617 learned_addr learned my addr 172.21.15.96:0/4202737617 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4202737617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bff3da9d0 con 0x556bff2ede50 2024-09-14T10:46:16.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce15f9640 1 --2- 172.21.15.96:0/4202737617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3da3e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40ac040 tx=0x7f0cd4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cedb8dbe2525fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0bcee0d640 1 -- 172.21.15.96:0/4202737617 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd40aa970 con 0x556bff2ede50 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0bcee0d640 1 -- 172.21.15.96:0/4202737617 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd40aab10 con 0x556bff2ede50 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0bcee0d640 1 -- 172.21.15.96:0/4202737617 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd40aae30 con 0x556bff2ede50 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4202737617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 msgr2=0x556bff3da3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4202737617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3da3e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40ac040 tx=0x7f0cd4003030 comp rx=0 tx=0).stop 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4202737617 shutdown_connections 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4202737617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3da3e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4202737617 >> 172.21.15.96:0/4202737617 conn(0x556bff2e9970 msgr2=0x556bff3d5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4202737617 shutdown_connections 2024-09-14T10:46:16.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4202737617 wait complete. 2024-09-14T10:46:16.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 Processor -- start 2024-09-14T10:46:16.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- start start 2024-09-14T10:46:16.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3e1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce3af39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556bff198a50 con 0x556bff2ede50 2024-09-14T10:46:16.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce15f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3e1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce15f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3e1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50908/0 (socket says 172.21.15.96:50908) 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.185+0000 7f0ce15f9640 1 -- 172.21.15.96:0/273175581 learned_addr learned my addr 172.21.15.96:0/273175581 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce15f9640 1 -- 172.21.15.96:0/273175581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bff3e2070 con 0x556bff2ede50 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce15f9640 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3e1b10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0cd401b170 tx=0x7f0cd40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0bcd60a640 1 -- 172.21.15.96:0/273175581 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd40c6690 con 0x556bff2ede50 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0bcd60a640 1 -- 172.21.15.96:0/273175581 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd40cc070 con 0x556bff2ede50 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bff3e2300 con 0x556bff2ede50 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0bcd60a640 1 -- 172.21.15.96:0/273175581 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd40c69a0 con 0x556bff2ede50 2024-09-14T10:46:16.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bff3e2cb0 con 0x556bff2ede50 2024-09-14T10:46:16.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0bcd60a640 1 -- 172.21.15.96:0/273175581 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0cd40c6c10 con 0x556bff2ede50 2024-09-14T10:46:16.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0bcd60a640 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bc803a150 0x7f0bc803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0bcd60a640 1 -- 172.21.15.96:0/273175581 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0cd40ec580 con 0x556bff2ede50 2024-09-14T10:46:16.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce0df8640 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bc803a150 0x7f0bc803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff2f1030 0x556bff3e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff3e91c0 con 0x556bff2f1030 2024-09-14T10:46:16.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff2f1030 0x556bff3e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce0df8640 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bc803a150 0x7f0bc803c610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0001640 tx=0x7f0cd00066a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff2f1030 0x556bff3e8c80 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/273175581 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cdc0083f0 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.189+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff3e95c0 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/273175581 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cdc0083f0 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff3eaec0 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/273175581 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0cdc0083f0 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff3ea0f0 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/273175581 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cdc0083f0 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff3ea540 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/273175581 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cdc0083f0 con 0x556bff2f1030 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 Processor -- start 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 -- start start 2024-09-14T10:46:16.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff3f9280 0x556bff3f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556bff203d80 con 0x556bff3f9280 2024-09-14T10:46:16.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce0df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff3f9280 0x556bff3f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce0df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff3f9280 0x556bff3f96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50922/0 (socket says 172.21.15.96:50922) 2024-09-14T10:46:16.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce0df8640 1 -- 172.21.15.96:0/1926009602 learned_addr learned my addr 172.21.15.96:0/1926009602 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce0df8640 1 -- 172.21.15.96:0/1926009602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bff3f9ce0 con 0x556bff3f9280 2024-09-14T10:46:16.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce0df8640 1 --2- 172.21.15.96:0/1926009602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff3f9280 0x556bff3f96a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0004fd0 tx=0x7f0cd0015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0bc67fc640 1 -- 172.21.15.96:0/1926009602 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd0011440 con 0x556bff3f9280 2024-09-14T10:46:16.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0bc67fc640 1 -- 172.21.15.96:0/1926009602 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd0011600 con 0x556bff3f9280 2024-09-14T10:46:16.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/1926009602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bff3fa540 con 0x556bff3f9280 2024-09-14T10:46:16.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0bc67fc640 1 -- 172.21.15.96:0/1926009602 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd0011920 con 0x556bff3f9280 2024-09-14T10:46:16.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.193+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/1926009602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bff3faab0 con 0x556bff3f9280 2024-09-14T10:46:16.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0bc67fc640 1 -- 172.21.15.96:0/1926009602 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0cd0011ac0 con 0x556bff3f9280 2024-09-14T10:46:16.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0bc67fc640 1 --2- 172.21.15.96:0/1926009602 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bb803a190 0x7f0bb803c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0bc67fc640 1 -- 172.21.15.96:0/1926009602 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0cd001b030 con 0x556bff3f9280 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/1926009602 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bb803a190 0x7f0bb803c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce3af39c0 1 Processor -- start 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce3af39c0 1 -- start start 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/1926009602 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bb803a190 0x7f0bb803c650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x556bff3e9c10 tx=0x7f0cdc003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce3af39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff405f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce3af39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556bff3dad40 con 0x556bff405ba0 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce0df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff405f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce0df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff405f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50938/0 (socket says 172.21.15.96:50938) 2024-09-14T10:46:16.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce0df8640 1 -- 172.21.15.96:0/3346379035 learned_addr learned my addr 172.21.15.96:0/3346379035 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce0df8640 1 -- 172.21.15.96:0/3346379035 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bff406550 con 0x556bff405ba0 2024-09-14T10:46:16.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0ce0df8640 1 --2- 172.21.15.96:0/3346379035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff405f80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0050b40 tx=0x7f0cd001f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1bc4659f89642f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0bb7fff640 1 -- 172.21.15.96:0/3346379035 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd0013db0 con 0x556bff405ba0 2024-09-14T10:46:16.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0bb7fff640 1 -- 172.21.15.96:0/3346379035 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd001fae0 con 0x556bff405ba0 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.197+0000 7f0bb7fff640 1 -- 172.21.15.96:0/3346379035 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd001fdc0 con 0x556bff405ba0 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/3346379035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 msgr2=0x556bff405f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/3346379035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff405f80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0050b40 tx=0x7f0cd001f450 comp rx=0 tx=0).stop 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/3346379035 shutdown_connections 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/3346379035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff405f80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/3346379035 >> 172.21.15.96:0/3346379035 conn(0x556bff401fd0 msgr2=0x556bff400210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/3346379035 shutdown_connections 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/3346379035 wait complete. 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 Processor -- start 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- start start 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff2f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556bff406bb0 con 0x556bff405ba0 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce0df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff2f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce0df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff2f8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50954/0 (socket says 172.21.15.96:50954) 2024-09-14T10:46:16.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 learned_addr learned my addr 172.21.15.96:0/4091940078 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bff2f91c0 con 0x556bff405ba0 2024-09-14T10:46:16.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce0df8640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff2f8c60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0cd001e740 tx=0x7f0cd0050aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0bb67fc640 1 -- 172.21.15.96:0/4091940078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd001dd60 con 0x556bff405ba0 2024-09-14T10:46:16.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0bb67fc640 1 -- 172.21.15.96:0/4091940078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd001f550 con 0x556bff405ba0 2024-09-14T10:46:16.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bff2f75a0 con 0x556bff405ba0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0bb67fc640 1 -- 172.21.15.96:0/4091940078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cd001f830 con 0x556bff405ba0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bff2f7a50 con 0x556bff405ba0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0bb67fc640 1 -- 172.21.15.96:0/4091940078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0cd0039060 con 0x556bff405ba0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0bb67fc640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bac03a150 0x7f0bac03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.201+0000 7f0bb67fc640 1 -- 172.21.15.96:0/4091940078 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0cd003cd20 con 0x556bff405ba0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bac03a150 0x7f0bac03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff41a8f0 0x556bff41cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41d4d0 con 0x556bff41a8f0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce15f9640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff41a8f0 0x556bff41cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bac03a150 0x7f0bac03c610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00f010 tx=0x7f0cdc01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce15f9640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff41a8f0 0x556bff41cd80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 realm 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41d8e0 con 0x556bff41a8f0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41e1b0 con 0x556bff41a8f0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41e550 con 0x556bff41a8f0 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41e9f0 con 0x556bff41a8f0 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 20 searching for the correct realm 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556bff4209f0 0x556bff422de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce0df8640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556bff4209f0 0x556bff422de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce0df8640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556bff4209f0 0x556bff422de0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce0df8640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0cd0032420 0x7f0cd004f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cd0032420 2024-09-14T10:46:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0cd0032420 0x7f0cd004f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0cd0032420 0x7f0cd004f2e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce1dfa640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0cdc019040 0x7f0cdc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.205+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cdc019040 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0cdc019040 0x7f0cdc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0cdc019040 0x7f0cdc019930 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff41a8f0 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff41a8f0 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cdc019040 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cdc019040 2024-09-14T10:46:16.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cd0032420 2024-09-14T10:46:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff41a8f0 2024-09-14T10:46:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.209+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cdc019040 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff41a8f0 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cd0032420 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cdc019040 2024-09-14T10:46:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff41a8f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff41a8f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.213+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cdc019040 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cd0032420 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff41a8f0 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cd0032420 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cdc019040 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cd0032420 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff4209f0 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cdc019040 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x556bff41a8f0 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.217+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556bff4234b0 con 0x7f0cd0032420 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:16.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41f490 con 0x556bff41a8f0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41fd30 con 0x556bff41a8f0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41f0d0 con 0x556bff41a8f0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:16.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 zone default found 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 4 Realm: () 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 zonegroup default 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff41fd30 con 0x7f0cd0032420 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff4257d0 con 0x556bff4209f0 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff425b70 con 0x556bff4209f0 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 started sync module instance, tier type = 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff424c10 con 0x7f0cd0032420 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93922332397872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff424c10 con 0x7f0cd0032420 2024-09-14T10:46:16.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.221+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff426570 con 0x556bff41a8f0 2024-09-14T10:46:16.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.225+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93922332397872] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.225+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.225+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93922332401792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff424c10 con 0x556bff41a8f0 2024-09-14T10:46:16.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.225+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff426fb0 con 0x556bff4209f0 2024-09-14T10:46:16.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.225+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93922332401792] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93922332395360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff424b80 con 0x556bff4209f0 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff427d60 con 0x7f0cd0032420 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93922332407888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff428600 con 0x7f0cd0032420 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff429040 con 0x556bff41a8f0 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93922332395360] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93922332407888] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93922332412688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff428150 con 0x556bff41a8f0 2024-09-14T10:46:16.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.229+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff4298e0 con 0x7f0cdc019040 2024-09-14T10:46:16.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.233+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93922332412688] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.233+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.233+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93922332406688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff429600 con 0x7f0cdc019040 2024-09-14T10:46:16.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.233+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff429e50 con 0x7f0cdc019040 2024-09-14T10:46:16.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93922332406688] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93922332414560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff429c50 con 0x7f0cdc019040 2024-09-14T10:46:16.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff42a740 con 0x7f0cdc019040 2024-09-14T10:46:16.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93922332414560] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93922332418576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff42a700 con 0x7f0cdc019040 2024-09-14T10:46:16.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 20 add_watcher() i=0 2024-09-14T10:46:16.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 20 add_watcher() i=1 2024-09-14T10:46:16.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 20 add_watcher() i=2 2024-09-14T10:46:16.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 20 add_watcher() i=3 2024-09-14T10:46:16.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 20 add_watcher() i=4 2024-09-14T10:46:16.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 20 add_watcher() i=5 2024-09-14T10:46:16.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.237+0000 7f0ce3af39c0 20 add_watcher() i=6 2024-09-14T10:46:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93922332418576] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 20 add_watcher() i=7 2024-09-14T10:46:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff42db60 con 0x556bff41a8f0 2024-09-14T10:46:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93922332415680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff42b080 con 0x556bff41a8f0 2024-09-14T10:46:16.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93922332415680] v34'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0b96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:16.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:16.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:16.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 5 note: GC not initialized 2024-09-14T10:46:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0b95fe3640 20 reqs_thread_entry: start 2024-09-14T10:46:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 20 Filter name: none 2024-09-14T10:46:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0b077fe640 20 reqs_thread_entry: start 2024-09-14T10:46:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff450ec0 con 0x556bff41a8f0 2024-09-14T10:46:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:46:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.241+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556bff452410 con 0x7f0cdc019040 2024-09-14T10:46:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.245+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.245+0000 7f0b96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.245+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93922332415680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff4146f0 con 0x556bff41a8f0 2024-09-14T10:46:16.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.245+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93922332415680] v34'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.245+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93922332397872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff4296c0 con 0x7f0cd0032420 2024-09-14T10:46:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.245+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93922332397872] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.249+0000 7f0ce3af39c0 20 remove_watcher() i=0 2024-09-14T10:46:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.249+0000 7f0ce3af39c0 2 removed watcher, disabling cache 2024-09-14T10:46:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.249+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93922332401792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff425130 con 0x556bff41a8f0 2024-09-14T10:46:16.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.249+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93922332401792] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.249+0000 7f0ce3af39c0 20 remove_watcher() i=1 2024-09-14T10:46:16.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.249+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93922332395360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff425130 con 0x556bff4209f0 2024-09-14T10:46:16.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce0df8640 1 -- 172.21.15.96:0/4091940078 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93922332395360] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd004f050 con 0x556bff4209f0 2024-09-14T10:46:16.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce3af39c0 20 remove_watcher() i=2 2024-09-14T10:46:16.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93922332407888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff424760 con 0x7f0cd0032420 2024-09-14T10:46:16.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce1dfa640 1 -- 172.21.15.96:0/4091940078 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93922332407888] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cdc02f040 con 0x7f0cd0032420 2024-09-14T10:46:16.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce3af39c0 20 remove_watcher() i=3 2024-09-14T10:46:16.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93922332412688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff424760 con 0x556bff41a8f0 2024-09-14T10:46:16.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93922332412688] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x556bff41a8f0 2024-09-14T10:46:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce3af39c0 20 remove_watcher() i=4 2024-09-14T10:46:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.253+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93922332406688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff428b10 con 0x7f0cdc019040 2024-09-14T10:46:16.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.257+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93922332406688] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.257+0000 7f0ce3af39c0 20 remove_watcher() i=5 2024-09-14T10:46:16.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.257+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93922332414560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff424760 con 0x7f0cdc019040 2024-09-14T10:46:16.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.257+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93922332414560] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.257+0000 7f0ce3af39c0 20 remove_watcher() i=6 2024-09-14T10:46:16.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.257+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93922332418576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556bff428b10 con 0x7f0cdc019040 2024-09-14T10:46:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93922332418576] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd40bd3f0 con 0x7f0cdc019040 2024-09-14T10:46:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 20 remove_watcher() i=7 2024-09-14T10:46:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0cdc019040 msgr2=0x7f0cdc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0cdc019040 0x7f0cdc019930 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff41a8f0 msgr2=0x556bff41cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff41a8f0 0x556bff41cd80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0cd0032420 msgr2=0x7f0cd004f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f0cd0032420 0x7f0cd004f2e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556bff4209f0 msgr2=0x556bff422de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556bff4209f0 0x556bff422de0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bac03a150 msgr2=0x7f0bac03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bac03a150 0x7f0bac03c610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00f010 tx=0x7f0cdc01b070 comp rx=0 tx=0).stop 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce15f9640 1 -- 172.21.15.96:0/4091940078 reap_dead start 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 msgr2=0x556bff2f8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff2f8c60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0cd001e740 tx=0x7f0cd0050aa0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 shutdown_connections 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/4091940078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff405ba0 0x556bff2f8c60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 >> 172.21.15.96:0/4091940078 conn(0x556bff401fd0 msgr2=0x556bff4001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 shutdown_connections 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/4091940078 wait complete. 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/1926009602 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bb803a190 msgr2=0x7f0bb803c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/1926009602 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bb803a190 0x7f0bb803c650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x556bff3e9c10 tx=0x7f0cdc003070 comp rx=0 tx=0).stop 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/1926009602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff3f9280 msgr2=0x556bff3f96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/1926009602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff3f9280 0x556bff3f96a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0004fd0 tx=0x7f0cd0015820 comp rx=0 tx=0).stop 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/1926009602 shutdown_connections 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/1926009602 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bb803a190 0x7f0bb803c650 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/1926009602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff3f9280 0x556bff3f96a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/1926009602 >> 172.21.15.96:0/1926009602 conn(0x556bff3eec30 msgr2=0x556bff3ef010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/1926009602 shutdown_connections 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/1926009602 wait complete. 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff2f1030 msgr2=0x556bff3e8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff2f1030 0x556bff3e8c80 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bc803a150 msgr2=0x7f0bc803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bc803a150 0x7f0bc803c610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0001640 tx=0x7f0cd00066a0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 msgr2=0x556bff3e1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3e1b10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0cd401b170 tx=0x7f0cd40180e0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 shutdown_connections 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556bff2f1030 0x556bff3e8c80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f0bc803a150 0x7f0bc803c610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 --2- 172.21.15.96:0/273175581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bff2ede50 0x556bff3e1b10 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 >> 172.21.15.96:0/273175581 conn(0x556bff2e9970 msgr2=0x556bff3db790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.261+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 shutdown_connections 2024-09-14T10:46:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.265+0000 7f0ce3af39c0 1 -- 172.21.15.96:0/273175581 wait complete. 2024-09-14T10:46:16.275 INFO:teuthology.orchestra.run.smithi096.stdout:{"entries":[],"summary":[]} 2024-09-14T10:46:16.275 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-14T10:46:16.275 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-14T10:46:16.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-14T10:46:16.275 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-14T10:46:16.349 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:16.349 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:16.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43d4199c0 1 Processor -- start 2024-09-14T10:46:16.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43d4199c0 1 -- start start 2024-09-14T10:46:16.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43d4199c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55a2a2bda080 0x55a2a2bd8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43d4199c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2a2b0b7a0 con 0x55a2a2bd9b50 2024-09-14T10:46:16.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43d4199c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55a2a2b671b0 con 0x55a2a2bda080 2024-09-14T10:46:16.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43a71e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55a2a2bda080 0x55a2a2bd8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43a71e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55a2a2bda080 0x55a2a2bd8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50956/0 (socket says 172.21.15.96:50956) 2024-09-14T10:46:16.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43a71e640 1 -- 172.21.15.96:0/2880001375 learned_addr learned my addr 172.21.15.96:0/2880001375 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43af1f640 1 --1- 172.21.15.96:0/2880001375 >> v1:172.21.15.70:6789/0 conn(0x55a2a2bd9b50 0x55a2a2bd84f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38212/0 (socket says 172.21.15.96:38212) 2024-09-14T10:46:16.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43a71e640 1 -- 172.21.15.96:0/2880001375 >> v1:172.21.15.70:6789/0 conn(0x55a2a2bd9b50 legacy=0x55a2a2bd84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.349+0000 7fa43a71e640 1 -- 172.21.15.96:0/2880001375 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a2ae5da0 con 0x55a2a2bda080 2024-09-14T10:46:16.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa43a71e640 1 --2- 172.21.15.96:0/2880001375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bda080 0x55a2a2bd8c00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa42400a4e0 tx=0x7fa42401b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c610748dac7db75 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa439f1d640 1 -- 172.21.15.96:0/2880001375 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240aa540 con 0x55a2a2bda080 2024-09-14T10:46:16.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa439f1d640 1 -- 172.21.15.96:0/2880001375 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4240aa6e0 con 0x55a2a2bda080 2024-09-14T10:46:16.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa439f1d640 1 -- 172.21.15.96:0/2880001375 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240aaa40 con 0x55a2a2bda080 2024-09-14T10:46:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2880001375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bda080 msgr2=0x55a2a2bd8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/2880001375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bda080 0x55a2a2bd8c00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa42400a4e0 tx=0x7fa42401b030 comp rx=0 tx=0).stop 2024-09-14T10:46:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2880001375 shutdown_connections 2024-09-14T10:46:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/2880001375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bda080 0x55a2a2bd8c00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2880001375 >> 172.21.15.96:0/2880001375 conn(0x55a2a2c5eb30 msgr2=0x55a2a2c60f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2880001375 shutdown_connections 2024-09-14T10:46:16.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.353+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2880001375 wait complete. 2024-09-14T10:46:16.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43d4199c0 1 Processor -- start 2024-09-14T10:46:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43d4199c0 1 -- start start 2024-09-14T10:46:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43d4199c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d50810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43d4199c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a2a2b6afc0 con 0x55a2a2bd9b50 2024-09-14T10:46:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43af1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d50810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43af1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d50810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50972/0 (socket says 172.21.15.96:50972) 2024-09-14T10:46:16.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43af1f640 1 -- 172.21.15.96:0/1218385956 learned_addr learned my addr 172.21.15.96:0/1218385956 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43af1f640 1 -- 172.21.15.96:0/1218385956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a2d50e00 con 0x55a2a2bd9b50 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa43af1f640 1 --2- 172.21.15.96:0/1218385956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d50810 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b270 tx=0x7fa42c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdba1abbb3a2c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa328e09640 1 -- 172.21.15.96:0/1218385956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42c00e5d0 con 0x55a2a2bd9b50 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa328e09640 1 -- 172.21.15.96:0/1218385956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42c00e770 con 0x55a2a2bd9b50 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.369+0000 7fa328e09640 1 -- 172.21.15.96:0/1218385956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42c00ea70 con 0x55a2a2bd9b50 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- 172.21.15.96:0/1218385956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 msgr2=0x55a2a2d50810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/1218385956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d50810 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b270 tx=0x7fa42c00b670 comp rx=0 tx=0).stop 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- 172.21.15.96:0/1218385956 shutdown_connections 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/1218385956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d50810 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- 172.21.15.96:0/1218385956 >> 172.21.15.96:0/1218385956 conn(0x55a2a2c5eb30 msgr2=0x55a2a2d4c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- 172.21.15.96:0/1218385956 shutdown_connections 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- 172.21.15.96:0/1218385956 wait complete. 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 Processor -- start 2024-09-14T10:46:16.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- start start 2024-09-14T10:46:16.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a2a2b0ca50 con 0x55a2a2bd9b50 2024-09-14T10:46:16.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43af1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43af1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50976/0 (socket says 172.21.15.96:50976) 2024-09-14T10:46:16.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43af1f640 1 -- 172.21.15.96:0/612527525 learned_addr learned my addr 172.21.15.96:0/612527525 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43af1f640 1 -- 172.21.15.96:0/612527525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a2d58630 con 0x55a2a2bd9b50 2024-09-14T10:46:16.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43af1f640 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d580d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55a2a2d517a0 tx=0x7fa42c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa327606640 1 -- 172.21.15.96:0/612527525 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42c00ee20 con 0x55a2a2bd9b50 2024-09-14T10:46:16.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa327606640 1 -- 172.21.15.96:0/612527525 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42c00fa40 con 0x55a2a2bd9b50 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2a2d588c0 con 0x55a2a2bd9b50 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa327606640 1 -- 172.21.15.96:0/612527525 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42c00fd40 con 0x55a2a2bd9b50 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2a2d59270 con 0x55a2a2bd9b50 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.373+0000 7fa327606640 1 -- 172.21.15.96:0/612527525 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa42c017070 con 0x55a2a2bd9b50 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa327606640 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa32003a150 0x7fa32003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa327606640 1 -- 172.21.15.96:0/612527525 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa42c015020 con 0x55a2a2bd9b50 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43a71e640 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa32003a150 0x7fa32003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2bda080 0x55a2a2d5f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d5f780 con 0x55a2a2bda080 2024-09-14T10:46:16.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43b720640 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2bda080 0x55a2a2d5f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43a71e640 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa32003a150 0x7fa32003c610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa4240ab000 tx=0x7fa4240a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43b720640 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2bda080 0x55a2a2d5f240 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43b720640 1 -- 172.21.15.96:0/612527525 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4340083f0 con 0x55a2a2bda080 2024-09-14T10:46:16.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d5fbd0 con 0x55a2a2bda080 2024-09-14T10:46:16.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43b720640 1 -- 172.21.15.96:0/612527525 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4340083f0 con 0x55a2a2bda080 2024-09-14T10:46:16.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d614d0 con 0x55a2a2bda080 2024-09-14T10:46:16.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43b720640 1 -- 172.21.15.96:0/612527525 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa4340083f0 con 0x55a2a2bda080 2024-09-14T10:46:16.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d60700 con 0x55a2a2bda080 2024-09-14T10:46:16.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43b720640 1 -- 172.21.15.96:0/612527525 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4340083f0 con 0x55a2a2bda080 2024-09-14T10:46:16.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d60b20 con 0x55a2a2bda080 2024-09-14T10:46:16.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43b720640 1 -- 172.21.15.96:0/612527525 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa4340083f0 con 0x55a2a2bda080 2024-09-14T10:46:16.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 Processor -- start 2024-09-14T10:46:16.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 -- start start 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d6f8c0 0x55a2a2d6fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43d4199c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a2a2b77d80 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43a71e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d6f8c0 0x55a2a2d6fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43a71e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d6f8c0 0x55a2a2d6fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50984/0 (socket says 172.21.15.96:50984) 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.377+0000 7fa43a71e640 1 -- 172.21.15.96:0/2941495598 learned_addr learned my addr 172.21.15.96:0/2941495598 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43a71e640 1 -- 172.21.15.96:0/2941495598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a2d70320 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43a71e640 1 --2- 172.21.15.96:0/2941495598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d6f8c0 0x55a2a2d6fce0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa4240aa6b0 tx=0x7fa424017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa324e01640 1 -- 172.21.15.96:0/2941495598 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240c2070 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa324e01640 1 -- 172.21.15.96:0/2941495598 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4240b5c20 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2941495598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2a2d70b80 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa324e01640 1 -- 172.21.15.96:0/2941495598 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240b9040 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2941495598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2a2d71090 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa324e01640 1 -- 172.21.15.96:0/2941495598 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa4240c5070 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa324e01640 1 --2- 172.21.15.96:0/2941495598 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa31403a1a0 0x7fa31403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa324e01640 1 -- 172.21.15.96:0/2941495598 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa4240ed860 con 0x55a2a2d6f8c0 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43b720640 1 --2- 172.21.15.96:0/2941495598 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa31403a1a0 0x7fa31403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43d4199c0 1 Processor -- start 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43d4199c0 1 -- start start 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43b720640 1 --2- 172.21.15.96:0/2941495598 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa31403a1a0 0x7fa31403c660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55a2a2d60aa0 tx=0x7fa434003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43d4199c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d7c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43d4199c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a2a2d51230 con 0x55a2a2d7c160 2024-09-14T10:46:16.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.381+0000 7fa43a71e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d7c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d7c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:50994/0 (socket says 172.21.15.96:50994) 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 -- 172.21.15.96:0/85127649 learned_addr learned my addr 172.21.15.96:0/85127649 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 -- 172.21.15.96:0/85127649 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a2d7cb10 con 0x55a2a2d7c160 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 --2- 172.21.15.96:0/85127649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d7c540 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa42400a190 tx=0x7fa4240c5a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aad60d6eeac602a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa31e7fc640 1 -- 172.21.15.96:0/85127649 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240cfcb0 con 0x55a2a2d7c160 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa31e7fc640 1 -- 172.21.15.96:0/85127649 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4240d6070 con 0x55a2a2d7c160 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa31e7fc640 1 -- 172.21.15.96:0/85127649 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240cf640 con 0x55a2a2d7c160 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- 172.21.15.96:0/85127649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 msgr2=0x55a2a2d7c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/85127649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d7c540 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa42400a190 tx=0x7fa4240c5a50 comp rx=0 tx=0).stop 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- 172.21.15.96:0/85127649 shutdown_connections 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/85127649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d7c540 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- 172.21.15.96:0/85127649 >> 172.21.15.96:0/85127649 conn(0x55a2a2d78590 msgr2=0x55a2a2d767d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- 172.21.15.96:0/85127649 shutdown_connections 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- 172.21.15.96:0/85127649 wait complete. 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 Processor -- start 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- start start 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d836f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a2a2d7d170 con 0x55a2a2d7c160 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d836f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d836f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51008/0 (socket says 172.21.15.96:51008) 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 learned_addr learned my addr 172.21.15.96:0/3972636024 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a2d83c50 con 0x55a2a2d7c160 2024-09-14T10:46:16.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43a71e640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d836f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa4240aefd0 tx=0x7fa4240eba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa31cff9640 1 -- 172.21.15.96:0/3972636024 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240edb00 con 0x55a2a2d7c160 2024-09-14T10:46:16.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa31cff9640 1 -- 172.21.15.96:0/3972636024 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4240edca0 con 0x55a2a2d7c160 2024-09-14T10:46:16.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2a2d83ee0 con 0x55a2a2d7c160 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa31cff9640 1 -- 172.21.15.96:0/3972636024 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4240be410 con 0x55a2a2d7c160 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.385+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2a2d83ee0 con 0x55a2a2d7c160 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa31cff9640 1 -- 172.21.15.96:0/3972636024 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa4240b3040 con 0x55a2a2d7c160 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa31cff9640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa30403a150 0x7fa30403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa31cff9640 1 -- 172.21.15.96:0/3972636024 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa4240f7d10 con 0x55a2a2d7c160 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43b720640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa30403a150 0x7fa30403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2d8e9f0 0x55a2a2d90eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d91600 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43af1f640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2d8e9f0 0x55a2a2d90eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43b720640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa30403a150 0x7fa30403c610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa43400f010 tx=0x7fa43401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43af1f640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2d8e9f0 0x55a2a2d90eb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 realm 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d91a10 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d922e0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d92680 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d92ed0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 20 searching for the correct realm 2024-09-14T10:46:16.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a2a2d94c40 0x55a2a2d97030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.389+0000 7fa43a71e640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a2a2d94c40 0x55a2a2d97030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43a71e640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a2a2d94c40 0x55a2a2d97030 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43a71e640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa4240bd370 0x7fa4240da860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa4240bd370 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43b720640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa4240bd370 0x7fa4240da860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43b720640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa4240bd370 0x7fa4240da860 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43b720640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa434019040 0x7fa434019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa434019040 2024-09-14T10:46:16.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43af1f640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa434019040 0x7fa434019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43af1f640 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa434019040 0x7fa434019930 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.393+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa434019040 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa434019040 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa4240bd370 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa434019040 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa4240bd370 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.397+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa434019040 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa434019040 2024-09-14T10:46:16.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa4240bd370 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa4240bd370 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.401+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa434019040 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa4240bd370 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d94c40 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa434019040 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d975c0 con 0x7fa4240bd370 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d93820 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d940c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d97a40 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 zone default found 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 4 Realm: () 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 zonegroup default 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d97a60 con 0x7fa4240bd370 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d99d40 con 0x55a2a2d94c40 2024-09-14T10:46:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9a190 con 0x55a2a2d94c40 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.405+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43d4199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43d4199c0 20 started sync module instance, tier type = 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43d4199c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d991d0 con 0x7fa4240bd370 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94157005231856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d991d0 con 0x7fa4240bd370 2024-09-14T10:46:16.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9ac50 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94157005231856] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94157005236064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d991d0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.409+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9b660 con 0x55a2a2d94c40 2024-09-14T10:46:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.413+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.413+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94157005238704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9bf00 con 0x55a2a2d94c40 2024-09-14T10:46:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.413+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9c8c0 con 0x7fa4240bd370 2024-09-14T10:46:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.413+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94157005236064] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.413+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94157005238704] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.413+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.413+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94157005229344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9c8c0 con 0x7fa4240bd370 2024-09-14T10:46:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.413+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9d190 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.417+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94157005229344] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.417+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.417+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94157005243680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9d190 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.417+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9da20 con 0x7fa434019040 2024-09-14T10:46:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.417+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94157005243680] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.421+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.421+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94157005245664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9d5b0 con 0x7fa434019040 2024-09-14T10:46:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.421+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9e460 con 0x7fa434019040 2024-09-14T10:46:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.421+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94157005245664] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.421+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.421+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94157005246992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9e460 con 0x7fa434019040 2024-09-14T10:46:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.421+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9ee20 con 0x7fa434019040 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94157005246992] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94157005250752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9ee20 con 0x7fa434019040 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 20 add_watcher() i=0 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 20 add_watcher() i=1 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 20 add_watcher() i=2 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 20 add_watcher() i=3 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 20 add_watcher() i=4 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 20 add_watcher() i=5 2024-09-14T10:46:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 20 add_watcher() i=6 2024-09-14T10:46:16.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94157005250752] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 20 add_watcher() i=7 2024-09-14T10:46:16.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:16.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da2100 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.425+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94157005253344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2d9f3b0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.429+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94157005253344] v34'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.429+0000 7fa2f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:16.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.429+0000 7fa43d4199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:16.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.429+0000 7fa43d4199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:16.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.429+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2daacd0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.429+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.429+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dab2e0 con 0x7fa434019040 2024-09-14T10:46:16.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.433+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.433+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dab230 con 0x55a2a2d94c40 2024-09-14T10:46:16.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.433+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.433+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2daba80 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.433+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.433+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2daa360 con 0x7fa4240bd370 2024-09-14T10:46:16.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.437+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'75 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.437+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2daa360 con 0x55a2a2d94c40 2024-09-14T10:46:16.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.437+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.437+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dac100 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.441+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.441+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dac100 con 0x7fa434019040 2024-09-14T10:46:16.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.441+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.441+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dac100 con 0x7fa4240bd370 2024-09-14T10:46:16.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.445+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.445+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dac670 con 0x55a2a2d94c40 2024-09-14T10:46:16.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.445+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.445+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dac670 con 0x7fa4240bd370 2024-09-14T10:46:16.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.445+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.445+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dacbe0 con 0x7fa434019040 2024-09-14T10:46:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.449+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.449+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dacbe0 con 0x7fa4240bd370 2024-09-14T10:46:16.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.449+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.449+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad190 con 0x7fa434019040 2024-09-14T10:46:16.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.453+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.453+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.453+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.453+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.457+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.457+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x7fa4240bd370 2024-09-14T10:46:16.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.457+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.457+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.461+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.461+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.461+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.461+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.461+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.465+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.465+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.465+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x7fa4240bd370 2024-09-14T10:46:16.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.465+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.465+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.469+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.469+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.469+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.469+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.469+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.469+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.473+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.473+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x7fa434019040 2024-09-14T10:46:16.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.473+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.473+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.477+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.477+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x7fa434019040 2024-09-14T10:46:16.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.477+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.477+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x55a2a2d94c40 2024-09-14T10:46:16.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.481+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.481+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x7fa434019040 2024-09-14T10:46:16.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dad010 con 0x7fa4240bd370 2024-09-14T10:46:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa26bfff640 20 reqs_thread_entry: start 2024-09-14T10:46:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 20 Filter name: none 2024-09-14T10:46:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa269ffb640 20 reqs_thread_entry: start 2024-09-14T10:46:16.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:46:16.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da9eb0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.485+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da99f0 con 0x7fa4240bd370 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv44 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 : miss 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:96 8.9 8:95075623:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dca8a0 con 0x7fa4240bd370 2024-09-14T10:46:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(96 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv40 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:46:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 info.flags=0x17 2024-09-14T10:46:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 to cache LRU end 2024-09-14T10:46:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:46:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 2024-09-14T10:46:16.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:97 4.18 4:183b695e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47dd0 con 0x7fa4240bd370 2024-09-14T10:46:16.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(97 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:98 4.9 4:92669125:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47e10 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(98 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 4.c 4:30c052d0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47e10 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(99 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 4.4 4:22d7fa1d:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47e10 con 0x7fa434019040 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(100 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:101 4.2b 4:d477fa5a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47e10 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(101 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4 [call out=430b] v0'0 uv8 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-14T10:46:16.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:102 4.1a 4:59a87cc7:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47e10 con 0x7fa4240bd370 2024-09-14T10:46:16.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.489+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(102 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:103 4.36 4:6e069e12:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47e10 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(103 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:104 4.2b 4:d752e12e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47e10 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(104 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 4.20 4:06bd1336:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47e10 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(105 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:106 4.3 4:c264a7f9:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47d90 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(106 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:107 4.2 4:41da9aa2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47d90 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(107 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 20 get_obj_state: octx=0x7fa42c00bfa0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55a2a2e46298 s->prefetch_data=0 2024-09-14T10:46:16.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:108 3.1es0 3:7ae8281b:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7_15f6f8dc036519d7fe15b39338f6e5db:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dcb4b0 con 0x7fa434019040 2024-09-14T10:46:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(108 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7_15f6f8dc036519d7fe15b39338f6e5db [call out=24b,getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+919 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 10 manifest: total_size = 6 2024-09-14T10:46:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 20 get_obj_state: setting s->obj_tag to 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.18313416228902088905 2024-09-14T10:46:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 20 get_obj_state: octx=0x7fa42c00bfa0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55a2a2e46298 s->prefetch_data=0 2024-09-14T10:46:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 20 prepare_atomic_modification: state is not atomic. state=0x55a2a2e46298 2024-09-14T10:46:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 20 bucket index object: :.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4 2024-09-14T10:46:16.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.493+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:109 4.2b 4:d477fa5a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dcf120 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.497+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 38 ==== osd_op_reply(109 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.497+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:110 3.1es0 3:7ae8281b:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dcf120 con 0x7fa434019040 2024-09-14T10:46:16.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(110 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:111 4.2b 4:d477fa5a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dcf6e0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 20 list_objects_ordered: starting attempt 1 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:112 4.18 4:183b695e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa42c065000 con 0x7fa4240bd370 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:113 4.9 4:92669125:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dcf610 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:114 4.c 4:30c052d0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dd6100 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:115 4.4 4:22d7fa1d:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dd8b70 con 0x7fa434019040 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:116 4.2b 4:d477fa5a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb840 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:117 4.1a 4:59a87cc7:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dde0f0 con 0x7fa4240bd370 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:118 4.36 4:6e069e12:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de09e0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:119 4.2b 4:d752e12e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dde0f0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:120 4.20 4:06bd1336:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 39 ==== osd_op_reply(113 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:121 4.3 4:c264a7f9:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de8990 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 40 ==== osd_op_reply(114 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(112 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(117 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:122 4.2 4:41da9aa2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de8990 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(115 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c02e070 con 0x7fa434019040 2024-09-14T10:46:16.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 41 ==== osd_op_reply(118 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 42 ==== osd_op_reply(120 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 43 ==== osd_op_reply(119 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 44 ==== osd_op_reply(121 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 45 ==== osd_op_reply(122 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 46 ==== osd_op_reply(111 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa31e7fc640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-14T10:46:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 47 ==== osd_op_reply(116 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4 [call out=128b] v0'0 uv10 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T10:46:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T10:46:16.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T10:46:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T10:46:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7])"; uploads.size()=0; is_truncated=0 2024-09-14T10:46:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:123 4.18 4:183b695e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de8990 con 0x7fa4240bd370 2024-09-14T10:46:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:124 4.9 4:92669125:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:125 4.c 4:30c052d0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddaf70 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:126 4.4 4:22d7fa1d:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3c0 con 0x7fa434019040 2024-09-14T10:46:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:127 4.2b 4:d477fa5a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de8500 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:128 4.1a 4:59a87cc7:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de8990 con 0x7fa4240bd370 2024-09-14T10:46:16.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:129 4.36 4:6e069e12:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:130 4.2b 4:d752e12e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddaf70 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:131 4.20 4:06bd1336:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de8990 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:132 4.3 4:c264a7f9:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:133 4.2 4:41da9aa2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de3890 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 48 ==== osd_op_reply(124 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 49 ==== osd_op_reply(125 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(123 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 50 ==== osd_op_reply(129 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(128 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 51 ==== osd_op_reply(127 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4 [call out=128b] v0'0 uv10 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 52 ==== osd_op_reply(131 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.501+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 53 ==== osd_op_reply(133 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 54 ==== osd_op_reply(132 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(126 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x7fa434019040 2024-09-14T10:46:16.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 55 ==== osd_op_reply(130 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x7fa4240bd370 2024-09-14T10:46:16.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(134 foo.buckets [call] v34'47 uv47 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa43402f040 con 0x7fa4240bd370 2024-09-14T10:46:16.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43d4199c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:46:16.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x7fa4240bd370 2024-09-14T10:46:16.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 29 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv41 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43d4199c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:46:16.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43d4199c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:46:16.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43d4199c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:46:16.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.505+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x7fa4240bd370 2024-09-14T10:46:16.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 30 ==== osd_op_reply(136 myfoo [call,call,delete] v34'48 uv48 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43d4199c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-14T10:46:16.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43d4199c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:46:16.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94157005501344 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x7fa434019040 2024-09-14T10:46:16.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== watch-notify(notify (1) cookie 94157005246992 notify 146028888102 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55a2a2dac670 con 0x7fa434019040 2024-09-14T10:46:16.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(137 notify.6 [notify cookie 94157005501344 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa42c07a040 con 0x7fa434019040 2024-09-14T10:46:16.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa31dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94157005246992 notifier 4781 bl.length()=149 2024-09-14T10:46:16.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa31dffb640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa2700032d0 con 0x7fa434019040 2024-09-14T10:46:16.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c07a040 con 0x7fa434019040 2024-09-14T10:46:16.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== watch-notify(notify_complete (2) cookie 94157005501344 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2a2d59270 con 0x7fa434019040 2024-09-14T10:46:16.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.509+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:139 8.9 8:95075623:root::.bucket.meta.myfoo%3a67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x7fa4240bd370 2024-09-14T10:46:16.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 31 ==== osd_op_reply(139 .bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 [call,call,delete] v34'49 uv49 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 from cache 2024-09-14T10:46:16.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7, ofs0, ns] 2024-09-14T10:46:16.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94157005501344 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2de5b60 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 56 ==== watch-notify(notify (1) cookie 94157005243680 notify 146028888097 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55a2a2d59270 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa31dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94157005243680 notifier 4781 bl.length()=206 2024-09-14T10:46:16.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa31dffb640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa2700032d0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 57 ==== osd_op_reply(140 notify.4 [notify cookie 94157005501344 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 58 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c07a040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 59 ==== watch-notify(notify_complete (2) cookie 94157005501344 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2a2d588c0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:142 4.18 4:183b695e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x7fa4240bd370 2024-09-14T10:46:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:143 4.9 4:92669125:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dcf120 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:144 4.c 4:30c052d0:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e460b0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:145 4.4 4:22d7fa1d:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dc8de0 con 0x7fa434019040 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:146 4.2b 4:d477fa5a:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:147 4.1a 4:59a87cc7:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e46b50 con 0x7fa4240bd370 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:148 4.36 4:6e069e12:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e474a0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:149 4.2b 4:d752e12e:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dcf120 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:150 4.20 4:06bd1336:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e47880 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:151 4.3 4:c264a7f9:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e46b50 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.513+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:152 4.2 4:41da9aa2:::.dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2e460b0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 60 ==== osd_op_reply(148 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.6 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 61 ==== osd_op_reply(146 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.4 [delete] v34'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 32 ==== osd_op_reply(142 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.0 [delete] v34'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 62 ==== osd_op_reply(149 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.7 [delete] v34'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 63 ==== osd_op_reply(144 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.2 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 64 ==== osd_op_reply(143 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.1 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 65 ==== osd_op_reply(151 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.9 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 66 ==== osd_op_reply(150 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.8 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 33 ==== osd_op_reply(147 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.5 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.517+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 67 ==== osd_op_reply(152 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.10 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(145 .dir.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7.3 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x7fa434019040 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 : miss 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:153 6.1e 6:78ef3099:::pubsub..bucket.myfoo%2f67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x55a2a2d94c40 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(153 pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 info.flags=0x0 2024-09-14T10:46:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 10 adding default.rgw.log++pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 to cache LRU end 2024-09-14T10:46:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:154 6.1e 6:78ef3099:::pubsub..bucket.myfoo%2f67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x55a2a2d94c40 2024-09-14T10:46:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(154 pubsub..bucket.myfoo/67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.7 [delete] v34'12 uv10 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x7fa4240bd370 2024-09-14T10:46:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 34 ==== osd_op_reply(155 foo.buckets [call] v34'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-14T10:46:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.521+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x7fa434019040 2024-09-14T10:46:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x7fa434019040 2024-09-14T10:46:16.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43d4199c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-14T10:46:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94157005941584 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x7fa4240bd370 2024-09-14T10:46:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 35 ==== watch-notify(notify (1) cookie 94157005229344 notify 146028888085 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a2a2dc9f50 con 0x7fa4240bd370 2024-09-14T10:46:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa31e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94157005229344 notifier 4781 bl.length()=170 2024-09-14T10:46:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 36 ==== osd_op_reply(157 notify.3 [notify cookie 94157005941584 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa31e7fc640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa300003d70 con 0x7fa4240bd370 2024-09-14T10:46:16.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 37 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 38 ==== watch-notify(notify_complete (2) cookie 94157005941584 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2a2dab5d0 con 0x7fa4240bd370 2024-09-14T10:46:16.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43d4199c0 10 removing email index: foo@foo.com 2024-09-14T10:46:16.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.525+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 68 ==== osd_op_reply(159 foo@foo.com [delete] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43d4199c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-14T10:46:16.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94157005432800 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x7fa4240bd370 2024-09-14T10:46:16.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 39 ==== watch-notify(notify (1) cookie 94157005229344 notify 146028888086 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55a2a2dab5d0 con 0x7fa4240bd370 2024-09-14T10:46:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa31e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94157005229344 notifier 4781 bl.length()=162 2024-09-14T10:46:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 40 ==== osd_op_reply(160 notify.3 [notify cookie 94157005432800 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa31e7fc640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa300003d70 con 0x7fa4240bd370 2024-09-14T10:46:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 41 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 42 ==== watch-notify(notify_complete (2) cookie 94157005432800 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2a2dac4a0 con 0x7fa4240bd370 2024-09-14T10:46:16.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43d4199c0 10 removing user buckets index 2024-09-14T10:46:16.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.529+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x7fa4240bd370 2024-09-14T10:46:16.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 43 ==== osd_op_reply(162 foo.buckets [delete] v34'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43d4199c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-14T10:46:16.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94157005501344 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dc9780 con 0x7fa434019040 2024-09-14T10:46:16.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== watch-notify(notify (1) cookie 94157005245664 notify 146028888103 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a2a2d588c0 con 0x7fa434019040 2024-09-14T10:46:16.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa31dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94157005245664 notifier 4781 bl.length()=160 2024-09-14T10:46:16.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa31dffb640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa2700032d0 con 0x7fa434019040 2024-09-14T10:46:16.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== osd_op_reply(163 notify.5 [notify cookie 94157005501344 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa42c085040 con 0x7fa434019040 2024-09-14T10:46:16.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x7fa434019040 2024-09-14T10:46:16.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== watch-notify(notify_complete (2) cookie 94157005501344 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2a2d58630 con 0x7fa434019040 2024-09-14T10:46:16.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43d4199c0 10 removing user index: foo 2024-09-14T10:46:16.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2ddb3a0 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 69 ==== osd_op_reply(165 foo [call,call,delete] v34'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43d4199c0 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43d4199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94157005501344 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2dcf120 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 70 ==== watch-notify(notify (1) cookie 94157005243680 notify 146028888098 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55a2a2d58630 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa31e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94157005243680 notifier 4781 bl.length()=152 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa31e7fc640 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa300003d70 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 71 ==== osd_op_reply(166 notify.4 [notify cookie 94157005501344 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.533+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 72 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 73 ==== watch-notify(notify_complete (2) cookie 94157005501344 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2a2d50e00 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa2f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:16.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94157005253344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 74 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94157005253344] v34'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94157005231856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x7fa4240bd370 2024-09-14T10:46:16.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 44 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94157005231856] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa43d4199c0 20 remove_watcher() i=0 2024-09-14T10:46:16.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa43d4199c0 2 removed watcher, disabling cache 2024-09-14T10:46:16.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.537+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94157005236064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.541+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 75 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94157005236064] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.541+0000 7fa43d4199c0 20 remove_watcher() i=1 2024-09-14T10:46:16.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.541+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94157005238704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x55a2a2d94c40 2024-09-14T10:46:16.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43a71e640 1 -- 172.21.15.96:0/3972636024 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94157005238704] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4240ff040 con 0x55a2a2d94c40 2024-09-14T10:46:16.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43d4199c0 20 remove_watcher() i=2 2024-09-14T10:46:16.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94157005229344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x7fa4240bd370 2024-09-14T10:46:16.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43b720640 1 -- 172.21.15.96:0/3972636024 <== osd.2 v2:172.21.15.96:6816/2312202642 45 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94157005229344] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa434050040 con 0x7fa4240bd370 2024-09-14T10:46:16.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43d4199c0 20 remove_watcher() i=3 2024-09-14T10:46:16.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94157005243680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.1 v2:172.21.15.96:6808/2339799699 76 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94157005243680] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x55a2a2d8e9f0 2024-09-14T10:46:16.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43d4199c0 20 remove_watcher() i=4 2024-09-14T10:46:16.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.545+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94157005245664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x7fa434019040 2024-09-14T10:46:16.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.549+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94157005245664] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x7fa434019040 2024-09-14T10:46:16.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.549+0000 7fa43d4199c0 20 remove_watcher() i=5 2024-09-14T10:46:16.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.549+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94157005246992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x7fa434019040 2024-09-14T10:46:16.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.549+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94157005246992] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x7fa434019040 2024-09-14T10:46:16.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.549+0000 7fa43d4199c0 20 remove_watcher() i=6 2024-09-14T10:46:16.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.549+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94157005250752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a2a2da6960 con 0x7fa434019040 2024-09-14T10:46:16.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94157005250752] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa42c085040 con 0x7fa434019040 2024-09-14T10:46:16.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 20 remove_watcher() i=7 2024-09-14T10:46:16.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa434019040 msgr2=0x7fa434019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa434019040 0x7fa434019930 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2d8e9f0 msgr2=0x55a2a2d90eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2d8e9f0 0x55a2a2d90eb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa4240bd370 msgr2=0x7fa4240da860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa4240bd370 0x7fa4240da860 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a2a2d94c40 msgr2=0x55a2a2d97030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a2a2d94c40 0x55a2a2d97030 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa30403a150 msgr2=0x7fa30403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa30403a150 0x7fa30403c610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa43400f010 tx=0x7fa43401b070 comp rx=0 tx=0).stop 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 msgr2=0x55a2a2d836f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/3972636024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d7c160 0x55a2a2d836f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa4240aefd0 tx=0x7fa4240eba80 comp rx=0 tx=0).stop 2024-09-14T10:46:16.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43af1f640 1 -- 172.21.15.96:0/3972636024 reap_dead start 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 shutdown_connections 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 >> 172.21.15.96:0/3972636024 conn(0x55a2a2d78590 msgr2=0x55a2a2d767a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 shutdown_connections 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/3972636024 wait complete. 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2941495598 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa31403a1a0 msgr2=0x7fa31403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/2941495598 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa31403a1a0 0x7fa31403c660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55a2a2d60aa0 tx=0x7fa434003070 comp rx=0 tx=0).stop 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2941495598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d6f8c0 msgr2=0x55a2a2d6fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/2941495598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d6f8c0 0x55a2a2d6fce0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa4240aa6b0 tx=0x7fa424017e30 comp rx=0 tx=0).stop 2024-09-14T10:46:16.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2941495598 shutdown_connections 2024-09-14T10:46:16.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/2941495598 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa31403a1a0 0x7fa31403c660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/2941495598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2d6f8c0 0x55a2a2d6fce0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2941495598 >> 172.21.15.96:0/2941495598 conn(0x55a2a2d65270 msgr2=0x55a2a2d65650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2941495598 shutdown_connections 2024-09-14T10:46:16.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/2941495598 wait complete. 2024-09-14T10:46:16.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2bda080 msgr2=0x55a2a2d5f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.553+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2bda080 0x55a2a2d5f240 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa32003a150 msgr2=0x7fa32003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa32003a150 0x7fa32003c610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa4240ab000 tx=0x7fa4240a5000 comp rx=0 tx=0).stop 2024-09-14T10:46:16.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 msgr2=0x55a2a2d580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d580d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55a2a2d517a0 tx=0x7fa42c000ee0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 shutdown_connections 2024-09-14T10:46:16.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a2a2bda080 0x55a2a2d5f240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa32003a150 0x7fa32003c610 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 --2- 172.21.15.96:0/612527525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a2a2bd9b50 0x55a2a2d580d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 >> 172.21.15.96:0/612527525 conn(0x55a2a2c5eb30 msgr2=0x55a2a2d51c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 shutdown_connections 2024-09-14T10:46:16.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.557+0000 7fa43d4199c0 1 -- 172.21.15.96:0/612527525 wait complete. 2024-09-14T10:46:16.568 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:46:16.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:46:16.568 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:46:16.650 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:16.650 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.649+0000 7f2089cd09c0 1 Processor -- start 2024-09-14T10:46:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.649+0000 7f2089cd09c0 1 -- start start 2024-09-14T10:46:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.649+0000 7f2089cd09c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55a3b6245250 0x55a3b62d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.649+0000 7f2089cd09c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a3b61797a0 con 0x55a3b62d41c0 2024-09-14T10:46:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.649+0000 7f2089cd09c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55a3b61d51b0 con 0x55a3b6245250 2024-09-14T10:46:16.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.649+0000 7f20877d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55a3b6245250 0x55a3b62d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.649+0000 7f2086fd5640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55a3b62d41c0 0x55a3b62d65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38218/0 (socket says 172.21.15.96:38218) 2024-09-14T10:46:16.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.649+0000 7f2086fd5640 1 -- 172.21.15.96:0/2655543730 learned_addr learned my addr 172.21.15.96:0/2655543730 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:46:16.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f20867d4640 1 -- 172.21.15.96:0/2655543730 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044974857 0 0) 0x55a3b61797a0 con 0x55a3b62d41c0 2024-09-14T10:46:16.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f20867d4640 1 -- 172.21.15.96:0/2655543730 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2070001e20 con 0x55a3b62d41c0 2024-09-14T10:46:16.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f20877d6640 1 -- 172.21.15.96:0/2655543730 >> v1:172.21.15.70:6789/0 conn(0x55a3b62d41c0 legacy=0x55a3b62d65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f20877d6640 1 -- 172.21.15.96:0/2655543730 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3b6153da0 con 0x55a3b6245250 2024-09-14T10:46:16.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f20877d6640 1 --2- 172.21.15.96:0/2655543730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d3c80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f207800a480 tx=0x7f207801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12fda29547b6180 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f20867d4640 1 -- 172.21.15.96:0/2655543730 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20780af070 con 0x55a3b6245250 2024-09-14T10:46:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f20867d4640 1 -- 172.21.15.96:0/2655543730 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20780aa530 con 0x55a3b6245250 2024-09-14T10:46:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f20867d4640 1 -- 172.21.15.96:0/2655543730 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20780aa830 con 0x55a3b6245250 2024-09-14T10:46:16.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2655543730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 msgr2=0x55a3b62d3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/2655543730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d3c80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f207800a480 tx=0x7f207801b280 comp rx=0 tx=0).stop 2024-09-14T10:46:16.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2655543730 shutdown_connections 2024-09-14T10:46:16.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/2655543730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d3c80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2655543730 >> 172.21.15.96:0/2655543730 conn(0x55a3b62cb970 msgr2=0x55a3b62cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2655543730 shutdown_connections 2024-09-14T10:46:16.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.653+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2655543730 wait complete. 2024-09-14T10:46:16.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.669+0000 7f2089cd09c0 1 Processor -- start 2024-09-14T10:46:16.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.669+0000 7f2089cd09c0 1 -- start start 2024-09-14T10:46:16.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.669+0000 7f2089cd09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.669+0000 7f2089cd09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3b61d8fc0 con 0x55a3b6245250 2024-09-14T10:46:16.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51022/0 (socket says 172.21.15.96:51022) 2024-09-14T10:46:16.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 -- 172.21.15.96:0/902830194 learned_addr learned my addr 172.21.15.96:0/902830194 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 -- 172.21.15.96:0/902830194 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3b62d1850 con 0x55a3b6245250 2024-09-14T10:46:16.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 --2- 172.21.15.96:0/902830194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d1260 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2078000c10 tx=0x7f2078003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8e7014648ab89f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f1f7560a640 1 -- 172.21.15.96:0/902830194 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20780af070 con 0x55a3b6245250 2024-09-14T10:46:16.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f1f7560a640 1 -- 172.21.15.96:0/902830194 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20780bb070 con 0x55a3b6245250 2024-09-14T10:46:16.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f1f7560a640 1 -- 172.21.15.96:0/902830194 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20780aa6e0 con 0x55a3b6245250 2024-09-14T10:46:16.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 -- 172.21.15.96:0/902830194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 msgr2=0x55a3b62d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/902830194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d1260 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2078000c10 tx=0x7f2078003030 comp rx=0 tx=0).stop 2024-09-14T10:46:16.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 -- 172.21.15.96:0/902830194 shutdown_connections 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/902830194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b62d1260 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 -- 172.21.15.96:0/902830194 >> 172.21.15.96:0/902830194 conn(0x55a3b62cb970 msgr2=0x55a3b63b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 -- 172.21.15.96:0/902830194 shutdown_connections 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 -- 172.21.15.96:0/902830194 wait complete. 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 Processor -- start 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 -- start start 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b63c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f2089cd09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3b617aa50 con 0x55a3b6245250 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b63c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b63c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51032/0 (socket says 172.21.15.96:51032) 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 -- 172.21.15.96:0/3534407205 learned_addr learned my addr 172.21.15.96:0/3534407205 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.673+0000 7f20877d6640 1 -- 172.21.15.96:0/3534407205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3b63c6290 con 0x55a3b6245250 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f20877d6640 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b63c5d30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2078018eb0 tx=0x7f2078018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f1f73e07640 1 -- 172.21.15.96:0/3534407205 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20780b6480 con 0x55a3b6245250 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f1f73e07640 1 -- 172.21.15.96:0/3534407205 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20780c3070 con 0x55a3b6245250 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3b63c6520 con 0x55a3b6245250 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f1f73e07640 1 -- 172.21.15.96:0/3534407205 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20780b6790 con 0x55a3b6245250 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3b63c6ed0 con 0x55a3b6245250 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f1f73e07640 1 -- 172.21.15.96:0/3534407205 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f20780ce060 con 0x55a3b6245250 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f1f73e07640 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6c03a150 0x7f1f6c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f1f73e07640 1 -- 172.21.15.96:0/3534407205 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f20780eb6c0 con 0x55a3b6245250 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2086fd5640 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6c03a150 0x7f1f6c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b62d41c0 0x55a3b63ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b63cd3e0 con 0x55a3b62d41c0 2024-09-14T10:46:16.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2087fd7640 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b62d41c0 0x55a3b63ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2086fd5640 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6c03a150 0x7f1f6c03c610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f207c006f80 tx=0x7f207c006570 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2087fd7640 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b62d41c0 0x55a3b63ccea0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2087fd7640 1 -- 172.21.15.96:0/3534407205 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20800083f0 con 0x55a3b62d41c0 2024-09-14T10:46:16.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b63cd830 con 0x55a3b62d41c0 2024-09-14T10:46:16.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2087fd7640 1 -- 172.21.15.96:0/3534407205 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20800083f0 con 0x55a3b62d41c0 2024-09-14T10:46:16.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.677+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b63cf130 con 0x55a3b62d41c0 2024-09-14T10:46:16.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2087fd7640 1 -- 172.21.15.96:0/3534407205 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20800083f0 con 0x55a3b62d41c0 2024-09-14T10:46:16.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b63ce360 con 0x55a3b62d41c0 2024-09-14T10:46:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2087fd7640 1 -- 172.21.15.96:0/3534407205 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20800083f0 con 0x55a3b62d41c0 2024-09-14T10:46:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b63ce780 con 0x55a3b62d41c0 2024-09-14T10:46:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2087fd7640 1 -- 172.21.15.96:0/3534407205 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20800083f0 con 0x55a3b62d41c0 2024-09-14T10:46:16.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2089cd09c0 1 Processor -- start 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2089cd09c0 1 -- start start 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2089cd09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63dd520 0x55a3b63dd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2089cd09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3b61e5d80 con 0x55a3b63dd520 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2086fd5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63dd520 0x55a3b63dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2086fd5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63dd520 0x55a3b63dd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51040/0 (socket says 172.21.15.96:51040) 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2086fd5640 1 -- 172.21.15.96:0/1365060635 learned_addr learned my addr 172.21.15.96:0/1365060635 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2086fd5640 1 -- 172.21.15.96:0/1365060635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3b63ddf80 con 0x55a3b63dd520 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2086fd5640 1 --2- 172.21.15.96:0/1365060635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63dd520 0x55a3b63dd940 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f207c004ed0 tx=0x7f207c015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f1f71602640 1 -- 172.21.15.96:0/1365060635 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f207c011440 con 0x55a3b63dd520 2024-09-14T10:46:16.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f1f71602640 1 -- 172.21.15.96:0/1365060635 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c0115e0 con 0x55a3b63dd520 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2089cd09c0 1 -- 172.21.15.96:0/1365060635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3b63de7e0 con 0x55a3b63dd520 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f1f71602640 1 -- 172.21.15.96:0/1365060635 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f207c011900 con 0x55a3b63dd520 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.681+0000 7f2089cd09c0 1 -- 172.21.15.96:0/1365060635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3b63ded50 con 0x55a3b63dd520 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f1f71602640 1 -- 172.21.15.96:0/1365060635 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f207c011aa0 con 0x55a3b63dd520 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f1f71602640 1 --2- 172.21.15.96:0/1365060635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6003a150 0x7f1f6003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f1f71602640 1 -- 172.21.15.96:0/1365060635 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f207c01b030 con 0x55a3b63dd520 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2087fd7640 1 --2- 172.21.15.96:0/1365060635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6003a150 0x7f1f6003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 Processor -- start 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- start start 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2087fd7640 1 --2- 172.21.15.96:0/1365060635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6003a150 0x7f1f6003c610 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55a3b63ce700 tx=0x7f2080003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63eb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3b62cfb30 con 0x55a3b63eaef0 2024-09-14T10:46:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2086fd5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63eb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2086fd5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63eb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51050/0 (socket says 172.21.15.96:51050) 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2086fd5640 1 -- 172.21.15.96:0/2366661123 learned_addr learned my addr 172.21.15.96:0/2366661123 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2086fd5640 1 -- 172.21.15.96:0/2366661123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3b63eb8c0 con 0x55a3b63eaef0 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2086fd5640 1 --2- 172.21.15.96:0/2366661123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63eb2d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f207c011fd0 tx=0x7f207c01f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea5bf814ceca89 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f1f6affd640 1 -- 172.21.15.96:0/2366661123 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f207c020cd0 con 0x55a3b63eaef0 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f1f6affd640 1 -- 172.21.15.96:0/2366661123 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c050bc0 con 0x55a3b63eaef0 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f1f6affd640 1 -- 172.21.15.96:0/2366661123 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f207c03ebc0 con 0x55a3b63eaef0 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2366661123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 msgr2=0x55a3b63eb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/2366661123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63eb2d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f207c011fd0 tx=0x7f207c01f810 comp rx=0 tx=0).stop 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2366661123 shutdown_connections 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/2366661123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63eb2d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2366661123 >> 172.21.15.96:0/2366661123 conn(0x55a3b63e62b0 msgr2=0x55a3b63e44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2366661123 shutdown_connections 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- 172.21.15.96:0/2366661123 wait complete. 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 Processor -- start 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- start start 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.685+0000 7f2089cd09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3b63e9de0 con 0x55a3b63eaef0 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2086fd5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2086fd5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63f13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51060/0 (socket says 172.21.15.96:51060) 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 learned_addr learned my addr 172.21.15.96:0/175313932 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3b63f1950 con 0x55a3b63eaef0 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2086fd5640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63f13f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f207c015d70 tx=0x7f207c050a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f1f697fa640 1 -- 172.21.15.96:0/175313932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f207c04f520 con 0x55a3b63eaef0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f1f697fa640 1 -- 172.21.15.96:0/175313932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207c04f6c0 con 0x55a3b63eaef0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3b63f1be0 con 0x55a3b63eaef0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f1f697fa640 1 -- 172.21.15.96:0/175313932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f207c010b70 con 0x55a3b63eaef0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3b63f2590 con 0x55a3b63eaef0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f1f697fa640 1 -- 172.21.15.96:0/175313932 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f207c030020 con 0x55a3b63eaef0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f1f697fa640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f5003a150 0x7f1f5003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f1f697fa640 1 -- 172.21.15.96:0/175313932 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f207c020cd0 con 0x55a3b63eaef0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2087fd7640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f5003a150 0x7f1f5003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b63fc910 0x55a3b63feda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b63ff4f0 con 0x55a3b63fc910 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f20877d6640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b63fc910 0x55a3b63feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2087fd7640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f5003a150 0x7f1f5003c610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f208000f010 tx=0x7f208001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f20877d6640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b63fc910 0x55a3b63feda0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 20 realm 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.689+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b63ff900 con 0x55a3b63fc910 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64001d0 con 0x55a3b63fc910 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6400570 con 0x55a3b63fc910 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6400a10 con 0x55a3b63fc910 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 20 searching for the correct realm 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a3b64029b0 0x55a3b6404de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2086fd5640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a3b64029b0 0x55a3b6404de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2086fd5640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a3b64029b0 0x55a3b6404de0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c00f070 con 0x55a3b64029b0 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2086fd5640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f207c00f300 0x7f207c00f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f207c00f300 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2087fd7640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f207c00f300 0x7f207c00f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2087fd7640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f207c00f300 0x7f207c00f9c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2087fd7640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2080019040 0x7f2080019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f2080019040 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f20877d6640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2080019040 0x7f2080019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.693+0000 7f20877d6640 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2080019040 0x7f2080019930 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b63fc910 2024-09-14T10:46:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b63fc910 2024-09-14T10:46:16.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f2080019040 2024-09-14T10:46:16.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f2080019040 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f207c00f300 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c00f070 con 0x55a3b64029b0 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b63fc910 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f2080019040 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b63fc910 2024-09-14T10:46:16.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.697+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f207c00f300 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f2080019040 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b63fc910 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b63fc910 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f2080019040 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.701+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f207c00f300 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b63fc910 2024-09-14T10:46:16.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f207c00f300 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f2080019040 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f207c00f300 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b64029b0 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f2080019040 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x55a3b63fc910 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64054b0 con 0x7f207c00f300 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2089cd09c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2089cd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2089cd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2089cd09c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2089cd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:16.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2089cd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.705+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6401450 con 0x55a3b63fc910 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6401090 con 0x55a3b63fc910 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6401db0 con 0x55a3b63fc910 2024-09-14T10:46:16.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 zone default found 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 4 Realm: () 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 zonegroup default 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6405930 con 0x7f207c00f300 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6407b70 con 0x55a3b64029b0 2024-09-14T10:46:16.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6407f10 con 0x55a3b64029b0 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 started sync module instance, tier type = 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6406fb0 con 0x7f207c00f300 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94161625707776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6406fb0 con 0x7f207c00f300 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.709+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64088d0 con 0x55a3b63fc910 2024-09-14T10:46:16.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.713+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94161625707776] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.713+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.713+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94161625711920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6406fb0 con 0x55a3b63fc910 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.713+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64092e0 con 0x55a3b64029b0 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.713+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94161625711920] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.713+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.713+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94161625705216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6406f20 con 0x55a3b64029b0 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.713+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6409fe0 con 0x7f207c00f300 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.717+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.717+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94161625717856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640a880 con 0x7f207c00f300 2024-09-14T10:46:16.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.717+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640b280 con 0x55a3b63fc910 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.717+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94161625705216] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.717+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94161625717856] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.717+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.717+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94161625716352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640a3d0 con 0x55a3b63fc910 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.717+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640bb20 con 0x7f2080019040 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.721+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94161625716352] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.721+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.721+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94161625722256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640a3d0 con 0x7f2080019040 2024-09-14T10:46:16.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.721+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640bfd0 con 0x7f2080019040 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.721+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94161625722256] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.721+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.721+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94161625725632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640bf90 con 0x7f2080019040 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.721+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640c9b0 con 0x7f2080019040 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94161625725632] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94161625728160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640c970 con 0x7f2080019040 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 20 add_watcher() i=0 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 20 add_watcher() i=1 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 20 add_watcher() i=2 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 20 add_watcher() i=3 2024-09-14T10:46:16.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 20 add_watcher() i=4 2024-09-14T10:46:16.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 20 add_watcher() i=5 2024-09-14T10:46:16.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 20 add_watcher() i=6 2024-09-14T10:46:16.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94161625728160] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 20 add_watcher() i=7 2024-09-14T10:46:16.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:16.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640fda0 con 0x55a3b63fc910 2024-09-14T10:46:16.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.725+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94161625723984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b640d2c0 con 0x55a3b63fc910 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94161625723984] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f1f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 5 note: GC not initialized 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f1f3cfe1640 20 reqs_thread_entry: start 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 20 Filter name: none 2024-09-14T10:46:16.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f1eb67fc640 20 reqs_thread_entry: start 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a3b64330d0 con 0x55a3b63fc910 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:could not fetch user info: no user info saved 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f1f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94161625723984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6433090 con 0x55a3b63fc910 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94161625723984] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.729+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94161625707776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6433090 con 0x7f207c00f300 2024-09-14T10:46:16.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.733+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94161625707776] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.733+0000 7f2089cd09c0 20 remove_watcher() i=0 2024-09-14T10:46:16.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.733+0000 7f2089cd09c0 2 removed watcher, disabling cache 2024-09-14T10:46:16.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.733+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94161625711920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6433090 con 0x55a3b63fc910 2024-09-14T10:46:16.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.733+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94161625711920] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.733+0000 7f2089cd09c0 20 remove_watcher() i=1 2024-09-14T10:46:16.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.733+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94161625705216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6433090 con 0x55a3b64029b0 2024-09-14T10:46:16.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f2086fd5640 1 -- 172.21.15.96:0/175313932 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94161625705216] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f207c05f040 con 0x55a3b64029b0 2024-09-14T10:46:16.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f2089cd09c0 20 remove_watcher() i=2 2024-09-14T10:46:16.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94161625717856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6430d70 con 0x7f207c00f300 2024-09-14T10:46:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f2087fd7640 1 -- 172.21.15.96:0/175313932 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94161625717856] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f208002f040 con 0x7f207c00f300 2024-09-14T10:46:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f2089cd09c0 20 remove_watcher() i=3 2024-09-14T10:46:16.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94161625716352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6430d70 con 0x55a3b63fc910 2024-09-14T10:46:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94161625716352] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x55a3b63fc910 2024-09-14T10:46:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f2089cd09c0 20 remove_watcher() i=4 2024-09-14T10:46:16.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.737+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94161625722256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6430d70 con 0x7f2080019040 2024-09-14T10:46:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.741+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94161625722256] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.741+0000 7f2089cd09c0 20 remove_watcher() i=5 2024-09-14T10:46:16.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.741+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94161625725632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6430d70 con 0x7f2080019040 2024-09-14T10:46:16.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94161625725632] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 20 remove_watcher() i=6 2024-09-14T10:46:16.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94161625728160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a3b6430d70 con 0x7f2080019040 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94161625728160] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20780a8070 con 0x7f2080019040 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 20 remove_watcher() i=7 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2080019040 msgr2=0x7f2080019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2080019040 0x7f2080019930 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b63fc910 msgr2=0x55a3b63feda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b63fc910 0x55a3b63feda0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f207c00f300 msgr2=0x7f207c00f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f207c00f300 0x7f207c00f9c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a3b64029b0 msgr2=0x55a3b6404de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a3b64029b0 0x55a3b6404de0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f5003a150 msgr2=0x7f1f5003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f5003a150 0x7f1f5003c610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f208000f010 tx=0x7f208001b070 comp rx=0 tx=0).stop 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 msgr2=0x55a3b63f13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/175313932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63eaef0 0x55a3b63f13f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f207c015d70 tx=0x7f207c050a10 comp rx=0 tx=0).stop 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 reap_dead start 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f20877d6640 1 -- 172.21.15.96:0/175313932 reap_dead start 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 shutdown_connections 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 >> 172.21.15.96:0/175313932 conn(0x55a3b63e62b0 msgr2=0x55a3b63e44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 shutdown_connections 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/175313932 wait complete. 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/1365060635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6003a150 msgr2=0x7f1f6003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/1365060635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6003a150 0x7f1f6003c610 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55a3b63ce700 tx=0x7f2080003070 comp rx=0 tx=0).stop 2024-09-14T10:46:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/1365060635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63dd520 msgr2=0x55a3b63dd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/1365060635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63dd520 0x55a3b63dd940 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f207c004ed0 tx=0x7f207c015820 comp rx=0 tx=0).stop 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/1365060635 shutdown_connections 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/1365060635 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6003a150 0x7f1f6003c610 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/1365060635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b63dd520 0x55a3b63dd940 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/1365060635 >> 172.21.15.96:0/1365060635 conn(0x55a3b63d2ed0 msgr2=0x55a3b63d32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/1365060635 shutdown_connections 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.745+0000 7f2089cd09c0 1 -- 172.21.15.96:0/1365060635 wait complete. 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b62d41c0 msgr2=0x55a3b63ccea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b62d41c0 0x55a3b63ccea0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6c03a150 msgr2=0x7f1f6c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6c03a150 0x7f1f6c03c610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f207c006f80 tx=0x7f207c006570 comp rx=0 tx=0).stop 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 msgr2=0x55a3b63c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b63c5d30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2078018eb0 tx=0x7f2078018020 comp rx=0 tx=0).stop 2024-09-14T10:46:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 shutdown_connections 2024-09-14T10:46:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a3b62d41c0 0x55a3b63ccea0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1f6c03a150 0x7f1f6c03c610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 --2- 172.21.15.96:0/3534407205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3b6245250 0x55a3b63c5d30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 >> 172.21.15.96:0/3534407205 conn(0x55a3b62cb970 msgr2=0x55a3b63b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 shutdown_connections 2024-09-14T10:46:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.749+0000 7f2089cd09c0 1 -- 172.21.15.96:0/3534407205 wait complete. 2024-09-14T10:46:16.758 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T10:46:16.758 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-14T10:46:16.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-14T10:46:16.759 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-14T10:46:16.832 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:16.832 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:16.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c898f9c0 1 Processor -- start 2024-09-14T10:46:16.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c898f9c0 1 -- start start 2024-09-14T10:46:16.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c898f9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x560718bae140 0x560718bb0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c898f9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560718a537a0 con 0x560718ba9f50 2024-09-14T10:46:16.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c898f9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x560718aaf1b0 con 0x560718bae140 2024-09-14T10:46:16.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c5c94640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x560718bae140 0x560718bb0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c5c94640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x560718bae140 0x560718bb0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51076/0 (socket says 172.21.15.96:51076) 2024-09-14T10:46:16.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c5c94640 1 -- 172.21.15.96:0/3610969206 learned_addr learned my addr 172.21.15.96:0/3610969206 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c5c94640 1 -- 172.21.15.96:0/3610969206 >> v1:172.21.15.70:6789/0 conn(0x560718ba9f50 legacy=0x560718baa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.833+0000 7f65c5c94640 1 -- 172.21.15.96:0/3610969206 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560718a2dda0 con 0x560718bae140 2024-09-14T10:46:16.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c5c94640 1 --2- 172.21.15.96:0/3610969206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718bae140 0x560718bb0530 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f65b000a5c0 tx=0x7f65b001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcb34cbecc57f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c5493640 1 -- 172.21.15.96:0/3610969206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b00a9590 con 0x560718bae140 2024-09-14T10:46:16.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c5493640 1 -- 172.21.15.96:0/3610969206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b00ae070 con 0x560718bae140 2024-09-14T10:46:16.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c5493640 1 -- 172.21.15.96:0/3610969206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b00a9880 con 0x560718bae140 2024-09-14T10:46:16.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3610969206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718bae140 msgr2=0x560718bb0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3610969206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718bae140 0x560718bb0530 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f65b000a5c0 tx=0x7f65b001b3d0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3610969206 shutdown_connections 2024-09-14T10:46:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3610969206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718bae140 0x560718bb0530 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3610969206 >> 172.21.15.96:0/3610969206 conn(0x560718ba5a70 msgr2=0x560718ba7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3610969206 shutdown_connections 2024-09-14T10:46:16.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.837+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3610969206 wait complete. 2024-09-14T10:46:16.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 Processor -- start 2024-09-14T10:46:16.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- start start 2024-09-14T10:46:16.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c942b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560718ab2fc0 con 0x560718ba9f50 2024-09-14T10:46:16.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c6495640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c942b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c6495640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c942b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51078/0 (socket says 172.21.15.96:51078) 2024-09-14T10:46:16.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c6495640 1 -- 172.21.15.96:0/4168495358 learned_addr learned my addr 172.21.15.96:0/4168495358 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c6495640 1 -- 172.21.15.96:0/4168495358 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560718c948a0 con 0x560718ba9f50 2024-09-14T10:46:16.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c6495640 1 --2- 172.21.15.96:0/4168495358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c942b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f65b8001680 tx=0x7f65b8001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5adeae8e37d97d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f64b4608640 1 -- 172.21.15.96:0/4168495358 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b8016070 con 0x560718ba9f50 2024-09-14T10:46:16.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f64b4608640 1 -- 172.21.15.96:0/4168495358 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b800f660 con 0x560718ba9f50 2024-09-14T10:46:16.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f64b4608640 1 -- 172.21.15.96:0/4168495358 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b800f980 con 0x560718ba9f50 2024-09-14T10:46:16.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- 172.21.15.96:0/4168495358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 msgr2=0x560718c942b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/4168495358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c942b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f65b8001680 tx=0x7f65b8001b40 comp rx=0 tx=0).stop 2024-09-14T10:46:16.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- 172.21.15.96:0/4168495358 shutdown_connections 2024-09-14T10:46:16.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/4168495358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c942b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- 172.21.15.96:0/4168495358 >> 172.21.15.96:0/4168495358 conn(0x560718ba5a70 msgr2=0x560718c8fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- 172.21.15.96:0/4168495358 shutdown_connections 2024-09-14T10:46:16.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- 172.21.15.96:0/4168495358 wait complete. 2024-09-14T10:46:16.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 Processor -- start 2024-09-14T10:46:16.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- start start 2024-09-14T10:46:16.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c9bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.853+0000 7f65c898f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560718a54a50 con 0x560718ba9f50 2024-09-14T10:46:16.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6495640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c9bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6495640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c9bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51082/0 (socket says 172.21.15.96:51082) 2024-09-14T10:46:16.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6495640 1 -- 172.21.15.96:0/59418922 learned_addr learned my addr 172.21.15.96:0/59418922 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6495640 1 -- 172.21.15.96:0/59418922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560718c9c0d0 con 0x560718ba9f50 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6495640 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c9bb70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x560718c95240 tx=0x7f65b8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b2e05640 1 -- 172.21.15.96:0/59418922 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b8016040 con 0x560718ba9f50 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b2e05640 1 -- 172.21.15.96:0/59418922 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b8022070 con 0x560718ba9f50 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560718c9c360 con 0x560718ba9f50 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b2e05640 1 -- 172.21.15.96:0/59418922 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b8006330 con 0x560718ba9f50 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560718c9cd10 con 0x560718ba9f50 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c898f9c0 1 Processor -- start 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c898f9c0 1 -- start start 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c898f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c898f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560718abfd80 con 0x560718cacc00 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6c96640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b2e05640 1 -- 172.21.15.96:0/59418922 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f65b80114c0 con 0x560718ba9f50 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6c96640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51088/0 (socket says 172.21.15.96:51088) 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6c96640 1 -- 172.21.15.96:0/1984843844 learned_addr learned my addr 172.21.15.96:0/1984843844 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b2e05640 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64ac03a2f0 0x7f64ac03c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b2e05640 1 -- 172.21.15.96:0/59418922 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f65b8050730 con 0x560718ba9f50 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6495640 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64ac03a2f0 0x7f64ac03c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6c96640 1 -- 172.21.15.96:0/1984843844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560718cad5f0 con 0x560718cacc00 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6495640 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64ac03a2f0 0x7f64ac03c7b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65b800ff50 tx=0x7f65b8027eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f65c6c96640 1 --2- 172.21.15.96:0/1984843844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cad000 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f65c000a440 tx=0x7f65c000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7ccb47f81af676 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b0e01640 1 -- 172.21.15.96:0/1984843844 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65c0008850 con 0x560718cacc00 2024-09-14T10:46:16.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b0e01640 1 -- 172.21.15.96:0/1984843844 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0008a10 con 0x560718cacc00 2024-09-14T10:46:16.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.857+0000 7f64b0e01640 1 -- 172.21.15.96:0/1984843844 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65c0008d30 con 0x560718cacc00 2024-09-14T10:46:16.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- 172.21.15.96:0/1984843844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 msgr2=0x560718cad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/1984843844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cad000 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f65c000a440 tx=0x7f65c000a900 comp rx=0 tx=0).stop 2024-09-14T10:46:16.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- 172.21.15.96:0/1984843844 shutdown_connections 2024-09-14T10:46:16.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/1984843844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cad000 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- 172.21.15.96:0/1984843844 >> 172.21.15.96:0/1984843844 conn(0x560718bae140 msgr2=0x560718ca4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- 172.21.15.96:0/1984843844 shutdown_connections 2024-09-14T10:46:16.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- 172.21.15.96:0/1984843844 wait complete. 2024-09-14T10:46:16.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 Processor -- start 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- start start 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cb4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560718cadde0 con 0x560718cacc00 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c6c96640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cb4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c6c96640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cb4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51102/0 (socket says 172.21.15.96:51102) 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c6c96640 1 -- 172.21.15.96:0/3691129983 learned_addr learned my addr 172.21.15.96:0/3691129983 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c6c96640 1 -- 172.21.15.96:0/3691129983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560718cb4560 con 0x560718cacc00 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c6c96640 1 --2- 172.21.15.96:0/3691129983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cb4000 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x560718cadb00 tx=0x7f65c0003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f64aaffd640 1 -- 172.21.15.96:0/3691129983 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65c0013a70 con 0x560718cacc00 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f64aaffd640 1 -- 172.21.15.96:0/3691129983 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0023070 con 0x560718cacc00 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3691129983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560718cb47f0 con 0x560718cacc00 2024-09-14T10:46:16.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f64aaffd640 1 -- 172.21.15.96:0/3691129983 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65c0013d80 con 0x560718cacc00 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3691129983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560718cb51a0 con 0x560718cacc00 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f65c898f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.861+0000 7f64aaffd640 1 -- 172.21.15.96:0/3691129983 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f65c0028460 con 0x560718cacc00 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c898f9c0 1 Processor -- start 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f64aaffd640 1 --2- 172.21.15.96:0/3691129983 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64a003a150 0x7f64a003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c898f9c0 1 -- start start 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f64aaffd640 1 -- 172.21.15.96:0/3691129983 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f65c0051010 con 0x560718cacc00 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c898f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ccd930 0x560718ccdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c898f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560718c94cd0 con 0x560718ccd930 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c6c96640 1 --2- 172.21.15.96:0/3691129983 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64a003a150 0x7f64a003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c6495640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ccd930 0x560718ccdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c6495640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ccd930 0x560718ccdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51118/0 (socket says 172.21.15.96:51118) 2024-09-14T10:46:16.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c6495640 1 -- 172.21.15.96:0/3772707817 learned_addr learned my addr 172.21.15.96:0/3772707817 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c6c96640 1 --2- 172.21.15.96:0/3691129983 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64a003a150 0x7f64a003c610 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65c001df90 tx=0x7f65c001df20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c6495640 1 -- 172.21.15.96:0/3772707817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560718cce370 con 0x560718ccd930 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c6495640 1 --2- 172.21.15.96:0/3772707817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ccd930 0x560718ccdd50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f65b804eab0 tx=0x7f65b804ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f648afe5640 1 -- 172.21.15.96:0/3772707817 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b801c7b0 con 0x560718ccd930 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f648afe5640 1 -- 172.21.15.96:0/3772707817 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b80119e0 con 0x560718ccd930 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3772707817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560718cd0c20 con 0x560718ccd930 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f648afe5640 1 -- 172.21.15.96:0/3772707817 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b8011cc0 con 0x560718ccd930 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3772707817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560718cd1090 con 0x560718ccd930 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f648afe5640 1 -- 172.21.15.96:0/3772707817 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f65b804e2f0 con 0x560718ccd930 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f648afe5640 1 --2- 172.21.15.96:0/3772707817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f640803a150 0x7f640803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f648afe5640 1 -- 172.21.15.96:0/3772707817 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f65b8048d60 con 0x560718ccd930 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c5c94640 1 --2- 172.21.15.96:0/3772707817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f640803a150 0x7f640803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f6488fe1640 20 reqs_thread_entry: start 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560718cd32e0 0x560718cd5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560718cd5e40 con 0x560718cd32e0 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c5c94640 1 --2- 172.21.15.96:0/3772707817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f640803a150 0x7f640803c610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f65b00ad000 tx=0x7f65b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.865+0000 7f65c6c96640 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560718cd32e0 0x560718cd5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c6c96640 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560718cd32e0 0x560718cd5770 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c6c96640 1 -- 172.21.15.96:0/59418922 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65c001e7a0 con 0x560718cd32e0 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560718cd7700 con 0x560718cd32e0 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c6c96640 1 -- 172.21.15.96:0/59418922 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65c001e7a0 con 0x560718cd32e0 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3691129983 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64a003a150 msgr2=0x7f64a003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3691129983 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64a003a150 0x7f64a003c610 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65c001df90 tx=0x7f65c001df20 comp rx=0 tx=0).stop 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3691129983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 msgr2=0x560718cb4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3691129983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cb4000 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x560718cadb00 tx=0x7f65c0003000 comp rx=0 tx=0).stop 2024-09-14T10:46:16.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3691129983 shutdown_connections 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3691129983 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64a003a150 0x7f64a003c610 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3691129983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718cacc00 0x560718cb4000 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3691129983 >> 172.21.15.96:0/3691129983 conn(0x560718bae140 msgr2=0x560718ca3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3691129983 shutdown_connections 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3691129983 wait complete. 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3772707817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f640803a150 msgr2=0x7f640803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3772707817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f640803a150 0x7f640803c610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f65b00ad000 tx=0x7f65b00a6000 comp rx=0 tx=0).stop 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3772707817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ccd930 msgr2=0x560718ccdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3772707817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ccd930 0x560718ccdd50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f65b804eab0 tx=0x7f65b804ea10 comp rx=0 tx=0).stop 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3772707817 shutdown_connections 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3772707817 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f640803a150 0x7f640803c610 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/3772707817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ccd930 0x560718ccdd50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3772707817 >> 172.21.15.96:0/3772707817 conn(0x560718cc2f70 msgr2=0x560718cc3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3772707817 shutdown_connections 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/3772707817 wait complete. 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560718cd32e0 msgr2=0x560718cd5770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560718cd32e0 0x560718cd5770 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64ac03a2f0 msgr2=0x7f64ac03c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64ac03a2f0 0x7f64ac03c7b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65b800ff50 tx=0x7f65b8027eb0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 msgr2=0x560718c9bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c9bb70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x560718c95240 tx=0x7f65b8000f50 comp rx=0 tx=0).stop 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 shutdown_connections 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x560718cd32e0 0x560718cd5770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f64ac03a2f0 0x7f64ac03c7b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 --2- 172.21.15.96:0/59418922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560718ba9f50 0x560718c9bb70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 >> 172.21.15.96:0/59418922 conn(0x560718ba5a70 msgr2=0x560718c956d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 shutdown_connections 2024-09-14T10:46:16.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.869+0000 7f65c898f9c0 1 -- 172.21.15.96:0/59418922 wait complete. 2024-09-14T10:46:16.882 INFO:teuthology.orchestra.run.smithi096.stdout:{"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:46:16.883 DEBUG:tasks.util.rgw: json result: {'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:46:16.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-14T10:46:16.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-14T10:46:16.883 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-14T10:46:16.953 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:16.953 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:16.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56e21ef9c0 1 Processor -- start 2024-09-14T10:46:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56e21ef9c0 1 -- start start 2024-09-14T10:46:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56e21ef9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55b146a7d280 0x55b146b0bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56e21ef9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1469b17a0 con 0x55b146b0c170 2024-09-14T10:46:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56e21ef9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55b146a0d1b0 con 0x55b146a7d280 2024-09-14T10:46:16.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56dfcf5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55b146a7d280 0x55b146b0bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56dfcf5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55b146a7d280 0x55b146b0bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51132/0 (socket says 172.21.15.96:51132) 2024-09-14T10:46:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1846789291 learned_addr learned my addr 172.21.15.96:0/1846789291 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1846789291 >> v1:172.21.15.70:6789/0 conn(0x55b146b0c170 legacy=0x55b146b0e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.953+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1846789291 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b14698bda0 con 0x55b146a7d280 2024-09-14T10:46:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/1846789291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146b0bc30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f56d000a4e0 tx=0x7f56d001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0d58696e1d10c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56decf3640 1 -- 172.21.15.96:0/1846789291 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d00aa540 con 0x55b146a7d280 2024-09-14T10:46:16.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56decf3640 1 -- 172.21.15.96:0/1846789291 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d00aa6e0 con 0x55b146a7d280 2024-09-14T10:46:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56decf3640 1 -- 172.21.15.96:0/1846789291 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d00aaa40 con 0x55b146a7d280 2024-09-14T10:46:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1846789291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 msgr2=0x55b146b0bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1846789291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146b0bc30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f56d000a4e0 tx=0x7f56d001b090 comp rx=0 tx=0).stop 2024-09-14T10:46:16.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1846789291 shutdown_connections 2024-09-14T10:46:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1846789291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146b0bc30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1846789291 >> 172.21.15.96:0/1846789291 conn(0x55b146b03960 msgr2=0x55b146b05d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1846789291 shutdown_connections 2024-09-14T10:46:16.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.957+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1846789291 wait complete. 2024-09-14T10:46:16.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56e21ef9c0 1 Processor -- start 2024-09-14T10:46:16.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56e21ef9c0 1 -- start start 2024-09-14T10:46:16.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56e21ef9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bf44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56e21ef9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b146a10fc0 con 0x55b146a7d280 2024-09-14T10:46:16.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56dfcf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bf44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56dfcf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bf44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51140/0 (socket says 172.21.15.96:51140) 2024-09-14T10:46:16.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56dfcf5640 1 -- 172.21.15.96:0/2116508368 learned_addr learned my addr 172.21.15.96:0/2116508368 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56dfcf5640 1 -- 172.21.15.96:0/2116508368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b146bf4ab0 con 0x55b146a7d280 2024-09-14T10:46:16.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/2116508368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bf44c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f56d0017ca0 tx=0x7f56d00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ca9e792fac7347 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f55cde0b640 1 -- 172.21.15.96:0/2116508368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d00b9030 con 0x55b146a7d280 2024-09-14T10:46:16.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f55cde0b640 1 -- 172.21.15.96:0/2116508368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d00aaa80 con 0x55b146a7d280 2024-09-14T10:46:16.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.973+0000 7f55cde0b640 1 -- 172.21.15.96:0/2116508368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d00aada0 con 0x55b146a7d280 2024-09-14T10:46:16.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/2116508368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 msgr2=0x55b146bf44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/2116508368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bf44c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f56d0017ca0 tx=0x7f56d00033b0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/2116508368 shutdown_connections 2024-09-14T10:46:16.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/2116508368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bf44c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/2116508368 >> 172.21.15.96:0/2116508368 conn(0x55b146b03960 msgr2=0x55b146bf00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/2116508368 shutdown_connections 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/2116508368 wait complete. 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 Processor -- start 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- start start 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bfbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b1469b2a50 con 0x55b146a7d280 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56dfcf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bfbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56dfcf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bfbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51148/0 (socket says 172.21.15.96:51148) 2024-09-14T10:46:16.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 learned_addr learned my addr 172.21.15.96:0/1760750433 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b146bfc170 con 0x55b146a7d280 2024-09-14T10:46:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bfbc10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f56d001b930 tx=0x7f56d0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f55c7fff640 1 -- 172.21.15.96:0/1760750433 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d00b9070 con 0x55b146a7d280 2024-09-14T10:46:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f55c7fff640 1 -- 172.21.15.96:0/1760750433 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d00c3030 con 0x55b146a7d280 2024-09-14T10:46:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f55c7fff640 1 -- 172.21.15.96:0/1760750433 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d00b5c40 con 0x55b146a7d280 2024-09-14T10:46:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b146bfc400 con 0x55b146a7d280 2024-09-14T10:46:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b146bfcd60 con 0x55b146a7d280 2024-09-14T10:46:16.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 Processor -- start 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- start start 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c08c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e21ef9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b146a1dd80 con 0x55b146c08840 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e04f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c08c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f55c7fff640 1 -- 172.21.15.96:0/1760750433 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f56d00b3040 con 0x55b146a7d280 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e04f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c08c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51156/0 (socket says 172.21.15.96:51156) 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f56e04f6640 1 -- 172.21.15.96:0/1451604563 learned_addr learned my addr 172.21.15.96:0/1451604563 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.977+0000 7f55c7fff640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55c803a150 0x7f55c803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f55c7fff640 1 -- 172.21.15.96:0/1760750433 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f56d00ba070 con 0x55b146a7d280 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55c803a150 0x7f55c803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e04f6640 1 -- 172.21.15.96:0/1451604563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b146c09230 con 0x55b146c08840 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55c803a150 0x7f55c803c610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56d00bdb50 tx=0x7f56d00a4000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e04f6640 1 --2- 172.21.15.96:0/1451604563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c08c40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f56d800a440 tx=0x7f56d800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2eb9331c46eedc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f55c5ffb640 1 -- 172.21.15.96:0/1451604563 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d8008850 con 0x55b146c08840 2024-09-14T10:46:16.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f55c5ffb640 1 -- 172.21.15.96:0/1451604563 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d8008a10 con 0x55b146c08840 2024-09-14T10:46:16.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f55c5ffb640 1 -- 172.21.15.96:0/1451604563 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d8008d30 con 0x55b146c08840 2024-09-14T10:46:16.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1451604563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 msgr2=0x55b146c08c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1451604563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c08c40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f56d800a440 tx=0x7f56d800a900 comp rx=0 tx=0).stop 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1451604563 shutdown_connections 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1451604563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c08c40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1451604563 >> 172.21.15.96:0/1451604563 conn(0x55b146b0c170 msgr2=0x55b146c04280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1451604563 shutdown_connections 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1451604563 wait complete. 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 Processor -- start 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- start start 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c0fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b146c09a20 con 0x55b146c08840 2024-09-14T10:46:16.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e04f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c0fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e04f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c0fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51172/0 (socket says 172.21.15.96:51172) 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e04f6640 1 -- 172.21.15.96:0/4180980794 learned_addr learned my addr 172.21.15.96:0/4180980794 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e04f6640 1 -- 172.21.15.96:0/4180980794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b146c101e0 con 0x55b146c08840 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e04f6640 1 --2- 172.21.15.96:0/4180980794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c0fc80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55b146c09740 tx=0x7f56d8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f55bffff640 1 -- 172.21.15.96:0/4180980794 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d8013a70 con 0x55b146c08840 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f55bffff640 1 -- 172.21.15.96:0/4180980794 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d8023070 con 0x55b146c08840 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/4180980794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b146c10470 con 0x55b146c08840 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f55bffff640 1 -- 172.21.15.96:0/4180980794 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d8013d80 con 0x55b146c08840 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.981+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/4180980794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b146c10e20 con 0x55b146c08840 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e21ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e21ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:16.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f55bffff640 1 -- 172.21.15.96:0/4180980794 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f56d8028460 con 0x55b146c08840 2024-09-14T10:46:16.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e21ef9c0 1 Processor -- start 2024-09-14T10:46:16.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f55bffff640 1 --2- 172.21.15.96:0/4180980794 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55b803a150 0x7f55b803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f55bffff640 1 -- 172.21.15.96:0/4180980794 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f56d8051010 con 0x55b146c08840 2024-09-14T10:46:16.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e21ef9c0 1 -- start start 2024-09-14T10:46:16.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e04f6640 1 --2- 172.21.15.96:0/4180980794 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55b803a150 0x7f55b803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e21ef9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c29580 0x55b146c299a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e21ef9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b146bf4e20 con 0x55b146c29580 2024-09-14T10:46:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e04f6640 1 --2- 172.21.15.96:0/4180980794 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55b803a150 0x7f55b803c610 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f56d801efd0 tx=0x7f56d801dea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56dfcf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c29580 0x55b146c299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56dfcf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c29580 0x55b146c299a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51188/0 (socket says 172.21.15.96:51188) 2024-09-14T10:46:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1973955288 learned_addr learned my addr 172.21.15.96:0/1973955288 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1973955288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b146c29fe0 con 0x55b146c29580 2024-09-14T10:46:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/1973955288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c29580 0x55b146c299a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f56d00aa650 tx=0x7f56d00ea100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f552ffff640 1 -- 172.21.15.96:0/1973955288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d00b4c20 con 0x55b146c29580 2024-09-14T10:46:16.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f552ffff640 1 -- 172.21.15.96:0/1973955288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d00b4dc0 con 0x55b146c29580 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1973955288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b146c2a780 con 0x55b146c29580 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f552ffff640 1 -- 172.21.15.96:0/1973955288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d00be540 con 0x55b146c29580 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.985+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1973955288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b146c2acf0 con 0x55b146c29580 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f552ffff640 1 -- 172.21.15.96:0/1973955288 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f56d00dd040 con 0x55b146c29580 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f552ffff640 1 --2- 172.21.15.96:0/1973955288 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f551803a150 0x7f551803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f552ffff640 1 -- 172.21.15.96:0/1973955288 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f56d00e9d20 con 0x55b146c29580 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56df4f4640 1 --2- 172.21.15.96:0/1973955288 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f551803a150 0x7f551803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f552dffb640 20 reqs_thread_entry: start 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55b146c2f020 0x55b146c314b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b146c31b30 con 0x55b146c2f020 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56df4f4640 1 --2- 172.21.15.96:0/1973955288 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f551803a150 0x7f551803c610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f56c8001e40 tx=0x7f56c80013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e04f6640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55b146c2f020 0x55b146c314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e04f6640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55b146c2f020 0x55b146c314b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b146c323e0 con 0x55b146c2f020 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b146c33790 con 0x55b146c2f020 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b146c3a4f0 con 0x55b146c2f020 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:NOTICE: set zone's realm_id= 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55b146c3e550 0x55b146c3a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55b146c3e550 0x55b146c3a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55b146c3e550 0x55b146c3a970 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56dfcf5640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f56d00f6040 0x7f56d00aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.989+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56d00f6040 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56df4f4640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f56d00f6040 0x7f56d00aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56df4f4640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f56d00f6040 0x7f56d00aca40 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c800d040 con 0x7f56d00f6040 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56df4f4640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f56c8010b60 0x7f56c800f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56c8010b60 2024-09-14T10:46:16.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f56c8010b60 0x7f56c800f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:16.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f56c8010b60 0x7f56c800f8e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x7f56c8010b60 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c2f020 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c2f020 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56c8010b60 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x7f56c8010b60 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56c8010b60 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x7f56c8010b60 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.993+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56d00f6040 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c800d040 con 0x7f56d00f6040 2024-09-14T10:46:17.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c2f020 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56c8010b60 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x7f56c8010b60 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c2f020 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(16 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56d00f6040 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56c800d040 con 0x7f56d00f6040 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:17.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56c8010b60 2024-09-14T10:46:17.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x7f56c8010b60 2024-09-14T10:46:17.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:17.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:17.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:17.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:17.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:16.997+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c2f020 2024-09-14T10:46:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c2f020 2024-09-14T10:46:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56c8010b60 2024-09-14T10:46:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x7f56c8010b60 2024-09-14T10:46:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:17.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56d00f6040 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c800d040 con 0x7f56d00f6040 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c2f020 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(28 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56d00f6040 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c800d040 con 0x7f56d00f6040 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56c8010b60 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x7f56c8010b60 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56d00f6040 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c800d040 con 0x7f56d00f6040 2024-09-14T10:46:17.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c3e550 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d00cf070 con 0x55b146c3e550 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.001+0000 7f56dfcf5640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56c8010b60 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56d804d040 con 0x7f56c8010b60 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x55b146c2f020 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39d80 con 0x7f56d00f6040 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56df4f4640 1 -- 172.21.15.96:0/1760750433 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c800d040 con 0x7f56d00f6040 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b146c3bb20 con 0x55b146c2f020 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b146c3c3a0 con 0x55b146c2f020 2024-09-14T10:46:17.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.005+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39040 con 0x55b146c2f020 2024-09-14T10:46:17.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.009+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.009+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b146c39040 con 0x55b146c2f020 2024-09-14T10:46:17.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.009+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.009+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b146c3ff20 con 0x55b146c2f020 2024-09-14T10:46:17.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.009+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f56d804d040 con 0x55b146c2f020 2024-09-14T10:46:17.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/4180980794 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55b803a150 msgr2=0x7f55b803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/4180980794 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55b803a150 0x7f55b803c610 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f56d801efd0 tx=0x7f56d801dea0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/4180980794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 msgr2=0x55b146c0fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/4180980794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c0fc80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55b146c09740 tx=0x7f56d8003000 comp rx=0 tx=0).stop 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/4180980794 shutdown_connections 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/4180980794 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55b803a150 0x7f55b803c610 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/4180980794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c08840 0x55b146c0fc80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/4180980794 >> 172.21.15.96:0/4180980794 conn(0x55b146b0c170 msgr2=0x55b146c03d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/4180980794 shutdown_connections 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/4180980794 wait complete. 2024-09-14T10:46:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1973955288 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f551803a150 msgr2=0x7f551803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1973955288 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f551803a150 0x7f551803c610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f56c8001e40 tx=0x7f56c80013c0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1973955288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c29580 msgr2=0x55b146c299a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1973955288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c29580 0x55b146c299a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f56d00aa650 tx=0x7f56d00ea100 comp rx=0 tx=0).stop 2024-09-14T10:46:17.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1973955288 shutdown_connections 2024-09-14T10:46:17.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1973955288 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f551803a150 0x7f551803c610 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1973955288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146c29580 0x55b146c299a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1973955288 >> 172.21.15.96:0/1973955288 conn(0x55b146c1eb80 msgr2=0x55b146c1ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1973955288 shutdown_connections 2024-09-14T10:46:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1973955288 wait complete. 2024-09-14T10:46:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f56c8010b60 msgr2=0x7f56c800f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f56c8010b60 0x7f56c800f8e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55b146c2f020 msgr2=0x55b146c314b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55b146c2f020 0x55b146c314b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f56d00f6040 msgr2=0x7f56d00aca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f56d00f6040 0x7f56d00aca40 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55b146c3e550 msgr2=0x55b146c3a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55b146c3e550 0x55b146c3a970 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55c803a150 msgr2=0x7f55c803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f55c803a150 0x7f55c803c610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56d00bdb50 tx=0x7f56d00a4000 comp rx=0 tx=0).stop 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 msgr2=0x55b146bfbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e04f6640 1 -- 172.21.15.96:0/1760750433 reap_dead start 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bfbc10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f56d001b930 tx=0x7f56d0017e30 comp rx=0 tx=0).stop 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 shutdown_connections 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 --2- 172.21.15.96:0/1760750433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b146a7d280 0x55b146bfbc10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 >> 172.21.15.96:0/1760750433 conn(0x55b146b03960 msgr2=0x55b146bf5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 shutdown_connections 2024-09-14T10:46:17.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.013+0000 7f56e21ef9c0 1 -- 172.21.15.96:0/1760750433 wait complete. 2024-09-14T10:46:17.024 INFO:teuthology.orchestra.run.smithi096.stdout:{"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:46:17.025 DEBUG:tasks.util.rgw: json result: {'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:46:17.025 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-14T10:46:17.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-14T10:46:17.025 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-14T10:46:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:17.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73168dd9c0 1 Processor -- start 2024-09-14T10:46:17.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73168dd9c0 1 -- start start 2024-09-14T10:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73168dd9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5636f2436e40 0x5636f2437220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73168dd9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5636f22e07a0 con 0x5636f243a020 2024-09-14T10:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73168dd9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5636f233c1b0 con 0x5636f2436e40 2024-09-14T10:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73143e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5636f2436e40 0x5636f2437220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73143e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5636f2436e40 0x5636f2437220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51194/0 (socket says 172.21.15.96:51194) 2024-09-14T10:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73143e3640 1 -- 172.21.15.96:0/3653457071 learned_addr learned my addr 172.21.15.96:0/3653457071 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73143e3640 1 -- 172.21.15.96:0/3653457071 >> v1:172.21.15.70:6789/0 conn(0x5636f243a020 legacy=0x5636f243c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73143e3640 1 -- 172.21.15.96:0/3653457071 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636f22bada0 con 0x5636f2436e40 2024-09-14T10:46:17.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.109+0000 7f73143e3640 1 --2- 172.21.15.96:0/3653457071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f2437220 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f730400a750 tx=0x7f730401d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769088adbbba4e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73133e1640 1 -- 172.21.15.96:0/3653457071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040b1070 con 0x5636f2436e40 2024-09-14T10:46:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73133e1640 1 -- 172.21.15.96:0/3653457071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73040a5e50 con 0x5636f2436e40 2024-09-14T10:46:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73133e1640 1 -- 172.21.15.96:0/3653457071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730400a350 con 0x5636f2436e40 2024-09-14T10:46:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3653457071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 msgr2=0x5636f2437220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/3653457071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f2437220 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f730400a750 tx=0x7f730401d200 comp rx=0 tx=0).stop 2024-09-14T10:46:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3653457071 shutdown_connections 2024-09-14T10:46:17.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/3653457071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f2437220 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3653457071 >> 172.21.15.96:0/3653457071 conn(0x5636f2432960 msgr2=0x5636f2434d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3653457071 shutdown_connections 2024-09-14T10:46:17.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.113+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3653457071 wait complete. 2024-09-14T10:46:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.125+0000 7f73168dd9c0 1 Processor -- start 2024-09-14T10:46:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.125+0000 7f73168dd9c0 1 -- start start 2024-09-14T10:46:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.125+0000 7f73168dd9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f25256f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.125+0000 7f73168dd9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5636f233ffc0 con 0x5636f2436e40 2024-09-14T10:46:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f25256f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f25256f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51204/0 (socket says 172.21.15.96:51204) 2024-09-14T10:46:17.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 -- 172.21.15.96:0/4133041774 learned_addr learned my addr 172.21.15.96:0/4133041774 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 -- 172.21.15.96:0/4133041774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636f2525ce0 con 0x5636f2436e40 2024-09-14T10:46:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 --2- 172.21.15.96:0/4133041774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f25256f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f73040af040 tx=0x7f7304003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1995974b71a9ba38 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f720260c640 1 -- 172.21.15.96:0/4133041774 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040ba070 con 0x5636f2436e40 2024-09-14T10:46:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f720260c640 1 -- 172.21.15.96:0/4133041774 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73040b5440 con 0x5636f2436e40 2024-09-14T10:46:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f720260c640 1 -- 172.21.15.96:0/4133041774 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040b1040 con 0x5636f2436e40 2024-09-14T10:46:17.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 -- 172.21.15.96:0/4133041774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 msgr2=0x5636f25256f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/4133041774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f25256f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f73040af040 tx=0x7f7304003030 comp rx=0 tx=0).stop 2024-09-14T10:46:17.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 -- 172.21.15.96:0/4133041774 shutdown_connections 2024-09-14T10:46:17.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/4133041774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f25256f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 -- 172.21.15.96:0/4133041774 >> 172.21.15.96:0/4133041774 conn(0x5636f2432960 msgr2=0x5636f251ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 -- 172.21.15.96:0/4133041774 shutdown_connections 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 -- 172.21.15.96:0/4133041774 wait complete. 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 Processor -- start 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 -- start start 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f252ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73168dd9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5636f22e1a50 con 0x5636f2436e40 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f252ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f252ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51214/0 (socket says 172.21.15.96:51214) 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 -- 172.21.15.96:0/2719531245 learned_addr learned my addr 172.21.15.96:0/2719531245 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.129+0000 7f73143e3640 1 -- 172.21.15.96:0/2719531245 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636f252d430 con 0x5636f2436e40 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73143e3640 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f252ced0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7304000c10 tx=0x7f7304019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7200e09640 1 -- 172.21.15.96:0/2719531245 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040b1050 con 0x5636f2436e40 2024-09-14T10:46:17.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7200e09640 1 -- 172.21.15.96:0/2719531245 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73040be430 con 0x5636f2436e40 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636f252d6c0 con 0x5636f2436e40 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7200e09640 1 -- 172.21.15.96:0/2719531245 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040ba040 con 0x5636f2436e40 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636f252e070 con 0x5636f2436e40 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 Processor -- start 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- start start 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2539f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5636f234cd80 con 0x5636f2539b70 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7314be4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2539f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7200e09640 1 -- 172.21.15.96:0/2719531245 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f73040be710 con 0x5636f2436e40 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7314be4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2539f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51230/0 (socket says 172.21.15.96:51230) 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7314be4640 1 -- 172.21.15.96:0/41253889 learned_addr learned my addr 172.21.15.96:0/41253889 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7200e09640 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71fc03a1a0 0x7f71fc03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7200e09640 1 -- 172.21.15.96:0/2719531245 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f73040eb1b0 con 0x5636f2436e40 2024-09-14T10:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73143e3640 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71fc03a1a0 0x7f71fc03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7314be4640 1 -- 172.21.15.96:0/41253889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636f253a560 con 0x5636f2539b70 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f7314be4640 1 --2- 172.21.15.96:0/41253889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2539f70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f730c00a430 tx=0x7f730c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574a797957b1a9c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73143e3640 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71fc03a1a0 0x7f71fc03c660 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f73040bdfd0 tx=0x7f73040d4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f71fa7fc640 1 -- 172.21.15.96:0/41253889 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730c00f6e0 con 0x5636f2539b70 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f71fa7fc640 1 -- 172.21.15.96:0/41253889 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730c015070 con 0x5636f2539b70 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f71fa7fc640 1 -- 172.21.15.96:0/41253889 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730c00fa10 con 0x5636f2539b70 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- 172.21.15.96:0/41253889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 msgr2=0x5636f2539f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/41253889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2539f70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f730c00a430 tx=0x7f730c00a8f0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- 172.21.15.96:0/41253889 shutdown_connections 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/41253889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2539f70 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- 172.21.15.96:0/41253889 >> 172.21.15.96:0/41253889 conn(0x5636f243a020 msgr2=0x5636f25355b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- 172.21.15.96:0/41253889 shutdown_connections 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- 172.21.15.96:0/41253889 wait complete. 2024-09-14T10:46:17.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 Processor -- start 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- start start 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2540ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.133+0000 7f73168dd9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5636f253ad50 con 0x5636f2539b70 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f7314be4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2540ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f7314be4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2540ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51246/0 (socket says 172.21.15.96:51246) 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f7314be4640 1 -- 172.21.15.96:0/1145875631 learned_addr learned my addr 172.21.15.96:0/1145875631 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f7314be4640 1 -- 172.21.15.96:0/1145875631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636f2541420 con 0x5636f2539b70 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f7314be4640 1 --2- 172.21.15.96:0/1145875631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2540ec0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f730c00adf0 tx=0x7f730c003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f71f8ff9640 1 -- 172.21.15.96:0/1145875631 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730c010a10 con 0x5636f2539b70 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f71f8ff9640 1 -- 172.21.15.96:0/1145875631 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730c020070 con 0x5636f2539b70 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f73168dd9c0 1 -- 172.21.15.96:0/1145875631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636f25416b0 con 0x5636f2539b70 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f71f8ff9640 1 -- 172.21.15.96:0/1145875631 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730c010d40 con 0x5636f2539b70 2024-09-14T10:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f73168dd9c0 1 -- 172.21.15.96:0/1145875631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636f2542060 con 0x5636f2539b70 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f73168dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f73168dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f71f8ff9640 1 -- 172.21.15.96:0/1145875631 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f730c01b420 con 0x5636f2539b70 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f73168dd9c0 1 Processor -- start 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f73168dd9c0 1 -- start start 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f71f8ff9640 1 --2- 172.21.15.96:0/1145875631 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71ec03a150 0x7f71ec03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f71f8ff9640 1 -- 172.21.15.96:0/1145875631 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f730c051620 con 0x5636f2539b70 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f7314be4640 1 --2- 172.21.15.96:0/1145875631 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71ec03a150 0x7f71ec03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f73168dd9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f255bcd0 0x5636f255c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f73168dd9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5636f25260b0 con 0x5636f255bcd0 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.137+0000 7f7314be4640 1 --2- 172.21.15.96:0/1145875631 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71ec03a150 0x7f71ec03c610 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f730c010fd0 tx=0x7f730c00df10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73143e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f255bcd0 0x5636f255c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73143e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f255bcd0 0x5636f255c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51262/0 (socket says 172.21.15.96:51262) 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73143e3640 1 -- 172.21.15.96:0/3819766733 learned_addr learned my addr 172.21.15.96:0/3819766733 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73143e3640 1 -- 172.21.15.96:0/3819766733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636f255c6e0 con 0x5636f255bcd0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73143e3640 1 --2- 172.21.15.96:0/3819766733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f255bcd0 0x5636f255c0f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f73040e9530 tx=0x7f73040c65d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f71d8fe1640 1 -- 172.21.15.96:0/3819766733 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040e9150 con 0x5636f255bcd0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f71d8fe1640 1 -- 172.21.15.96:0/3819766733 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7304006a90 con 0x5636f255bcd0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3819766733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636f255a610 con 0x5636f255bcd0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f71d8fe1640 1 -- 172.21.15.96:0/3819766733 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73040e92f0 con 0x5636f255bcd0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3819766733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636f255a610 con 0x5636f255bcd0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f71d8fe1640 1 -- 172.21.15.96:0/3819766733 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f73040bd5b0 con 0x5636f255bcd0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f71d8fe1640 1 --2- 172.21.15.96:0/3819766733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f715003a150 0x7f715003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f71d8fe1640 1 -- 172.21.15.96:0/3819766733 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f73040d9070 con 0x5636f255bcd0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f7313be2640 1 --2- 172.21.15.96:0/3819766733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f715003a150 0x7f715003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f715a7fc640 20 reqs_thread_entry: start 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5636f2560130 0x5636f25625c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f7313be2640 1 --2- 172.21.15.96:0/3819766733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f715003a150 0x7f715003c610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7308001de0 tx=0x7f7308001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5636f2562c40 con 0x5636f2560130 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f7314be4640 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5636f2560130 0x5636f25625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f7314be4640 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5636f2560130 0x5636f25625c0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f7314be4640 1 -- 172.21.15.96:0/2719531245 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c00e070 con 0x5636f2560130 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.141+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5636f25634f0 con 0x5636f2560130 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f7314be4640 1 -- 172.21.15.96:0/2719531245 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f730c00e070 con 0x5636f2560130 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5636f25648a0 con 0x5636f2560130 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f7314be4640 1 -- 172.21.15.96:0/2719531245 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f730c00e070 con 0x5636f2560130 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/1145875631 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71ec03a150 msgr2=0x7f71ec03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/1145875631 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71ec03a150 0x7f71ec03c610 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f730c010fd0 tx=0x7f730c00df10 comp rx=0 tx=0).stop 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/1145875631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 msgr2=0x5636f2540ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/1145875631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2540ec0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f730c00adf0 tx=0x7f730c003380 comp rx=0 tx=0).stop 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/1145875631 shutdown_connections 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/1145875631 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71ec03a150 0x7f71ec03c610 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/1145875631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2539b70 0x5636f2540ec0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/1145875631 >> 172.21.15.96:0/1145875631 conn(0x5636f243a020 msgr2=0x5636f2535100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/1145875631 shutdown_connections 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/1145875631 wait complete. 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3819766733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f715003a150 msgr2=0x7f715003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/3819766733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f715003a150 0x7f715003c610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7308001de0 tx=0x7f7308001360 comp rx=0 tx=0).stop 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3819766733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f255bcd0 msgr2=0x5636f255c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/3819766733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f255bcd0 0x5636f255c0f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f73040e9530 tx=0x7f73040c65d0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3819766733 shutdown_connections 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/3819766733 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f715003a150 0x7f715003c610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/3819766733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f255bcd0 0x5636f255c0f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3819766733 >> 172.21.15.96:0/3819766733 conn(0x5636f254fe60 msgr2=0x5636f2550240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3819766733 shutdown_connections 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/3819766733 wait complete. 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5636f2560130 msgr2=0x5636f25625c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5636f2560130 0x5636f25625c0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71fc03a1a0 msgr2=0x7f71fc03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71fc03a1a0 0x7f71fc03c660 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f73040bdfd0 tx=0x7f73040d4040 comp rx=0 tx=0).stop 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 msgr2=0x5636f252ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f252ced0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7304000c10 tx=0x7f7304019fa0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 shutdown_connections 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5636f2560130 0x5636f25625c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f71fc03a1a0 0x7f71fc03c660 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 --2- 172.21.15.96:0/2719531245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636f2436e40 0x5636f252ced0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 >> 172.21.15.96:0/2719531245 conn(0x5636f2432960 msgr2=0x5636f2526b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 shutdown_connections 2024-09-14T10:46:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.145+0000 7f73168dd9c0 1 -- 172.21.15.96:0/2719531245 wait complete. 2024-09-14T10:46:17.162 INFO:teuthology.orchestra.run.smithi096.stdout:{"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:46:17.163 DEBUG:tasks.util.rgw: json result: {'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:46:17.163 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-14T10:46:17.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-14T10:46:17.163 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-14T10:46:17.241 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:17.241 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99976d09c0 1 Processor -- start 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99976d09c0 1 -- start start 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99976d09c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5566bee170c0 0x5566bee194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99976d09c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566becbc7a0 con 0x5566bee12ed0 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99976d09c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5566bed181b0 con 0x5566bee170c0 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99951d6640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5566bee12ed0 0x5566bee132b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38252/0 (socket says 172.21.15.96:38252) 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99949d5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5566bee170c0 0x5566bee194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99951d6640 1 -- 172.21.15.96:0/2453820641 learned_addr learned my addr 172.21.15.96:0/2453820641 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f9987fff640 1 -- 172.21.15.96:0/2453820641 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455088891 0 0) 0x5566becbc7a0 con 0x5566bee12ed0 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f9987fff640 1 -- 172.21.15.96:0/2453820641 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9980001e20 con 0x5566bee12ed0 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99949d5640 1 -- 172.21.15.96:0/2453820641 >> v1:172.21.15.70:6789/0 conn(0x5566bee12ed0 legacy=0x5566bee132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.237+0000 7f99949d5640 1 -- 172.21.15.96:0/2453820641 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566bec96da0 con 0x5566bee170c0 2024-09-14T10:46:17.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f99949d5640 1 --2- 172.21.15.96:0/2453820641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee170c0 0x5566bee194b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f998c00a480 tx=0x7f998c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e8a9863002e595 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f9987fff640 1 -- 172.21.15.96:0/2453820641 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f998c0aa570 con 0x5566bee170c0 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f9987fff640 1 -- 172.21.15.96:0/2453820641 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998c0af070 con 0x5566bee170c0 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f9987fff640 1 -- 172.21.15.96:0/2453820641 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f998c0aa860 con 0x5566bee170c0 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f99976d09c0 1 -- 172.21.15.96:0/2453820641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee170c0 msgr2=0x5566bee194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f99976d09c0 1 --2- 172.21.15.96:0/2453820641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee170c0 0x5566bee194b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f998c00a480 tx=0x7f998c01b310 comp rx=0 tx=0).stop 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f99976d09c0 1 -- 172.21.15.96:0/2453820641 shutdown_connections 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f99976d09c0 1 --2- 172.21.15.96:0/2453820641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee170c0 0x5566bee194b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f99976d09c0 1 -- 172.21.15.96:0/2453820641 >> 172.21.15.96:0/2453820641 conn(0x5566bee0e9f0 msgr2=0x5566bee10e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f99976d09c0 1 -- 172.21.15.96:0/2453820641 shutdown_connections 2024-09-14T10:46:17.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.241+0000 7f99976d09c0 1 -- 172.21.15.96:0/2453820641 wait complete. 2024-09-14T10:46:17.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99976d09c0 1 Processor -- start 2024-09-14T10:46:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99976d09c0 1 -- start start 2024-09-14T10:46:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99976d09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566beeff320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99976d09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566bed1bfc0 con 0x5566bee12ed0 2024-09-14T10:46:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99951d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566beeff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99951d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566beeff320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51282/0 (socket says 172.21.15.96:51282) 2024-09-14T10:46:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99951d6640 1 -- 172.21.15.96:0/4176842358 learned_addr learned my addr 172.21.15.96:0/4176842358 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99951d6640 1 -- 172.21.15.96:0/4176842358 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566beeff910 con 0x5566bee12ed0 2024-09-14T10:46:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f99951d6640 1 --2- 172.21.15.96:0/4176842358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566beeff320 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f99900016a0 tx=0x7f9990001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870ce33b22033620 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f9883606640 1 -- 172.21.15.96:0/4176842358 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9990004530 con 0x5566bee12ed0 2024-09-14T10:46:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f9883606640 1 -- 172.21.15.96:0/4176842358 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99900046d0 con 0x5566bee12ed0 2024-09-14T10:46:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.257+0000 7f9883606640 1 -- 172.21.15.96:0/4176842358 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99900049f0 con 0x5566bee12ed0 2024-09-14T10:46:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- 172.21.15.96:0/4176842358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 msgr2=0x5566beeff320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 --2- 172.21.15.96:0/4176842358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566beeff320 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f99900016a0 tx=0x7f9990001b60 comp rx=0 tx=0).stop 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- 172.21.15.96:0/4176842358 shutdown_connections 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 --2- 172.21.15.96:0/4176842358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566beeff320 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- 172.21.15.96:0/4176842358 >> 172.21.15.96:0/4176842358 conn(0x5566bee0e9f0 msgr2=0x5566beefaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- 172.21.15.96:0/4176842358 shutdown_connections 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- 172.21.15.96:0/4176842358 wait complete. 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 Processor -- start 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- start start 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566bef06ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566becbda50 con 0x5566bee12ed0 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99951d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566bef06ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99951d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566bef06ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51288/0 (socket says 172.21.15.96:51288) 2024-09-14T10:46:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99951d6640 1 -- 172.21.15.96:0/400037868 learned_addr learned my addr 172.21.15.96:0/400037868 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99951d6640 1 -- 172.21.15.96:0/400037868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566bef07100 con 0x5566bee12ed0 2024-09-14T10:46:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99951d6640 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566bef06ba0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9990001ba0 tx=0x7f9990004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f9881e03640 1 -- 172.21.15.96:0/400037868 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9990013760 con 0x5566bee12ed0 2024-09-14T10:46:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f9881e03640 1 -- 172.21.15.96:0/400037868 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9990013900 con 0x5566bee12ed0 2024-09-14T10:46:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566bef07390 con 0x5566bee12ed0 2024-09-14T10:46:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f9881e03640 1 -- 172.21.15.96:0/400037868 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9990013c00 con 0x5566bee12ed0 2024-09-14T10:46:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566bef07d40 con 0x5566bee12ed0 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.261+0000 7f99976d09c0 1 Processor -- start 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- start start 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef13c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566bed28d80 con 0x5566bef13840 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f9881e03640 1 -- 172.21.15.96:0/400037868 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9990010070 con 0x5566bee12ed0 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef13c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f9881e03640 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f987c03a1a0 0x7f987c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef13c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51296/0 (socket says 172.21.15.96:51296) 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 -- 172.21.15.96:0/3402260390 learned_addr learned my addr 172.21.15.96:0/3402260390 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f9881e03640 1 -- 172.21.15.96:0/400037868 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9990018070 con 0x5566bee12ed0 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99951d6640 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f987c03a1a0 0x7f987c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 -- 172.21.15.96:0/3402260390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566bef14230 con 0x5566bef13840 2024-09-14T10:46:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99951d6640 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f987c03a1a0 0x7f987c03c660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9990000f90 tx=0x7f9990012f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 --2- 172.21.15.96:0/3402260390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef13c40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f998800a440 tx=0x7f998800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c40dbf25b70f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f987b7fe640 1 -- 172.21.15.96:0/3402260390 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9988008850 con 0x5566bef13840 2024-09-14T10:46:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f987b7fe640 1 -- 172.21.15.96:0/3402260390 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9988008a10 con 0x5566bef13840 2024-09-14T10:46:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f987b7fe640 1 -- 172.21.15.96:0/3402260390 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9988008d30 con 0x5566bef13840 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- 172.21.15.96:0/3402260390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 msgr2=0x5566bef13c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 --2- 172.21.15.96:0/3402260390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef13c40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f998800a440 tx=0x7f998800a900 comp rx=0 tx=0).stop 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- 172.21.15.96:0/3402260390 shutdown_connections 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 --2- 172.21.15.96:0/3402260390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef13c40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- 172.21.15.96:0/3402260390 >> 172.21.15.96:0/3402260390 conn(0x5566bee170c0 msgr2=0x5566bef0f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- 172.21.15.96:0/3402260390 shutdown_connections 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- 172.21.15.96:0/3402260390 wait complete. 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 Processor -- start 2024-09-14T10:46:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- start start 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef1abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99976d09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566bef14a20 con 0x5566bef13840 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef1abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef1abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51298/0 (socket says 172.21.15.96:51298) 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 -- 172.21.15.96:0/1907206320 learned_addr learned my addr 172.21.15.96:0/1907206320 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.265+0000 7f99959d7640 1 -- 172.21.15.96:0/1907206320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566bef1b110 con 0x5566bef13840 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99959d7640 1 --2- 172.21.15.96:0/1907206320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef1abb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x5566bef14740 tx=0x7f9988003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f9879ffb640 1 -- 172.21.15.96:0/1907206320 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9988013a70 con 0x5566bef13840 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f9879ffb640 1 -- 172.21.15.96:0/1907206320 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9988023070 con 0x5566bef13840 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99976d09c0 1 -- 172.21.15.96:0/1907206320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566bef1b3a0 con 0x5566bef13840 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f9879ffb640 1 -- 172.21.15.96:0/1907206320 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9988013d80 con 0x5566bef13840 2024-09-14T10:46:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99976d09c0 1 -- 172.21.15.96:0/1907206320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566bef1bd50 con 0x5566bef13840 2024-09-14T10:46:17.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99976d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:17.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99976d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:17.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f9879ffb640 1 -- 172.21.15.96:0/1907206320 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9988028460 con 0x5566bef13840 2024-09-14T10:46:17.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99976d09c0 1 Processor -- start 2024-09-14T10:46:17.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f9879ffb640 1 --2- 172.21.15.96:0/1907206320 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f986c03a150 0x7f986c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99976d09c0 1 -- start start 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f9879ffb640 1 -- 172.21.15.96:0/1907206320 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9988051010 con 0x5566bef13840 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99959d7640 1 --2- 172.21.15.96:0/1907206320 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f986c03a150 0x7f986c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99976d09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef34520 0x5566bef34940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99976d09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566beeffd40 con 0x5566bef34520 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99951d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef34520 0x5566bef34940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99959d7640 1 --2- 172.21.15.96:0/1907206320 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f986c03a150 0x7f986c03c610 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f998801afd0 tx=0x7f998800ae30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99951d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef34520 0x5566bef34940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51308/0 (socket says 172.21.15.96:51308) 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99951d6640 1 -- 172.21.15.96:0/2443787075 learned_addr learned my addr 172.21.15.96:0/2443787075 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99951d6640 1 -- 172.21.15.96:0/2443787075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566bef34f10 con 0x5566bef34520 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.269+0000 7f99951d6640 1 --2- 172.21.15.96:0/2443787075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef34520 0x5566bef34940 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f99900115a0 tx=0x7f999001d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f9859fe3640 1 -- 172.21.15.96:0/2443787075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9990045070 con 0x5566bef34520 2024-09-14T10:46:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f9859fe3640 1 -- 172.21.15.96:0/2443787075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9990012960 con 0x5566bef34520 2024-09-14T10:46:17.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99976d09c0 1 -- 172.21.15.96:0/2443787075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566bef35780 con 0x5566bef34520 2024-09-14T10:46:17.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f9859fe3640 1 -- 172.21.15.96:0/2443787075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9990039070 con 0x5566bef34520 2024-09-14T10:46:17.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99976d09c0 1 -- 172.21.15.96:0/2443787075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566bef35cf0 con 0x5566bef34520 2024-09-14T10:46:17.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f9859fe3640 1 -- 172.21.15.96:0/2443787075 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9990048070 con 0x5566bef34520 2024-09-14T10:46:17.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f9859fe3640 1 --2- 172.21.15.96:0/2443787075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97d803a0b0 0x7f97d803c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f9859fe3640 1 -- 172.21.15.96:0/2443787075 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f999004bd70 con 0x5566bef34520 2024-09-14T10:46:17.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99949d5640 1 --2- 172.21.15.96:0/2443787075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97d803a0b0 0x7f97d803c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f97d37fe640 20 reqs_thread_entry: start 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99976d09c0 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566bef39f90 0x5566bef3c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566bef3ca00 con 0x5566bef39f90 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99949d5640 1 --2- 172.21.15.96:0/2443787075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97d803a0b0 0x7f97d803c570 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f998c0ae000 tx=0x7f998c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99959d7640 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566bef39f90 0x5566bef3c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99959d7640 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566bef39f90 0x5566bef3c380 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99959d7640 1 -- 172.21.15.96:0/400037868 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f998804f050 con 0x5566bef39f90 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566bef3e2c0 con 0x5566bef39f90 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99959d7640 1 -- 172.21.15.96:0/400037868 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f998801e7a0 con 0x5566bef39f90 2024-09-14T10:46:17.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.273+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566bef43320 con 0x5566bef39f90 2024-09-14T10:46:17.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99959d7640 1 -- 172.21.15.96:0/400037868 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f998801e7a0 con 0x5566bef39f90 2024-09-14T10:46:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/1907206320 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f986c03a150 msgr2=0x7f986c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/1907206320 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f986c03a150 0x7f986c03c610 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f998801afd0 tx=0x7f998800ae30 comp rx=0 tx=0).stop 2024-09-14T10:46:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/1907206320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 msgr2=0x5566bef1abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/1907206320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef1abb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x5566bef14740 tx=0x7f9988003000 comp rx=0 tx=0).stop 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/1907206320 shutdown_connections 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/1907206320 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f986c03a150 0x7f986c03c610 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/1907206320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef13840 0x5566bef1abb0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/1907206320 >> 172.21.15.96:0/1907206320 conn(0x5566bee170c0 msgr2=0x5566bef0ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/1907206320 shutdown_connections 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/1907206320 wait complete. 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/2443787075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97d803a0b0 msgr2=0x7f97d803c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/2443787075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97d803a0b0 0x7f97d803c570 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f998c0ae000 tx=0x7f998c0a6000 comp rx=0 tx=0).stop 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/2443787075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef34520 msgr2=0x5566bef34940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/2443787075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef34520 0x5566bef34940 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f99900115a0 tx=0x7f999001d720 comp rx=0 tx=0).stop 2024-09-14T10:46:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/2443787075 shutdown_connections 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/2443787075 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97d803a0b0 0x7f97d803c570 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/2443787075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bef34520 0x5566bef34940 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/2443787075 >> 172.21.15.96:0/2443787075 conn(0x5566bef29b20 msgr2=0x5566bef29f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/2443787075 shutdown_connections 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/2443787075 wait complete. 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566bef39f90 msgr2=0x5566bef3c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566bef39f90 0x5566bef3c380 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f987c03a1a0 msgr2=0x7f987c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f987c03a1a0 0x7f987c03c660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9990000f90 tx=0x7f9990012f20 comp rx=0 tx=0).stop 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 msgr2=0x5566bef06ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566bef06ba0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9990001ba0 tx=0x7f9990004470 comp rx=0 tx=0).stop 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 shutdown_connections 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5566bef39f90 0x5566bef3c380 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f987c03a1a0 0x7f987c03c660 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 --2- 172.21.15.96:0/400037868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566bee12ed0 0x5566bef06ba0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 >> 172.21.15.96:0/400037868 conn(0x5566bee0e9f0 msgr2=0x5566beef99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 shutdown_connections 2024-09-14T10:46:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.277+0000 7f99976d09c0 1 -- 172.21.15.96:0/400037868 wait complete. 2024-09-14T10:46:17.290 INFO:teuthology.orchestra.run.smithi096.stdout:{"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:46:17.291 DEBUG:tasks.util.rgw: json result: {'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:46:17.291 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-14T10:46:17.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-14T10:46:17.291 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-14T10:46:17.369 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:17.369 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:17.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff282a89c0 1 Processor -- start 2024-09-14T10:46:17.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff282a89c0 1 -- start start 2024-09-14T10:46:17.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff282a89c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55adc76eab30 0x55adc76eaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff282a89c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55adc761c7a0 con 0x55adc76e9530 2024-09-14T10:46:17.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff282a89c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55adc76781b0 con 0x55adc76eab30 2024-09-14T10:46:17.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff25dae640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55adc76eab30 0x55adc76eaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff25dae640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55adc76eab30 0x55adc76eaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51324/0 (socket says 172.21.15.96:51324) 2024-09-14T10:46:17.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff25dae640 1 -- 172.21.15.96:0/1723643232 learned_addr learned my addr 172.21.15.96:0/1723643232 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff255ad640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55adc76e9530 0x55adc76e9940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38256/0 (socket says 172.21.15.96:38256) 2024-09-14T10:46:17.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff25dae640 1 -- 172.21.15.96:0/1723643232 >> v1:172.21.15.70:6789/0 conn(0x55adc76e9530 legacy=0x55adc76e9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.369+0000 7eff25dae640 1 -- 172.21.15.96:0/1723643232 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc75f6da0 con 0x55adc76eab30 2024-09-14T10:46:17.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff25dae640 1 --2- 172.21.15.96:0/1723643232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76eab30 0x55adc76eaf10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7eff1800a4e0 tx=0x7eff1801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dccc439659a8557 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff24dac640 1 -- 172.21.15.96:0/1723643232 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff180aa540 con 0x55adc76eab30 2024-09-14T10:46:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff24dac640 1 -- 172.21.15.96:0/1723643232 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180aa6e0 con 0x55adc76eab30 2024-09-14T10:46:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff24dac640 1 -- 172.21.15.96:0/1723643232 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff180aaa40 con 0x55adc76eab30 2024-09-14T10:46:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff282a89c0 1 -- 172.21.15.96:0/1723643232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76eab30 msgr2=0x55adc76eaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff282a89c0 1 --2- 172.21.15.96:0/1723643232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76eab30 0x55adc76eaf10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7eff1800a4e0 tx=0x7eff1801b090 comp rx=0 tx=0).stop 2024-09-14T10:46:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff282a89c0 1 -- 172.21.15.96:0/1723643232 shutdown_connections 2024-09-14T10:46:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff282a89c0 1 --2- 172.21.15.96:0/1723643232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76eab30 0x55adc76eaf10 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff282a89c0 1 -- 172.21.15.96:0/1723643232 >> 172.21.15.96:0/1723643232 conn(0x55adc776fb10 msgr2=0x55adc7771f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff282a89c0 1 -- 172.21.15.96:0/1723643232 shutdown_connections 2024-09-14T10:46:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.373+0000 7eff282a89c0 1 -- 172.21.15.96:0/1723643232 wait complete. 2024-09-14T10:46:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff282a89c0 1 Processor -- start 2024-09-14T10:46:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff282a89c0 1 -- start start 2024-09-14T10:46:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff282a89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc7861810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff282a89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55adc767bfc0 con 0x55adc76e9530 2024-09-14T10:46:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff25dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc7861810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff25dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc7861810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51334/0 (socket says 172.21.15.96:51334) 2024-09-14T10:46:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff25dae640 1 -- 172.21.15.96:0/2905523615 learned_addr learned my addr 172.21.15.96:0/2905523615 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff25dae640 1 -- 172.21.15.96:0/2905523615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc7861e00 con 0x55adc76e9530 2024-09-14T10:46:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7eff25dae640 1 --2- 172.21.15.96:0/2905523615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc7861810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7eff180ac040 tx=0x7eff18003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef514c45c78efb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7efe13e07640 1 -- 172.21.15.96:0/2905523615 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff180aaa80 con 0x55adc76e9530 2024-09-14T10:46:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7efe13e07640 1 -- 172.21.15.96:0/2905523615 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180aac20 con 0x55adc76e9530 2024-09-14T10:46:17.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.389+0000 7efe13e07640 1 -- 172.21.15.96:0/2905523615 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff180b4460 con 0x55adc76e9530 2024-09-14T10:46:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- 172.21.15.96:0/2905523615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 msgr2=0x55adc7861810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2905523615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc7861810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7eff180ac040 tx=0x7eff18003340 comp rx=0 tx=0).stop 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- 172.21.15.96:0/2905523615 shutdown_connections 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2905523615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc7861810 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- 172.21.15.96:0/2905523615 >> 172.21.15.96:0/2905523615 conn(0x55adc776fb10 msgr2=0x55adc785d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- 172.21.15.96:0/2905523615 shutdown_connections 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- 172.21.15.96:0/2905523615 wait complete. 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 Processor -- start 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- start start 2024-09-14T10:46:17.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc786d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55adc761da50 con 0x55adc76e9530 2024-09-14T10:46:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff25dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc786d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff25dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc786d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51342/0 (socket says 172.21.15.96:51342) 2024-09-14T10:46:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff25dae640 1 -- 172.21.15.96:0/2555696267 learned_addr learned my addr 172.21.15.96:0/2555696267 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff25dae640 1 -- 172.21.15.96:0/2555696267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc786d8c0 con 0x55adc76e9530 2024-09-14T10:46:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff25dae640 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc786d360 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7eff18000f90 tx=0x55adc76ea470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7efe12604640 1 -- 172.21.15.96:0/2555696267 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff180c2070 con 0x55adc76e9530 2024-09-14T10:46:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7efe12604640 1 -- 172.21.15.96:0/2555696267 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180c0070 con 0x55adc76e9530 2024-09-14T10:46:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adc786db50 con 0x55adc76e9530 2024-09-14T10:46:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7efe12604640 1 -- 172.21.15.96:0/2555696267 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff180b4a50 con 0x55adc76e9530 2024-09-14T10:46:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc786e500 con 0x55adc76e9530 2024-09-14T10:46:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 Processor -- start 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- start start 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc787a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.393+0000 7eff282a89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55adc7688d80 con 0x55adc7879fe0 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7efe12604640 1 -- 172.21.15.96:0/2555696267 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7eff180bc430 con 0x55adc76e9530 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc787a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc787a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51358/0 (socket says 172.21.15.96:51358) 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 -- 172.21.15.96:0/2082933322 learned_addr learned my addr 172.21.15.96:0/2082933322 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7efe12604640 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0c03a1a0 0x7efe0c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7efe12604640 1 -- 172.21.15.96:0/2555696267 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7eff180eb450 con 0x55adc76e9530 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff25dae640 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0c03a1a0 0x7efe0c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 -- 172.21.15.96:0/2082933322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc787a9d0 con 0x55adc7879fe0 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff25dae640 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0c03a1a0 0x7efe0c03c660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7eff180b38c0 tx=0x7eff180c8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 --2- 172.21.15.96:0/2082933322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc787a3e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff2000a440 tx=0x7eff2000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe53dbc86db8f878 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7efe0bfff640 1 -- 172.21.15.96:0/2082933322 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff20008850 con 0x55adc7879fe0 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7efe0bfff640 1 -- 172.21.15.96:0/2082933322 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff20008a10 con 0x55adc7879fe0 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7efe0bfff640 1 -- 172.21.15.96:0/2082933322 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff20008d30 con 0x55adc7879fe0 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 -- 172.21.15.96:0/2082933322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 msgr2=0x55adc787a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2082933322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc787a3e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff2000a440 tx=0x7eff2000a900 comp rx=0 tx=0).stop 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 -- 172.21.15.96:0/2082933322 shutdown_connections 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2082933322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc787a3e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 -- 172.21.15.96:0/2082933322 >> 172.21.15.96:0/2082933322 conn(0x55adc76eab30 msgr2=0x55adc7875a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 -- 172.21.15.96:0/2082933322 shutdown_connections 2024-09-14T10:46:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 -- 172.21.15.96:0/2082933322 wait complete. 2024-09-14T10:46:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 Processor -- start 2024-09-14T10:46:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 -- start start 2024-09-14T10:46:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc7881440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff282a89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55adc787b1c0 con 0x55adc7879fe0 2024-09-14T10:46:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc7881440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc7881440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51370/0 (socket says 172.21.15.96:51370) 2024-09-14T10:46:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 -- 172.21.15.96:0/1269900795 learned_addr learned my addr 172.21.15.96:0/1269900795 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.397+0000 7eff265af640 1 -- 172.21.15.96:0/1269900795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc78819a0 con 0x55adc7879fe0 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff265af640 1 --2- 172.21.15.96:0/1269900795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc7881440 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55adc787aee0 tx=0x7eff20003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7efe0a7fc640 1 -- 172.21.15.96:0/1269900795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff20013a70 con 0x55adc7879fe0 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7efe0a7fc640 1 -- 172.21.15.96:0/1269900795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff20023070 con 0x55adc7879fe0 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff282a89c0 1 -- 172.21.15.96:0/1269900795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adc7881c30 con 0x55adc7879fe0 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7efe0a7fc640 1 -- 172.21.15.96:0/1269900795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff20013d80 con 0x55adc7879fe0 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff282a89c0 1 -- 172.21.15.96:0/1269900795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc78825e0 con 0x55adc7879fe0 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7efe0a7fc640 1 -- 172.21.15.96:0/1269900795 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7eff20028460 con 0x55adc7879fe0 2024-09-14T10:46:17.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff282a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff282a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7efe0a7fc640 1 --2- 172.21.15.96:0/1269900795 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0003a150 0x7efe0003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7efe0a7fc640 1 -- 172.21.15.96:0/1269900795 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7eff200510d0 con 0x55adc7879fe0 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff265af640 1 --2- 172.21.15.96:0/1269900795 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0003a150 0x7efe0003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff282a89c0 1 Processor -- start 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff282a89c0 1 -- start start 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff282a89c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc789acf0 0x55adc789b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff282a89c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55adc78621d0 con 0x55adc789acf0 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff265af640 1 --2- 172.21.15.96:0/1269900795 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0003a150 0x7efe0003c610 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff2001df90 tx=0x7eff2001df20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff25dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc789acf0 0x55adc789b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff25dae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc789acf0 0x55adc789b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51386/0 (socket says 172.21.15.96:51386) 2024-09-14T10:46:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff25dae640 1 -- 172.21.15.96:0/3925754541 learned_addr learned my addr 172.21.15.96:0/3925754541 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff25dae640 1 -- 172.21.15.96:0/3925754541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc789b750 con 0x55adc789acf0 2024-09-14T10:46:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.401+0000 7eff25dae640 1 --2- 172.21.15.96:0/3925754541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc789acf0 0x55adc789b110 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7eff180b6010 tx=0x7eff180b3850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7efdeafe5640 1 -- 172.21.15.96:0/3925754541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff180df070 con 0x55adc789acf0 2024-09-14T10:46:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7efdeafe5640 1 -- 172.21.15.96:0/3925754541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180a98f0 con 0x55adc789acf0 2024-09-14T10:46:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff282a89c0 1 -- 172.21.15.96:0/3925754541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55adc789bf50 con 0x55adc789acf0 2024-09-14T10:46:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7efdeafe5640 1 -- 172.21.15.96:0/3925754541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff180a9bf0 con 0x55adc789acf0 2024-09-14T10:46:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff282a89c0 1 -- 172.21.15.96:0/3925754541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc789bf50 con 0x55adc789acf0 2024-09-14T10:46:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7efdeafe5640 1 -- 172.21.15.96:0/3925754541 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7eff180d8040 con 0x55adc789acf0 2024-09-14T10:46:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7efdeafe5640 1 --2- 172.21.15.96:0/3925754541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efd5c03a150 0x7efd5c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7efdeafe5640 1 -- 172.21.15.96:0/3925754541 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7eff180ec060 con 0x55adc789acf0 2024-09-14T10:46:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff255ad640 1 --2- 172.21.15.96:0/3925754541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efd5c03a150 0x7efd5c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7efde8fe1640 20 reqs_thread_entry: start 2024-09-14T10:46:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55adc78a0540 0x55adc78a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adc78a3050 con 0x55adc78a0540 2024-09-14T10:46:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff255ad640 1 --2- 172.21.15.96:0/3925754541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efd5c03a150 0x7efd5c03c610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7eff10001dc0 tx=0x7eff10001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff265af640 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55adc78a0540 0x55adc78a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff265af640 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55adc78a0540 0x55adc78a29d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff265af640 1 -- 172.21.15.96:0/2555696267 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff2003b040 con 0x55adc78a0540 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adc78a3570 con 0x55adc78a0540 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff265af640 1 -- 172.21.15.96:0/2555696267 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff2003b040 con 0x55adc78a0540 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55adc78a4e50 con 0x55adc78a0540 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.405+0000 7eff265af640 1 -- 172.21.15.96:0/2555696267 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff2003b040 con 0x55adc78a0540 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/1269900795 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0003a150 msgr2=0x7efe0003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/1269900795 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0003a150 0x7efe0003c610 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff2001df90 tx=0x7eff2001df20 comp rx=0 tx=0).stop 2024-09-14T10:46:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/1269900795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 msgr2=0x55adc7881440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/1269900795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc7881440 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55adc787aee0 tx=0x7eff20003000 comp rx=0 tx=0).stop 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/1269900795 shutdown_connections 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/1269900795 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0003a150 0x7efe0003c610 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/1269900795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc7879fe0 0x55adc7881440 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/1269900795 >> 172.21.15.96:0/1269900795 conn(0x55adc76eab30 msgr2=0x55adc7875510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/1269900795 shutdown_connections 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/1269900795 wait complete. 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/3925754541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efd5c03a150 msgr2=0x7efd5c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/3925754541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efd5c03a150 0x7efd5c03c610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7eff10001dc0 tx=0x7eff10001320 comp rx=0 tx=0).stop 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/3925754541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc789acf0 msgr2=0x55adc789b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/3925754541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc789acf0 0x55adc789b110 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7eff180b6010 tx=0x7eff180b3850 comp rx=0 tx=0).stop 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/3925754541 shutdown_connections 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/3925754541 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efd5c03a150 0x7efd5c03c610 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/3925754541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc789acf0 0x55adc789b110 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/3925754541 >> 172.21.15.96:0/3925754541 conn(0x55adc7890340 msgr2=0x55adc7890720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/3925754541 shutdown_connections 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/3925754541 wait complete. 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55adc78a0540 msgr2=0x55adc78a29d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55adc78a0540 0x55adc78a29d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0c03a1a0 msgr2=0x7efe0c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0c03a1a0 0x7efe0c03c660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7eff180b38c0 tx=0x7eff180c8040 comp rx=0 tx=0).stop 2024-09-14T10:46:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 msgr2=0x55adc786d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc786d360 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7eff18000f90 tx=0x55adc76ea470 comp rx=0 tx=0).stop 2024-09-14T10:46:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 shutdown_connections 2024-09-14T10:46:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55adc78a0540 0x55adc78a29d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7efe0c03a1a0 0x7efe0c03c660 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 --2- 172.21.15.96:0/2555696267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55adc76e9530 0x55adc786d360 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 >> 172.21.15.96:0/2555696267 conn(0x55adc776fb10 msgr2=0x55adc7862c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 shutdown_connections 2024-09-14T10:46:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.409+0000 7eff282a89c0 1 -- 172.21.15.96:0/2555696267 wait complete. 2024-09-14T10:46:17.421 INFO:teuthology.orchestra.run.smithi096.stdout:{"id":"81c91f69-c086-4f6e-b0d8-6162f65a1a15","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d","zones":[{"id":"67d5d4ca-fcee-4ea2-925b-fcc0d92e249d","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-14T10:46:17.421 DEBUG:tasks.util.rgw: json result: {'id': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d', 'zones': [{'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-14T10:46:17.425 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-14T10:46:17.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-14T10:46:17.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-14T10:46:17.473 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-14T10:46:17.519 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:17.519 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f075b1d59c0 1 Processor -- start 2024-09-14T10:46:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f075b1d59c0 1 -- start start 2024-09-14T10:46:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f075b1d59c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555af56c1fe0 0x555af56c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f075b1d59c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555af55677a0 con 0x555af56bddf0 2024-09-14T10:46:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f075b1d59c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x555af55c31b0 con 0x555af56c1fe0 2024-09-14T10:46:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f07584da640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555af56c1fe0 0x555af56c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f07584da640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555af56c1fe0 0x555af56c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51402/0 (socket says 172.21.15.96:51402) 2024-09-14T10:46:17.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f07584da640 1 -- 172.21.15.96:0/1134028948 learned_addr learned my addr 172.21.15.96:0/1134028948 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f07584da640 1 -- 172.21.15.96:0/1134028948 >> v1:172.21.15.70:6789/0 conn(0x555af56bddf0 legacy=0x555af56be1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f07584da640 1 -- 172.21.15.96:0/1134028948 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af5541da0 con 0x555af56c1fe0 2024-09-14T10:46:17.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.521+0000 7f07584da640 1 --2- 172.21.15.96:0/1134028948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56c1fe0 0x555af56c43d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f074c00a750 tx=0x7f074c01d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae35d53167aab4b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f0757cd9640 1 -- 172.21.15.96:0/1134028948 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c00a200 con 0x555af56c1fe0 2024-09-14T10:46:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f0757cd9640 1 -- 172.21.15.96:0/1134028948 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c00a3a0 con 0x555af56c1fe0 2024-09-14T10:46:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f0757cd9640 1 -- 172.21.15.96:0/1134028948 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c0086f0 con 0x555af56c1fe0 2024-09-14T10:46:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1134028948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56c1fe0 msgr2=0x555af56c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1134028948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56c1fe0 0x555af56c43d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f074c00a750 tx=0x7f074c01d290 comp rx=0 tx=0).stop 2024-09-14T10:46:17.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1134028948 shutdown_connections 2024-09-14T10:46:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1134028948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56c1fe0 0x555af56c43d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1134028948 >> 172.21.15.96:0/1134028948 conn(0x555af56b9910 msgr2=0x555af56bbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1134028948 shutdown_connections 2024-09-14T10:46:17.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.525+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1134028948 wait complete. 2024-09-14T10:46:17.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.537+0000 7f075b1d59c0 1 Processor -- start 2024-09-14T10:46:17.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.537+0000 7f075b1d59c0 1 -- start start 2024-09-14T10:46:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.537+0000 7f075b1d59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57ac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.537+0000 7f075b1d59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555af55c6fc0 con 0x555af56bddf0 2024-09-14T10:46:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.537+0000 7f0758cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57ac690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51408/0 (socket says 172.21.15.96:51408) 2024-09-14T10:46:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 -- 172.21.15.96:0/2931784658 learned_addr learned my addr 172.21.15.96:0/2931784658 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 -- 172.21.15.96:0/2931784658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af57acc80 con 0x555af56bddf0 2024-09-14T10:46:17.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 --2- 172.21.15.96:0/2931784658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57ac690 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0750001690 tx=0x7f0750001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe61160db65d611d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0646e0d640 1 -- 172.21.15.96:0/2931784658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0750016070 con 0x555af56bddf0 2024-09-14T10:46:17.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0646e0d640 1 -- 172.21.15.96:0/2931784658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075000f640 con 0x555af56bddf0 2024-09-14T10:46:17.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0646e0d640 1 -- 172.21.15.96:0/2931784658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f075000f960 con 0x555af56bddf0 2024-09-14T10:46:17.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 -- 172.21.15.96:0/2931784658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 msgr2=0x555af57ac690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/2931784658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57ac690 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0750001690 tx=0x7f0750001b50 comp rx=0 tx=0).stop 2024-09-14T10:46:17.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 -- 172.21.15.96:0/2931784658 shutdown_connections 2024-09-14T10:46:17.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/2931784658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57ac690 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 -- 172.21.15.96:0/2931784658 >> 172.21.15.96:0/2931784658 conn(0x555af56b9910 msgr2=0x555af57a3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 -- 172.21.15.96:0/2931784658 shutdown_connections 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 -- 172.21.15.96:0/2931784658 wait complete. 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 Processor -- start 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 -- start start 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f075b1d59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555af5568a50 con 0x555af56bddf0 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51420/0 (socket says 172.21.15.96:51420) 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 -- 172.21.15.96:0/149685468 learned_addr learned my addr 172.21.15.96:0/149685468 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 -- 172.21.15.96:0/149685468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af57b44f0 con 0x555af56bddf0 2024-09-14T10:46:17.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.541+0000 7f0758cdb640 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57b3f90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x555af57ad650 tx=0x7f0750001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f064560a640 1 -- 172.21.15.96:0/149685468 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0750021020 con 0x555af56bddf0 2024-09-14T10:46:17.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f064560a640 1 -- 172.21.15.96:0/149685468 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07500115f0 con 0x555af56bddf0 2024-09-14T10:46:17.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555af57b4780 con 0x555af56bddf0 2024-09-14T10:46:17.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f064560a640 1 -- 172.21.15.96:0/149685468 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0750016040 con 0x555af56bddf0 2024-09-14T10:46:17.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af57b5130 con 0x555af56bddf0 2024-09-14T10:46:17.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f064560a640 1 -- 172.21.15.96:0/149685468 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f0750024020 con 0x555af56bddf0 2024-09-14T10:46:17.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f064560a640 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f064003a150 0x7f064003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f064560a640 1 -- 172.21.15.96:0/149685468 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0750050600 con 0x555af56bddf0 2024-09-14T10:46:17.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f07584da640 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f064003a150 0x7f064003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af56c1fe0 0x555af57bb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57bb640 con 0x555af56c1fe0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f07594dc640 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af56c1fe0 0x555af57bb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f07584da640 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f064003a150 0x7f064003c610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f074c0ad000 tx=0x7f074c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f07594dc640 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af56c1fe0 0x555af57bb100 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f07594dc640 1 -- 172.21.15.96:0/149685468 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07480083f0 con 0x555af56c1fe0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57bba70 con 0x555af56c1fe0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f07594dc640 1 -- 172.21.15.96:0/149685468 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07480083f0 con 0x555af56c1fe0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57bd370 con 0x555af56c1fe0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f07594dc640 1 -- 172.21.15.96:0/149685468 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07480083f0 con 0x555af56c1fe0 2024-09-14T10:46:17.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57bc5a0 con 0x555af56c1fe0 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f07594dc640 1 -- 172.21.15.96:0/149685468 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07480083f0 con 0x555af56c1fe0 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.545+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57bc9c0 con 0x555af56c1fe0 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f07594dc640 1 -- 172.21.15.96:0/149685468 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07480083f0 con 0x555af56c1fe0 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f075b1d59c0 1 Processor -- start 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f075b1d59c0 1 -- start start 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f075b1d59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57cb760 0x555af57cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f075b1d59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555af55d3d80 con 0x555af57cb760 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f07584da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57cb760 0x555af57cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f07584da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57cb760 0x555af57cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51426/0 (socket says 172.21.15.96:51426) 2024-09-14T10:46:17.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f07584da640 1 -- 172.21.15.96:0/973207698 learned_addr learned my addr 172.21.15.96:0/973207698 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f07584da640 1 -- 172.21.15.96:0/973207698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af57cc1c0 con 0x555af57cb760 2024-09-14T10:46:17.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f07584da640 1 --2- 172.21.15.96:0/973207698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57cb760 0x555af57cbb80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f074c019ea0 tx=0x7f074c01a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f063e7fc640 1 -- 172.21.15.96:0/973207698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c0c7070 con 0x555af57cb760 2024-09-14T10:46:17.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f063e7fc640 1 -- 172.21.15.96:0/973207698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c007cf0 con 0x555af57cb760 2024-09-14T10:46:17.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f063e7fc640 1 -- 172.21.15.96:0/973207698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c0c2400 con 0x555af57cb760 2024-09-14T10:46:17.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f075b1d59c0 1 -- 172.21.15.96:0/973207698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555af57cca20 con 0x555af57cb760 2024-09-14T10:46:17.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.549+0000 7f075b1d59c0 1 -- 172.21.15.96:0/973207698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af57ccf90 con 0x555af57cb760 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f063e7fc640 1 -- 172.21.15.96:0/973207698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f074c0ac3f0 con 0x555af57cb760 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f063e7fc640 1 --2- 172.21.15.96:0/973207698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f063003a1a0 0x7f063003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f063e7fc640 1 -- 172.21.15.96:0/973207698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f074c0b2040 con 0x555af57cb760 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f07594dc640 1 --2- 172.21.15.96:0/973207698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f063003a1a0 0x7f063003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 Processor -- start 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- start start 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f07594dc640 1 --2- 172.21.15.96:0/973207698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f063003a1a0 0x7f063003c660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x555af57bc940 tx=0x7f0748003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555af57ad0b0 con 0x555af57d9050 2024-09-14T10:46:17.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f07584da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f07584da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57d9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51438/0 (socket says 172.21.15.96:51438) 2024-09-14T10:46:17.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f07584da640 1 -- 172.21.15.96:0/927605527 learned_addr learned my addr 172.21.15.96:0/927605527 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f07584da640 1 -- 172.21.15.96:0/927605527 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af57d9a40 con 0x555af57d9050 2024-09-14T10:46:17.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f07584da640 1 --2- 172.21.15.96:0/927605527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57d9450 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f074c0eb7e0 tx=0x7f074c0ca650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5b45427cd56736 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f062ffff640 1 -- 172.21.15.96:0/927605527 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c0b6580 con 0x555af57d9050 2024-09-14T10:46:17.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f062ffff640 1 -- 172.21.15.96:0/927605527 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c0ab3a0 con 0x555af57d9050 2024-09-14T10:46:17.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f062ffff640 1 -- 172.21.15.96:0/927605527 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c0acc90 con 0x555af57d9050 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- 172.21.15.96:0/927605527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 msgr2=0x555af57d9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/927605527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57d9450 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f074c0eb7e0 tx=0x7f074c0ca650 comp rx=0 tx=0).stop 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- 172.21.15.96:0/927605527 shutdown_connections 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/927605527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57d9450 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- 172.21.15.96:0/927605527 >> 172.21.15.96:0/927605527 conn(0x555af57d4470 msgr2=0x555af57d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- 172.21.15.96:0/927605527 shutdown_connections 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- 172.21.15.96:0/927605527 wait complete. 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 Processor -- start 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- start start 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.553+0000 7f075b1d59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555af57d7fa0 con 0x555af57d9050 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f07584da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f07584da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57df5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51454/0 (socket says 172.21.15.96:51454) 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 learned_addr learned my addr 172.21.15.96:0/1261685190 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af57dfb20 con 0x555af57d9050 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f07584da640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57df5c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f074c0077f0 tx=0x7f074c0eb770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f062e7fc640 1 -- 172.21.15.96:0/1261685190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c0e4070 con 0x555af57d9050 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f062e7fc640 1 -- 172.21.15.96:0/1261685190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c0ed0d0 con 0x555af57d9050 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555af57dfdb0 con 0x555af57d9050 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f062e7fc640 1 -- 172.21.15.96:0/1261685190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c006390 con 0x555af57d9050 2024-09-14T10:46:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af57e0760 con 0x555af57d9050 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f062e7fc640 1 -- 172.21.15.96:0/1261685190 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f074c006530 con 0x555af57d9050 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f062e7fc640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f062403a150 0x7f062403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f062e7fc640 1 -- 172.21.15.96:0/1261685190 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f074c0d5040 con 0x555af57d9050 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f07594dc640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f062403a150 0x7f062403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af57eab10 0x555af57ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57ed720 con 0x555af57eab10 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f0758cdb640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af57eab10 0x555af57ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f07594dc640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f062403a150 0x7f062403c610 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f074800f010 tx=0x7f074801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.557+0000 7f0758cdb640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af57eab10 0x555af57ecfd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 realm 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57edb30 con 0x555af57eab10 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57ee400 con 0x555af57eab10 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57ee7a0 con 0x555af57eab10 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57eeff0 con 0x555af57eab10 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 20 searching for the correct realm 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555af57f0d60 0x555af57f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07584da640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555af57f0d60 0x555af57f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07584da640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555af57f0d60 0x555af57f3150 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07584da640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f074c0b6070 0x7f074c0e5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f074c0b6070 2024-09-14T10:46:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07594dc640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f074c0b6070 0x7f074c0e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07594dc640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f074c0b6070 0x7f074c0e5260 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07594dc640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0748019040 0x7f0748019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f0748019040 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f0758cdb640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0748019040 0x7f0748019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.561+0000 7f0758cdb640 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0748019040 0x7f0748019930 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57eab10 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57eab10 2024-09-14T10:46:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f0748019040 2024-09-14T10:46:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f0748019040 2024-09-14T10:46:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f074c0b6070 2024-09-14T10:46:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57eab10 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f0748019040 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.565+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57eab10 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f074c0b6070 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f0748019040 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57eab10 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57eab10 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f0748019040 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.569+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f074c0b6070 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57eab10 2024-09-14T10:46:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f074c0b6070 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f0748019040 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f074c0b6070 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57f0d60 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f0748019040 2024-09-14T10:46:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x555af57eab10 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3710 con 0x7f074c0b6070 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57ef970 con 0x555af57eab10 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.573+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57f0210 con 0x555af57eab10 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3b90 con 0x555af57eab10 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 zone default found 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 4 Realm: () 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 zonegroup default 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57f3b90 con 0x7f074c0b6070 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57f5e70 con 0x555af57f0d60 2024-09-14T10:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57f62c0 con 0x555af57f0d60 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 started sync module instance, tier type = 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f5300 con 0x7f074c0b6070 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93849154181152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f5300 con 0x7f074c0b6070 2024-09-14T10:46:17.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.577+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f6d80 con 0x555af57eab10 2024-09-14T10:46:17.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.581+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93849154181152] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.581+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.581+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93849154185360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f5300 con 0x555af57eab10 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.581+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f7790 con 0x555af57f0d60 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.581+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.581+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93849154185360] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.581+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93849154188000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f7fe0 con 0x555af57f0d60 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.581+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f4e90 con 0x7f074c0b6070 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.585+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.585+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93849154192624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f8dc0 con 0x7f074c0b6070 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.585+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f9780 con 0x555af57eab10 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.585+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93849154188000] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.585+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93849154192624] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.585+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.585+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93849154196176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f8dc0 con 0x555af57eab10 2024-09-14T10:46:17.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.585+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f96f0 con 0x7f0748019040 2024-09-14T10:46:17.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.589+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93849154196176] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.589+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.589+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93849154193680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f8d30 con 0x7f0748019040 2024-09-14T10:46:17.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.589+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57fa480 con 0x7f0748019040 2024-09-14T10:46:17.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.589+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93849154193680] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.589+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.589+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93849154198240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57fa480 con 0x7f0748019040 2024-09-14T10:46:17.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.589+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57fae40 con 0x7f0748019040 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93849154198240] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93849154199296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57fae40 con 0x7f0748019040 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f075b1d59c0 20 add_watcher() i=0 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f075b1d59c0 20 add_watcher() i=1 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f075b1d59c0 20 add_watcher() i=2 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f075b1d59c0 20 add_watcher() i=3 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f075b1d59c0 20 add_watcher() i=4 2024-09-14T10:46:17.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f075b1d59c0 20 add_watcher() i=5 2024-09-14T10:46:17.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.593+0000 7f075b1d59c0 20 add_watcher() i=6 2024-09-14T10:46:17.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93849154199296] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 20 add_watcher() i=7 2024-09-14T10:46:17.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:17.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af57fe270 con 0x555af57eab10 2024-09-14T10:46:17.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93849154202464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57fb7c0 con 0x555af57eab10 2024-09-14T10:46:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93849154202464] v34'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f060efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 5 note: GC not initialized 2024-09-14T10:46:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f060dfe3640 20 reqs_thread_entry: start 2024-09-14T10:46:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 20 Filter name: none 2024-09-14T10:46:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f057f7fe640 20 reqs_thread_entry: start 2024-09-14T10:46:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.597+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af5821b00 con 0x7f0748019040 2024-09-14T10:46:17.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af5820040 con 0x555af57eab10 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-14T10:46:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af58250f0 con 0x7f0748019040 2024-09-14T10:46:17.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:17.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:17.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:17.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.601+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93849154357856 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af58257e0 con 0x555af57eab10 2024-09-14T10:46:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== watch-notify(notify (1) cookie 93849154196176 notify 146028888099 ret 0) ==== 691+0+0 (crc 0 0 0) 0x555af5820630 con 0x555af57eab10 2024-09-14T10:46:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f062ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 93849154196176 notifier 4830 bl.length()=649 2024-09-14T10:46:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f062ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f062ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify cookie 93849154357856 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f062ffff640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f061c003eb0 con 0x555af57eab10 2024-09-14T10:46:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== watch-notify(notify_complete (2) cookie 93849154357856 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0750047020 con 0x555af57eab10 2024-09-14T10:46:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af5820a60 con 0x555af57eab10 2024-09-14T10:46:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f075b1d59c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f075b1d59c0 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f075b1d59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93849154357856 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555af5825c10 con 0x555af57f0d60 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== watch-notify(notify (1) cookie 93849154188000 notify 146028888072 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555af57dfdb0 con 0x555af57f0d60 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f062f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 93849154188000 notifier 4830 bl.length()=177 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(68 notify.2 [notify cookie 93849154357856 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f062f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f062f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-14T10:46:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f062f7fe640 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f058c003410 con 0x555af57f0d60 2024-09-14T10:46:17.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== watch-notify(notify_complete (2) cookie 93849154357856 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555af57dfb20 con 0x555af57f0d60 2024-09-14T10:46:17.608 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:17.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f060efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:17.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.605+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93849154202464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af581f640 con 0x555af57eab10 2024-09-14T10:46:17.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.609+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93849154202464] v34'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.609+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93849154181152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af581f640 con 0x7f074c0b6070 2024-09-14T10:46:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.609+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93849154181152] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.609+0000 7f075b1d59c0 20 remove_watcher() i=0 2024-09-14T10:46:17.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.609+0000 7f075b1d59c0 2 removed watcher, disabling cache 2024-09-14T10:46:17.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.609+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93849154185360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af581f640 con 0x555af57eab10 2024-09-14T10:46:17.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.613+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93849154185360] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.613+0000 7f075b1d59c0 20 remove_watcher() i=1 2024-09-14T10:46:17.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.613+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93849154188000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af581f640 con 0x555af57f0d60 2024-09-14T10:46:17.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.613+0000 7f07584da640 1 -- 172.21.15.96:0/1261685190 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93849154188000] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c0dd070 con 0x555af57f0d60 2024-09-14T10:46:17.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.613+0000 7f075b1d59c0 20 remove_watcher() i=2 2024-09-14T10:46:17.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.613+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93849154192624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f6890 con 0x7f074c0b6070 2024-09-14T10:46:17.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.617+0000 7f07594dc640 1 -- 172.21.15.96:0/1261685190 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93849154192624] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074802f040 con 0x7f074c0b6070 2024-09-14T10:46:17.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.617+0000 7f075b1d59c0 20 remove_watcher() i=3 2024-09-14T10:46:17.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.617+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93849154196176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f6890 con 0x555af57eab10 2024-09-14T10:46:17.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.617+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93849154196176] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x555af57eab10 2024-09-14T10:46:17.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.617+0000 7f075b1d59c0 20 remove_watcher() i=4 2024-09-14T10:46:17.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.617+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93849154193680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f92d0 con 0x7f0748019040 2024-09-14T10:46:17.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.621+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93849154193680] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.621+0000 7f075b1d59c0 20 remove_watcher() i=5 2024-09-14T10:46:17.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.621+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93849154198240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f92d0 con 0x7f0748019040 2024-09-14T10:46:17.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.621+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93849154198240] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.621+0000 7f075b1d59c0 20 remove_watcher() i=6 2024-09-14T10:46:17.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.621+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93849154199296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555af57f9ae0 con 0x7f0748019040 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93849154199296] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f075000f070 con 0x7f0748019040 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 20 remove_watcher() i=7 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0748019040 msgr2=0x7f0748019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f0748019040 0x7f0748019930 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af57eab10 msgr2=0x555af57ecfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af57eab10 0x555af57ecfd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f074c0b6070 msgr2=0x7f074c0e5260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f074c0b6070 0x7f074c0e5260 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555af57f0d60 msgr2=0x555af57f3150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555af57f0d60 0x555af57f3150 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f062403a150 msgr2=0x7f062403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f062403a150 0x7f062403c610 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f074800f010 tx=0x7f074801b070 comp rx=0 tx=0).stop 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 msgr2=0x555af57df5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f0758cdb640 1 -- 172.21.15.96:0/1261685190 reap_dead start 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57df5c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f074c0077f0 tx=0x7f074c0eb770 comp rx=0 tx=0).stop 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 shutdown_connections 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/1261685190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57d9050 0x555af57df5c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 >> 172.21.15.96:0/1261685190 conn(0x555af57d4470 msgr2=0x555af57d2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 shutdown_connections 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/1261685190 wait complete. 2024-09-14T10:46:17.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/973207698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f063003a1a0 msgr2=0x7f063003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/973207698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f063003a1a0 0x7f063003c660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x555af57bc940 tx=0x7f0748003070 comp rx=0 tx=0).stop 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/973207698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57cb760 msgr2=0x555af57cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/973207698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57cb760 0x555af57cbb80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f074c019ea0 tx=0x7f074c01a030 comp rx=0 tx=0).stop 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/973207698 shutdown_connections 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/973207698 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f063003a1a0 0x7f063003c660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/973207698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af57cb760 0x555af57cbb80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/973207698 >> 172.21.15.96:0/973207698 conn(0x555af57c1110 msgr2=0x555af57c14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/973207698 shutdown_connections 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/973207698 wait complete. 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af56c1fe0 msgr2=0x555af57bb100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af56c1fe0 0x555af57bb100 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f064003a150 msgr2=0x7f064003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f064003a150 0x7f064003c610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f074c0ad000 tx=0x7f074c0a7000 comp rx=0 tx=0).stop 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 msgr2=0x555af57b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57b3f90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x555af57ad650 tx=0x7f0750001260 comp rx=0 tx=0).stop 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 shutdown_connections 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555af56c1fe0 0x555af57bb100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f064003a150 0x7f064003c610 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 --2- 172.21.15.96:0/149685468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af56bddf0 0x555af57b3f90 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 >> 172.21.15.96:0/149685468 conn(0x555af56b9910 msgr2=0x555af57adae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 shutdown_connections 2024-09-14T10:46:17.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.625+0000 7f075b1d59c0 1 -- 172.21.15.96:0/149685468 wait complete. 2024-09-14T10:46:17.637 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:17.638 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:17.638 ERROR:root:0 2024-09-14T10:46:17.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:17.645 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000f98b78a48110df27-0066e56979-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:46:17.646 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-14T10:46:17.660 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:17.660 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-14T10:46:17.676 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-14T10:46:17.676 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-14T10:46:17.698 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-14T10:46:17.698 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-14T10:46:17.709 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-14T10:46:17.709 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:17.714 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:17.714 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-14T10:46:17.718 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:17.719 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:46:17.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:46:17.719 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-14T10:46:17.755 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:17.755 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.753+0000 7f2986ff39c0 1 Processor -- start 2024-09-14T10:46:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.753+0000 7f2986ff39c0 1 -- start start 2024-09-14T10:46:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.753+0000 7f2986ff39c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55a11cdd23b0 0x55a11cdd47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.753+0000 7f2986ff39c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a11cc747a0 con 0x55a11cdce260 2024-09-14T10:46:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.753+0000 7f2986ff39c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55a11ccd01b0 con 0x55a11cdd23b0 2024-09-14T10:46:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f29842f8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55a11cdd23b0 0x55a11cdd47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f29842f8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55a11cdd23b0 0x55a11cdd47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51466/0 (socket says 172.21.15.96:51466) 2024-09-14T10:46:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f29842f8640 1 -- 172.21.15.96:0/3138708985 learned_addr learned my addr 172.21.15.96:0/3138708985 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f2984af9640 1 --1- 172.21.15.96:0/3138708985 >> v1:172.21.15.70:6789/0 conn(0x55a11cdce260 0x55a11cdce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38276/0 (socket says 172.21.15.96:38276) 2024-09-14T10:46:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f29842f8640 1 -- 172.21.15.96:0/3138708985 >> v1:172.21.15.70:6789/0 conn(0x55a11cdce260 legacy=0x55a11cdce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f29842f8640 1 -- 172.21.15.96:0/3138708985 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a11cc4eda0 con 0x55a11cdd23b0 2024-09-14T10:46:17.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f29842f8640 1 --2- 172.21.15.96:0/3138708985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdd23b0 0x55a11cdd47a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f296c00a5c0 tx=0x7f296c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113bf76f2af3a66a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f2983af7640 1 -- 172.21.15.96:0/3138708985 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c0a9590 con 0x55a11cdd23b0 2024-09-14T10:46:17.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f2983af7640 1 -- 172.21.15.96:0/3138708985 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f296c0ae070 con 0x55a11cdd23b0 2024-09-14T10:46:17.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.757+0000 7f2983af7640 1 -- 172.21.15.96:0/3138708985 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c0a9880 con 0x55a11cdd23b0 2024-09-14T10:46:17.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.761+0000 7f2986ff39c0 1 -- 172.21.15.96:0/3138708985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdd23b0 msgr2=0x55a11cdd47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.761+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/3138708985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdd23b0 0x55a11cdd47a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f296c00a5c0 tx=0x7f296c01b3d0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.761+0000 7f2986ff39c0 1 -- 172.21.15.96:0/3138708985 shutdown_connections 2024-09-14T10:46:17.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.761+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/3138708985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdd23b0 0x55a11cdd47a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.761+0000 7f2986ff39c0 1 -- 172.21.15.96:0/3138708985 >> 172.21.15.96:0/3138708985 conn(0x55a11cd41b70 msgr2=0x55a11cd41f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.761+0000 7f2986ff39c0 1 -- 172.21.15.96:0/3138708985 shutdown_connections 2024-09-14T10:46:17.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.761+0000 7f2986ff39c0 1 -- 172.21.15.96:0/3138708985 wait complete. 2024-09-14T10:46:17.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.773+0000 7f2986ff39c0 1 Processor -- start 2024-09-14T10:46:17.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.773+0000 7f2986ff39c0 1 -- start start 2024-09-14T10:46:17.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.773+0000 7f2986ff39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11ceb9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.773+0000 7f2986ff39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a11ccd3fc0 con 0x55a11cdce260 2024-09-14T10:46:17.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11ceb9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11ceb9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51480/0 (socket says 172.21.15.96:51480) 2024-09-14T10:46:17.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 -- 172.21.15.96:0/807797604 learned_addr learned my addr 172.21.15.96:0/807797604 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 -- 172.21.15.96:0/807797604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a11ceb9c00 con 0x55a11cdce260 2024-09-14T10:46:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 --2- 172.21.15.96:0/807797604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11ceb9610 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f297c001ec0 tx=0x7f297c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44519a5e8196477e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2872e0d640 1 -- 172.21.15.96:0/807797604 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c00e5d0 con 0x55a11cdce260 2024-09-14T10:46:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2872e0d640 1 -- 172.21.15.96:0/807797604 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c00e770 con 0x55a11cdce260 2024-09-14T10:46:17.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2872e0d640 1 -- 172.21.15.96:0/807797604 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c00ea70 con 0x55a11cdce260 2024-09-14T10:46:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 -- 172.21.15.96:0/807797604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 msgr2=0x55a11ceb9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/807797604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11ceb9610 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f297c001ec0 tx=0x7f297c00b6d0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 -- 172.21.15.96:0/807797604 shutdown_connections 2024-09-14T10:46:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/807797604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11ceb9610 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 -- 172.21.15.96:0/807797604 >> 172.21.15.96:0/807797604 conn(0x55a11cd41b70 msgr2=0x55a11ceb5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 -- 172.21.15.96:0/807797604 shutdown_connections 2024-09-14T10:46:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 -- 172.21.15.96:0/807797604 wait complete. 2024-09-14T10:46:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 Processor -- start 2024-09-14T10:46:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 -- start start 2024-09-14T10:46:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11cec0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2986ff39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a11cc75a50 con 0x55a11cdce260 2024-09-14T10:46:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11cec0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11cec0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51492/0 (socket says 172.21.15.96:51492) 2024-09-14T10:46:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 -- 172.21.15.96:0/82351627 learned_addr learned my addr 172.21.15.96:0/82351627 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.777+0000 7f2984af9640 1 -- 172.21.15.96:0/82351627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a11cec1470 con 0x55a11cdce260 2024-09-14T10:46:17.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f2984af9640 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11cec0f10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x55a11ceba5d0 tx=0x7f297c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f287160a640 1 -- 172.21.15.96:0/82351627 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c00f8e0 con 0x55a11cdce260 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a11cec1700 con 0x55a11cdce260 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f287160a640 1 -- 172.21.15.96:0/82351627 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c00fa80 con 0x55a11cdce260 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f287160a640 1 -- 172.21.15.96:0/82351627 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f297c00fda0 con 0x55a11cdce260 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a11cec20b0 con 0x55a11cdce260 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f287160a640 1 -- 172.21.15.96:0/82351627 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f297c017070 con 0x55a11cdce260 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f287160a640 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f286c03a1a0 0x7f286c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f287160a640 1 -- 172.21.15.96:0/82351627 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f297c015020 con 0x55a11cdce260 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f29842f8640 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f286c03a1a0 0x7f286c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cdd23b0 0x55a11cec8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cec85c0 con 0x55a11cdd23b0 2024-09-14T10:46:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f29852fa640 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cdd23b0 0x55a11cec8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f29842f8640 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f286c03a1a0 0x7f286c03c660 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f296c0ad000 tx=0x7f296c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f29852fa640 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cdd23b0 0x55a11cec8080 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f29852fa640 1 -- 172.21.15.96:0/82351627 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297400a4d0 con 0x55a11cdd23b0 2024-09-14T10:46:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cec24d0 con 0x55a11cdd23b0 2024-09-14T10:46:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f29852fa640 1 -- 172.21.15.96:0/82351627 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f297400a4d0 con 0x55a11cdd23b0 2024-09-14T10:46:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.781+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11ceca3a0 con 0x55a11cdd23b0 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f29852fa640 1 -- 172.21.15.96:0/82351627 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f297400a4d0 con 0x55a11cdd23b0 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cec9600 con 0x55a11cdd23b0 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f29852fa640 1 -- 172.21.15.96:0/82351627 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f297400a4d0 con 0x55a11cdd23b0 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cec9a50 con 0x55a11cdd23b0 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f29852fa640 1 -- 172.21.15.96:0/82351627 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f297400a4d0 con 0x55a11cdd23b0 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f2986ff39c0 1 Processor -- start 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f2986ff39c0 1 -- start start 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f2986ff39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11ced86e0 0x55a11ced8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f2986ff39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a11cce0d80 con 0x55a11ced86e0 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f29842f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11ced86e0 0x55a11ced8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f29842f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11ced86e0 0x55a11ced8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51498/0 (socket says 172.21.15.96:51498) 2024-09-14T10:46:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f29842f8640 1 -- 172.21.15.96:0/255525353 learned_addr learned my addr 172.21.15.96:0/255525353 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f29842f8640 1 -- 172.21.15.96:0/255525353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a11ced9140 con 0x55a11ced86e0 2024-09-14T10:46:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f29842f8640 1 --2- 172.21.15.96:0/255525353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11ced86e0 0x55a11ced8b00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f296c017fe0 tx=0x7f296c018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f286a7fc640 1 -- 172.21.15.96:0/255525353 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c0b3ba0 con 0x55a11ced86e0 2024-09-14T10:46:17.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f286a7fc640 1 -- 172.21.15.96:0/255525353 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f296c0b3d40 con 0x55a11ced86e0 2024-09-14T10:46:17.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f2986ff39c0 1 -- 172.21.15.96:0/255525353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a11ced99a0 con 0x55a11ced86e0 2024-09-14T10:46:17.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f286a7fc640 1 -- 172.21.15.96:0/255525353 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c0c8580 con 0x55a11ced86e0 2024-09-14T10:46:17.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.785+0000 7f2986ff39c0 1 -- 172.21.15.96:0/255525353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a11ced9eb0 con 0x55a11ced86e0 2024-09-14T10:46:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f286a7fc640 1 -- 172.21.15.96:0/255525353 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f296c0d1440 con 0x55a11ced86e0 2024-09-14T10:46:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f286a7fc640 1 --2- 172.21.15.96:0/255525353 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285c03a1a0 0x7f285c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f286a7fc640 1 -- 172.21.15.96:0/255525353 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f296c0ee700 con 0x55a11ced86e0 2024-09-14T10:46:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f29852fa640 1 --2- 172.21.15.96:0/255525353 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285c03a1a0 0x7f285c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 Processor -- start 2024-09-14T10:46:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 -- start start 2024-09-14T10:46:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f29852fa640 1 --2- 172.21.15.96:0/255525353 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285c03a1a0 0x7f285c03c660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55a11cec9120 tx=0x7f2974005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cee5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a11ceba030 con 0x55a11cee4f20 2024-09-14T10:46:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f29842f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cee5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f29842f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cee5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51510/0 (socket says 172.21.15.96:51510) 2024-09-14T10:46:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f29842f8640 1 -- 172.21.15.96:0/1990629894 learned_addr learned my addr 172.21.15.96:0/1990629894 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f29842f8640 1 -- 172.21.15.96:0/1990629894 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a11cee58d0 con 0x55a11cee4f20 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f29842f8640 1 --2- 172.21.15.96:0/1990629894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cee5300 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f296c0ec990 tx=0x7f296c0c7a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aac320fb36f373 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f285bfff640 1 -- 172.21.15.96:0/1990629894 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c0bce00 con 0x55a11cee4f20 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f285bfff640 1 -- 172.21.15.96:0/1990629894 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f296c0be410 con 0x55a11cee4f20 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f285bfff640 1 -- 172.21.15.96:0/1990629894 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c0bc3b0 con 0x55a11cee4f20 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 -- 172.21.15.96:0/1990629894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 msgr2=0x55a11cee5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/1990629894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cee5300 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f296c0ec990 tx=0x7f296c0c7a10 comp rx=0 tx=0).stop 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 -- 172.21.15.96:0/1990629894 shutdown_connections 2024-09-14T10:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/1990629894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cee5300 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 -- 172.21.15.96:0/1990629894 >> 172.21.15.96:0/1990629894 conn(0x55a11cee1350 msgr2=0x55a11cedf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 -- 172.21.15.96:0/1990629894 shutdown_connections 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.789+0000 7f2986ff39c0 1 -- 172.21.15.96:0/1990629894 wait complete. 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f2986ff39c0 1 Processor -- start 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f2986ff39c0 1 -- start start 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f2986ff39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cd431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f2986ff39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a11cee5f30 con 0x55a11cee4f20 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f29842f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cd431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f29842f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cd431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51520/0 (socket says 172.21.15.96:51520) 2024-09-14T10:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 learned_addr learned my addr 172.21.15.96:0/343852673 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a11cd43720 con 0x55a11cee4f20 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f29842f8640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cd431c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f296c0c7b40 tx=0x7f296c0ec920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f285a7fc640 1 -- 172.21.15.96:0/343852673 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c0eb020 con 0x55a11cee4f20 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f285a7fc640 1 -- 172.21.15.96:0/343852673 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f296c0e2040 con 0x55a11cee4f20 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a11cd439b0 con 0x55a11cee4f20 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f285a7fc640 1 -- 172.21.15.96:0/343852673 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f296c0a8b90 con 0x55a11cee4f20 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a11cd44360 con 0x55a11cee4f20 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f285a7fc640 1 -- 172.21.15.96:0/343852673 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f296c0da070 con 0x55a11cee4f20 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f285a7fc640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285003a1a0 0x7f285003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f285a7fc640 1 -- 172.21.15.96:0/343852673 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f296c0f8d10 con 0x55a11cee4f20 2024-09-14T10:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f29852fa640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285003a1a0 0x7f285003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.793+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cefbe50 0x55a11cefe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cefea30 con 0x55a11cefbe50 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2984af9640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cefbe50 0x55a11cefe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29852fa640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285003a1a0 0x7f285003c660 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55a11cec2420 tx=0x7f297401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2984af9640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cefbe50 0x55a11cefe2e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 realm 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cefee40 con 0x55a11cefbe50 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11ceff710 con 0x55a11cefbe50 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11ceffab0 con 0x55a11cefbe50 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf00300 con 0x55a11cefbe50 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 20 searching for the correct realm 2024-09-14T10:46:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a11cf02070 0x55a11cf04460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29842f8640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a11cf02070 0x55a11cf04460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29842f8640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a11cf02070 0x55a11cf04460 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29842f8640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f296c0dc030 0x7f296c0ee070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f296c0dc030 2024-09-14T10:46:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29852fa640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f296c0dc030 0x7f296c0ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29852fa640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f296c0dc030 0x7f296c0ee070 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401f070 con 0x7f296c0dc030 2024-09-14T10:46:17.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29852fa640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2974031040 0x7f2974032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.797+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f2974031040 2024-09-14T10:46:17.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2974031040 0x7f2974032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2974031040 0x7f2974032430 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cefbe50 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cefbe50 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f2974031040 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f2974031040 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f296c0dc030 2024-09-14T10:46:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401f070 con 0x7f296c0dc030 2024-09-14T10:46:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.801+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cefbe50 2024-09-14T10:46:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f2974031040 2024-09-14T10:46:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cefbe50 2024-09-14T10:46:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f296c0dc030 2024-09-14T10:46:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f297401f070 con 0x7f296c0dc030 2024-09-14T10:46:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f2974031040 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cefbe50 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cefbe50 2024-09-14T10:46:17.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.805+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f2974031040 2024-09-14T10:46:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f296c0dc030 2024-09-14T10:46:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401f070 con 0x7f296c0dc030 2024-09-14T10:46:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cefbe50 2024-09-14T10:46:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f296c0dc030 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401f070 con 0x7f296c0dc030 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f2974031040 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f296c0dc030 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297401f070 con 0x7f296c0dc030 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cf02070 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.809+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f2974031040 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x55a11cefbe50 2024-09-14T10:46:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf049f0 con 0x7f296c0dc030 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2974040040 con 0x7f296c0dc030 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf00c80 con 0x55a11cefbe50 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf01520 con 0x55a11cefbe50 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf01520 con 0x55a11cefbe50 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 zone default found 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 4 Realm: () 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 zonegroup default 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf04e50 con 0x7f296c0dc030 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2974040040 con 0x7f296c0dc030 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf06d70 con 0x55a11cf02070 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf072b0 con 0x55a11cf02070 2024-09-14T10:46:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 started sync module instance, tier type = 2024-09-14T10:46:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.813+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf06080 con 0x7f296c0dc030 2024-09-14T10:46:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.817+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2974040040 con 0x7f296c0dc030 2024-09-14T10:46:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.817+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94150463612320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf06080 con 0x7f296c0dc030 2024-09-14T10:46:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.817+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf07d70 con 0x55a11cefbe50 2024-09-14T10:46:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.817+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94150463612320] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2974040040 con 0x7f296c0dc030 2024-09-14T10:46:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.817+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.817+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94150463617152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf06080 con 0x55a11cefbe50 2024-09-14T10:46:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.817+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf08780 con 0x55a11cf02070 2024-09-14T10:46:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94150463619792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf08fd0 con 0x55a11cf02070 2024-09-14T10:46:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf099d0 con 0x7f296c0dc030 2024-09-14T10:46:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94150463617152] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2974040040 con 0x7f296c0dc030 2024-09-14T10:46:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94150463609808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf09dc0 con 0x7f296c0dc030 2024-09-14T10:46:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0a780 con 0x55a11cefbe50 2024-09-14T10:46:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94150463619792] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94150463609808] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2974040040 con 0x7f296c0dc030 2024-09-14T10:46:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94150463624416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0a2d0 con 0x55a11cefbe50 2024-09-14T10:46:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.821+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0b020 con 0x7f2974031040 2024-09-14T10:46:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.825+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94150463624416] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.825+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.825+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94150463621920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0acf0 con 0x7f2974031040 2024-09-14T10:46:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.825+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0b540 con 0x7f2974031040 2024-09-14T10:46:17.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.825+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94150463621920] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.825+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94150463629648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0b360 con 0x7f2974031040 2024-09-14T10:46:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0be50 con 0x7f2974031040 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94150463629648] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94150463633696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0be10 con 0x7f2974031040 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 20 add_watcher() i=0 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 20 add_watcher() i=1 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 20 add_watcher() i=2 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 20 add_watcher() i=3 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 20 add_watcher() i=4 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 20 add_watcher() i=5 2024-09-14T10:46:17.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 20 add_watcher() i=6 2024-09-14T10:46:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94150463633696] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 20 add_watcher() i=7 2024-09-14T10:46:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.829+0000 7f2986ff39c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0f2a0 con 0x55a11cefbe50 2024-09-14T10:46:17.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94150463630768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf0c7c0 con 0x55a11cefbe50 2024-09-14T10:46:17.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94150463630768] v34'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f283afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 5 note: GC not initialized 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2839fe3640 20 reqs_thread_entry: start 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 20 Filter name: none 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f27ab7fe640 20 reqs_thread_entry: start 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf32ad0 con 0x7f2974031040 2024-09-14T10:46:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-14T10:46:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:17.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.833+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf397f0 con 0x7f2974031040 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2986ff39c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2986ff39c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2986ff39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94150463820384 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf34f00 con 0x55a11cefbe50 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94150463624416 notify 146028888101 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55a11cec20b0 con 0x55a11cefbe50 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f285bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94150463624416 notifier 4837 bl.length()=636 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f285bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f285bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 94150463820384 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f285bfff640 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2848003eb0 con 0x55a11cefbe50 2024-09-14T10:46:17.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94150463820384 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a11cec1700 con 0x55a11cefbe50 2024-09-14T10:46:17.840 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:17.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f283afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:17.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.837+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94150463630768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf306a0 con 0x55a11cefbe50 2024-09-14T10:46:17.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.841+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94150463630768] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.841+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94150463612320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf306a0 con 0x7f296c0dc030 2024-09-14T10:46:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.841+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94150463612320] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2974040040 con 0x7f296c0dc030 2024-09-14T10:46:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.841+0000 7f2986ff39c0 20 remove_watcher() i=0 2024-09-14T10:46:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.841+0000 7f2986ff39c0 2 removed watcher, disabling cache 2024-09-14T10:46:17.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.841+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94150463617152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf306a0 con 0x55a11cefbe50 2024-09-14T10:46:17.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.845+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94150463617152] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.845+0000 7f2986ff39c0 20 remove_watcher() i=1 2024-09-14T10:46:17.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.845+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94150463619792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf306a0 con 0x55a11cf02070 2024-09-14T10:46:17.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.845+0000 7f29842f8640 1 -- 172.21.15.96:0/343852673 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94150463619792] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f296c0ce020 con 0x55a11cf02070 2024-09-14T10:46:17.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.845+0000 7f2986ff39c0 20 remove_watcher() i=2 2024-09-14T10:46:17.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.845+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94150463609808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf07880 con 0x7f296c0dc030 2024-09-14T10:46:17.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.849+0000 7f29852fa640 1 -- 172.21.15.96:0/343852673 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94150463609808] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2974040040 con 0x7f296c0dc030 2024-09-14T10:46:17.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.849+0000 7f2986ff39c0 20 remove_watcher() i=3 2024-09-14T10:46:17.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.849+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94150463624416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf082d0 con 0x55a11cefbe50 2024-09-14T10:46:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.849+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94150463624416] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x55a11cefbe50 2024-09-14T10:46:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.849+0000 7f2986ff39c0 20 remove_watcher() i=4 2024-09-14T10:46:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.849+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94150463621920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf05bd0 con 0x7f2974031040 2024-09-14T10:46:17.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.853+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94150463621920] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.853+0000 7f2986ff39c0 20 remove_watcher() i=5 2024-09-14T10:46:17.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.853+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94150463629648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf07880 con 0x7f2974031040 2024-09-14T10:46:17.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.853+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94150463629648] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.853+0000 7f2986ff39c0 20 remove_watcher() i=6 2024-09-14T10:46:17.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.853+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94150463633696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a11cf094e0 con 0x7f2974031040 2024-09-14T10:46:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94150463633696] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f297c02e070 con 0x7f2974031040 2024-09-14T10:46:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 20 remove_watcher() i=7 2024-09-14T10:46:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2974031040 msgr2=0x7f2974032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f2974031040 0x7f2974032430 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cefbe50 msgr2=0x55a11cefe2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cefbe50 0x55a11cefe2e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f296c0dc030 msgr2=0x7f296c0ee070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f296c0dc030 0x7f296c0ee070 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a11cf02070 msgr2=0x55a11cf04460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55a11cf02070 0x55a11cf04460 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285003a1a0 msgr2=0x7f285003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285003a1a0 0x7f285003c660 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55a11cec2420 tx=0x7f297401f000 comp rx=0 tx=0).stop 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 msgr2=0x55a11cd431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2984af9640 1 -- 172.21.15.96:0/343852673 reap_dead start 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cd431c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f296c0c7b40 tx=0x7f296c0ec920 comp rx=0 tx=0).stop 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 shutdown_connections 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/343852673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cee4f20 0x55a11cd431c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 >> 172.21.15.96:0/343852673 conn(0x55a11cee1350 msgr2=0x55a11cedf560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 shutdown_connections 2024-09-14T10:46:17.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/343852673 wait complete. 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/255525353 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285c03a1a0 msgr2=0x7f285c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/255525353 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285c03a1a0 0x7f285c03c660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55a11cec9120 tx=0x7f2974005850 comp rx=0 tx=0).stop 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/255525353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11ced86e0 msgr2=0x55a11ced8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/255525353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11ced86e0 0x55a11ced8b00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f296c017fe0 tx=0x7f296c018170 comp rx=0 tx=0).stop 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/255525353 shutdown_connections 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/255525353 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f285c03a1a0 0x7f285c03c660 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/255525353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11ced86e0 0x55a11ced8b00 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/255525353 >> 172.21.15.96:0/255525353 conn(0x55a11cece090 msgr2=0x55a11cece470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/255525353 shutdown_connections 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/255525353 wait complete. 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cdd23b0 msgr2=0x55a11cec8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cdd23b0 0x55a11cec8080 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f286c03a1a0 msgr2=0x7f286c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f286c03a1a0 0x7f286c03c660 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f296c0ad000 tx=0x7f296c0a6000 comp rx=0 tx=0).stop 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 msgr2=0x55a11cec0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11cec0f10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x55a11ceba5d0 tx=0x7f297c000bd0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 shutdown_connections 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55a11cdd23b0 0x55a11cec8080 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f286c03a1a0 0x7f286c03c660 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 --2- 172.21.15.96:0/82351627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a11cdce260 0x55a11cec0f10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 >> 172.21.15.96:0/82351627 conn(0x55a11cd41b70 msgr2=0x55a11cebaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 shutdown_connections 2024-09-14T10:46:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.857+0000 7f2986ff39c0 1 -- 172.21.15.96:0/82351627 wait complete. 2024-09-14T10:46:17.869 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:17.869 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:17.869 ERROR:root:0 2024-09-14T10:46:17.869 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-14T10:46:17.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-14T10:46:17.869 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-14T10:46:17.955 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:17.955 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f8371adf9c0 1 Processor -- start 2024-09-14T10:46:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f8371adf9c0 1 -- start start 2024-09-14T10:46:17.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f8371adf9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55980254e5d0 0x5598025e2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f8371adf9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598024827a0 con 0x55980254e1f0 2024-09-14T10:46:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f8371adf9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5598024de1b0 con 0x55980254e5d0 2024-09-14T10:46:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f836ede4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55980254e5d0 0x5598025e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f836ede4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55980254e5d0 0x5598025e2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51534/0 (socket says 172.21.15.96:51534) 2024-09-14T10:46:17.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f836f5e5640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55980254e1f0 0x5598025df020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38286/0 (socket says 172.21.15.96:38286) 2024-09-14T10:46:17.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f836ede4640 1 -- 172.21.15.96:0/1202213842 learned_addr learned my addr 172.21.15.96:0/1202213842 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f836ede4640 1 -- 172.21.15.96:0/1202213842 >> v1:172.21.15.70:6789/0 conn(0x55980254e1f0 legacy=0x5598025df020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f836ede4640 1 -- 172.21.15.96:0/1202213842 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55980245cda0 con 0x55980254e5d0 2024-09-14T10:46:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.957+0000 7f836ede4640 1 --2- 172.21.15.96:0/1202213842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e5d0 0x5598025e2750 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f836400a5c0 tx=0x7f836401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7a2199e68250fc server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f836e5e3640 1 -- 172.21.15.96:0/1202213842 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640a6070 con 0x55980254e5d0 2024-09-14T10:46:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f836e5e3640 1 -- 172.21.15.96:0/1202213842 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83640af070 con 0x55980254e5d0 2024-09-14T10:46:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f836e5e3640 1 -- 172.21.15.96:0/1202213842 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640aa5c0 con 0x55980254e5d0 2024-09-14T10:46:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f8371adf9c0 1 -- 172.21.15.96:0/1202213842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e5d0 msgr2=0x5598025e2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/1202213842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e5d0 0x5598025e2750 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f836400a5c0 tx=0x7f836401b340 comp rx=0 tx=0).stop 2024-09-14T10:46:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f8371adf9c0 1 -- 172.21.15.96:0/1202213842 shutdown_connections 2024-09-14T10:46:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/1202213842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e5d0 0x5598025e2750 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f8371adf9c0 1 -- 172.21.15.96:0/1202213842 >> 172.21.15.96:0/1202213842 conn(0x5598025d4910 msgr2=0x5598025d6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f8371adf9c0 1 -- 172.21.15.96:0/1202213842 shutdown_connections 2024-09-14T10:46:17.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.961+0000 7f8371adf9c0 1 -- 172.21.15.96:0/1202213842 wait complete. 2024-09-14T10:46:17.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 Processor -- start 2024-09-14T10:46:17.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- start start 2024-09-14T10:46:17.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598024e1fc0 con 0x55980254e1f0 2024-09-14T10:46:17.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f836f5e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f836f5e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51548/0 (socket says 172.21.15.96:51548) 2024-09-14T10:46:17.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f836f5e5640 1 -- 172.21.15.96:0/4028004051 learned_addr learned my addr 172.21.15.96:0/4028004051 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f836f5e5640 1 -- 172.21.15.96:0/4028004051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598026c7bc0 con 0x55980254e1f0 2024-09-14T10:46:17.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f836f5e5640 1 --2- 172.21.15.96:0/4028004051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026c75d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8368001ec0 tx=0x7f836800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb0cd58c4314c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f825d60a640 1 -- 172.21.15.96:0/4028004051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836800e5d0 con 0x55980254e1f0 2024-09-14T10:46:17.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f825d60a640 1 -- 172.21.15.96:0/4028004051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836800e770 con 0x55980254e1f0 2024-09-14T10:46:17.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f825d60a640 1 -- 172.21.15.96:0/4028004051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836800ea70 con 0x55980254e1f0 2024-09-14T10:46:17.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- 172.21.15.96:0/4028004051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 msgr2=0x5598026c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/4028004051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026c75d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8368001ec0 tx=0x7f836800b6d0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- 172.21.15.96:0/4028004051 shutdown_connections 2024-09-14T10:46:17.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/4028004051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026c75d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- 172.21.15.96:0/4028004051 >> 172.21.15.96:0/4028004051 conn(0x5598025d4910 msgr2=0x5598026c31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- 172.21.15.96:0/4028004051 shutdown_connections 2024-09-14T10:46:17.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- 172.21.15.96:0/4028004051 wait complete. 2024-09-14T10:46:17.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 Processor -- start 2024-09-14T10:46:17.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- start start 2024-09-14T10:46:17.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f8371adf9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559802483a50 con 0x55980254e1f0 2024-09-14T10:46:17.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f836f5e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f836f5e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51550/0 (socket says 172.21.15.96:51550) 2024-09-14T10:46:17.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.977+0000 7f836f5e5640 1 -- 172.21.15.96:0/3107613949 learned_addr learned my addr 172.21.15.96:0/3107613949 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f836f5e5640 1 -- 172.21.15.96:0/3107613949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598026cf430 con 0x55980254e1f0 2024-09-14T10:46:17.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f836f5e5640 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026ceed0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5598026c8590 tx=0x7f8368000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f825be07640 1 -- 172.21.15.96:0/3107613949 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836800f8e0 con 0x55980254e1f0 2024-09-14T10:46:17.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f825be07640 1 -- 172.21.15.96:0/3107613949 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836800fa80 con 0x55980254e1f0 2024-09-14T10:46:17.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f825be07640 1 -- 172.21.15.96:0/3107613949 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f836800fda0 con 0x55980254e1f0 2024-09-14T10:46:17.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598026cf6c0 con 0x55980254e1f0 2024-09-14T10:46:17.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598026d0070 con 0x55980254e1f0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f825be07640 1 -- 172.21.15.96:0/3107613949 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f8368017070 con 0x55980254e1f0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f825be07640 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f825403a150 0x7f825403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f825be07640 1 -- 172.21.15.96:0/3107613949 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8368015020 con 0x55980254e1f0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f836ede4640 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f825403a150 0x7f825403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55980254e5d0 0x5598026d6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598026d6580 con 0x55980254e5d0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f836fde6640 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55980254e5d0 0x5598026d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f836ede4640 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f825403a150 0x7f825403c610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f83640ae000 tx=0x7f83640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f836fde6640 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55980254e5d0 0x5598026d6040 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f836fde6640 1 -- 172.21.15.96:0/3107613949 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836000a4d0 con 0x55980254e5d0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.981+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598026d69d0 con 0x55980254e5d0 2024-09-14T10:46:17.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836fde6640 1 -- 172.21.15.96:0/3107613949 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f836000a4d0 con 0x55980254e5d0 2024-09-14T10:46:17.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598026d82d0 con 0x55980254e5d0 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836fde6640 1 -- 172.21.15.96:0/3107613949 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f836000a4d0 con 0x55980254e5d0 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598026d7500 con 0x55980254e5d0 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836fde6640 1 -- 172.21.15.96:0/3107613949 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f836000a4d0 con 0x55980254e5d0 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598026d7950 con 0x55980254e5d0 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836fde6640 1 -- 172.21.15.96:0/3107613949 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f836000a4d0 con 0x55980254e5d0 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 Processor -- start 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 -- start start 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026e6690 0x5598026e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598024eed80 con 0x5598026e6690 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836ede4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026e6690 0x5598026e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836ede4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026e6690 0x5598026e6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51560/0 (socket says 172.21.15.96:51560) 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836ede4640 1 -- 172.21.15.96:0/267706806 learned_addr learned my addr 172.21.15.96:0/267706806 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836ede4640 1 -- 172.21.15.96:0/267706806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598026e70f0 con 0x5598026e6690 2024-09-14T10:46:17.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f836ede4640 1 --2- 172.21.15.96:0/267706806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026e6690 0x5598026e6ab0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8364000c10 tx=0x7f83640180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8259602640 1 -- 172.21.15.96:0/267706806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640b3b90 con 0x5598026e6690 2024-09-14T10:46:17.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8259602640 1 -- 172.21.15.96:0/267706806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83640b3d30 con 0x5598026e6690 2024-09-14T10:46:17.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8259602640 1 -- 172.21.15.96:0/267706806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640c8560 con 0x5598026e6690 2024-09-14T10:46:17.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 -- 172.21.15.96:0/267706806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598026e7950 con 0x5598026e6690 2024-09-14T10:46:17.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.985+0000 7f8371adf9c0 1 -- 172.21.15.96:0/267706806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598026e7e60 con 0x5598026e6690 2024-09-14T10:46:17.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8259602640 1 -- 172.21.15.96:0/267706806 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f83640d1440 con 0x5598026e6690 2024-09-14T10:46:17.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8259602640 1 --2- 172.21.15.96:0/267706806 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f824803a190 0x7f824803c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8259602640 1 -- 172.21.15.96:0/267706806 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f83640ee4b0 con 0x5598026e6690 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f836fde6640 1 --2- 172.21.15.96:0/267706806 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f824803a190 0x7f824803c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 Processor -- start 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 -- start start 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f836fde6640 1 --2- 172.21.15.96:0/267706806 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f824803a190 0x7f824803c650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5598026d7020 tx=0x7f8360005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026f4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598026c7ff0 con 0x5598026f3f40 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f836ede4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f836ede4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026f4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51566/0 (socket says 172.21.15.96:51566) 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f836ede4640 1 -- 172.21.15.96:0/144640377 learned_addr learned my addr 172.21.15.96:0/144640377 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f836ede4640 1 -- 172.21.15.96:0/144640377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598026f4910 con 0x5598026f3f40 2024-09-14T10:46:17.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f836ede4640 1 --2- 172.21.15.96:0/144640377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026f4320 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f83640bdb30 tx=0x7f83640bd8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59171f4495e8a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8252ffd640 1 -- 172.21.15.96:0/144640377 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640be410 con 0x5598026f3f40 2024-09-14T10:46:17.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8252ffd640 1 -- 172.21.15.96:0/144640377 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83640bcca0 con 0x5598026f3f40 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8252ffd640 1 -- 172.21.15.96:0/144640377 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640be5b0 con 0x5598026f3f40 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 -- 172.21.15.96:0/144640377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 msgr2=0x5598026f4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/144640377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026f4320 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f83640bdb30 tx=0x7f83640bd8a0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 -- 172.21.15.96:0/144640377 shutdown_connections 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/144640377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026f4320 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 -- 172.21.15.96:0/144640377 >> 172.21.15.96:0/144640377 conn(0x5598026ef300 msgr2=0x5598026ed540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 -- 172.21.15.96:0/144640377 shutdown_connections 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.989+0000 7f8371adf9c0 1 -- 172.21.15.96:0/144640377 wait complete. 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 1 Processor -- start 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 1 -- start start 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026fa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598026f2e30 con 0x5598026f3f40 2024-09-14T10:46:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f836ede4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026fa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f836ede4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026fa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51568/0 (socket says 172.21.15.96:51568) 2024-09-14T10:46:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 learned_addr learned my addr 172.21.15.96:0/283176098 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598026fa980 con 0x5598026f3f40 2024-09-14T10:46:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f836ede4640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026fa420 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f836400a5c0 tx=0x7f83640ec6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f82517fa640 1 -- 172.21.15.96:0/283176098 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640bdc40 con 0x5598026f3f40 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f82517fa640 1 -- 172.21.15.96:0/283176098 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83640e1070 con 0x5598026f3f40 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598026fac10 con 0x5598026f3f40 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f82517fa640 1 -- 172.21.15.96:0/283176098 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83640c7c30 con 0x5598026f3f40 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598026fb5c0 con 0x5598026f3f40 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f82517fa640 1 -- 172.21.15.96:0/283176098 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f83640d1910 con 0x5598026f3f40 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f82517fa640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f823803a150 0x7f823803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f82517fa640 1 -- 172.21.15.96:0/283176098 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f83640eb050 con 0x5598026f3f40 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f836fde6640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f823803a150 0x7f823803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559802705990 0x559802707e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559802708570 con 0x559802705990 2024-09-14T10:46:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.993+0000 7f836f5e5640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559802705990 0x559802707e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836fde6640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f823803a150 0x7f823803c610 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5598026d1050 tx=0x7f836001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836f5e5640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559802705990 0x559802707e20 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 realm 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559802708980 con 0x559802705990 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559802709250 con 0x559802705990 2024-09-14T10:46:18.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598027095f0 con 0x559802705990 2024-09-14T10:46:18.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559802709e40 con 0x559802705990 2024-09-14T10:46:18.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:18.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 20 searching for the correct realm 2024-09-14T10:46:18.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55980270bbb0 0x55980270dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836ede4640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55980270bbb0 0x55980270dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836ede4640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55980270bbb0 0x55980270dfa0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836ede4640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f83640dd040 0x7f83640e5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f83640dd040 2024-09-14T10:46:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836fde6640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f83640dd040 0x7f83640e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836fde6640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f83640dd040 0x7f83640e5760 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836001f070 con 0x7f83640dd040 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836fde6640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8360031040 0x7f8360032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f8360031040 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:17.997+0000 7f836f5e5640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8360031040 0x7f8360032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8360031040 0x7f8360032940 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x559802705990 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x559802705990 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f8360031040 2024-09-14T10:46:18.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f8360031040 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f83640dd040 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836001f070 con 0x7f83640dd040 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x559802705990 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f8360031040 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.001+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x559802705990 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f83640dd040 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f836001f070 con 0x7f83640dd040 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f8360031040 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x559802705990 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x559802705990 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f8360031040 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.005+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f83640dd040 2024-09-14T10:46:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836001f070 con 0x7f83640dd040 2024-09-14T10:46:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x559802705990 2024-09-14T10:46:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f83640dd040 2024-09-14T10:46:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836001f070 con 0x7f83640dd040 2024-09-14T10:46:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f8360031040 2024-09-14T10:46:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f83640dd040 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836001f070 con 0x7f83640dd040 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x55980270bbb0 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f8360031040 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x559802705990 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55980270e530 con 0x7f83640dd040 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55980270a7f0 con 0x559802705990 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.009+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55980270abe0 con 0x559802705990 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55980270abe0 con 0x559802705990 2024-09-14T10:46:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 zone default found 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 4 Realm: () 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 zonegroup default 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55980270b000 con 0x7f83640dd040 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598027104d0 con 0x55980270bbb0 2024-09-14T10:46:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598027109e0 con 0x55980270bbb0 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 started sync module instance, tier type = 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55980270f820 con 0x7f83640dd040 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94111364349216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55980270f820 con 0x7f83640dd040 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.013+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802711460 con 0x559802705990 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.017+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94111364349216] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.017+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.017+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94111364354240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55980270f820 con 0x559802705990 2024-09-14T10:46:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.017+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802711e70 con 0x55980270bbb0 2024-09-14T10:46:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.017+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.017+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94111364356544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598027126c0 con 0x55980270bbb0 2024-09-14T10:46:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.017+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598027130e0 con 0x7f83640dd040 2024-09-14T10:46:18.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.017+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94111364354240] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.021+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.021+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94111364361168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598027134d0 con 0x7f83640dd040 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.021+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802713e90 con 0x559802705990 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.021+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94111364356544] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.021+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94111364361168] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.021+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.021+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94111364346736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598027139e0 con 0x559802705990 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.021+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802714270 con 0x7f8360031040 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.025+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94111364346736] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.025+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.025+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94111364358672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802713e90 con 0x7f8360031040 2024-09-14T10:46:18.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.025+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802714c80 con 0x7f8360031040 2024-09-14T10:46:18.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.025+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94111364358672] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.025+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.025+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94111364365040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802714c80 con 0x7f8360031040 2024-09-14T10:46:18.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.025+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802715640 con 0x7f8360031040 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94111364365040] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94111364368608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802715640 con 0x7f8360031040 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 20 add_watcher() i=0 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 20 add_watcher() i=1 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 20 add_watcher() i=2 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 20 add_watcher() i=3 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 20 add_watcher() i=4 2024-09-14T10:46:18.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 20 add_watcher() i=5 2024-09-14T10:46:18.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 20 add_watcher() i=6 2024-09-14T10:46:18.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94111364368608] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 20 add_watcher() i=7 2024-09-14T10:46:18.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:18.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559802718960 con 0x559802705990 2024-09-14T10:46:18.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.029+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94111364371200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802715bd0 con 0x559802705990 2024-09-14T10:46:18.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94111364371200] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8225fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:18.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:18.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 5 note: GC not initialized 2024-09-14T10:46:18.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8224fe1640 20 reqs_thread_entry: start 2024-09-14T10:46:18.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:18.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 20 Filter name: none 2024-09-14T10:46:18.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f819e7fc640 20 reqs_thread_entry: start 2024-09-14T10:46:18.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-14T10:46:18.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55980273c210 con 0x7f8360031040 2024-09-14T10:46:18.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-14T10:46:18.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-14T10:46:18.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-14T10:46:18.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55980273a750 con 0x55980270bbb0 2024-09-14T10:46:18.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-14T10:46:18.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-14T10:46:18.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-14T10:46:18.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-14T10:46:18.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.033+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55980273f800 con 0x7f8360031040 2024-09-14T10:46:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-14T10:46:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-14T10:46:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-14T10:46:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94111364540400 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559802740170 con 0x7f83640dd040 2024-09-14T10:46:18.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== watch-notify(notify (1) cookie 94111364349216 notify 146028888089 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f8360024680 con 0x7f83640dd040 2024-09-14T10:46:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8252ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94111364349216 notifier 4844 bl.length()=533 2024-09-14T10:46:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(65 notify.0 [notify cookie 94111364540400 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8252ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-14T10:46:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8252ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-14T10:46:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8252ffd640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8234003eb0 con 0x7f83640dd040 2024-09-14T10:46:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== watch-notify(notify_complete (2) cookie 94111364540400 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8360024920 con 0x7f83640dd040 2024-09-14T10:46:18.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55980273dc90 con 0x55980270bbb0 2024-09-14T10:46:18.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-14T10:46:18.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94111364536288 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598027401b0 con 0x559802705990 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94111364354240 notify 146028888102 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55980273ad90 con 0x559802705990 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(68 notify.1 [notify cookie 94111364536288 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8252ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94111364354240 notifier 4844 bl.length()=176 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8252ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8252ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f8252ffd640 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8234003eb0 con 0x559802705990 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.037+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94111364536288 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598026d0070 con 0x559802705990 2024-09-14T10:46:18.041 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-14T10:46:18.039151Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:18.039138Z","tags":[],"group_ids":[]} 2024-09-14T10:46:18.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.041+0000 7f8225fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.041+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94111364371200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x559802705990 2024-09-14T10:46:18.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.041+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94111364371200] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.041+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94111364349216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x7f83640dd040 2024-09-14T10:46:18.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.041+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94111364349216] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.041+0000 7f8371adf9c0 20 remove_watcher() i=0 2024-09-14T10:46:18.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.041+0000 7f8371adf9c0 2 removed watcher, disabling cache 2024-09-14T10:46:18.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.041+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94111364354240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x559802705990 2024-09-14T10:46:18.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.045+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94111364354240] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.045+0000 7f8371adf9c0 20 remove_watcher() i=1 2024-09-14T10:46:18.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.045+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94111364356544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x55980270bbb0 2024-09-14T10:46:18.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.045+0000 7f836ede4640 1 -- 172.21.15.96:0/283176098 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94111364356544] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83640f4020 con 0x55980270bbb0 2024-09-14T10:46:18.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.045+0000 7f8371adf9c0 20 remove_watcher() i=2 2024-09-14T10:46:18.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.045+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94111364361168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x7f83640dd040 2024-09-14T10:46:18.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.049+0000 7f836fde6640 1 -- 172.21.15.96:0/283176098 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94111364361168] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8360040040 con 0x7f83640dd040 2024-09-14T10:46:18.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.049+0000 7f8371adf9c0 20 remove_watcher() i=3 2024-09-14T10:46:18.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.049+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94111364346736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x559802705990 2024-09-14T10:46:18.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.049+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94111364346736] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x559802705990 2024-09-14T10:46:18.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.049+0000 7f8371adf9c0 20 remove_watcher() i=4 2024-09-14T10:46:18.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.049+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94111364358672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x7f8360031040 2024-09-14T10:46:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.053+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94111364358672] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.053+0000 7f8371adf9c0 20 remove_watcher() i=5 2024-09-14T10:46:18.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.053+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94111364365040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x7f8360031040 2024-09-14T10:46:18.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.053+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94111364365040] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.053+0000 7f8371adf9c0 20 remove_watcher() i=6 2024-09-14T10:46:18.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.053+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94111364368608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559802739de0 con 0x7f8360031040 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94111364368608] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f836802e070 con 0x7f8360031040 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 20 remove_watcher() i=7 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8360031040 msgr2=0x7f8360032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f8360031040 0x7f8360032940 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559802705990 msgr2=0x559802707e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x559802705990 0x559802707e20 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f83640dd040 msgr2=0x7f83640e5760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f83640dd040 0x7f83640e5760 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55980270bbb0 msgr2=0x55980270dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55980270bbb0 0x55980270dfa0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f823803a150 msgr2=0x7f823803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f823803a150 0x7f823803c610 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5598026d1050 tx=0x7f836001f000 comp rx=0 tx=0).stop 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 msgr2=0x5598026fa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026fa420 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f836400a5c0 tx=0x7f83640ec6d0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f836f5e5640 1 -- 172.21.15.96:0/283176098 reap_dead start 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 shutdown_connections 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/283176098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026f3f40 0x5598026fa420 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 >> 172.21.15.96:0/283176098 conn(0x5598026ef300 msgr2=0x5598026ed510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 shutdown_connections 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/283176098 wait complete. 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/267706806 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f824803a190 msgr2=0x7f824803c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/267706806 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f824803a190 0x7f824803c650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5598026d7020 tx=0x7f8360005850 comp rx=0 tx=0).stop 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/267706806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026e6690 msgr2=0x5598026e6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/267706806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026e6690 0x5598026e6ab0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8364000c10 tx=0x7f83640180e0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/267706806 shutdown_connections 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/267706806 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f824803a190 0x7f824803c650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/267706806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598026e6690 0x5598026e6ab0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/267706806 >> 172.21.15.96:0/267706806 conn(0x5598026dc040 msgr2=0x5598026dc420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/267706806 shutdown_connections 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/267706806 wait complete. 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55980254e5d0 msgr2=0x5598026d6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55980254e5d0 0x5598026d6040 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f825403a150 msgr2=0x7f825403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f825403a150 0x7f825403c610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f83640ae000 tx=0x7f83640a6000 comp rx=0 tx=0).stop 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 msgr2=0x5598026ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026ceed0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5598026c8590 tx=0x7f8368000bd0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 shutdown_connections 2024-09-14T10:46:18.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55980254e5d0 0x5598026d6040 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f825403a150 0x7f825403c610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 --2- 172.21.15.96:0/3107613949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55980254e1f0 0x5598026ceed0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 >> 172.21.15.96:0/3107613949 conn(0x5598025d4910 msgr2=0x5598026c8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 shutdown_connections 2024-09-14T10:46:18.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.057+0000 7f8371adf9c0 1 -- 172.21.15.96:0/3107613949 wait complete. 2024-09-14T10:46:18.069 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-14T10:46:18.039151Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:18.039138Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:18.069 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-14T10:46:18.039151Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:18.039138Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:18.070 ERROR:root:0 2024-09-14T10:46:18.070 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:18.075 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:18.075 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-14T10:46:18.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-14T10:46:18.075 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-14T10:46:18.144 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:18.145 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:18.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2663ff59c0 1 Processor -- start 2024-09-14T10:46:18.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2663ff59c0 1 -- start start 2024-09-14T10:46:18.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2663ff59c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fa24bcbe50 0x55fa24c5f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2663ff59c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa24aff7a0 con 0x55fa24bcba70 2024-09-14T10:46:18.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2663ff59c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55fa24b5b1b0 con 0x55fa24bcbe50 2024-09-14T10:46:18.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f26612fa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55fa24bcbe50 0x55fa24c5f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2661afb640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55fa24bcba70 0x55fa24c5c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38296/0 (socket says 172.21.15.96:38296) 2024-09-14T10:46:18.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2661afb640 1 -- 172.21.15.96:0/432312724 learned_addr learned my addr 172.21.15.96:0/432312724 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:46:18.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2660af9640 1 -- 172.21.15.96:0/432312724 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062730964 0 0) 0x55fa24aff7a0 con 0x55fa24bcba70 2024-09-14T10:46:18.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f2660af9640 1 -- 172.21.15.96:0/432312724 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f264c001e20 con 0x55fa24bcba70 2024-09-14T10:46:18.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f26612fa640 1 -- 172.21.15.96:0/432312724 >> v1:172.21.15.70:6789/0 conn(0x55fa24bcba70 legacy=0x55fa24c5c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.145+0000 7f26612fa640 1 -- 172.21.15.96:0/432312724 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa24ad9da0 con 0x55fa24bcbe50 2024-09-14T10:46:18.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f26612fa640 1 --2- 172.21.15.96:0/432312724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcbe50 0x55fa24c5f800 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f265800a480 tx=0x7f265801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd05b7053075c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2660af9640 1 -- 172.21.15.96:0/432312724 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26580b0070 con 0x55fa24bcbe50 2024-09-14T10:46:18.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2660af9640 1 -- 172.21.15.96:0/432312724 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26580ab540 con 0x55fa24bcbe50 2024-09-14T10:46:18.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2660af9640 1 -- 172.21.15.96:0/432312724 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26580ab820 con 0x55fa24bcbe50 2024-09-14T10:46:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2663ff59c0 1 -- 172.21.15.96:0/432312724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcbe50 msgr2=0x55fa24c5f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/432312724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcbe50 0x55fa24c5f800 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f265800a480 tx=0x7f265801b280 comp rx=0 tx=0).stop 2024-09-14T10:46:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2663ff59c0 1 -- 172.21.15.96:0/432312724 shutdown_connections 2024-09-14T10:46:18.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/432312724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcbe50 0x55fa24c5f800 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2663ff59c0 1 -- 172.21.15.96:0/432312724 >> 172.21.15.96:0/432312724 conn(0x55fa24c519c0 msgr2=0x55fa24c53de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2663ff59c0 1 -- 172.21.15.96:0/432312724 shutdown_connections 2024-09-14T10:46:18.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.149+0000 7f2663ff59c0 1 -- 172.21.15.96:0/432312724 wait complete. 2024-09-14T10:46:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2663ff59c0 1 Processor -- start 2024-09-14T10:46:18.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2663ff59c0 1 -- start start 2024-09-14T10:46:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2663ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d443e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2663ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa24b5efc0 con 0x55fa24bcba70 2024-09-14T10:46:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2661afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2661afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d443e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51590/0 (socket says 172.21.15.96:51590) 2024-09-14T10:46:18.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2661afb640 1 -- 172.21.15.96:0/3278336602 learned_addr learned my addr 172.21.15.96:0/3278336602 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2661afb640 1 -- 172.21.15.96:0/3278336602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa24d449d0 con 0x55fa24bcba70 2024-09-14T10:46:18.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f2661afb640 1 --2- 172.21.15.96:0/3278336602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d443e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2654001e40 tx=0x7f265400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1eb8d27778fc2c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f254fe07640 1 -- 172.21.15.96:0/3278336602 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2654012020 con 0x55fa24bcba70 2024-09-14T10:46:18.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f254fe07640 1 -- 172.21.15.96:0/3278336602 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265400e690 con 0x55fa24bcba70 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.165+0000 7f254fe07640 1 -- 172.21.15.96:0/3278336602 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f265400e9b0 con 0x55fa24bcba70 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3278336602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 msgr2=0x55fa24d443e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3278336602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d443e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2654001e40 tx=0x7f265400b790 comp rx=0 tx=0).stop 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3278336602 shutdown_connections 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3278336602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d443e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3278336602 >> 172.21.15.96:0/3278336602 conn(0x55fa24c519c0 msgr2=0x55fa24d40020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3278336602 shutdown_connections 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3278336602 wait complete. 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 Processor -- start 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- start start 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d4bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa24b00a50 con 0x55fa24bcba70 2024-09-14T10:46:18.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2661afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d4bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2661afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d4bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51596/0 (socket says 172.21.15.96:51596) 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2661afb640 1 -- 172.21.15.96:0/3064600359 learned_addr learned my addr 172.21.15.96:0/3064600359 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2661afb640 1 -- 172.21.15.96:0/3064600359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa24d4c1b0 con 0x55fa24bcba70 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2661afb640 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d4bc50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55fa24d45370 tx=0x7f26540040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f254e604640 1 -- 172.21.15.96:0/3064600359 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2654012030 con 0x55fa24bcba70 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa24d4c440 con 0x55fa24bcba70 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f254e604640 1 -- 172.21.15.96:0/3064600359 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265401a720 con 0x55fa24bcba70 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f254e604640 1 -- 172.21.15.96:0/3064600359 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f265401a8d0 con 0x55fa24bcba70 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.169+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa24d4cdf0 con 0x55fa24bcba70 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f254e604640 1 -- 172.21.15.96:0/3064600359 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2654015020 con 0x55fa24bcba70 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f254e604640 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f254803a150 0x7f254803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f254e604640 1 -- 172.21.15.96:0/3064600359 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2654020070 con 0x55fa24bcba70 2024-09-14T10:46:18.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24bcbe50 0x55fa24d52dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d53300 con 0x55fa24bcbe50 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26612fa640 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f254803a150 0x7f254803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26622fc640 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24bcbe50 0x55fa24d52dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26622fc640 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24bcbe50 0x55fa24d52dc0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26612fa640 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f254803a150 0x7f254803c610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f26580ad000 tx=0x7f26580a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26622fc640 1 -- 172.21.15.96:0/3064600359 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f265c00a4d0 con 0x55fa24bcbe50 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d536c0 con 0x55fa24bcbe50 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26622fc640 1 -- 172.21.15.96:0/3064600359 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f265c00a4d0 con 0x55fa24bcbe50 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d54fc0 con 0x55fa24bcbe50 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26622fc640 1 -- 172.21.15.96:0/3064600359 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f265c00a4d0 con 0x55fa24bcbe50 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d541c0 con 0x55fa24bcbe50 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26622fc640 1 -- 172.21.15.96:0/3064600359 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f265c00a4d0 con 0x55fa24bcbe50 2024-09-14T10:46:18.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d54610 con 0x55fa24bcbe50 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f26622fc640 1 -- 172.21.15.96:0/3064600359 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f265c00a4d0 con 0x55fa24bcbe50 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 Processor -- start 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 -- start start 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d633c0 0x55fa24d637e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.173+0000 7f2663ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa24b6bd80 con 0x55fa24d633c0 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26612fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d633c0 0x55fa24d637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26612fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d633c0 0x55fa24d637e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51602/0 (socket says 172.21.15.96:51602) 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26612fa640 1 -- 172.21.15.96:0/2849989260 learned_addr learned my addr 172.21.15.96:0/2849989260 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26612fa640 1 -- 172.21.15.96:0/2849989260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa24d63e20 con 0x55fa24d633c0 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26612fa640 1 --2- 172.21.15.96:0/2849989260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d633c0 0x55fa24d637e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2658000c10 tx=0x7f2658018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f25477fe640 1 -- 172.21.15.96:0/2849989260 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26580c7070 con 0x55fa24d633c0 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f25477fe640 1 -- 172.21.15.96:0/2849989260 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26580b7b20 con 0x55fa24d633c0 2024-09-14T10:46:18.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2849989260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa24d64680 con 0x55fa24d633c0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f25477fe640 1 -- 172.21.15.96:0/2849989260 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26580b0040 con 0x55fa24d633c0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2849989260 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa24d64b90 con 0x55fa24d633c0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f25477fe640 1 -- 172.21.15.96:0/2849989260 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f26580ca070 con 0x55fa24d633c0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f25477fe640 1 --2- 172.21.15.96:0/2849989260 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f253c03a150 0x7f253c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f25477fe640 1 -- 172.21.15.96:0/2849989260 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f26580a8070 con 0x55fa24d633c0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26622fc640 1 --2- 172.21.15.96:0/2849989260 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f253c03a150 0x7f253c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f2663ff59c0 1 Processor -- start 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f2663ff59c0 1 -- start start 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26622fc640 1 --2- 172.21.15.96:0/2849989260 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f253c03a150 0x7f253c03c610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55fa24d53ce0 tx=0x7f265c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f2663ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d70ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f2663ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa24d44e00 con 0x55fa24d70bf0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26612fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d70ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26612fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d70ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51606/0 (socket says 172.21.15.96:51606) 2024-09-14T10:46:18.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.177+0000 7f26612fa640 1 -- 172.21.15.96:0/1595635720 learned_addr learned my addr 172.21.15.96:0/1595635720 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f26612fa640 1 -- 172.21.15.96:0/1595635720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa24d715e0 con 0x55fa24d70bf0 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f26612fa640 1 --2- 172.21.15.96:0/1595635720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d70ff0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f26580cc030 tx=0x7f26580cb780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c215c0543bb7ebda server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f25457fa640 1 -- 172.21.15.96:0/1595635720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26580de070 con 0x55fa24d70bf0 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f25457fa640 1 -- 172.21.15.96:0/1595635720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2658009420 con 0x55fa24d70bf0 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f25457fa640 1 -- 172.21.15.96:0/1595635720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26580ed070 con 0x55fa24d70bf0 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- 172.21.15.96:0/1595635720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 msgr2=0x55fa24d70ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/1595635720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d70ff0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f26580cc030 tx=0x7f26580cb780 comp rx=0 tx=0).stop 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- 172.21.15.96:0/1595635720 shutdown_connections 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/1595635720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d70ff0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- 172.21.15.96:0/1595635720 >> 172.21.15.96:0/1595635720 conn(0x55fa24d6c010 msgr2=0x55fa24d6a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- 172.21.15.96:0/1595635720 shutdown_connections 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- 172.21.15.96:0/1595635720 wait complete. 2024-09-14T10:46:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 Processor -- start 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- start start 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d77180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa24d6fb40 con 0x55fa24d70bf0 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f26612fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d77180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f26612fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d77180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51610/0 (socket says 172.21.15.96:51610) 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 learned_addr learned my addr 172.21.15.96:0/2157888813 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa24d776e0 con 0x55fa24d70bf0 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f26612fa640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d77180 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f26580b7810 tx=0x7f26580eb700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f25337fe640 1 -- 172.21.15.96:0/2157888813 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26580de030 con 0x55fa24d70bf0 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f25337fe640 1 -- 172.21.15.96:0/2157888813 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26580aa780 con 0x55fa24d70bf0 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa24d77970 con 0x55fa24d70bf0 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f25337fe640 1 -- 172.21.15.96:0/2157888813 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26580eb2c0 con 0x55fa24d70bf0 2024-09-14T10:46:18.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.181+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa24d78320 con 0x55fa24d70bf0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f25337fe640 1 -- 172.21.15.96:0/2157888813 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f26580cb830 con 0x55fa24d70bf0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f25337fe640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f252c03a150 0x7f252c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f25337fe640 1 -- 172.21.15.96:0/2157888813 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f26580ea020 con 0x55fa24d70bf0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f26622fc640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f252c03a150 0x7f252c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24d826f0 0x55fa24d84b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d852d0 con 0x55fa24d826f0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2661afb640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24d826f0 0x55fa24d84b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f26622fc640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f252c03a150 0x7f252c03c610 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55fa24d4dd50 tx=0x7f265c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2661afb640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24d826f0 0x55fa24d84b80 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 realm 2024-09-14T10:46:18.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d856e0 con 0x55fa24d826f0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d85fb0 con 0x55fa24d826f0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d86350 con 0x55fa24d826f0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d86ba0 con 0x55fa24d826f0 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 20 searching for the correct realm 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fa24d88910 0x55fa24d8ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.185+0000 7f26612fa640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fa24d88910 0x55fa24d8ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26612fa640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fa24d88910 0x55fa24d8ad00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26612fa640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f26580cc060 0x7f26580a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f26580cc060 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26622fc640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f26580cc060 0x7f26580a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26622fc640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f26580cc060 0x7f26580a4a80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c01f070 con 0x7f26580cc060 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26622fc640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f265c031040 0x7f265c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f265c031040 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f265c031040 0x7f265c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f265c031040 0x7f265c032430 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d826f0 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d826f0 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f265c031040 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.189+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f265c031040 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f26580cc060 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c01f070 con 0x7f26580cc060 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d826f0 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f265c031040 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d826f0 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f26580cc060 2024-09-14T10:46:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f265c01f070 con 0x7f26580cc060 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f265c031040 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.193+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d826f0 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d826f0 2024-09-14T10:46:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f265c031040 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f26580cc060 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c01f070 con 0x7f26580cc060 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d826f0 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f26580cc060 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c01f070 con 0x7f26580cc060 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f265c031040 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.197+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f26580cc060 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c01f070 con 0x7f26580cc060 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d88910 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f265c031040 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x55fa24d826f0 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b2c0 con 0x7f26580cc060 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d87520 con 0x55fa24d826f0 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d87dc0 con 0x55fa24d826f0 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d87dc0 con 0x55fa24d826f0 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 zone default found 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 4 Realm: () 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 zonegroup default 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8b740 con 0x7f26580cc060 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8d5d0 con 0x55fa24d88910 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8dab0 con 0x55fa24d88910 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 started sync module instance, tier type = 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.201+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8c970 con 0x7f26580cc060 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.205+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.205+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94532848373392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8c970 con 0x7f26580cc060 2024-09-14T10:46:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.205+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8e570 con 0x55fa24d826f0 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.205+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94532848373392] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.205+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.205+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94532848377984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8c970 con 0x55fa24d826f0 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.205+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8efb0 con 0x55fa24d88910 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.209+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94532848377984] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.209+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.209+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94532848370880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8c8e0 con 0x55fa24d88910 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.209+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d8fcb0 con 0x7f26580cc060 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.209+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.209+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94532848384304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d90550 con 0x7f26580cc060 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.209+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d90f70 con 0x55fa24d826f0 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.209+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94532848370880] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.213+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94532848384304] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.213+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.213+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94532848388704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d900a0 con 0x55fa24d826f0 2024-09-14T10:46:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.213+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d91810 con 0x7f265c031040 2024-09-14T10:46:18.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.213+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94532848388704] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.213+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.213+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94532848382800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d91530 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.213+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d91d80 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94532848382800] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94532848390544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d91b80 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d926a0 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94532848390544] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94532848394608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d92660 con 0x7f265c031040 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 20 add_watcher() i=0 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 20 add_watcher() i=1 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 20 add_watcher() i=2 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 20 add_watcher() i=3 2024-09-14T10:46:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 20 add_watcher() i=4 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 20 add_watcher() i=5 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.217+0000 7f2663ff59c0 20 add_watcher() i=6 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94532848394608] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2663ff59c0 20 add_watcher() i=7 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2663ff59c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d95ac0 con 0x55fa24d826f0 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94532848391664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d92fe0 con 0x55fa24d826f0 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94532848391664] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f25137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2663ff59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2663ff59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.221+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9e5c0 con 0x55fa24d826f0 2024-09-14T10:46:18.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.225+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.225+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9ebd0 con 0x7f265c031040 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.225+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.225+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9eaf0 con 0x55fa24d88910 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.225+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.225+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9f3a0 con 0x55fa24d826f0 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.229+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.229+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9dc80 con 0x7f26580cc060 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.229+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'78 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.229+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9dc80 con 0x55fa24d88910 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.229+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.229+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9fa00 con 0x55fa24d826f0 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.233+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.233+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9fa00 con 0x7f265c031040 2024-09-14T10:46:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.233+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'53 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.233+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9fa00 con 0x7f26580cc060 2024-09-14T10:46:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.237+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.237+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9fff0 con 0x55fa24d88910 2024-09-14T10:46:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.237+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.237+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9ff70 con 0x7f26580cc060 2024-09-14T10:46:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.237+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.237+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0580 con 0x7f265c031040 2024-09-14T10:46:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.241+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.241+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da04e0 con 0x7f26580cc060 2024-09-14T10:46:18.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.241+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.241+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a90 con 0x7f265c031040 2024-09-14T10:46:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.245+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.245+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a50 con 0x55fa24d826f0 2024-09-14T10:46:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.245+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.245+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d88910 2024-09-14T10:46:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.245+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.245+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x7f26580cc060 2024-09-14T10:46:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.249+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.249+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d88910 2024-09-14T10:46:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.249+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.249+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d826f0 2024-09-14T10:46:18.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.253+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.253+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0990 con 0x55fa24d826f0 2024-09-14T10:46:18.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.253+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.253+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d88910 2024-09-14T10:46:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.253+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.253+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x7f26580cc060 2024-09-14T10:46:18.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.257+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.257+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d88910 2024-09-14T10:46:18.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.257+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.257+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d88910 2024-09-14T10:46:18.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.257+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.257+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d88910 2024-09-14T10:46:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.257+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.257+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d88910 2024-09-14T10:46:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.261+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.261+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x7f265c031040 2024-09-14T10:46:18.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.261+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.261+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a20 con 0x55fa24d88910 2024-09-14T10:46:18.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.265+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.265+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a50 con 0x7f265c031040 2024-09-14T10:46:18.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.265+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'54 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.265+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a50 con 0x55fa24d88910 2024-09-14T10:46:18.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.269+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.269+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a50 con 0x7f265c031040 2024-09-14T10:46:18.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.269+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.269+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24da0a90 con 0x7f26580cc060 2024-09-14T10:46:18.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f25127fc640 20 reqs_thread_entry: start 2024-09-14T10:46:18.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:18.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 20 Filter name: none 2024-09-14T10:46:18.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2483fff640 20 reqs_thread_entry: start 2024-09-14T10:46:18.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-14T10:46:18.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9d6b0 con 0x7f265c031040 2024-09-14T10:46:18.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 20 rados_obj.operate() r=0 bl.length=349 2024-09-14T10:46:18.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-14T10:46:18.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-14T10:46:18.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:18.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9d7e0 con 0x7f265c031040 2024-09-14T10:46:18.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 10 removing key index: system_akey 2024-09-14T10:46:18.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.273+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9d7e0 con 0x55fa24d88910 2024-09-14T10:46:18.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2663ff59c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-14T10:46:18.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94532848570816 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24dbeaa0 con 0x55fa24d826f0 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== watch-notify(notify (1) cookie 94532848377984 notify 146028888103 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55fa24d9ff70 con 0x55fa24d826f0 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f25457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94532848377984 notifier 4851 bl.length()=161 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(97 notify.1 [notify cookie 94532848570816 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f25457fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2524003d70 con 0x55fa24d826f0 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== watch-notify(notify_complete (2) cookie 94532848570816 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2654033040 con 0x55fa24d826f0 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2663ff59c0 10 removing email index: 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2663ff59c0 10 removing user buckets index 2024-09-14T10:46:18.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24dbc610 con 0x7f265c031040 2024-09-14T10:46:18.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(99 system_user.buckets [delete] v34'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2663ff59c0 10 removing user index: system_user 2024-09-14T10:46:18.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.277+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24dc0650 con 0x7f265c031040 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(100 system_user [call,call,delete] v34'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f2663ff59c0 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f2663ff59c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94532848566624 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fa24dbda40 con 0x7f26580cc060 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== watch-notify(notify (1) cookie 94532848373392 notify 146028888090 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55fa24d9f720 con 0x7f26580cc060 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f25457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94532848373392 notifier 4851 bl.length()=160 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f25457fa640 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2524003d70 con 0x7f26580cc060 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(101 notify.0 [notify cookie 94532848566624 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== watch-notify(notify_complete (2) cookie 94532848566624 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fa24da0310 con 0x7f26580cc060 2024-09-14T10:46:18.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f25137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94532848391664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x55fa24d826f0 2024-09-14T10:46:18.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94532848391664] v34'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.281+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94532848373392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x7f26580cc060 2024-09-14T10:46:18.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.285+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94532848373392] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.285+0000 7f2663ff59c0 20 remove_watcher() i=0 2024-09-14T10:46:18.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.285+0000 7f2663ff59c0 2 removed watcher, disabling cache 2024-09-14T10:46:18.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.285+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94532848377984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x55fa24d826f0 2024-09-14T10:46:18.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.285+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94532848377984] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.285+0000 7f2663ff59c0 20 remove_watcher() i=1 2024-09-14T10:46:18.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.285+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94532848370880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x55fa24d88910 2024-09-14T10:46:18.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.289+0000 7f26612fa640 1 -- 172.21.15.96:0/2157888813 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94532848370880] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26580d7070 con 0x55fa24d88910 2024-09-14T10:46:18.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.289+0000 7f2663ff59c0 20 remove_watcher() i=2 2024-09-14T10:46:18.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.289+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94532848384304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x7f26580cc060 2024-09-14T10:46:18.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.289+0000 7f26622fc640 1 -- 172.21.15.96:0/2157888813 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94532848384304] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x7f26580cc060 2024-09-14T10:46:18.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.289+0000 7f2663ff59c0 20 remove_watcher() i=3 2024-09-14T10:46:18.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.289+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94532848388704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x55fa24d826f0 2024-09-14T10:46:18.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.293+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94532848388704] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x55fa24d826f0 2024-09-14T10:46:18.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.293+0000 7f2663ff59c0 20 remove_watcher() i=4 2024-09-14T10:46:18.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.293+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94532848382800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x7f265c031040 2024-09-14T10:46:18.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.293+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94532848382800] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.293+0000 7f2663ff59c0 20 remove_watcher() i=5 2024-09-14T10:46:18.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.293+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94532848390544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x7f265c031040 2024-09-14T10:46:18.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94532848390544] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 20 remove_watcher() i=6 2024-09-14T10:46:18.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94532848394608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fa24d9a2e0 con 0x7f265c031040 2024-09-14T10:46:18.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94532848394608] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2654008030 con 0x7f265c031040 2024-09-14T10:46:18.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 20 remove_watcher() i=7 2024-09-14T10:46:18.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f265c031040 msgr2=0x7f265c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f265c031040 0x7f265c032430 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24d826f0 msgr2=0x55fa24d84b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24d826f0 0x55fa24d84b80 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f26580cc060 msgr2=0x7f26580a4a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f26580cc060 0x7f26580a4a80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fa24d88910 msgr2=0x55fa24d8ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55fa24d88910 0x55fa24d8ad00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f252c03a150 msgr2=0x7f252c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f252c03a150 0x7f252c03c610 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55fa24d4dd50 tx=0x7f265c01f000 comp rx=0 tx=0).stop 2024-09-14T10:46:18.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 msgr2=0x55fa24d77180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2661afb640 1 -- 172.21.15.96:0/2157888813 reap_dead start 2024-09-14T10:46:18.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d77180 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f26580b7810 tx=0x7f26580eb700 comp rx=0 tx=0).stop 2024-09-14T10:46:18.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 shutdown_connections 2024-09-14T10:46:18.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2157888813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d70bf0 0x55fa24d77180 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 >> 172.21.15.96:0/2157888813 conn(0x55fa24d6c010 msgr2=0x55fa24d6a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 shutdown_connections 2024-09-14T10:46:18.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2157888813 wait complete. 2024-09-14T10:46:18.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2849989260 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f253c03a150 msgr2=0x7f253c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2849989260 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f253c03a150 0x7f253c03c610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55fa24d53ce0 tx=0x7f265c005850 comp rx=0 tx=0).stop 2024-09-14T10:46:18.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2849989260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d633c0 msgr2=0x55fa24d637e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2849989260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d633c0 0x55fa24d637e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2658000c10 tx=0x7f2658018020 comp rx=0 tx=0).stop 2024-09-14T10:46:18.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2849989260 shutdown_connections 2024-09-14T10:46:18.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2849989260 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f253c03a150 0x7f253c03c610 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/2849989260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24d633c0 0x55fa24d637e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2849989260 >> 172.21.15.96:0/2849989260 conn(0x55fa24d58d70 msgr2=0x55fa24d59150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2849989260 shutdown_connections 2024-09-14T10:46:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/2849989260 wait complete. 2024-09-14T10:46:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24bcbe50 msgr2=0x55fa24d52dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24bcbe50 0x55fa24d52dc0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f254803a150 msgr2=0x7f254803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f254803a150 0x7f254803c610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f26580ad000 tx=0x7f26580a5040 comp rx=0 tx=0).stop 2024-09-14T10:46:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 msgr2=0x55fa24d4bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d4bc50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55fa24d45370 tx=0x7f26540040f0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 shutdown_connections 2024-09-14T10:46:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55fa24bcbe50 0x55fa24d52dc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f254803a150 0x7f254803c610 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 --2- 172.21.15.96:0/3064600359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa24bcba70 0x55fa24d4bc50 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 >> 172.21.15.96:0/3064600359 conn(0x55fa24c519c0 msgr2=0x55fa24d45800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 shutdown_connections 2024-09-14T10:46:18.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.297+0000 7f2663ff59c0 1 -- 172.21.15.96:0/3064600359 wait complete. 2024-09-14T10:46:18.309 ERROR:root:None 2024-09-14T10:46:18.309 ERROR:root:0 2024-09-14T10:46:18.309 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-14T10:46:18.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-14T10:46:18.310 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-14T10:46:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba9ce39c0 1 Processor -- start 2024-09-14T10:46:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba9ce39c0 1 -- start start 2024-09-14T10:46:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba9ce39c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555c8dbfd230 0x555c8dc8bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba9ce39c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c8db317a0 con 0x555c8dc8c120 2024-09-14T10:46:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba9ce39c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x555c8db8d1b0 con 0x555c8dbfd230 2024-09-14T10:46:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba77e9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555c8dbfd230 0x555c8dc8bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba77e9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x555c8dbfd230 0x555c8dc8bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51622/0 (socket says 172.21.15.96:51622) 2024-09-14T10:46:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba77e9640 1 -- 172.21.15.96:0/3374335885 learned_addr learned my addr 172.21.15.96:0/3374335885 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba77e9640 1 -- 172.21.15.96:0/3374335885 >> v1:172.21.15.70:6789/0 conn(0x555c8dc8c120 legacy=0x555c8dc8e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.397+0000 7fbba77e9640 1 -- 172.21.15.96:0/3374335885 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8db0bda0 con 0x555c8dbfd230 2024-09-14T10:46:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba77e9640 1 --2- 172.21.15.96:0/3374335885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dc8bbe0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800a4e0 tx=0x7fbb9801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bb1f5af724af3f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba67e7640 1 -- 172.21.15.96:0/3374335885 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb980aa540 con 0x555c8dbfd230 2024-09-14T10:46:18.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba67e7640 1 -- 172.21.15.96:0/3374335885 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb980aa6e0 con 0x555c8dbfd230 2024-09-14T10:46:18.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba67e7640 1 -- 172.21.15.96:0/3374335885 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb980aaa40 con 0x555c8dbfd230 2024-09-14T10:46:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3374335885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 msgr2=0x555c8dc8bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3374335885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dc8bbe0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800a4e0 tx=0x7fbb9801b090 comp rx=0 tx=0).stop 2024-09-14T10:46:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3374335885 shutdown_connections 2024-09-14T10:46:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3374335885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dc8bbe0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3374335885 >> 172.21.15.96:0/3374335885 conn(0x555c8dc83910 msgr2=0x555c8dc85d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3374335885 shutdown_connections 2024-09-14T10:46:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.401+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3374335885 wait complete. 2024-09-14T10:46:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.413+0000 7fbba9ce39c0 1 Processor -- start 2024-09-14T10:46:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.413+0000 7fbba9ce39c0 1 -- start start 2024-09-14T10:46:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.413+0000 7fbba9ce39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.413+0000 7fbba9ce39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555c8db90fc0 con 0x555c8dbfd230 2024-09-14T10:46:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.413+0000 7fbba77e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.413+0000 7fbba77e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51630/0 (socket says 172.21.15.96:51630) 2024-09-14T10:46:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.413+0000 7fbba77e9640 1 -- 172.21.15.96:0/2819370351 learned_addr learned my addr 172.21.15.96:0/2819370351 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.413+0000 7fbba77e9640 1 -- 172.21.15.96:0/2819370351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8dd728c0 con 0x555c8dbfd230 2024-09-14T10:46:18.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba77e9640 1 --2- 172.21.15.96:0/2819370351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd722d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbb98017ca0 tx=0x7fbb980033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d7f2a59d98a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fba9560a640 1 -- 172.21.15.96:0/2819370351 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb980b9030 con 0x555c8dbfd230 2024-09-14T10:46:18.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fba9560a640 1 -- 172.21.15.96:0/2819370351 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb980aaa80 con 0x555c8dbfd230 2024-09-14T10:46:18.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fba9560a640 1 -- 172.21.15.96:0/2819370351 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb980aada0 con 0x555c8dbfd230 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2819370351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 msgr2=0x555c8dd722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/2819370351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd722d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbb98017ca0 tx=0x7fbb980033b0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2819370351 shutdown_connections 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/2819370351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd722d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2819370351 >> 172.21.15.96:0/2819370351 conn(0x555c8dc83910 msgr2=0x555c8dd6dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2819370351 shutdown_connections 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2819370351 wait complete. 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 Processor -- start 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- start start 2024-09-14T10:46:18.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd79a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555c8db32a50 con 0x555c8dbfd230 2024-09-14T10:46:18.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba77e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd79a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba77e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd79a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51640/0 (socket says 172.21.15.96:51640) 2024-09-14T10:46:18.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba77e9640 1 -- 172.21.15.96:0/258555077 learned_addr learned my addr 172.21.15.96:0/258555077 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba77e9640 1 -- 172.21.15.96:0/258555077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8dd79f80 con 0x555c8dbfd230 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba77e9640 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd79a20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbb9801b930 tx=0x7fbb98017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fba93e07640 1 -- 172.21.15.96:0/258555077 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb980b9070 con 0x555c8dbfd230 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c8dd7a210 con 0x555c8dbfd230 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8dd7ab70 con 0x555c8dbfd230 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fba93e07640 1 -- 172.21.15.96:0/258555077 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb980c3030 con 0x555c8dbfd230 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.417+0000 7fba93e07640 1 -- 172.21.15.96:0/258555077 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb980cd060 con 0x555c8dbfd230 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fba93e07640 1 -- 172.21.15.96:0/258555077 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbb980b3040 con 0x555c8dbfd230 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fba93e07640 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8c03a1a0 0x7fba8c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fba93e07640 1 -- 172.21.15.96:0/258555077 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbb980ba070 con 0x555c8dbfd230 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba6fe8640 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8c03a1a0 0x7fba8c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8dc8c120 0x555c8dd80b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8dd81080 con 0x555c8dc8c120 2024-09-14T10:46:18.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba7fea640 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8dc8c120 0x555c8dd80b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba6fe8640 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8c03a1a0 0x7fba8c03c660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c001ec0 tx=0x7fbb9c001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba7fea640 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8dc8c120 0x555c8dd80b40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba7fea640 1 -- 172.21.15.96:0/258555077 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbba00083f0 con 0x555c8dc8c120 2024-09-14T10:46:18.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8dd81440 con 0x555c8dc8c120 2024-09-14T10:46:18.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba7fea640 1 -- 172.21.15.96:0/258555077 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbba00083f0 con 0x555c8dc8c120 2024-09-14T10:46:18.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8dd82d40 con 0x555c8dc8c120 2024-09-14T10:46:18.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba7fea640 1 -- 172.21.15.96:0/258555077 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbba00083f0 con 0x555c8dc8c120 2024-09-14T10:46:18.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8dd81f70 con 0x555c8dc8c120 2024-09-14T10:46:18.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba7fea640 1 -- 172.21.15.96:0/258555077 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbba00083f0 con 0x555c8dc8c120 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8dd82390 con 0x555c8dc8c120 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba7fea640 1 -- 172.21.15.96:0/258555077 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbba00083f0 con 0x555c8dc8c120 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba9ce39c0 1 Processor -- start 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.421+0000 7fbba9ce39c0 1 -- start start 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba9ce39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd91120 0x555c8dd91540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba9ce39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555c8db9dd80 con 0x555c8dd91120 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba6fe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd91120 0x555c8dd91540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba6fe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd91120 0x555c8dd91540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51646/0 (socket says 172.21.15.96:51646) 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba6fe8640 1 -- 172.21.15.96:0/2331102545 learned_addr learned my addr 172.21.15.96:0/2331102545 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba6fe8640 1 -- 172.21.15.96:0/2331102545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8dd91b80 con 0x555c8dd91120 2024-09-14T10:46:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba6fe8640 1 --2- 172.21.15.96:0/2331102545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd91120 0x555c8dd91540 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c010fd0 tx=0x7fbb9c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fba91602640 1 -- 172.21.15.96:0/2331102545 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c00a040 con 0x555c8dd91120 2024-09-14T10:46:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fba91602640 1 -- 172.21.15.96:0/2331102545 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c017050 con 0x555c8dd91120 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2331102545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c8dd923e0 con 0x555c8dd91120 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fba91602640 1 -- 172.21.15.96:0/2331102545 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c00e6b0 con 0x555c8dd91120 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2331102545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8dd92950 con 0x555c8dd91120 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fba91602640 1 -- 172.21.15.96:0/2331102545 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbb9c00e8e0 con 0x555c8dd91120 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fba91602640 1 --2- 172.21.15.96:0/2331102545 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8003a150 0x7fba8003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fba91602640 1 -- 172.21.15.96:0/2331102545 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbb9c052af0 con 0x555c8dd91120 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba7fea640 1 --2- 172.21.15.96:0/2331102545 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8003a150 0x7fba8003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba9ce39c0 1 Processor -- start 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba7fea640 1 --2- 172.21.15.96:0/2331102545 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8003a150 0x7fba8003c610 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x555c8dd82310 tx=0x7fbba0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba9ce39c0 1 -- start start 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba9ce39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dd9ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba9ce39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555c8dd72c30 con 0x555c8dd9ea90 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba6fe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dd9ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba6fe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dd9ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51662/0 (socket says 172.21.15.96:51662) 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.425+0000 7fbba6fe8640 1 -- 172.21.15.96:0/2058561534 learned_addr learned my addr 172.21.15.96:0/2058561534 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba6fe8640 1 -- 172.21.15.96:0/2058561534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8dd9f480 con 0x555c8dd9ea90 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba6fe8640 1 --2- 172.21.15.96:0/2058561534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dd9ee90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c050e40 tx=0x7fbb9c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63be4b08b568b883 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fba8affd640 1 -- 172.21.15.96:0/2058561534 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c01c930 con 0x555c8dd9ea90 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fba8affd640 1 -- 172.21.15.96:0/2058561534 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c01a310 con 0x555c8dd9ea90 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fba8affd640 1 -- 172.21.15.96:0/2058561534 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c01cad0 con 0x555c8dd9ea90 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2058561534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 msgr2=0x555c8dd9ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/2058561534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dd9ee90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c050e40 tx=0x7fbb9c01acd0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2058561534 shutdown_connections 2024-09-14T10:46:18.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/2058561534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dd9ee90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2058561534 >> 172.21.15.96:0/2058561534 conn(0x555c8dd99eb0 msgr2=0x555c8dd980f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2058561534 shutdown_connections 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2058561534 wait complete. 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 Processor -- start 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- start start 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dda5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555c8dd9d9e0 con 0x555c8dd9ea90 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba6fe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dda5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba6fe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dda5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51666/0 (socket says 172.21.15.96:51666) 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 learned_addr learned my addr 172.21.15.96:0/3546993703 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8dda5590 con 0x555c8dd9ea90 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba6fe8640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dda5030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00fcf0 tx=0x7fbb9c050dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fba897fa640 1 -- 172.21.15.96:0/3546993703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c01ccc0 con 0x555c8dd9ea90 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c8dda5820 con 0x555c8dd9ea90 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fba897fa640 1 -- 172.21.15.96:0/3546993703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9c01c410 con 0x555c8dd9ea90 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fba897fa640 1 -- 172.21.15.96:0/3546993703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb9c01c600 con 0x555c8dd9ea90 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.429+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8dda5820 con 0x555c8dd9ea90 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fba897fa640 1 -- 172.21.15.96:0/3546993703 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbb9c038020 con 0x555c8dd9ea90 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fba897fa640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba7003a100 0x7fba7003c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fba897fa640 1 -- 172.21.15.96:0/3546993703 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbb9c036020 con 0x555c8dd9ea90 2024-09-14T10:46:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba7fea640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba7003a100 0x7fba7003c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8ddb03e0 0x555c8ddb2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb2fc0 con 0x555c8ddb03e0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba77e9640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8ddb03e0 0x555c8ddb2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba7fea640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba7003a100 0x7fba7003c5c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbba000f010 tx=0x7fbba001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba77e9640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8ddb03e0 0x555c8ddb2870 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 realm 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb3420 con 0x555c8ddb03e0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb3cf0 con 0x555c8ddb03e0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb4090 con 0x555c8ddb03e0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb48e0 con 0x555c8ddb03e0 2024-09-14T10:46:18.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 20 searching for the correct realm 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555c8ddb6650 0x555c8ddb8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba6fe8640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555c8ddb6650 0x555c8ddb8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba6fe8640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555c8ddb6650 0x555c8ddb8a40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba6fe8640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbb9c05e040 0x7fbb9c051030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbb9c05e040 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba7fea640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbb9c05e040 0x7fbb9c051030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.433+0000 7fbba7fea640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbb9c05e040 0x7fbb9c051030 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba7fea640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbba0019040 0x7fbba0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbba0019040 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbba0019040 0x7fbba0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbba0019040 0x7fbba0019930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x7fbba0019040 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb03e0 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb03e0 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbba0019040 2024-09-14T10:46:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x7fbba0019040 2024-09-14T10:46:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbba0019040 2024-09-14T10:46:18.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x7fbba0019040 2024-09-14T10:46:18.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbb9c05e040 2024-09-14T10:46:18.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.437+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb03e0 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbba0019040 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x7fbba0019040 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb03e0 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbb9c05e040 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbba0019040 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x7fbba0019040 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb03e0 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb03e0 2024-09-14T10:46:18.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.441+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbba0019040 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb980c8d20 con 0x7fbba0019040 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbb9c05e040 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb03e0 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb980c8d20 con 0x555c8ddb03e0 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbb9c05e040 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbba0019040 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbb9c05e040 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb6650 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbba0019040 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x555c8ddb03e0 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb9020 con 0x7fbb9c05e040 2024-09-14T10:46:18.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba9ce39c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba9ce39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba9ce39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba9ce39c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba9ce39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba9ce39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.445+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb5260 con 0x555c8ddb03e0 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb5b00 con 0x555c8ddb03e0 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb94a0 con 0x555c8ddb03e0 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 zone default found 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 4 Realm: () 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:18.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 zonegroup default 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddb94a0 con 0x7fbb9c05e040 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbb780 con 0x555c8ddb6650 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbbb20 con 0x555c8ddb6650 2024-09-14T10:46:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 started sync module instance, tier type = 2024-09-14T10:46:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbac10 con 0x7fbb9c05e040 2024-09-14T10:46:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93856005337360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbac10 con 0x7fbb9c05e040 2024-09-14T10:46:18.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbc600 con 0x555c8ddb03e0 2024-09-14T10:46:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.449+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93856005337360] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.453+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.453+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93856005341424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbac10 con 0x555c8ddb03e0 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.453+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbd040 con 0x555c8ddb6650 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.453+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93856005341424] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.453+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.453+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93856005334880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbab80 con 0x555c8ddb6650 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.453+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbddc0 con 0x7fbb9c05e040 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.457+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.457+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93856005347472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbe660 con 0x7fbb9c05e040 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.457+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbf0a0 con 0x555c8ddb03e0 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.457+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93856005334880] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.457+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93856005347472] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.457+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.457+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93856005352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbe1b0 con 0x555c8ddb03e0 2024-09-14T10:46:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.457+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbf940 con 0x7fbba0019040 2024-09-14T10:46:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.461+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93856005352304] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.461+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.461+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93856005346272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbf660 con 0x7fbba0019040 2024-09-14T10:46:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.461+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbfeb0 con 0x7fbba0019040 2024-09-14T10:46:18.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.461+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93856005346272] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.461+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.461+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93856005354176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbfc90 con 0x7fbba0019040 2024-09-14T10:46:18.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.461+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddc0790 con 0x7fbba0019040 2024-09-14T10:46:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93856005358208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddc0c00 con 0x7fbba0019040 2024-09-14T10:46:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 20 add_watcher() i=0 2024-09-14T10:46:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 20 add_watcher() i=1 2024-09-14T10:46:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 20 add_watcher() i=2 2024-09-14T10:46:18.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 20 add_watcher() i=3 2024-09-14T10:46:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 20 add_watcher() i=4 2024-09-14T10:46:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 20 add_watcher() i=5 2024-09-14T10:46:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93856005354176] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 20 add_watcher() i=6 2024-09-14T10:46:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93856005358208] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 20 add_watcher() i=7 2024-09-14T10:46:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddc0c00 con 0x555c8ddb03e0 2024-09-14T10:46:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.465+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93856005359440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddc0b70 con 0x555c8ddb03e0 2024-09-14T10:46:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93856005359440] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fba5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 5 note: GC not initialized 2024-09-14T10:46:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fba5cfe1640 20 reqs_thread_entry: start 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 20 Filter name: none 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fb9d67fc640 20 reqs_thread_entry: start 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8dde73d0 con 0x555c8ddb6650 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-14T10:46:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8dde5dc0 con 0x555c8ddb6650 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-14T10:46:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddea9c0 con 0x555c8ddb6650 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'9 uv9 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 93856005512192 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddeb400 con 0x555c8ddb6650 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== watch-notify(notify (1) cookie 93856005334880 notify 146028888073 ret 0) ==== 584+0+0 (crc 0 0 0) 0x555c8dde5910 con 0x555c8ddb6650 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fba8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 93856005334880 notifier 4858 bl.length()=542 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fba8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fba8affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fba8affd640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fba6c003eb0 con 0x555c8ddb6650 2024-09-14T10:46:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(65 notify.2 [notify cookie 93856005512192 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== watch-notify(notify_complete (2) cookie 93856005512192 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c8dd9f480 con 0x555c8ddb6650 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.469+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8dde5c00 con 0x555c8ddb6650 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba9ce39c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba9ce39c0 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba9ce39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93856005512192 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddeb400 con 0x7fbba0019040 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== watch-notify(notify (1) cookie 93856005346272 notify 146028888104 ret 0) ==== 217+0+0 (crc 0 0 0) 0x555c8dd7ab70 con 0x7fbba0019040 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fba8a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 93856005346272 notifier 4858 bl.length()=175 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fba8a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-14T10:46:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fba8a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-14T10:46:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fba8a7fc640 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb9dc003410 con 0x7fbba0019040 2024-09-14T10:46:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(68 notify.5 [notify cookie 93856005512192 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== watch-notify(notify_complete (2) cookie 93856005512192 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c8dd7a210 con 0x7fbba0019040 2024-09-14T10:46:18.477 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-14T10:46:18.474520Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:18.474509Z","tags":[],"group_ids":[]} 2024-09-14T10:46:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fba5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.473+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93856005359440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8dde4f70 con 0x555c8ddb03e0 2024-09-14T10:46:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93856005359440] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93856005337360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8dde4f70 con 0x7fbb9c05e040 2024-09-14T10:46:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93856005337360] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba9ce39c0 20 remove_watcher() i=0 2024-09-14T10:46:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba9ce39c0 2 removed watcher, disabling cache 2024-09-14T10:46:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93856005341424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbb110 con 0x555c8ddb03e0 2024-09-14T10:46:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93856005341424] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba9ce39c0 20 remove_watcher() i=1 2024-09-14T10:46:18.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.477+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93856005334880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8dde4f70 con 0x555c8ddb6650 2024-09-14T10:46:18.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.481+0000 7fbba6fe8640 1 -- 172.21.15.96:0/3546993703 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93856005334880] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9c05b040 con 0x555c8ddb6650 2024-09-14T10:46:18.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.481+0000 7fbba9ce39c0 20 remove_watcher() i=2 2024-09-14T10:46:18.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.481+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93856005347472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbb110 con 0x7fbb9c05e040 2024-09-14T10:46:18.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.481+0000 7fbba7fea640 1 -- 172.21.15.96:0/3546993703 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93856005347472] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba002f040 con 0x7fbb9c05e040 2024-09-14T10:46:18.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.481+0000 7fbba9ce39c0 20 remove_watcher() i=3 2024-09-14T10:46:18.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.481+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93856005352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddba760 con 0x555c8ddb03e0 2024-09-14T10:46:18.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.485+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93856005352304] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x555c8ddb03e0 2024-09-14T10:46:18.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.485+0000 7fbba9ce39c0 20 remove_watcher() i=4 2024-09-14T10:46:18.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.485+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93856005346272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8dde4f70 con 0x7fbba0019040 2024-09-14T10:46:18.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.485+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93856005346272] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.485+0000 7fbba9ce39c0 20 remove_watcher() i=5 2024-09-14T10:46:18.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.485+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93856005354176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddbb110 con 0x7fbba0019040 2024-09-14T10:46:18.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93856005354176] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 20 remove_watcher() i=6 2024-09-14T10:46:18.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93856005358208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c8ddba760 con 0x7fbba0019040 2024-09-14T10:46:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93856005358208] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb98101040 con 0x7fbba0019040 2024-09-14T10:46:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 20 remove_watcher() i=7 2024-09-14T10:46:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbba0019040 msgr2=0x7fbba0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbba0019040 0x7fbba0019930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8ddb03e0 msgr2=0x555c8ddb2870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8ddb03e0 0x555c8ddb2870 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbb9c05e040 msgr2=0x7fbb9c051030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbb9c05e040 0x7fbb9c051030 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555c8ddb6650 msgr2=0x555c8ddb8a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x555c8ddb6650 0x555c8ddb8a40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba7003a100 msgr2=0x7fba7003c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba7003a100 0x7fba7003c5c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbba000f010 tx=0x7fbba001b070 comp rx=0 tx=0).stop 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 msgr2=0x555c8dda5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba77e9640 1 -- 172.21.15.96:0/3546993703 reap_dead start 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dda5030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00fcf0 tx=0x7fbb9c050dd0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 shutdown_connections 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/3546993703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd9ea90 0x555c8dda5030 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 >> 172.21.15.96:0/3546993703 conn(0x555c8dd99eb0 msgr2=0x555c8dd980c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 shutdown_connections 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/3546993703 wait complete. 2024-09-14T10:46:18.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2331102545 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8003a150 msgr2=0x7fba8003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/2331102545 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8003a150 0x7fba8003c610 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x555c8dd82310 tx=0x7fbba0003070 comp rx=0 tx=0).stop 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2331102545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd91120 msgr2=0x555c8dd91540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/2331102545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd91120 0x555c8dd91540 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c010fd0 tx=0x7fbb9c00f7a0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2331102545 shutdown_connections 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/2331102545 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8003a150 0x7fba8003c610 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/2331102545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dd91120 0x555c8dd91540 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2331102545 >> 172.21.15.96:0/2331102545 conn(0x555c8dd86ad0 msgr2=0x555c8dd86eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2331102545 shutdown_connections 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.489+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/2331102545 wait complete. 2024-09-14T10:46:18.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8dc8c120 msgr2=0x555c8dd80b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8dc8c120 0x555c8dd80b40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8c03a1a0 msgr2=0x7fba8c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8c03a1a0 0x7fba8c03c660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c001ec0 tx=0x7fbb9c001440 comp rx=0 tx=0).stop 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 msgr2=0x555c8dd79a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd79a20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbb9801b930 tx=0x7fbb98017e30 comp rx=0 tx=0).stop 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 shutdown_connections 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x555c8dc8c120 0x555c8dd80b40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fba8c03a1a0 0x7fba8c03c660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 --2- 172.21.15.96:0/258555077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555c8dbfd230 0x555c8dd79a20 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 >> 172.21.15.96:0/258555077 conn(0x555c8dc83910 msgr2=0x555c8dd73680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 shutdown_connections 2024-09-14T10:46:18.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.493+0000 7fbba9ce39c0 1 -- 172.21.15.96:0/258555077 wait complete. 2024-09-14T10:46:18.501 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-14T10:46:18.474520Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:18.474509Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:18.502 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-14T10:46:18.474520Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:18.474509Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:18.502 ERROR:root:0 2024-09-14T10:46:18.502 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:18.507 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:18.507 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-14T10:46:18.507 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-14T10:46:18.507 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-14T10:46:18.535 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:18.535 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:18.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd89ca09c0 1 Processor -- start 2024-09-14T10:46:18.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd89ca09c0 1 -- start start 2024-09-14T10:46:18.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd89ca09c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5641bd50b040 0x5641bd50d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd89ca09c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641bd3b07a0 con 0x5641bd506e50 2024-09-14T10:46:18.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd89ca09c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5641bd40c1b0 con 0x5641bd50b040 2024-09-14T10:46:18.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd7ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5641bd50b040 0x5641bd50d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd7ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5641bd50b040 0x5641bd50d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51678/0 (socket says 172.21.15.96:51678) 2024-09-14T10:46:18.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd877a6640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x5641bd506e50 0x5641bd507230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38312/0 (socket says 172.21.15.96:38312) 2024-09-14T10:46:18.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd7ffff640 1 -- 172.21.15.96:0/3931553919 learned_addr learned my addr 172.21.15.96:0/3931553919 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd7ffff640 1 -- 172.21.15.96:0/3931553919 >> v1:172.21.15.70:6789/0 conn(0x5641bd506e50 legacy=0x5641bd507230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.537+0000 7fbd7ffff640 1 -- 172.21.15.96:0/3931553919 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641bd38ada0 con 0x5641bd50b040 2024-09-14T10:46:18.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/3931553919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd50b040 0x5641bd50d430 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000a5c0 tx=0x7fbd7001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa8cb5e94dc81d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd86fa5640 1 -- 172.21.15.96:0/3931553919 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd700a9590 con 0x5641bd50b040 2024-09-14T10:46:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd86fa5640 1 -- 172.21.15.96:0/3931553919 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd700ae070 con 0x5641bd50b040 2024-09-14T10:46:18.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd86fa5640 1 -- 172.21.15.96:0/3931553919 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd700a9880 con 0x5641bd50b040 2024-09-14T10:46:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/3931553919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd50b040 msgr2=0x5641bd50d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/3931553919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd50b040 0x5641bd50d430 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000a5c0 tx=0x7fbd7001b3d0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/3931553919 shutdown_connections 2024-09-14T10:46:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/3931553919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd50b040 0x5641bd50d430 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/3931553919 >> 172.21.15.96:0/3931553919 conn(0x5641bd502970 msgr2=0x5641bd504d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/3931553919 shutdown_connections 2024-09-14T10:46:18.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.541+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/3931553919 wait complete. 2024-09-14T10:46:18.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd89ca09c0 1 Processor -- start 2024-09-14T10:46:18.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd89ca09c0 1 -- start start 2024-09-14T10:46:18.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd89ca09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd89ca09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641bd40ffc0 con 0x5641bd506e50 2024-09-14T10:46:18.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd877a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd877a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5f33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51684/0 (socket says 172.21.15.96:51684) 2024-09-14T10:46:18.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd877a6640 1 -- 172.21.15.96:0/1295910635 learned_addr learned my addr 172.21.15.96:0/1295910635 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd877a6640 1 -- 172.21.15.96:0/1295910635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641bd5f39c0 con 0x5641bd506e50 2024-09-14T10:46:18.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.553+0000 7fbd877a6640 1 --2- 172.21.15.96:0/1295910635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5f33d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800b270 tx=0x7fbd7800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de87841babc9f8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbc7560a640 1 -- 172.21.15.96:0/1295910635 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd7800e5d0 con 0x5641bd506e50 2024-09-14T10:46:18.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbc7560a640 1 -- 172.21.15.96:0/1295910635 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7800e770 con 0x5641bd506e50 2024-09-14T10:46:18.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbc7560a640 1 -- 172.21.15.96:0/1295910635 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd7800ea70 con 0x5641bd506e50 2024-09-14T10:46:18.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1295910635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 msgr2=0x5641bd5f33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1295910635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5f33d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800b270 tx=0x7fbd7800b670 comp rx=0 tx=0).stop 2024-09-14T10:46:18.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1295910635 shutdown_connections 2024-09-14T10:46:18.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1295910635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5f33d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1295910635 >> 172.21.15.96:0/1295910635 conn(0x5641bd502970 msgr2=0x5641bd5eefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1295910635 shutdown_connections 2024-09-14T10:46:18.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1295910635 wait complete. 2024-09-14T10:46:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 Processor -- start 2024-09-14T10:46:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- start start 2024-09-14T10:46:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5facd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641bd3b1a50 con 0x5641bd506e50 2024-09-14T10:46:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd877a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5facd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd877a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5facd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51696/0 (socket says 172.21.15.96:51696) 2024-09-14T10:46:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd877a6640 1 -- 172.21.15.96:0/1301177205 learned_addr learned my addr 172.21.15.96:0/1301177205 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd877a6640 1 -- 172.21.15.96:0/1301177205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641bd5fb230 con 0x5641bd506e50 2024-09-14T10:46:18.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd877a6640 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5facd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x5641bd5f4390 tx=0x7fbd78000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbc73e07640 1 -- 172.21.15.96:0/1301177205 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd7800be70 con 0x5641bd506e50 2024-09-14T10:46:18.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641bd5fb4c0 con 0x5641bd506e50 2024-09-14T10:46:18.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbc73e07640 1 -- 172.21.15.96:0/1301177205 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7800f9f0 con 0x5641bd506e50 2024-09-14T10:46:18.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641bd5fbe70 con 0x5641bd506e50 2024-09-14T10:46:18.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.557+0000 7fbc73e07640 1 -- 172.21.15.96:0/1301177205 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd7802c060 con 0x5641bd506e50 2024-09-14T10:46:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbc73e07640 1 -- 172.21.15.96:0/1301177205 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbd78017070 con 0x5641bd506e50 2024-09-14T10:46:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbc73e07640 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6c03a150 0x7fbc6c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbc73e07640 1 -- 172.21.15.96:0/1301177205 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd78015020 con 0x5641bd506e50 2024-09-14T10:46:18.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6c03a150 0x7fbc6c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd50b040 0x5641bd601e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd602380 con 0x5641bd50b040 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd50b040 0x5641bd601e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6c03a150 0x7fbc6c03c610 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd700ad000 tx=0x7fbd700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd50b040 0x5641bd601e40 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd87fa7640 1 -- 172.21.15.96:0/1301177205 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd8000a4d0 con 0x5641bd50b040 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6027d0 con 0x5641bd50b040 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd87fa7640 1 -- 172.21.15.96:0/1301177205 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd8000a4d0 con 0x5641bd50b040 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6040d0 con 0x5641bd50b040 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd87fa7640 1 -- 172.21.15.96:0/1301177205 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd8000a4d0 con 0x5641bd50b040 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd603300 con 0x5641bd50b040 2024-09-14T10:46:18.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd87fa7640 1 -- 172.21.15.96:0/1301177205 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd8000a4d0 con 0x5641bd50b040 2024-09-14T10:46:18.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd603750 con 0x5641bd50b040 2024-09-14T10:46:18.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd87fa7640 1 -- 172.21.15.96:0/1301177205 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd8000a4d0 con 0x5641bd50b040 2024-09-14T10:46:18.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 Processor -- start 2024-09-14T10:46:18.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 -- start start 2024-09-14T10:46:18.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd612490 0x5641bd6128b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd89ca09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641bd41cd80 con 0x5641bd612490 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd7ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd612490 0x5641bd6128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd7ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd612490 0x5641bd6128b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51702/0 (socket says 172.21.15.96:51702) 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.561+0000 7fbd7ffff640 1 -- 172.21.15.96:0/1419067034 learned_addr learned my addr 172.21.15.96:0/1419067034 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd7ffff640 1 -- 172.21.15.96:0/1419067034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641bd612ef0 con 0x5641bd612490 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/1419067034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd612490 0x5641bd6128b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbd700ab040 tx=0x7fbd70018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbc71602640 1 -- 172.21.15.96:0/1419067034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd700b3ba0 con 0x5641bd612490 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbc71602640 1 -- 172.21.15.96:0/1419067034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd700b3d40 con 0x5641bd612490 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1419067034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641bd613750 con 0x5641bd612490 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbc71602640 1 -- 172.21.15.96:0/1419067034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd700c8580 con 0x5641bd612490 2024-09-14T10:46:18.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1419067034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641bd613c60 con 0x5641bd612490 2024-09-14T10:46:18.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbc71602640 1 -- 172.21.15.96:0/1419067034 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbd700d1440 con 0x5641bd612490 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbc71602640 1 --2- 172.21.15.96:0/1419067034 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6003a190 0x7fbc6003c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbc71602640 1 -- 172.21.15.96:0/1419067034 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd700ee700 con 0x5641bd612490 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/1419067034 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6003a190 0x7fbc6003c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd89ca09c0 1 Processor -- start 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd89ca09c0 1 -- start start 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/1419067034 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6003a190 0x7fbc6003c650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5641bd602e20 tx=0x7fbd80005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd89ca09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd6200e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd89ca09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641bd5f3df0 con 0x5641bd61fce0 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd7ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd6200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd7ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd6200e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51714/0 (socket says 172.21.15.96:51714) 2024-09-14T10:46:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.565+0000 7fbd7ffff640 1 -- 172.21.15.96:0/170055887 learned_addr learned my addr 172.21.15.96:0/170055887 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd7ffff640 1 -- 172.21.15.96:0/170055887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641bd6206d0 con 0x5641bd61fce0 2024-09-14T10:46:18.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/170055887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd6200e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbd700ec990 tx=0x7fbd700c78c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eccb9c96a409476 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbc6affd640 1 -- 172.21.15.96:0/170055887 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd700be540 con 0x5641bd61fce0 2024-09-14T10:46:18.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbc6affd640 1 -- 172.21.15.96:0/170055887 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd700bc3b0 con 0x5641bd61fce0 2024-09-14T10:46:18.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbc6affd640 1 -- 172.21.15.96:0/170055887 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd700bcca0 con 0x5641bd61fce0 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/170055887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 msgr2=0x5641bd6200e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/170055887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd6200e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbd700ec990 tx=0x7fbd700c78c0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/170055887 shutdown_connections 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/170055887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd6200e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/170055887 >> 172.21.15.96:0/170055887 conn(0x5641bd61b100 msgr2=0x5641bd619340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/170055887 shutdown_connections 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/170055887 wait complete. 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 Processor -- start 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- start start 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd512360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641bd61ec30 con 0x5641bd61fce0 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd7ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd512360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd7ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd512360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51726/0 (socket says 172.21.15.96:51726) 2024-09-14T10:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 learned_addr learned my addr 172.21.15.96:0/998425231 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641bd5128c0 con 0x5641bd61fce0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd512360 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbd700c7d40 tx=0x7fbd700ec920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbc697fa640 1 -- 172.21.15.96:0/998425231 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd700eb020 con 0x5641bd61fce0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641bd510ca0 con 0x5641bd61fce0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbc697fa640 1 -- 172.21.15.96:0/998425231 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd700e2040 con 0x5641bd61fce0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbc697fa640 1 -- 172.21.15.96:0/998425231 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd700bfc30 con 0x5641bd61fce0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.569+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641bd511150 con 0x5641bd61fce0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbc697fa640 1 -- 172.21.15.96:0/998425231 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbd700da070 con 0x5641bd61fce0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbc697fa640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5003a150 0x7fbc5003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbc697fa640 1 -- 172.21.15.96:0/998425231 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd700f8d10 con 0x5641bd61fce0 2024-09-14T10:46:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5003a150 0x7fbc5003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd6339a0 0x5641bd635e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6365b0 con 0x5641bd6339a0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd877a6640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd6339a0 0x5641bd635e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5003a150 0x7fbc5003c610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5641bd5fce50 tx=0x7fbd8001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd877a6640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd6339a0 0x5641bd635e60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 realm 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6369c0 con 0x5641bd6339a0 2024-09-14T10:46:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd637290 con 0x5641bd6339a0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd637630 con 0x5641bd6339a0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd637e80 con 0x5641bd6339a0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 20 searching for the correct realm 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5641bd639bf0 0x5641bd63bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5641bd639bf0 0x5641bd63bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5641bd639bf0 0x5641bd63bfe0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd7ffff640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd700dc030 0x7fbd700a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd700dc030 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.573+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd700dc030 0x7fbd700a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd700dc030 0x7fbd700a8a60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8001f070 con 0x7fbd700dc030 2024-09-14T10:46:18.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd87fa7640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd80031040 0x7fbd80032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd80031040 2024-09-14T10:46:18.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd80031040 0x7fbd80032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd80031040 0x7fbd80032940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd6339a0 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd6339a0 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd80031040 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd80031040 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd700dc030 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8001f070 con 0x7fbd700dc030 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.577+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd6339a0 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd80031040 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd6339a0 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd700dc030 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd8001f070 con 0x7fbd700dc030 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd80031040 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd6339a0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd6339a0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd80031040 2024-09-14T10:46:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.581+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd700dc030 2024-09-14T10:46:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8001f070 con 0x7fbd700dc030 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd6339a0 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd700dc030 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8001f070 con 0x7fbd700dc030 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd80031040 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd700dc030 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8001f070 con 0x7fbd700dc030 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd639bf0 2024-09-14T10:46:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x7fbd80031040 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63c5c0 con 0x5641bd6339a0 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbd7805b080 con 0x7fbd700dc030 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd638800 con 0x5641bd6339a0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.585+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6390a0 con 0x5641bd6339a0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6390a0 con 0x5641bd6339a0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 zone default found 2024-09-14T10:46:18.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 4 Realm: () 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 zonegroup default 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6390c0 con 0x7fbd700dc030 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63e980 con 0x5641bd639bf0 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63edc0 con 0x5641bd639bf0 2024-09-14T10:46:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 started sync module instance, tier type = 2024-09-14T10:46:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63de10 con 0x7fbd700dc030 2024-09-14T10:46:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94840350302720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63f6d0 con 0x7fbd700dc030 2024-09-14T10:46:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63ff20 con 0x5641bd6339a0 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.589+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94840350302720] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.593+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.593+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94840350306848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63fb30 con 0x5641bd6339a0 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.593+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd640630 con 0x5641bd639bf0 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.593+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94840350306848] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.593+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.593+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94840350310688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd640a20 con 0x5641bd639bf0 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.593+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6413e0 con 0x7fbd700dc030 2024-09-14T10:46:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.597+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.597+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94840350314560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd641c80 con 0x7fbd700dc030 2024-09-14T10:46:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.597+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd642680 con 0x5641bd6339a0 2024-09-14T10:46:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.597+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94840350310688] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.597+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94840350314560] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.597+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.597+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94840350307904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6417d0 con 0x5641bd6339a0 2024-09-14T10:46:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.597+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd642f20 con 0x7fbd80031040 2024-09-14T10:46:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.601+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94840350307904] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.601+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.601+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94840350318992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6417d0 con 0x7fbd80031040 2024-09-14T10:46:18.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.601+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd643370 con 0x7fbd80031040 2024-09-14T10:46:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.601+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94840350318992] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.601+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.601+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94840350320736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd643330 con 0x7fbd80031040 2024-09-14T10:46:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.601+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd643d30 con 0x7fbd80031040 2024-09-14T10:46:18.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94840350324800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd644150 con 0x7fbd80031040 2024-09-14T10:46:18.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 add_watcher() i=0 2024-09-14T10:46:18.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 add_watcher() i=1 2024-09-14T10:46:18.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 add_watcher() i=2 2024-09-14T10:46:18.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 add_watcher() i=3 2024-09-14T10:46:18.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 add_watcher() i=4 2024-09-14T10:46:18.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 add_watcher() i=5 2024-09-14T10:46:18.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94840350320736] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 add_watcher() i=6 2024-09-14T10:46:18.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94840350324800] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 add_watcher() i=7 2024-09-14T10:46:18.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:18.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd642e80 con 0x5641bd6339a0 2024-09-14T10:46:18.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94840350322304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd644690 con 0x5641bd6339a0 2024-09-14T10:46:18.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94840350322304] v34'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbc3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:18.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:18.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.605+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd64ffa0 con 0x5641bd6339a0 2024-09-14T10:46:18.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.609+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.609+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd64ffa0 con 0x7fbd80031040 2024-09-14T10:46:18.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.609+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.609+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd64ffa0 con 0x5641bd639bf0 2024-09-14T10:46:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.613+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.613+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6505b0 con 0x5641bd6339a0 2024-09-14T10:46:18.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.613+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.613+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6504a0 con 0x7fbd700dc030 2024-09-14T10:46:18.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.613+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'81 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.613+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd650af0 con 0x5641bd639bf0 2024-09-14T10:46:18.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.613+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.613+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd650ee0 con 0x5641bd6339a0 2024-09-14T10:46:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.617+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.617+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd650ff0 con 0x7fbd80031040 2024-09-14T10:46:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.621+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.621+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd650ff0 con 0x7fbd700dc030 2024-09-14T10:46:18.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.621+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.621+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd651600 con 0x5641bd639bf0 2024-09-14T10:46:18.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.621+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.621+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6519a0 con 0x7fbd700dc030 2024-09-14T10:46:18.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.621+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.621+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd651f10 con 0x7fbd80031040 2024-09-14T10:46:18.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.625+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.625+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd651f10 con 0x7fbd700dc030 2024-09-14T10:46:18.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.625+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.625+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x7fbd80031040 2024-09-14T10:46:18.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.629+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.629+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd6339a0 2024-09-14T10:46:18.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.629+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.629+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.629+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.629+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x7fbd700dc030 2024-09-14T10:46:18.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.633+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.633+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.633+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.633+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd6339a0 2024-09-14T10:46:18.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.633+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.633+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd6339a0 2024-09-14T10:46:18.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.637+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.637+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.637+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.637+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x7fbd700dc030 2024-09-14T10:46:18.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.637+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.637+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.641+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.641+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.641+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.641+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.641+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.641+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.645+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.645+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x7fbd80031040 2024-09-14T10:46:18.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.645+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.645+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.645+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.645+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x7fbd80031040 2024-09-14T10:46:18.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.649+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.649+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x5641bd639bf0 2024-09-14T10:46:18.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.649+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.649+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x7fbd80031040 2024-09-14T10:46:18.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.653+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.653+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd6523c0 con 0x7fbd700dc030 2024-09-14T10:46:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.653+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.653+0000 7fbc3cfe1640 20 reqs_thread_entry: start 2024-09-14T10:46:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.653+0000 7fbd89ca09c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:18.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.653+0000 7fbd89ca09c0 20 Filter name: none 2024-09-14T10:46:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbbb67fc640 20 reqs_thread_entry: start 2024-09-14T10:46:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-14T10:46:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd66d4f0 con 0x5641bd639bf0 2024-09-14T10:46:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 20 rados_obj.operate() r=0 bl.length=363 2024-09-14T10:46:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-14T10:46:18.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-14T10:46:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd66ff80 con 0x5641bd639bf0 2024-09-14T10:46:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 10 removing key index: true_admin_akey 2024-09-14T10:46:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd66df60 con 0x5641bd639bf0 2024-09-14T10:46:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(96 true_admin_akey [delete] v34'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-14T10:46:18.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94840350501488 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd670530 con 0x7fbd80031040 2024-09-14T10:46:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== watch-notify(notify (1) cookie 94840350318992 notify 146028888105 ret 0) ==== 207+0+0 (crc 0 0 0) 0x5641bd6519a0 con 0x7fbd80031040 2024-09-14T10:46:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbc6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94840350318992 notifier 4865 bl.length()=165 2024-09-14T10:46:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(97 notify.5 [notify cookie 94840350501488 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbc6a7fc640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbc4c003d70 con 0x7fbd80031040 2024-09-14T10:46:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== watch-notify(notify_complete (2) cookie 94840350501488 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641bd5fbe70 con 0x7fbd80031040 2024-09-14T10:46:18.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 10 removing email index: 2024-09-14T10:46:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 10 removing user buckets index 2024-09-14T10:46:18.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.657+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd670430 con 0x5641bd639bf0 2024-09-14T10:46:18.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(99 a_user.buckets [delete] v34'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd89ca09c0 10 removing user index: a_user 2024-09-14T10:46:18.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd670430 con 0x5641bd639bf0 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(100 a_user [call,call,delete] v34'10 uv10 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd89ca09c0 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd89ca09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94840350506880 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641bd66ea70 con 0x5641bd639bf0 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 31 ==== watch-notify(notify (1) cookie 94840350310688 notify 146028888074 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5641bd651040 con 0x5641bd639bf0 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 32 ==== osd_op_reply(101 notify.2 [notify cookie 94840350506880 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbc6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94840350310688 notifier 4865 bl.length()=155 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbc6a7fc640 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbc4c003d70 con 0x5641bd639bf0 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 33 ==== watch-notify(notify_complete (2) cookie 94840350506880 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641bd5128c0 con 0x5641bd639bf0 2024-09-14T10:46:18.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbc3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.661+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94840350322304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd66ff80 con 0x5641bd6339a0 2024-09-14T10:46:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94840350322304] v34'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94840350302720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd642e80 con 0x7fbd700dc030 2024-09-14T10:46:18.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94840350302720] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd89ca09c0 20 remove_watcher() i=0 2024-09-14T10:46:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd89ca09c0 2 removed watcher, disabling cache 2024-09-14T10:46:18.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94840350306848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63e200 con 0x5641bd6339a0 2024-09-14T10:46:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94840350306848] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd89ca09c0 20 remove_watcher() i=1 2024-09-14T10:46:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.665+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94840350310688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63e200 con 0x5641bd639bf0 2024-09-14T10:46:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.669+0000 7fbd7ffff640 1 -- 172.21.15.96:0/998425231 <== osd.3 v2:172.21.15.96:6800/3683402699 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94840350310688] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd700ce020 con 0x5641bd639bf0 2024-09-14T10:46:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.669+0000 7fbd89ca09c0 20 remove_watcher() i=2 2024-09-14T10:46:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.669+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94840350314560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd640120 con 0x7fbd700dc030 2024-09-14T10:46:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.669+0000 7fbd87fa7640 1 -- 172.21.15.96:0/998425231 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94840350314560] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80040040 con 0x7fbd700dc030 2024-09-14T10:46:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.669+0000 7fbd89ca09c0 20 remove_watcher() i=3 2024-09-14T10:46:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.669+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94840350307904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63e200 con 0x5641bd6339a0 2024-09-14T10:46:18.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.673+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94840350307904] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x5641bd6339a0 2024-09-14T10:46:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.673+0000 7fbd89ca09c0 20 remove_watcher() i=4 2024-09-14T10:46:18.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.673+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94840350318992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63e200 con 0x7fbd80031040 2024-09-14T10:46:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.673+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94840350318992] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.673+0000 7fbd89ca09c0 20 remove_watcher() i=5 2024-09-14T10:46:18.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.673+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94840350320736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63e200 con 0x7fbd80031040 2024-09-14T10:46:18.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94840350320736] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 20 remove_watcher() i=6 2024-09-14T10:46:18.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94840350324800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641bd63e200 con 0x7fbd80031040 2024-09-14T10:46:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94840350324800] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7802e070 con 0x7fbd80031040 2024-09-14T10:46:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 20 remove_watcher() i=7 2024-09-14T10:46:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd80031040 msgr2=0x7fbd80032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fbd80031040 0x7fbd80032940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd6339a0 msgr2=0x5641bd635e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd6339a0 0x5641bd635e60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd700dc030 msgr2=0x7fbd700a8a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbd700dc030 0x7fbd700a8a60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5641bd639bf0 msgr2=0x5641bd63bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5641bd639bf0 0x5641bd63bfe0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5003a150 msgr2=0x7fbc5003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc5003a150 0x7fbc5003c610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5641bd5fce50 tx=0x7fbd8001f000 comp rx=0 tx=0).stop 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 msgr2=0x5641bd512360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd877a6640 1 -- 172.21.15.96:0/998425231 reap_dead start 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd512360 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbd700c7d40 tx=0x7fbd700ec920 comp rx=0 tx=0).stop 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 shutdown_connections 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/998425231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd61fce0 0x5641bd512360 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 >> 172.21.15.96:0/998425231 conn(0x5641bd61b100 msgr2=0x5641bd619310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 shutdown_connections 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/998425231 wait complete. 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1419067034 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6003a190 msgr2=0x7fbc6003c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1419067034 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6003a190 0x7fbc6003c650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5641bd602e20 tx=0x7fbd80005850 comp rx=0 tx=0).stop 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1419067034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd612490 msgr2=0x5641bd6128b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1419067034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd612490 0x5641bd6128b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbd700ab040 tx=0x7fbd70018170 comp rx=0 tx=0).stop 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1419067034 shutdown_connections 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1419067034 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6003a190 0x7fbc6003c650 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1419067034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd612490 0x5641bd6128b0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1419067034 >> 172.21.15.96:0/1419067034 conn(0x5641bd607e40 msgr2=0x5641bd608220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1419067034 shutdown_connections 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.677+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1419067034 wait complete. 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd50b040 msgr2=0x5641bd601e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd50b040 0x5641bd601e40 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6c03a150 msgr2=0x7fbc6c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6c03a150 0x7fbc6c03c610 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd700ad000 tx=0x7fbd700a6000 comp rx=0 tx=0).stop 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 msgr2=0x5641bd5facd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5facd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x5641bd5f4390 tx=0x7fbd78000ee0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 shutdown_connections 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5641bd50b040 0x5641bd601e40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbc6c03a150 0x7fbc6c03c610 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 --2- 172.21.15.96:0/1301177205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641bd506e50 0x5641bd5facd0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 >> 172.21.15.96:0/1301177205 conn(0x5641bd502970 msgr2=0x5641bd5f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 shutdown_connections 2024-09-14T10:46:18.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.681+0000 7fbd89ca09c0 1 -- 172.21.15.96:0/1301177205 wait complete. 2024-09-14T10:46:18.691 ERROR:root:None 2024-09-14T10:46:18.692 ERROR:root:0 2024-09-14T10:46:18.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-14T10:46:18.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-14T10:46:18.692 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-14T10:46:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:18.768 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:18.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7c54a9c0 1 Processor -- start 2024-09-14T10:46:18.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7c54a9c0 1 -- start start 2024-09-14T10:46:18.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7c54a9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d459939640 0x55d4599cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7c54a9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d45986d7a0 con 0x55d459939260 2024-09-14T10:46:18.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7c54a9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55d4598c91b0 con 0x55d459939640 2024-09-14T10:46:18.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7984f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d459939640 0x55d4599cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7984f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55d459939640 0x55d4599cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51736/0 (socket says 172.21.15.96:51736) 2024-09-14T10:46:18.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7984f640 1 -- 172.21.15.96:0/1692346239 learned_addr learned my addr 172.21.15.96:0/1692346239 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7984f640 1 -- 172.21.15.96:0/1692346239 >> v1:172.21.15.70:6789/0 conn(0x55d459939260 legacy=0x55d4599ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7984f640 1 -- 172.21.15.96:0/1692346239 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d459847da0 con 0x55d459939640 2024-09-14T10:46:18.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.769+0000 7f7f7984f640 1 --2- 172.21.15.96:0/1692346239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939640 0x55d4599cd7c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000a5c0 tx=0x7f7f7001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd46652ffc244356 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7904e640 1 -- 172.21.15.96:0/1692346239 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f700a6070 con 0x55d459939640 2024-09-14T10:46:18.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7904e640 1 -- 172.21.15.96:0/1692346239 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700af070 con 0x55d459939640 2024-09-14T10:46:18.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7904e640 1 -- 172.21.15.96:0/1692346239 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f700aa5c0 con 0x55d459939640 2024-09-14T10:46:18.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1692346239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939640 msgr2=0x55d4599cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/1692346239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939640 0x55d4599cd7c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000a5c0 tx=0x7f7f7001b340 comp rx=0 tx=0).stop 2024-09-14T10:46:18.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1692346239 shutdown_connections 2024-09-14T10:46:18.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/1692346239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939640 0x55d4599cd7c0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1692346239 >> 172.21.15.96:0/1692346239 conn(0x55d4599bf980 msgr2=0x55d4599c1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1692346239 shutdown_connections 2024-09-14T10:46:18.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.773+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1692346239 wait complete. 2024-09-14T10:46:18.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7c54a9c0 1 Processor -- start 2024-09-14T10:46:18.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7c54a9c0 1 -- start start 2024-09-14T10:46:18.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7c54a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7c54a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d4598ccfc0 con 0x55d459939260 2024-09-14T10:46:18.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7a050640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7a050640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51748/0 (socket says 172.21.15.96:51748) 2024-09-14T10:46:18.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7a050640 1 -- 172.21.15.96:0/1447268830 learned_addr learned my addr 172.21.15.96:0/1447268830 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7a050640 1 -- 172.21.15.96:0/1447268830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d459ab2c30 con 0x55d459939260 2024-09-14T10:46:18.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7f7a050640 1 --2- 172.21.15.96:0/1447268830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab2640 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c001680 tx=0x7f7f6c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33ac0ff3fc0fb55 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7e68608640 1 -- 172.21.15.96:0/1447268830 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c016070 con 0x55d459939260 2024-09-14T10:46:18.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7e68608640 1 -- 172.21.15.96:0/1447268830 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6c00f660 con 0x55d459939260 2024-09-14T10:46:18.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.785+0000 7f7e68608640 1 -- 172.21.15.96:0/1447268830 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c00f980 con 0x55d459939260 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1447268830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 msgr2=0x55d459ab2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/1447268830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab2640 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c001680 tx=0x7f7f6c001b40 comp rx=0 tx=0).stop 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1447268830 shutdown_connections 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/1447268830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab2640 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1447268830 >> 172.21.15.96:0/1447268830 conn(0x55d4599bf980 msgr2=0x55d459aae230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1447268830 shutdown_connections 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1447268830 wait complete. 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 Processor -- start 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- start start 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d45986ea50 con 0x55d459939260 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7a050640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7a050640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51758/0 (socket says 172.21.15.96:51758) 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7a050640 1 -- 172.21.15.96:0/83591993 learned_addr learned my addr 172.21.15.96:0/83591993 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7a050640 1 -- 172.21.15.96:0/83591993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d459aba470 con 0x55d459939260 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7a050640 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab9f10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55d459ab3600 tx=0x7f7f6c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7e66e05640 1 -- 172.21.15.96:0/83591993 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c016040 con 0x55d459939260 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d459aba700 con 0x55d459939260 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d459abb0b0 con 0x55d459939260 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7e66e05640 1 -- 172.21.15.96:0/83591993 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6c022070 con 0x55d459939260 2024-09-14T10:46:18.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7e66e05640 1 -- 172.21.15.96:0/83591993 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c0062b0 con 0x55d459939260 2024-09-14T10:46:18.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.789+0000 7f7e66e05640 1 -- 172.21.15.96:0/83591993 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7f6c0114c0 con 0x55d459939260 2024-09-14T10:46:18.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7e66e05640 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e6003a100 0x7f7e6003c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7e66e05640 1 -- 172.21.15.96:0/83591993 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7f6c050750 con 0x55d459939260 2024-09-14T10:46:18.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7984f640 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e6003a100 0x7f7e6003c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459939640 0x55d459ac1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459ac15c0 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7a851640 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459939640 0x55d459ac1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7984f640 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e6003a100 0x7f7e6003c5c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f700ae000 tx=0x7f7f700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7a851640 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459939640 0x55d459ac1080 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7a851640 1 -- 172.21.15.96:0/83591993 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f740083f0 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459ac1a10 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7a851640 1 -- 172.21.15.96:0/83591993 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f740083f0 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459ac3310 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7a851640 1 -- 172.21.15.96:0/83591993 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7f740083f0 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459ac2540 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7a851640 1 -- 172.21.15.96:0/83591993 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f740083f0 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459ac2960 con 0x55d459939640 2024-09-14T10:46:18.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7a851640 1 -- 172.21.15.96:0/83591993 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7f740083f0 con 0x55d459939640 2024-09-14T10:46:18.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 Processor -- start 2024-09-14T10:46:18.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 -- start start 2024-09-14T10:46:18.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459ad1700 0x55d459ad1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7c54a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d4598d9d80 con 0x55d459ad1700 2024-09-14T10:46:18.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7984f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459ad1700 0x55d459ad1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7984f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459ad1700 0x55d459ad1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51762/0 (socket says 172.21.15.96:51762) 2024-09-14T10:46:18.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.793+0000 7f7f7984f640 1 -- 172.21.15.96:0/2631130156 learned_addr learned my addr 172.21.15.96:0/2631130156 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7984f640 1 -- 172.21.15.96:0/2631130156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d459ad2160 con 0x55d459ad1700 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7984f640 1 --2- 172.21.15.96:0/2631130156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459ad1700 0x55d459ad1b20 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7f70000c10 tx=0x7f7f700180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7e5ffff640 1 -- 172.21.15.96:0/2631130156 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f700b3b90 con 0x55d459ad1700 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7e5ffff640 1 -- 172.21.15.96:0/2631130156 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700b3d30 con 0x55d459ad1700 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/2631130156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d459ad29c0 con 0x55d459ad1700 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7e5ffff640 1 -- 172.21.15.96:0/2631130156 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f700c8560 con 0x55d459ad1700 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/2631130156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d459ad2ed0 con 0x55d459ad1700 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7e5ffff640 1 -- 172.21.15.96:0/2631130156 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7f700d1440 con 0x55d459ad1700 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7e5ffff640 1 --2- 172.21.15.96:0/2631130156 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e5403a1a0 0x7f7e5403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7e5ffff640 1 -- 172.21.15.96:0/2631130156 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7f700ee470 con 0x55d459ad1700 2024-09-14T10:46:18.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7a851640 1 --2- 172.21.15.96:0/2631130156 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e5403a1a0 0x7f7e5403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7c54a9c0 1 Processor -- start 2024-09-14T10:46:18.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7a851640 1 --2- 172.21.15.96:0/2631130156 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e5403a1a0 0x7f7e5403c660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55d459ac28e0 tx=0x7f7f74003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7c54a9c0 1 -- start start 2024-09-14T10:46:18.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7c54a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459adf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7c54a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d459ab3060 con 0x55d459adef50 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7984f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459adf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7984f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459adf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51764/0 (socket says 172.21.15.96:51764) 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7984f640 1 -- 172.21.15.96:0/1514823834 learned_addr learned my addr 172.21.15.96:0/1514823834 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.797+0000 7f7f7984f640 1 -- 172.21.15.96:0/1514823834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d459adf940 con 0x55d459adef50 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7984f640 1 --2- 172.21.15.96:0/1514823834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459adf350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7f700ec730 tx=0x7f7f700bd8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9fe9313090dc85 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7e5dffb640 1 -- 172.21.15.96:0/1514823834 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f700e0070 con 0x55d459adef50 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7e5dffb640 1 -- 172.21.15.96:0/1514823834 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700be540 con 0x55d459adef50 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7e5dffb640 1 -- 172.21.15.96:0/1514823834 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f700bcdd0 con 0x55d459adef50 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1514823834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 msgr2=0x55d459adf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/1514823834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459adf350 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7f700ec730 tx=0x7f7f700bd8f0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1514823834 shutdown_connections 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/1514823834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459adf350 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1514823834 >> 172.21.15.96:0/1514823834 conn(0x55d459ada370 msgr2=0x55d459ad85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1514823834 shutdown_connections 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/1514823834 wait complete. 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 Processor -- start 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- start start 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459ae54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d459addea0 con 0x55d459adef50 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7984f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459ae54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7984f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459ae54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51780/0 (socket says 172.21.15.96:51780) 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 learned_addr learned my addr 172.21.15.96:0/3783764392 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d459ae5a20 con 0x55d459adef50 2024-09-14T10:46:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7984f640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459ae54c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7f700bd780 tx=0x7f7f700ec690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7e4bfff640 1 -- 172.21.15.96:0/3783764392 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f700eb020 con 0x55d459adef50 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d459ae5cb0 con 0x55d459adef50 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7e4bfff640 1 -- 172.21.15.96:0/3783764392 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700ec350 con 0x55d459adef50 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7e4bfff640 1 -- 172.21.15.96:0/3783764392 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f700e0030 con 0x55d459adef50 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.801+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d459ae6660 con 0x55d459adef50 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7e4bfff640 1 -- 172.21.15.96:0/3783764392 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f7f700ecb10 con 0x55d459adef50 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7e4bfff640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e4403a150 0x7f7e4403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7e4bfff640 1 -- 172.21.15.96:0/3783764392 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7f700e1070 con 0x55d459adef50 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a851640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e4403a150 0x7f7e4403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459af0a20 0x55d459af2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af3600 con 0x55d459af0a20 2024-09-14T10:46:18.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a050640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459af0a20 0x55d459af2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a851640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e4403a150 0x7f7e4403c610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400f010 tx=0x7f7f7401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a050640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459af0a20 0x55d459af2eb0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 realm 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af3a10 con 0x55d459af0a20 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af42e0 con 0x55d459af0a20 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af4680 con 0x55d459af0a20 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af4ed0 con 0x55d459af0a20 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 20 searching for the correct realm 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d459af6c40 0x55d459af9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7984f640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d459af6c40 0x55d459af9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7984f640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d459af6c40 0x55d459af9030 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7984f640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7f70009040 0x7f7f700c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f70009040 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a851640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7f70009040 0x7f7f700c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a851640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7f70009040 0x7f7f700c7ae0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a851640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7f74019040 0x7f7f74019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.805+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f74019040 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7f74019040 0x7f7f74019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7f74019040 0x7f7f74019930 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af0a20 2024-09-14T10:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af0a20 2024-09-14T10:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f74019040 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f74019040 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f70009040 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af0a20 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.809+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f74019040 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af0a20 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f70009040 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f74019040 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af0a20 2024-09-14T10:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af0a20 2024-09-14T10:46:18.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f74019040 2024-09-14T10:46:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.813+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f70009040 2024-09-14T10:46:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af0a20 2024-09-14T10:46:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f70009040 2024-09-14T10:46:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f74019040 2024-09-14T10:46:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f70009040 2024-09-14T10:46:18.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af6c40 2024-09-14T10:46:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f74019040 2024-09-14T10:46:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x55d459af0a20 2024-09-14T10:46:18.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d459af95c0 con 0x7f7f70009040 2024-09-14T10:46:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:18.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af5820 con 0x55d459af0a20 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af60c0 con 0x55d459af0a20 2024-09-14T10:46:18.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af60c0 con 0x55d459af0a20 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.817+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 zone default found 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 4 Realm: () 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 zonegroup default 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459af9a20 con 0x7f7f70009040 2024-09-14T10:46:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459afb8b0 con 0x55d459af6c40 2024-09-14T10:46:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459afbdf0 con 0x55d459af6c40 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 started sync module instance, tier type = 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afac50 con 0x7f7f70009040 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94370526114160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afac50 con 0x7f7f70009040 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afc8d0 con 0x55d459af0a20 2024-09-14T10:46:18.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.821+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94370526114160] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94370526118848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afac50 con 0x55d459af0a20 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afd2e0 con 0x55d459af6c40 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94370526118848] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94370526111648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afabc0 con 0x55d459af6c40 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afe070 con 0x7f7f70009040 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94370526124928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afe940 con 0x7f7f70009040 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.825+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459aff360 con 0x55d459af0a20 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94370526111648] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94370526124928] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94370526129744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afe490 con 0x55d459af0a20 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459affc00 con 0x7f7f74019040 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94370526129744] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94370526123728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afe490 con 0x7f7f74019040 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.829+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b000d0 con 0x7f7f74019040 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.833+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94370526123728] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.833+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.833+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94370526133152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b00090 con 0x7f7f74019040 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.833+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b00ad0 con 0x7f7f74019040 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.833+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94370526133152] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94370526135712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b00a90 con 0x7f7f74019040 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 add_watcher() i=0 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 add_watcher() i=1 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 add_watcher() i=2 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 add_watcher() i=3 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 add_watcher() i=4 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 add_watcher() i=5 2024-09-14T10:46:18.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 add_watcher() i=6 2024-09-14T10:46:18.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94370526135712] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 add_watcher() i=7 2024-09-14T10:46:18.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:18.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459b03ec0 con 0x55d459af0a20 2024-09-14T10:46:18.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94370526131504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b013b0 con 0x55d459af0a20 2024-09-14T10:46:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94370526131504] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.837+0000 7f7f7c54a9c0 5 note: GC not initialized 2024-09-14T10:46:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7dab7fe640 20 reqs_thread_entry: start 2024-09-14T10:46:18.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 20 Filter name: none 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7da97fa640 20 reqs_thread_entry: start 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459b27740 con 0x7f7f74019040 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:18.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:18.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:18.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b2e140 con 0x7f7f74019040 2024-09-14T10:46:18.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.841+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94370526321584 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d459b29830 con 0x55d459af0a20 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94370526129744 notify 146028888104 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f7f6c056040 con 0x55d459af0a20 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7e5dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94370526129744 notifier 4872 bl.length()=666 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7e5dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7e5dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7e5dffb640 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7e40003eb0 con 0x55d459af0a20 2024-09-14T10:46:18.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 94370526321584 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94370526321584 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d459abb0b0 con 0x55d459af0a20 2024-09-14T10:46:18.851 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:18.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94370526131504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b252e0 con 0x55d459af0a20 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94370526131504] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94370526114160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b252e0 con 0x7f7f70009040 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94370526114160] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7c54a9c0 20 remove_watcher() i=0 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7c54a9c0 2 removed watcher, disabling cache 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.845+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94370526118848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b252e0 con 0x55d459af0a20 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.849+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94370526118848] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.849+0000 7f7f7c54a9c0 20 remove_watcher() i=1 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.849+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94370526111648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459b252e0 con 0x55d459af6c40 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.849+0000 7f7f7984f640 1 -- 172.21.15.96:0/3783764392 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94370526111648] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f700f4020 con 0x55d459af6c40 2024-09-14T10:46:18.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.849+0000 7f7f7c54a9c0 20 remove_watcher() i=2 2024-09-14T10:46:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.849+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94370526124928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afa7a0 con 0x7f7f70009040 2024-09-14T10:46:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.853+0000 7f7f7a851640 1 -- 172.21.15.96:0/3783764392 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94370526124928] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7402f040 con 0x7f7f70009040 2024-09-14T10:46:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.853+0000 7f7f7c54a9c0 20 remove_watcher() i=3 2024-09-14T10:46:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.853+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94370526129744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afa7a0 con 0x55d459af0a20 2024-09-14T10:46:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.853+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94370526129744] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x55d459af0a20 2024-09-14T10:46:18.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.853+0000 7f7f7c54a9c0 20 remove_watcher() i=4 2024-09-14T10:46:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.853+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94370526123728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afee50 con 0x7f7f74019040 2024-09-14T10:46:18.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.857+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94370526123728] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.857+0000 7f7f7c54a9c0 20 remove_watcher() i=5 2024-09-14T10:46:18.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.857+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94370526133152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afa7a0 con 0x7f7f74019040 2024-09-14T10:46:18.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.857+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94370526133152] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.857+0000 7f7f7c54a9c0 20 remove_watcher() i=6 2024-09-14T10:46:18.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.857+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94370526135712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d459afee50 con 0x7f7f74019040 2024-09-14T10:46:18.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94370526135712] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c00f070 con 0x7f7f74019040 2024-09-14T10:46:18.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 20 remove_watcher() i=7 2024-09-14T10:46:18.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7f74019040 msgr2=0x7f7f74019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f7f74019040 0x7f7f74019930 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459af0a20 msgr2=0x55d459af2eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459af0a20 0x55d459af2eb0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7f70009040 msgr2=0x7f7f700c7ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f7f70009040 0x7f7f700c7ae0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d459af6c40 msgr2=0x55d459af9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55d459af6c40 0x55d459af9030 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e4403a150 msgr2=0x7f7e4403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e4403a150 0x7f7e4403c610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400f010 tx=0x7f7f7401b070 comp rx=0 tx=0).stop 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 msgr2=0x55d459ae54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/3783764392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459adef50 0x55d459ae54c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7f700bd780 tx=0x7f7f700ec690 comp rx=0 tx=0).stop 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7a050640 1 -- 172.21.15.96:0/3783764392 reap_dead start 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 shutdown_connections 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 >> 172.21.15.96:0/3783764392 conn(0x55d459ada370 msgr2=0x55d459ad8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 shutdown_connections 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/3783764392 wait complete. 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/2631130156 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e5403a1a0 msgr2=0x7f7e5403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/2631130156 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e5403a1a0 0x7f7e5403c660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55d459ac28e0 tx=0x7f7f74003070 comp rx=0 tx=0).stop 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/2631130156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459ad1700 msgr2=0x55d459ad1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/2631130156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459ad1700 0x55d459ad1b20 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7f70000c10 tx=0x7f7f700180e0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/2631130156 shutdown_connections 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/2631130156 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e5403a1a0 0x7f7e5403c660 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/2631130156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459ad1700 0x55d459ad1b20 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/2631130156 >> 172.21.15.96:0/2631130156 conn(0x55d459ac70b0 msgr2=0x55d459ac7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/2631130156 shutdown_connections 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/2631130156 wait complete. 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459939640 msgr2=0x55d459ac1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459939640 0x55d459ac1080 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e6003a100 msgr2=0x7f7e6003c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e6003a100 0x7f7e6003c5c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f700ae000 tx=0x7f7f700a6000 comp rx=0 tx=0).stop 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 msgr2=0x55d459ab9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab9f10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55d459ab3600 tx=0x7f7f6c000f50 comp rx=0 tx=0).stop 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 shutdown_connections 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55d459939640 0x55d459ac1080 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f7e6003a100 0x7f7e6003c5c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 --2- 172.21.15.96:0/83591993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d459939260 0x55d459ab9f10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 >> 172.21.15.96:0/83591993 conn(0x55d4599bf980 msgr2=0x55d459ab3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 shutdown_connections 2024-09-14T10:46:18.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.861+0000 7f7f7c54a9c0 1 -- 172.21.15.96:0/83591993 wait complete. 2024-09-14T10:46:18.872 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:18.872 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:18.872 ERROR:root:0 2024-09-14T10:46:18.872 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:18.877 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:18.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-14T10:46:18.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-14T10:46:18.877 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-14T10:46:18.951 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:18.951 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:18.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.949+0000 7f43f485d9c0 1 Processor -- start 2024-09-14T10:46:18.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.949+0000 7f43f485d9c0 1 -- start start 2024-09-14T10:46:18.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.949+0000 7f43f485d9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562f7c14d050 0x562f7c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.949+0000 7f43f485d9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f7bff27a0 con 0x562f7c148e60 2024-09-14T10:46:18.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.949+0000 7f43f485d9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x562f7c04e1b0 con 0x562f7c14d050 2024-09-14T10:46:18.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f1b62640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562f7c14d050 0x562f7c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f2363640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x562f7c148e60 0x562f7c149240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38326/0 (socket says 172.21.15.96:38326) 2024-09-14T10:46:18.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f2363640 1 -- 172.21.15.96:0/3997904394 learned_addr learned my addr 172.21.15.96:0/3997904394 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:46:18.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f1b62640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x562f7c14d050 0x562f7c14f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51784/0 (socket says 172.21.15.96:51784) 2024-09-14T10:46:18.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f1b62640 1 -- 172.21.15.96:0/3997904394 >> v1:172.21.15.70:6789/0 conn(0x562f7c148e60 legacy=0x562f7c149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f1b62640 1 -- 172.21.15.96:0/3997904394 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7bfccda0 con 0x562f7c14d050 2024-09-14T10:46:18.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f1b62640 1 --2- 172.21.15.96:0/3997904394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c14d050 0x562f7c14f440 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f43e800a610 tx=0x7f43e801d1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563602b08efe778c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f1361640 1 -- 172.21.15.96:0/3997904394 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e80b1070 con 0x562f7c14d050 2024-09-14T10:46:18.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f1361640 1 -- 172.21.15.96:0/3997904394 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e800a200 con 0x562f7c14d050 2024-09-14T10:46:18.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.953+0000 7f43f1361640 1 -- 172.21.15.96:0/3997904394 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e80085a0 con 0x562f7c14d050 2024-09-14T10:46:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.957+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3997904394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c14d050 msgr2=0x562f7c14f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.957+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3997904394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c14d050 0x562f7c14f440 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f43e800a610 tx=0x7f43e801d1d0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.957+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3997904394 shutdown_connections 2024-09-14T10:46:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.957+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3997904394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c14d050 0x562f7c14f440 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.957+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3997904394 >> 172.21.15.96:0/3997904394 conn(0x562f7c144980 msgr2=0x562f7c146da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.957+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3997904394 shutdown_connections 2024-09-14T10:46:18.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.957+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3997904394 wait complete. 2024-09-14T10:46:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 Processor -- start 2024-09-14T10:46:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 -- start start 2024-09-14T10:46:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c233280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f7c051fc0 con 0x562f7c148e60 2024-09-14T10:46:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f2363640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c233280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f2363640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c233280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51790/0 (socket says 172.21.15.96:51790) 2024-09-14T10:46:18.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f2363640 1 -- 172.21.15.96:0/1382171833 learned_addr learned my addr 172.21.15.96:0/1382171833 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f2363640 1 -- 172.21.15.96:0/1382171833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7c233870 con 0x562f7c148e60 2024-09-14T10:46:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f2363640 1 --2- 172.21.15.96:0/1382171833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c233280 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f43ec001810 tx=0x7f43ec001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e43992d37141c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f42e0608640 1 -- 172.21.15.96:0/1382171833 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec004530 con 0x562f7c148e60 2024-09-14T10:46:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f42e0608640 1 -- 172.21.15.96:0/1382171833 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec0046d0 con 0x562f7c148e60 2024-09-14T10:46:18.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f42e0608640 1 -- 172.21.15.96:0/1382171833 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec0049f0 con 0x562f7c148e60 2024-09-14T10:46:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 -- 172.21.15.96:0/1382171833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 msgr2=0x562f7c233280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/1382171833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c233280 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f43ec001810 tx=0x7f43ec001cd0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 -- 172.21.15.96:0/1382171833 shutdown_connections 2024-09-14T10:46:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/1382171833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c233280 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 -- 172.21.15.96:0/1382171833 >> 172.21.15.96:0/1382171833 conn(0x562f7c144980 msgr2=0x562f7c22ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 -- 172.21.15.96:0/1382171833 shutdown_connections 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 -- 172.21.15.96:0/1382171833 wait complete. 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.969+0000 7f43f485d9c0 1 Processor -- start 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f485d9c0 1 -- start start 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f485d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c23ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f485d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f7bff3a50 con 0x562f7c148e60 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f2363640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c23ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f2363640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c23ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51804/0 (socket says 172.21.15.96:51804) 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f2363640 1 -- 172.21.15.96:0/3488351283 learned_addr learned my addr 172.21.15.96:0/3488351283 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f2363640 1 -- 172.21.15.96:0/3488351283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7c23f4f0 con 0x562f7c148e60 2024-09-14T10:46:18.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f2363640 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c23ef90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000f90 tx=0x7f43ec001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f42dee05640 1 -- 172.21.15.96:0/3488351283 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec013820 con 0x562f7c148e60 2024-09-14T10:46:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f7c23f780 con 0x562f7c148e60 2024-09-14T10:46:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7c240130 con 0x562f7c148e60 2024-09-14T10:46:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f42dee05640 1 -- 172.21.15.96:0/3488351283 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec0139c0 con 0x562f7c148e60 2024-09-14T10:46:18.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f42dee05640 1 -- 172.21.15.96:0/3488351283 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec013ca0 con 0x562f7c148e60 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f42dee05640 1 -- 172.21.15.96:0/3488351283 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f43ec010070 con 0x562f7c148e60 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f42dee05640 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42d803a150 0x7f42d803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f42dee05640 1 -- 172.21.15.96:0/3488351283 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f43ec018070 con 0x562f7c148e60 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f1b62640 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42d803a150 0x7f42d803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c14d050 0x562f7c246100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c246640 con 0x562f7c14d050 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c14d050 0x562f7c246100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f1b62640 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42d803a150 0x7f42d803c610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ae000 tx=0x7f43e80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.973+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c14d050 0x562f7c246100 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f2b64640 1 -- 172.21.15.96:0/3488351283 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43e40083f0 con 0x562f7c14d050 2024-09-14T10:46:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c246a70 con 0x562f7c14d050 2024-09-14T10:46:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f2b64640 1 -- 172.21.15.96:0/3488351283 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43e40083f0 con 0x562f7c14d050 2024-09-14T10:46:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c248370 con 0x562f7c14d050 2024-09-14T10:46:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f2b64640 1 -- 172.21.15.96:0/3488351283 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43e40083f0 con 0x562f7c14d050 2024-09-14T10:46:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2475a0 con 0x562f7c14d050 2024-09-14T10:46:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f2b64640 1 -- 172.21.15.96:0/3488351283 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43e40083f0 con 0x562f7c14d050 2024-09-14T10:46:18.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2479f0 con 0x562f7c14d050 2024-09-14T10:46:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f2b64640 1 -- 172.21.15.96:0/3488351283 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43e40083f0 con 0x562f7c14d050 2024-09-14T10:46:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 Processor -- start 2024-09-14T10:46:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 -- start start 2024-09-14T10:46:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c256730 0x562f7c256b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f7c05ed80 con 0x562f7c256730 2024-09-14T10:46:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f1b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c256730 0x562f7c256b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f1b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c256730 0x562f7c256b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51816/0 (socket says 172.21.15.96:51816) 2024-09-14T10:46:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f1b62640 1 -- 172.21.15.96:0/3981126675 learned_addr learned my addr 172.21.15.96:0/3981126675 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f1b62640 1 -- 172.21.15.96:0/3981126675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7c257190 con 0x562f7c256730 2024-09-14T10:46:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f1b62640 1 --2- 172.21.15.96:0/3981126675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c256730 0x562f7c256b50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f43e801d210 tx=0x7f43e8019f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f42d7fff640 1 -- 172.21.15.96:0/3981126675 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e80b1040 con 0x562f7c256730 2024-09-14T10:46:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3981126675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f7c2579f0 con 0x562f7c256730 2024-09-14T10:46:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f42d7fff640 1 -- 172.21.15.96:0/3981126675 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e80b9cd0 con 0x562f7c256730 2024-09-14T10:46:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3981126675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7c257f00 con 0x562f7c256730 2024-09-14T10:46:18.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.977+0000 7f42d7fff640 1 -- 172.21.15.96:0/3981126675 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e80b7450 con 0x562f7c256730 2024-09-14T10:46:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f42d7fff640 1 -- 172.21.15.96:0/3981126675 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f43e80b75f0 con 0x562f7c256730 2024-09-14T10:46:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f42d7fff640 1 --2- 172.21.15.96:0/3981126675 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42cc03a140 0x7f42cc03c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f42d7fff640 1 -- 172.21.15.96:0/3981126675 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f43e80edd80 con 0x562f7c256730 2024-09-14T10:46:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3981126675 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42cc03a140 0x7f42cc03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 Processor -- start 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 -- start start 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3981126675 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42cc03a140 0x7f42cc03c600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x562f7c2470c0 tx=0x7f43e4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c2643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f7c233ca0 con 0x562f7c263fa0 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f1b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c2643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f1b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c2643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51824/0 (socket says 172.21.15.96:51824) 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f1b62640 1 -- 172.21.15.96:0/4070238432 learned_addr learned my addr 172.21.15.96:0/4070238432 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f1b62640 1 -- 172.21.15.96:0/4070238432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7c264990 con 0x562f7c263fa0 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f1b62640 1 --2- 172.21.15.96:0/4070238432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c2643a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ebf70 tx=0x7f43e80064c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39851ae8bd3fc0a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f42d5ffb640 1 -- 172.21.15.96:0/4070238432 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e80e9070 con 0x562f7c263fa0 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f42d5ffb640 1 -- 172.21.15.96:0/4070238432 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e80ac920 con 0x562f7c263fa0 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f42d5ffb640 1 -- 172.21.15.96:0/4070238432 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e80c2390 con 0x562f7c263fa0 2024-09-14T10:46:18.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 -- 172.21.15.96:0/4070238432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 msgr2=0x562f7c2643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/4070238432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c2643a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ebf70 tx=0x7f43e80064c0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 -- 172.21.15.96:0/4070238432 shutdown_connections 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/4070238432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c2643a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 -- 172.21.15.96:0/4070238432 >> 172.21.15.96:0/4070238432 conn(0x562f7c25f3c0 msgr2=0x562f7c25d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 -- 172.21.15.96:0/4070238432 shutdown_connections 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.981+0000 7f43f485d9c0 1 -- 172.21.15.96:0/4070238432 wait complete. 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 1 Processor -- start 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 1 -- start start 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c26a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f7c262ef0 con 0x562f7c263fa0 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f1b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c26a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f1b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c26a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51828/0 (socket says 172.21.15.96:51828) 2024-09-14T10:46:18.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 learned_addr learned my addr 172.21.15.96:0/3864494660 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7c26aa20 con 0x562f7c263fa0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f1b62640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c26a4c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f43e8005880 tx=0x7f43e80ebfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f42c3fff640 1 -- 172.21.15.96:0/3864494660 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e80da070 con 0x562f7c263fa0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f7c26acb0 con 0x562f7c263fa0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f42c3fff640 1 -- 172.21.15.96:0/3864494660 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e80cd910 con 0x562f7c263fa0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f42c3fff640 1 -- 172.21.15.96:0/3864494660 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e80cdc50 con 0x562f7c263fa0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7c26b660 con 0x562f7c263fa0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f42c3fff640 1 -- 172.21.15.96:0/3864494660 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f43e80dd070 con 0x562f7c263fa0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f42c3fff640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42bc03a150 0x7f42bc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f42c3fff640 1 -- 172.21.15.96:0/3864494660 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f43e80f7d30 con 0x562f7c263fa0 2024-09-14T10:46:18.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42bc03a150 0x7f42bc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c275ad0 0x562f7c277f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2786b0 con 0x562f7c275ad0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f2363640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c275ad0 0x562f7c277f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.985+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42bc03a150 0x7f42bc03c610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f43e400f010 tx=0x7f43e401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2363640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c275ad0 0x562f7c277f60 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 realm 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c278ac0 con 0x562f7c275ad0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279390 con 0x562f7c275ad0 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:18.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279f80 con 0x562f7c275ad0 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 20 searching for the correct realm 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562f7c27b790 0x562f7c27dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27e290 con 0x562f7c27b790 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f1b62640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562f7c27b790 0x562f7c27dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f1b62640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562f7c27b790 0x562f7c27dc10 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f1b62640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f43e80aba20 0x7f43e80e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f43e80ff040 con 0x7f43e80aba20 2024-09-14T10:46:18.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f43e80aba20 0x7f43e80e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:18.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f43e80aba20 0x7f43e80e7a10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:18.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:18.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2b64640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f43e4019040 0x7f43e4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:18.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f43e80ff040 con 0x7f43e4019040 2024-09-14T10:46:18.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2363640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f43e4019040 0x7f43e4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.989+0000 7f43f2363640 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f43e4019040 0x7f43e4019930 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e4019040 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e4019040 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e80aba20 2024-09-14T10:46:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c27b790 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e4019040 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e80aba20 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.993+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c27b790 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c27b790 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e4019040 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c27b790 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c27b790 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e4019040 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c27b790 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e80aba20 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e80aba20 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c27b790 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:18.997+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e4019040 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e80aba20 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c27b790 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e4019040 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x562f7c275ad0 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562f7c279730 con 0x7f43e80aba20 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27ad60 con 0x562f7c275ad0 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27a5d0 con 0x562f7c275ad0 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27e710 con 0x562f7c275ad0 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 zone default found 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 4 Realm: () 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 zonegroup default 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27e7a0 con 0x7f43e80aba20 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c280a80 con 0x562f7c27b790 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c280e50 con 0x562f7c27b790 2024-09-14T10:46:19.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.001+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f485d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f485d9c0 20 started sync module instance, tier type = 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f485d9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27ff10 con 0x7f43e80aba20 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94761946448912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27ff10 con 0x7f43e80aba20 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c281910 con 0x562f7c275ad0 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94761946448912] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94761946453024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27ff10 con 0x562f7c275ad0 2024-09-14T10:46:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.005+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c282350 con 0x562f7c27b790 2024-09-14T10:46:19.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.009+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94761946453024] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.009+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.009+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94761946446432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27fe80 con 0x562f7c27b790 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.009+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c283100 con 0x7f43e80aba20 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.009+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.009+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94761946459120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2839a0 con 0x7f43e80aba20 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.009+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2843e0 con 0x562f7c275ad0 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.009+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94761946446432] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.013+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94761946459120] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.013+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.013+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94761946463920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2834f0 con 0x562f7c275ad0 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.013+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c284c80 con 0x7f43e4019040 2024-09-14T10:46:19.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.013+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94761946463920] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.013+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.013+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94761946457920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2834f0 con 0x7f43e4019040 2024-09-14T10:46:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.013+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c285150 con 0x7f43e4019040 2024-09-14T10:46:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94761946457920] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94761946467360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c285110 con 0x7f43e4019040 2024-09-14T10:46:19.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c285b50 con 0x7f43e4019040 2024-09-14T10:46:19.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94761946467360] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94761946469920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c285b10 con 0x7f43e4019040 2024-09-14T10:46:19.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 20 add_watcher() i=0 2024-09-14T10:46:19.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 20 add_watcher() i=1 2024-09-14T10:46:19.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 20 add_watcher() i=2 2024-09-14T10:46:19.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 20 add_watcher() i=3 2024-09-14T10:46:19.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 20 add_watcher() i=4 2024-09-14T10:46:19.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 20 add_watcher() i=5 2024-09-14T10:46:19.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.017+0000 7f43f485d9c0 20 add_watcher() i=6 2024-09-14T10:46:19.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94761946469920] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 20 add_watcher() i=7 2024-09-14T10:46:19.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:19.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c288f40 con 0x562f7c275ad0 2024-09-14T10:46:19.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94761946465712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c286430 con 0x562f7c275ad0 2024-09-14T10:46:19.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94761946465712] v34'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f42a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:19.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:19.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 5 note: GC not initialized 2024-09-14T10:46:19.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f42237fe640 20 reqs_thread_entry: start 2024-09-14T10:46:19.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:19.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 20 Filter name: none 2024-09-14T10:46:19.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f42217fa640 20 reqs_thread_entry: start 2024-09-14T10:46:19.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:19.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.021+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2ac7a0 con 0x7f43e4019040 2024-09-14T10:46:19.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-14T10:46:19.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:19.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:19.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2b3520 con 0x7f43e4019040 2024-09-14T10:46:19.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:19.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94761946656656 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2aebd0 con 0x562f7c275ad0 2024-09-14T10:46:19.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94761946463920 notify 146028888105 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f43ec056040 con 0x562f7c275ad0 2024-09-14T10:46:19.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 94761946656656 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f42d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94761946463920 notifier 4879 bl.length()=666 2024-09-14T10:46:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f42d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f42d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f42d5ffb640 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f42b8003eb0 con 0x562f7c275ad0 2024-09-14T10:46:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.025+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94761946656656 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562f7c240130 con 0x562f7c275ad0 2024-09-14T10:46:19.031 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:19.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.029+0000 7f42a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.029+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94761946465712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2aa340 con 0x562f7c275ad0 2024-09-14T10:46:19.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.029+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94761946465712] v34'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.029+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94761946448912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2aa340 con 0x7f43e80aba20 2024-09-14T10:46:19.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.029+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94761946448912] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.029+0000 7f43f485d9c0 20 remove_watcher() i=0 2024-09-14T10:46:19.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.029+0000 7f43f485d9c0 2 removed watcher, disabling cache 2024-09-14T10:46:19.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.029+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94761946453024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2aa340 con 0x562f7c275ad0 2024-09-14T10:46:19.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94761946453024] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f485d9c0 20 remove_watcher() i=1 2024-09-14T10:46:19.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94761946446432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c281420 con 0x562f7c27b790 2024-09-14T10:46:19.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f1b62640 1 -- 172.21.15.96:0/3864494660 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94761946446432] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e80dc030 con 0x562f7c27b790 2024-09-14T10:46:19.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f485d9c0 20 remove_watcher() i=2 2024-09-14T10:46:19.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94761946459120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2aa340 con 0x7f43e80aba20 2024-09-14T10:46:19.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f2b64640 1 -- 172.21.15.96:0/3864494660 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94761946459120] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43e402f040 con 0x7f43e80aba20 2024-09-14T10:46:19.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f485d9c0 20 remove_watcher() i=3 2024-09-14T10:46:19.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.033+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94761946463920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27fa60 con 0x562f7c275ad0 2024-09-14T10:46:19.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.037+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94761946463920] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x562f7c275ad0 2024-09-14T10:46:19.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.037+0000 7f43f485d9c0 20 remove_watcher() i=4 2024-09-14T10:46:19.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.037+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94761946457920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c2aa340 con 0x7f43e4019040 2024-09-14T10:46:19.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.037+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94761946457920] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.037+0000 7f43f485d9c0 20 remove_watcher() i=5 2024-09-14T10:46:19.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.037+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94761946467360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c283eb0 con 0x7f43e4019040 2024-09-14T10:46:19.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94761946467360] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 20 remove_watcher() i=6 2024-09-14T10:46:19.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94761946469920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562f7c27fa60 con 0x7f43e4019040 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94761946469920] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec01b030 con 0x7f43e4019040 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 20 remove_watcher() i=7 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f43e4019040 msgr2=0x7f43e4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f43e4019040 0x7f43e4019930 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c275ad0 msgr2=0x562f7c277f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c275ad0 0x562f7c277f60 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f43e80aba20 msgr2=0x7f43e80e7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f43e80aba20 0x7f43e80e7a10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562f7c27b790 msgr2=0x562f7c27dc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x562f7c27b790 0x562f7c27dc10 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42bc03a150 msgr2=0x7f42bc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42bc03a150 0x7f42bc03c610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f43e400f010 tx=0x7f43e401b070 comp rx=0 tx=0).stop 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 msgr2=0x562f7c26a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3864494660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c263fa0 0x562f7c26a4c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f43e8005880 tx=0x7f43e80ebfa0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f2363640 1 -- 172.21.15.96:0/3864494660 reap_dead start 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 shutdown_connections 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 >> 172.21.15.96:0/3864494660 conn(0x562f7c25f3c0 msgr2=0x562f7c25d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 shutdown_connections 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.041+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3864494660 wait complete. 2024-09-14T10:46:19.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3981126675 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42cc03a140 msgr2=0x7f42cc03c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3981126675 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42cc03a140 0x7f42cc03c600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x562f7c2470c0 tx=0x7f43e4003070 comp rx=0 tx=0).stop 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3981126675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c256730 msgr2=0x562f7c256b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3981126675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c256730 0x562f7c256b50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f43e801d210 tx=0x7f43e8019f70 comp rx=0 tx=0).stop 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3981126675 shutdown_connections 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3981126675 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42cc03a140 0x7f42cc03c600 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3981126675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c256730 0x562f7c256b50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3981126675 >> 172.21.15.96:0/3981126675 conn(0x562f7c24c0e0 msgr2=0x562f7c24c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3981126675 shutdown_connections 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3981126675 wait complete. 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c14d050 msgr2=0x562f7c246100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c14d050 0x562f7c246100 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42d803a150 msgr2=0x7f42d803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42d803a150 0x7f42d803c610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ae000 tx=0x7f43e80a7000 comp rx=0 tx=0).stop 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 msgr2=0x562f7c23ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c23ef90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000f90 tx=0x7f43ec001260 comp rx=0 tx=0).stop 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 shutdown_connections 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x562f7c14d050 0x562f7c246100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42d803a150 0x7f42d803c610 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 --2- 172.21.15.96:0/3488351283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f7c148e60 0x562f7c23ef90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 >> 172.21.15.96:0/3488351283 conn(0x562f7c144980 msgr2=0x562f7c2346d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 shutdown_connections 2024-09-14T10:46:19.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.045+0000 7f43f485d9c0 1 -- 172.21.15.96:0/3488351283 wait complete. 2024-09-14T10:46:19.054 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.054 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.054 ERROR:root:0 2024-09-14T10:46:19.054 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:19.059 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:19.059 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:46:19.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:46:19.059 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-14T10:46:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.129+0000 7f52914129c0 1 Processor -- start 2024-09-14T10:46:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.129+0000 7f52914129c0 1 -- start start 2024-09-14T10:46:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.129+0000 7f52914129c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55892870fb50 0x55892870ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.129+0000 7f52914129c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589286417a0 con 0x55892870e550 2024-09-14T10:46:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.129+0000 7f52914129c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55892869d1b0 con 0x55892870fb50 2024-09-14T10:46:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528ef18640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55892870fb50 0x55892870ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528ef18640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55892870fb50 0x55892870ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51840/0 (socket says 172.21.15.96:51840) 2024-09-14T10:46:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528ef18640 1 -- 172.21.15.96:0/933816490 learned_addr learned my addr 172.21.15.96:0/933816490 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528ef18640 1 -- 172.21.15.96:0/933816490 >> v1:172.21.15.70:6789/0 conn(0x55892870e550 legacy=0x55892870e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528ef18640 1 -- 172.21.15.96:0/933816490 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892861bda0 con 0x55892870fb50 2024-09-14T10:46:19.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528ef18640 1 --2- 172.21.15.96:0/933816490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870fb50 0x55892870ff30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f528000a5c0 tx=0x7f528001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e431b101e3f4ab23 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528df16640 1 -- 172.21.15.96:0/933816490 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52800a6070 con 0x55892870fb50 2024-09-14T10:46:19.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528df16640 1 -- 172.21.15.96:0/933816490 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52800af070 con 0x55892870fb50 2024-09-14T10:46:19.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.133+0000 7f528df16640 1 -- 172.21.15.96:0/933816490 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52800aa5c0 con 0x55892870fb50 2024-09-14T10:46:19.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.137+0000 7f52914129c0 1 -- 172.21.15.96:0/933816490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870fb50 msgr2=0x55892870ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.137+0000 7f52914129c0 1 --2- 172.21.15.96:0/933816490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870fb50 0x55892870ff30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f528000a5c0 tx=0x7f528001b340 comp rx=0 tx=0).stop 2024-09-14T10:46:19.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.137+0000 7f52914129c0 1 -- 172.21.15.96:0/933816490 shutdown_connections 2024-09-14T10:46:19.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.137+0000 7f52914129c0 1 --2- 172.21.15.96:0/933816490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870fb50 0x55892870ff30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.137+0000 7f52914129c0 1 -- 172.21.15.96:0/933816490 >> 172.21.15.96:0/933816490 conn(0x558928794b30 msgr2=0x558928796f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.137+0000 7f52914129c0 1 -- 172.21.15.96:0/933816490 shutdown_connections 2024-09-14T10:46:19.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.137+0000 7f52914129c0 1 -- 172.21.15.96:0/933816490 wait complete. 2024-09-14T10:46:19.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f52914129c0 1 Processor -- start 2024-09-14T10:46:19.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f52914129c0 1 -- start start 2024-09-14T10:46:19.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f52914129c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x558928886830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f52914129c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589286a0fc0 con 0x55892870e550 2024-09-14T10:46:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f528ef18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x558928886830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f528ef18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x558928886830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51850/0 (socket says 172.21.15.96:51850) 2024-09-14T10:46:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f528ef18640 1 -- 172.21.15.96:0/518470851 learned_addr learned my addr 172.21.15.96:0/518470851 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f528ef18640 1 -- 172.21.15.96:0/518470851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558928886e20 con 0x55892870e550 2024-09-14T10:46:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f528ef18640 1 --2- 172.21.15.96:0/518470851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x558928886830 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5280018f70 tx=0x7f5280002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b35a89b92f8f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f517ce09640 1 -- 172.21.15.96:0/518470851 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52800aa9e0 con 0x55892870e550 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f517ce09640 1 -- 172.21.15.96:0/518470851 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52800aab80 con 0x55892870e550 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f517ce09640 1 -- 172.21.15.96:0/518470851 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52800aae60 con 0x55892870e550 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f52914129c0 1 -- 172.21.15.96:0/518470851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 msgr2=0x558928886830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.149+0000 7f52914129c0 1 --2- 172.21.15.96:0/518470851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x558928886830 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5280018f70 tx=0x7f5280002fc0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 -- 172.21.15.96:0/518470851 shutdown_connections 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 --2- 172.21.15.96:0/518470851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x558928886830 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 -- 172.21.15.96:0/518470851 >> 172.21.15.96:0/518470851 conn(0x558928794b30 msgr2=0x558928882470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 -- 172.21.15.96:0/518470851 shutdown_connections 2024-09-14T10:46:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 -- 172.21.15.96:0/518470851 wait complete. 2024-09-14T10:46:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 Processor -- start 2024-09-14T10:46:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 -- start start 2024-09-14T10:46:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x55892888dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558928642a50 con 0x55892870e550 2024-09-14T10:46:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f528ef18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x55892888dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f528ef18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x55892888dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51866/0 (socket says 172.21.15.96:51866) 2024-09-14T10:46:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f528ef18640 1 -- 172.21.15.96:0/1375595253 learned_addr learned my addr 172.21.15.96:0/1375595253 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f528ef18640 1 -- 172.21.15.96:0/1375595253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892888e500 con 0x55892870e550 2024-09-14T10:46:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f528ef18640 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x55892888dfa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5280000c10 tx=0x55892870f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f517b606640 1 -- 172.21.15.96:0/1375595253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52800c6690 con 0x55892870e550 2024-09-14T10:46:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55892888e790 con 0x55892870e550 2024-09-14T10:46:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892888f0f0 con 0x55892870e550 2024-09-14T10:46:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f517b606640 1 -- 172.21.15.96:0/1375595253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52800c6830 con 0x55892870e550 2024-09-14T10:46:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f517b606640 1 -- 172.21.15.96:0/1375595253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52800c6b10 con 0x55892870e550 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f517b606640 1 -- 172.21.15.96:0/1375595253 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f52800ce030 con 0x55892870e550 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f517b606640 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f517403a1a0 0x7f517403c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.153+0000 7f517b606640 1 -- 172.21.15.96:0/1375595253 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f52800cc020 con 0x55892870e550 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528e717640 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f517403a1a0 0x7f517403c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55892870fb50 0x5589288950c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558928895600 con 0x55892870fb50 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528f719640 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55892870fb50 0x5589288950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528e717640 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f517403a1a0 0x7f517403c660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5284001ec0 tx=0x7f5284001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528f719640 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55892870fb50 0x5589288950c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528f719640 1 -- 172.21.15.96:0/1375595253 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f528800a4d0 con 0x55892870fb50 2024-09-14T10:46:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558928895a70 con 0x55892870fb50 2024-09-14T10:46:19.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528f719640 1 -- 172.21.15.96:0/1375595253 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f528800a4d0 con 0x55892870fb50 2024-09-14T10:46:19.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558928897370 con 0x55892870fb50 2024-09-14T10:46:19.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528f719640 1 -- 172.21.15.96:0/1375595253 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f528800a4d0 con 0x55892870fb50 2024-09-14T10:46:19.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288965a0 con 0x55892870fb50 2024-09-14T10:46:19.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528f719640 1 -- 172.21.15.96:0/1375595253 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f528800a4d0 con 0x55892870fb50 2024-09-14T10:46:19.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288969c0 con 0x55892870fb50 2024-09-14T10:46:19.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528f719640 1 -- 172.21.15.96:0/1375595253 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f528800a4d0 con 0x55892870fb50 2024-09-14T10:46:19.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 Processor -- start 2024-09-14T10:46:19.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 -- start start 2024-09-14T10:46:19.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288a5760 0x5589288a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f52914129c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589286add80 con 0x5589288a5760 2024-09-14T10:46:19.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528e717640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288a5760 0x5589288a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528e717640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288a5760 0x5589288a5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51882/0 (socket says 172.21.15.96:51882) 2024-09-14T10:46:19.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528e717640 1 -- 172.21.15.96:0/1234795883 learned_addr learned my addr 172.21.15.96:0/1234795883 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.157+0000 7f528e717640 1 -- 172.21.15.96:0/1234795883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589288a61c0 con 0x5589288a5760 2024-09-14T10:46:19.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f528e717640 1 --2- 172.21.15.96:0/1234795883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288a5760 0x5589288a5b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5284010fd0 tx=0x7f528400f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f5178e01640 1 -- 172.21.15.96:0/1234795883 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528400a040 con 0x5589288a5760 2024-09-14T10:46:19.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f5178e01640 1 -- 172.21.15.96:0/1234795883 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5284017050 con 0x5589288a5760 2024-09-14T10:46:19.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f52914129c0 1 -- 172.21.15.96:0/1234795883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589288a6a20 con 0x5589288a5760 2024-09-14T10:46:19.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f5178e01640 1 -- 172.21.15.96:0/1234795883 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528400e6b0 con 0x5589288a5760 2024-09-14T10:46:19.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f52914129c0 1 -- 172.21.15.96:0/1234795883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589288a6f90 con 0x5589288a5760 2024-09-14T10:46:19.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f5178e01640 1 -- 172.21.15.96:0/1234795883 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f528400e8e0 con 0x5589288a5760 2024-09-14T10:46:19.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f5178e01640 1 --2- 172.21.15.96:0/1234795883 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f516803a150 0x7f516803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f5178e01640 1 -- 172.21.15.96:0/1234795883 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5284052bb0 con 0x5589288a5760 2024-09-14T10:46:19.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f528f719640 1 --2- 172.21.15.96:0/1234795883 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f516803a150 0x7f516803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f52914129c0 1 Processor -- start 2024-09-14T10:46:19.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f52914129c0 1 -- start start 2024-09-14T10:46:19.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f528f719640 1 --2- 172.21.15.96:0/1234795883 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f516803a150 0x7f516803c610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x558928896940 tx=0x7f5288005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f52914129c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f52914129c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558928887190 con 0x5589288b30d0 2024-09-14T10:46:19.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f528e717640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f528e717640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51894/0 (socket says 172.21.15.96:51894) 2024-09-14T10:46:19.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f528e717640 1 -- 172.21.15.96:0/2137950903 learned_addr learned my addr 172.21.15.96:0/2137950903 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f528e717640 1 -- 172.21.15.96:0/2137950903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589288b3ac0 con 0x5589288b30d0 2024-09-14T10:46:19.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f528e717640 1 --2- 172.21.15.96:0/2137950903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b34d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5284050e40 tx=0x7f5284024360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae97ff463fcdd46 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f51727fc640 1 -- 172.21.15.96:0/2137950903 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528401c930 con 0x5589288b30d0 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.161+0000 7f51727fc640 1 -- 172.21.15.96:0/2137950903 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528401a310 con 0x5589288b30d0 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f51727fc640 1 -- 172.21.15.96:0/2137950903 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528401cad0 con 0x5589288b30d0 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- 172.21.15.96:0/2137950903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 msgr2=0x5589288b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 --2- 172.21.15.96:0/2137950903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b34d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5284050e40 tx=0x7f5284024360 comp rx=0 tx=0).stop 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- 172.21.15.96:0/2137950903 shutdown_connections 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 --2- 172.21.15.96:0/2137950903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b34d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- 172.21.15.96:0/2137950903 >> 172.21.15.96:0/2137950903 conn(0x5589288ae4f0 msgr2=0x5589288ac730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- 172.21.15.96:0/2137950903 shutdown_connections 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- 172.21.15.96:0/2137950903 wait complete. 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 Processor -- start 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- start start 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589288b2020 con 0x5589288b30d0 2024-09-14T10:46:19.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f528e717640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f528e717640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51908/0 (socket says 172.21.15.96:51908) 2024-09-14T10:46:19.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 learned_addr learned my addr 172.21.15.96:0/2930982959 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589288b9b40 con 0x5589288b30d0 2024-09-14T10:46:19.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f528e717640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b95e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f528400fcf0 tx=0x7f5284050dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f5170ff9640 1 -- 172.21.15.96:0/2930982959 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5284051040 con 0x5589288b30d0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589288b9dd0 con 0x5589288b30d0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f5170ff9640 1 -- 172.21.15.96:0/2930982959 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528401c410 con 0x5589288b30d0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f5170ff9640 1 -- 172.21.15.96:0/2930982959 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f528401c5c0 con 0x5589288b30d0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589288ba780 con 0x5589288b30d0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f5170ff9640 1 -- 172.21.15.96:0/2930982959 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f5284023760 con 0x5589288b30d0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.165+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f5170ff9640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f515803a100 0x7f515803c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f5170ff9640 1 -- 172.21.15.96:0/2930982959 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5284048070 con 0x5589288b30d0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528f719640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f515803a100 0x7f515803c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5589288c49b0 0x5589288c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288c7590 con 0x5589288c49b0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528ef18640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5589288c49b0 0x5589288c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528f719640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f515803a100 0x7f515803c5c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5589288960c0 tx=0x7f528801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528ef18640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5589288c49b0 0x5589288c6e40 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 realm 2024-09-14T10:46:19.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288c79a0 con 0x5589288c49b0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288c8270 con 0x5589288c49b0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288c8610 con 0x5589288c49b0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288c8e60 con 0x5589288c49b0 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 20 searching for the correct realm 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5589288cabd0 0x5589288ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528e717640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5589288cabd0 0x5589288ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528e717640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5589288cabd0 0x5589288ccfc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528e717640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f528401c030 0x7f5284043740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f528401c030 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528f719640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f528401c030 0x7f5284043740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528f719640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f528401c030 0x7f5284043740 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528801f070 con 0x7f528401c030 2024-09-14T10:46:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528f719640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5288031040 0x7f5288032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f5288031040 2024-09-14T10:46:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.169+0000 7f528ef18640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5288031040 0x7f5288032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5288031040 0x7f5288032940 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288c49b0 2024-09-14T10:46:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288c49b0 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f5288031040 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f5288031040 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f528401c030 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528801f070 con 0x7f528401c030 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288c49b0 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f5288031040 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.173+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288c49b0 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f528401c030 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f528801f070 con 0x7f528401c030 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f5288031040 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288c49b0 2024-09-14T10:46:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288c49b0 2024-09-14T10:46:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f5288031040 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f528401c030 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528801f070 con 0x7f528401c030 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288c49b0 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f528401c030 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528801f070 con 0x7f528401c030 2024-09-14T10:46:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.177+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f5288031040 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f528401c030 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528801f070 con 0x7f528401c030 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288cabd0 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f5288031040 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x5589288c49b0 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd550 con 0x7f528401c030 2024-09-14T10:46:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288040040 con 0x7f528401c030 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288c9810 con 0x5589288c49b0 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288ca0b0 con 0x5589288c49b0 2024-09-14T10:46:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288cd9b0 con 0x5589288c49b0 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 zone default found 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 4 Realm: () 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 zonegroup default 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288cda10 con 0x7f528401c030 2024-09-14T10:46:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5288040040 con 0x7f528401c030 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288cfcf0 con 0x5589288cabd0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.181+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288d0140 con 0x5589288cabd0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f52914129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f52914129c0 20 started sync module instance, tier type = 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f52914129c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288cf180 con 0x7f528401c030 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288040040 con 0x7f528401c030 2024-09-14T10:46:19.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94047579207328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288cf180 con 0x7f528401c030 2024-09-14T10:46:19.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d0c00 con 0x5589288c49b0 2024-09-14T10:46:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94047579207328] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288040040 con 0x7f528401c030 2024-09-14T10:46:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94047579211536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288cf180 con 0x5589288c49b0 2024-09-14T10:46:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.185+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d1610 con 0x5589288cabd0 2024-09-14T10:46:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.189+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94047579211536] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.189+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.189+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94047579204816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288cf0f0 con 0x5589288cabd0 2024-09-14T10:46:19.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.189+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d2350 con 0x7f528401c030 2024-09-14T10:46:19.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.189+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288040040 con 0x7f528401c030 2024-09-14T10:46:19.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.189+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94047579217504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d2bf0 con 0x7f528401c030 2024-09-14T10:46:19.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.189+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d35f0 con 0x5589288c49b0 2024-09-14T10:46:19.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94047579204816] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94047579217504] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288040040 con 0x7f528401c030 2024-09-14T10:46:19.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94047579216304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d2740 con 0x5589288c49b0 2024-09-14T10:46:19.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d3ec0 con 0x7f5288031040 2024-09-14T10:46:19.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94047579216304] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94047579222272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d2740 con 0x7f5288031040 2024-09-14T10:46:19.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.193+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d4350 con 0x7f5288031040 2024-09-14T10:46:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.197+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94047579222272] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.197+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.197+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94047579225632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d4310 con 0x7f5288031040 2024-09-14T10:46:19.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.197+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d4d50 con 0x7f5288031040 2024-09-14T10:46:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.197+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94047579225632] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94047579228192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d4d10 con 0x7f5288031040 2024-09-14T10:46:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 20 add_watcher() i=0 2024-09-14T10:46:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 20 add_watcher() i=1 2024-09-14T10:46:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 20 add_watcher() i=2 2024-09-14T10:46:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 20 add_watcher() i=3 2024-09-14T10:46:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 20 add_watcher() i=4 2024-09-14T10:46:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 20 add_watcher() i=5 2024-09-14T10:46:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 20 add_watcher() i=6 2024-09-14T10:46:19.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94047579228192] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 20 add_watcher() i=7 2024-09-14T10:46:19.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:19.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288d81a0 con 0x5589288c49b0 2024-09-14T10:46:19.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.201+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94047579223840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d5690 con 0x5589288c49b0 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94047579223840] v34'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f51457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 5 note: GC not initialized 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f50bffff640 20 reqs_thread_entry: start 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 20 Filter name: none 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f50bdffb640 20 reqs_thread_entry: start 2024-09-14T10:46:19.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:19.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288fb9e0 con 0x7f5288031040 2024-09-14T10:46:19.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-14T10:46:19.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:19.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:19.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.205+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558928902770 con 0x7f5288031040 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f52914129c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f52914129c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f52914129c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94047579415008 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589288fde00 con 0x5589288c49b0 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94047579216304 notify 146028888106 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55892888f0f0 con 0x5589288c49b0 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f51727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94047579216304 notifier 4886 bl.length()=679 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f51727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f51727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 94047579415008 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f51727fc640 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5154003eb0 con 0x5589288c49b0 2024-09-14T10:46:19.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94047579415008 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55892888e790 con 0x5589288c49b0 2024-09-14T10:46:19.211 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:19.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f51457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94047579223840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288f9580 con 0x5589288c49b0 2024-09-14T10:46:19.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94047579223840] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.209+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94047579207328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288f9580 con 0x7f528401c030 2024-09-14T10:46:19.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.213+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94047579207328] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288040040 con 0x7f528401c030 2024-09-14T10:46:19.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.213+0000 7f52914129c0 20 remove_watcher() i=0 2024-09-14T10:46:19.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.213+0000 7f52914129c0 2 removed watcher, disabling cache 2024-09-14T10:46:19.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.213+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94047579211536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288f9580 con 0x5589288c49b0 2024-09-14T10:46:19.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.213+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94047579211536] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.213+0000 7f52914129c0 20 remove_watcher() i=1 2024-09-14T10:46:19.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.213+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94047579204816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288f9580 con 0x5589288cabd0 2024-09-14T10:46:19.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f528e717640 1 -- 172.21.15.96:0/2930982959 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94047579204816] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f528400d040 con 0x5589288cabd0 2024-09-14T10:46:19.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f52914129c0 20 remove_watcher() i=2 2024-09-14T10:46:19.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94047579217504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288cecd0 con 0x7f528401c030 2024-09-14T10:46:19.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f528f719640 1 -- 172.21.15.96:0/2930982959 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94047579217504] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288040040 con 0x7f528401c030 2024-09-14T10:46:19.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f52914129c0 20 remove_watcher() i=3 2024-09-14T10:46:19.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94047579216304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288cecd0 con 0x5589288c49b0 2024-09-14T10:46:19.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94047579216304] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x5589288c49b0 2024-09-14T10:46:19.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f52914129c0 20 remove_watcher() i=4 2024-09-14T10:46:19.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.217+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94047579222272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d19b0 con 0x7f5288031040 2024-09-14T10:46:19.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.221+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94047579222272] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.221+0000 7f52914129c0 20 remove_watcher() i=5 2024-09-14T10:46:19.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.221+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94047579225632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288cecd0 con 0x7f5288031040 2024-09-14T10:46:19.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.221+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94047579225632] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.221+0000 7f52914129c0 20 remove_watcher() i=6 2024-09-14T10:46:19.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.221+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94047579228192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589288d19b0 con 0x7f5288031040 2024-09-14T10:46:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94047579228192] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52800b33f0 con 0x7f5288031040 2024-09-14T10:46:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 20 remove_watcher() i=7 2024-09-14T10:46:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5288031040 msgr2=0x7f5288032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f5288031040 0x7f5288032940 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5589288c49b0 msgr2=0x5589288c6e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5589288c49b0 0x5589288c6e40 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f528401c030 msgr2=0x7f5284043740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f528401c030 0x7f5284043740 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5589288cabd0 msgr2=0x5589288ccfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5589288cabd0 0x5589288ccfc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f515803a100 msgr2=0x7f515803c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f515803a100 0x7f515803c5c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5589288960c0 tx=0x7f528801f000 comp rx=0 tx=0).stop 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 msgr2=0x5589288b95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f528ef18640 1 -- 172.21.15.96:0/2930982959 reap_dead start 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b95e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f528400fcf0 tx=0x7f5284050dd0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 shutdown_connections 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/2930982959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288b30d0 0x5589288b95e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 >> 172.21.15.96:0/2930982959 conn(0x5589288ae4f0 msgr2=0x5589288ac700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 shutdown_connections 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/2930982959 wait complete. 2024-09-14T10:46:19.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1234795883 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f516803a150 msgr2=0x7f516803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1234795883 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f516803a150 0x7f516803c610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x558928896940 tx=0x7f5288005850 comp rx=0 tx=0).stop 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1234795883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288a5760 msgr2=0x5589288a5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1234795883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288a5760 0x5589288a5b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5284010fd0 tx=0x7f528400f7a0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1234795883 shutdown_connections 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1234795883 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f516803a150 0x7f516803c610 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1234795883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589288a5760 0x5589288a5b80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1234795883 >> 172.21.15.96:0/1234795883 conn(0x55892889b110 msgr2=0x55892889b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1234795883 shutdown_connections 2024-09-14T10:46:19.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1234795883 wait complete. 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55892870fb50 msgr2=0x5589288950c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55892870fb50 0x5589288950c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f517403a1a0 msgr2=0x7f517403c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f517403a1a0 0x7f517403c660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5284001ec0 tx=0x7f5284001440 comp rx=0 tx=0).stop 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 msgr2=0x55892888dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x55892888dfa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5280000c10 tx=0x55892870f490 comp rx=0 tx=0).stop 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 shutdown_connections 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55892870fb50 0x5589288950c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f517403a1a0 0x7f517403c660 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 --2- 172.21.15.96:0/1375595253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55892870e550 0x55892888dfa0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 >> 172.21.15.96:0/1375595253 conn(0x558928794b30 msgr2=0x558928887bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 shutdown_connections 2024-09-14T10:46:19.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.225+0000 7f52914129c0 1 -- 172.21.15.96:0/1375595253 wait complete. 2024-09-14T10:46:19.236 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.236 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.236 ERROR:root:0 2024-09-14T10:46:19.236 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:19.241 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:19.242 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-14T10:46:19.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-14T10:46:19.242 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-14T10:46:19.314 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:19.314 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:19.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.313+0000 7fc8351779c0 1 Processor -- start 2024-09-14T10:46:19.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.313+0000 7fc8351779c0 1 -- start start 2024-09-14T10:46:19.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.313+0000 7fc8351779c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556b3c5713b0 0x556b3c5737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.313+0000 7fc8351779c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b3c4157a0 con 0x556b3c4e1260 2024-09-14T10:46:19.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.313+0000 7fc8351779c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x556b3c4711b0 con 0x556b3c5713b0 2024-09-14T10:46:19.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc83247c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556b3c5713b0 0x556b3c5737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc83247c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x556b3c5713b0 0x556b3c5737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51924/0 (socket says 172.21.15.96:51924) 2024-09-14T10:46:19.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc83247c640 1 -- 172.21.15.96:0/839063393 learned_addr learned my addr 172.21.15.96:0/839063393 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc83247c640 1 -- 172.21.15.96:0/839063393 >> v1:172.21.15.70:6789/0 conn(0x556b3c4e1260 legacy=0x556b3c56fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc83247c640 1 -- 172.21.15.96:0/839063393 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3c3efda0 con 0x556b3c5713b0 2024-09-14T10:46:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc83247c640 1 --2- 172.21.15.96:0/839063393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c5713b0 0x556b3c5737a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00a5c0 tx=0x7fc81c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99910b6e9cc98427 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc831c7b640 1 -- 172.21.15.96:0/839063393 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc81c0b1070 con 0x556b3c5713b0 2024-09-14T10:46:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc831c7b640 1 -- 172.21.15.96:0/839063393 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c0a8070 con 0x556b3c5713b0 2024-09-14T10:46:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc831c7b640 1 -- 172.21.15.96:0/839063393 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc81c0ac5b0 con 0x556b3c5713b0 2024-09-14T10:46:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc8351779c0 1 -- 172.21.15.96:0/839063393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c5713b0 msgr2=0x556b3c5737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc8351779c0 1 --2- 172.21.15.96:0/839063393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c5713b0 0x556b3c5737a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00a5c0 tx=0x7fc81c01b340 comp rx=0 tx=0).stop 2024-09-14T10:46:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc8351779c0 1 -- 172.21.15.96:0/839063393 shutdown_connections 2024-09-14T10:46:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc8351779c0 1 --2- 172.21.15.96:0/839063393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c5713b0 0x556b3c5737a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc8351779c0 1 -- 172.21.15.96:0/839063393 >> 172.21.15.96:0/839063393 conn(0x556b3c567980 msgr2=0x556b3c569da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc8351779c0 1 -- 172.21.15.96:0/839063393 shutdown_connections 2024-09-14T10:46:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.317+0000 7fc8351779c0 1 -- 172.21.15.96:0/839063393 wait complete. 2024-09-14T10:46:19.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 Processor -- start 2024-09-14T10:46:19.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- start start 2024-09-14T10:46:19.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c658570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b3c474fc0 con 0x556b3c4e1260 2024-09-14T10:46:19.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc832c7d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c658570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc832c7d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c658570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51928/0 (socket says 172.21.15.96:51928) 2024-09-14T10:46:19.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc832c7d640 1 -- 172.21.15.96:0/1233984644 learned_addr learned my addr 172.21.15.96:0/1233984644 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc832c7d640 1 -- 172.21.15.96:0/1233984644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3c658b60 con 0x556b3c4e1260 2024-09-14T10:46:19.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc832c7d640 1 --2- 172.21.15.96:0/1233984644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c658570 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc824001680 tx=0x7fc824001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40dbea6b48ba938 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc720e09640 1 -- 172.21.15.96:0/1233984644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc824016070 con 0x556b3c4e1260 2024-09-14T10:46:19.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc720e09640 1 -- 172.21.15.96:0/1233984644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82400f660 con 0x556b3c4e1260 2024-09-14T10:46:19.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc720e09640 1 -- 172.21.15.96:0/1233984644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc82400f980 con 0x556b3c4e1260 2024-09-14T10:46:19.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- 172.21.15.96:0/1233984644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 msgr2=0x556b3c658570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 --2- 172.21.15.96:0/1233984644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c658570 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc824001680 tx=0x7fc824001b40 comp rx=0 tx=0).stop 2024-09-14T10:46:19.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- 172.21.15.96:0/1233984644 shutdown_connections 2024-09-14T10:46:19.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 --2- 172.21.15.96:0/1233984644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c658570 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- 172.21.15.96:0/1233984644 >> 172.21.15.96:0/1233984644 conn(0x556b3c567980 msgr2=0x556b3c654180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- 172.21.15.96:0/1233984644 shutdown_connections 2024-09-14T10:46:19.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- 172.21.15.96:0/1233984644 wait complete. 2024-09-14T10:46:19.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 Processor -- start 2024-09-14T10:46:19.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- start start 2024-09-14T10:46:19.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c65fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.333+0000 7fc8351779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b3c416a50 con 0x556b3c4e1260 2024-09-14T10:46:19.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc832c7d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c65fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc832c7d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c65fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51930/0 (socket says 172.21.15.96:51930) 2024-09-14T10:46:19.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc832c7d640 1 -- 172.21.15.96:0/714950284 learned_addr learned my addr 172.21.15.96:0/714950284 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc832c7d640 1 -- 172.21.15.96:0/714950284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3c660370 con 0x556b3c4e1260 2024-09-14T10:46:19.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc832c7d640 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c65fe10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x556b3c659530 tx=0x7fc824000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc71f606640 1 -- 172.21.15.96:0/714950284 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc824016040 con 0x556b3c4e1260 2024-09-14T10:46:19.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b3c660600 con 0x556b3c4e1260 2024-09-14T10:46:19.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b3c660fb0 con 0x556b3c4e1260 2024-09-14T10:46:19.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc71f606640 1 -- 172.21.15.96:0/714950284 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc824022070 con 0x556b3c4e1260 2024-09-14T10:46:19.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc71f606640 1 -- 172.21.15.96:0/714950284 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8240062b0 con 0x556b3c4e1260 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc71f606640 1 -- 172.21.15.96:0/714950284 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc8240114c0 con 0x556b3c4e1260 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc71f606640 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71803a0e0 0x7fc71803c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc71f606640 1 -- 172.21.15.96:0/714950284 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc824050780 con 0x556b3c4e1260 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc83247c640 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71803a0e0 0x7fc71803c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc8351779c0 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c5713b0 0x556b3c666f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6674c0 con 0x556b3c5713b0 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc83347e640 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c5713b0 0x556b3c666f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc83247c640 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71803a0e0 0x7fc71803c5a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0ae000 tx=0x7fc81c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.337+0000 7fc83347e640 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c5713b0 0x556b3c666f80 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83347e640 1 -- 172.21.15.96:0/714950284 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82c0083f0 con 0x556b3c5713b0 2024-09-14T10:46:19.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c667910 con 0x556b3c5713b0 2024-09-14T10:46:19.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83347e640 1 -- 172.21.15.96:0/714950284 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc82c0083f0 con 0x556b3c5713b0 2024-09-14T10:46:19.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c669210 con 0x556b3c5713b0 2024-09-14T10:46:19.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83347e640 1 -- 172.21.15.96:0/714950284 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc82c0083f0 con 0x556b3c5713b0 2024-09-14T10:46:19.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c668440 con 0x556b3c5713b0 2024-09-14T10:46:19.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83347e640 1 -- 172.21.15.96:0/714950284 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc82c0083f0 con 0x556b3c5713b0 2024-09-14T10:46:19.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c668860 con 0x556b3c5713b0 2024-09-14T10:46:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83347e640 1 -- 172.21.15.96:0/714950284 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc82c0083f0 con 0x556b3c5713b0 2024-09-14T10:46:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 Processor -- start 2024-09-14T10:46:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 -- start start 2024-09-14T10:46:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c56d3f0 0x556b3c56bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b3c481d80 con 0x556b3c56d3f0 2024-09-14T10:46:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83247c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c56d3f0 0x556b3c56bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83247c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c56d3f0 0x556b3c56bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51940/0 (socket says 172.21.15.96:51940) 2024-09-14T10:46:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83247c640 1 -- 172.21.15.96:0/775608130 learned_addr learned my addr 172.21.15.96:0/775608130 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83247c640 1 -- 172.21.15.96:0/775608130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3c56d910 con 0x556b3c56d3f0 2024-09-14T10:46:19.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc83247c640 1 --2- 172.21.15.96:0/775608130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c56d3f0 0x556b3c56bc90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc81c096e30 tx=0x7fc81c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc71ce01640 1 -- 172.21.15.96:0/775608130 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc81c0b1040 con 0x556b3c56d3f0 2024-09-14T10:46:19.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 -- 172.21.15.96:0/775608130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b3c56c1d0 con 0x556b3c56d3f0 2024-09-14T10:46:19.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc71ce01640 1 -- 172.21.15.96:0/775608130 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c0c7070 con 0x556b3c56d3f0 2024-09-14T10:46:19.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc8351779c0 1 -- 172.21.15.96:0/775608130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b3c56c680 con 0x556b3c56d3f0 2024-09-14T10:46:19.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.341+0000 7fc71ce01640 1 -- 172.21.15.96:0/775608130 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc81c0b6720 con 0x556b3c56d3f0 2024-09-14T10:46:19.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc71ce01640 1 -- 172.21.15.96:0/775608130 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc81c0c1070 con 0x556b3c56d3f0 2024-09-14T10:46:19.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc71ce01640 1 --2- 172.21.15.96:0/775608130 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70c03a1a0 0x7fc70c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc71ce01640 1 -- 172.21.15.96:0/775608130 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc81c0ed890 con 0x556b3c56d3f0 2024-09-14T10:46:19.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc83347e640 1 --2- 172.21.15.96:0/775608130 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70c03a1a0 0x7fc70c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 Processor -- start 2024-09-14T10:46:19.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 -- start start 2024-09-14T10:46:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc83347e640 1 --2- 172.21.15.96:0/775608130 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70c03a1a0 0x7fc70c03c660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x556b3c6687e0 tx=0x7fc82c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c6874a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b3c658f90 con 0x556b3c6870c0 2024-09-14T10:46:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc83247c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c6874a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc83247c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c6874a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51952/0 (socket says 172.21.15.96:51952) 2024-09-14T10:46:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc83247c640 1 -- 172.21.15.96:0/2502439754 learned_addr learned my addr 172.21.15.96:0/2502439754 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc83247c640 1 -- 172.21.15.96:0/2502439754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3c687a90 con 0x556b3c6870c0 2024-09-14T10:46:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc83247c640 1 --2- 172.21.15.96:0/2502439754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c6874a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0aa710 tx=0x7fc81c0c1ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5496b697960759 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc7167fc640 1 -- 172.21.15.96:0/2502439754 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc81c0db070 con 0x556b3c6870c0 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc7167fc640 1 -- 172.21.15.96:0/2502439754 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c0c2e40 con 0x556b3c6870c0 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc7167fc640 1 -- 172.21.15.96:0/2502439754 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc81c0aa520 con 0x556b3c6870c0 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 -- 172.21.15.96:0/2502439754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 msgr2=0x556b3c6874a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 --2- 172.21.15.96:0/2502439754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c6874a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0aa710 tx=0x7fc81c0c1ab0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 -- 172.21.15.96:0/2502439754 shutdown_connections 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 --2- 172.21.15.96:0/2502439754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c6874a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 -- 172.21.15.96:0/2502439754 >> 172.21.15.96:0/2502439754 conn(0x556b3c682480 msgr2=0x556b3c6806c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 -- 172.21.15.96:0/2502439754 shutdown_connections 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.345+0000 7fc8351779c0 1 -- 172.21.15.96:0/2502439754 wait complete. 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 1 Processor -- start 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 1 -- start start 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c68d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b3c685fb0 con 0x556b3c6870c0 2024-09-14T10:46:19.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc83247c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c68d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc83247c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c68d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51954/0 (socket says 172.21.15.96:51954) 2024-09-14T10:46:19.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 learned_addr learned my addr 172.21.15.96:0/179570540 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3c68db40 con 0x556b3c6870c0 2024-09-14T10:46:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc83247c640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c68d5e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0ccaf0 tx=0x7fc81c0ebab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc714ff9640 1 -- 172.21.15.96:0/179570540 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc81c0f2070 con 0x556b3c6870c0 2024-09-14T10:46:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b3c68ddd0 con 0x556b3c6870c0 2024-09-14T10:46:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc714ff9640 1 -- 172.21.15.96:0/179570540 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c0aa520 con 0x556b3c6870c0 2024-09-14T10:46:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b3c68e780 con 0x556b3c6870c0 2024-09-14T10:46:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc714ff9640 1 -- 172.21.15.96:0/179570540 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc81c0fc060 con 0x556b3c6870c0 2024-09-14T10:46:19.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc714ff9640 1 -- 172.21.15.96:0/179570540 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fc81c0f5070 con 0x556b3c6870c0 2024-09-14T10:46:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc714ff9640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6fc03a150 0x7fc6fc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc714ff9640 1 -- 172.21.15.96:0/179570540 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc81c0e7030 con 0x556b3c6870c0 2024-09-14T10:46:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc83347e640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6fc03a150 0x7fc6fc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c698ad0 0x556b3c69af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c69b6b0 con 0x556b3c698ad0 2024-09-14T10:46:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc832c7d640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c698ad0 0x556b3c69af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.349+0000 7fc832c7d640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c698ad0 0x556b3c69af60 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83347e640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6fc03a150 0x7fc6fc03c610 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00f010 tx=0x7fc82c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 realm 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c69bac0 con 0x556b3c698ad0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c69c390 con 0x556b3c698ad0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c69c730 con 0x556b3c698ad0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c69cf80 con 0x556b3c698ad0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 20 searching for the correct realm 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b3c69ecf0 0x556b3c6a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83247c640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b3c69ecf0 0x556b3c6a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83247c640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b3c69ecf0 0x556b3c6a10e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83247c640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc81c0f7060 0x7fc81c0d77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc81c0f7060 2024-09-14T10:46:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83347e640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc81c0f7060 0x7fc81c0d77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83347e640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc81c0f7060 0x7fc81c0d77d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83347e640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc82c019040 0x7fc82c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc82c019040 2024-09-14T10:46:19.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc832c7d640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc82c019040 0x7fc82c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.353+0000 7fc832c7d640 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc82c019040 0x7fc82c019930 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c698ad0 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c698ad0 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc82c019040 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc82c019040 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc81c0f7060 2024-09-14T10:46:19.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c698ad0 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc82c019040 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c698ad0 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc81c0f7060 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.357+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc82c019040 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c698ad0 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c698ad0 2024-09-14T10:46:19.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc82c019040 2024-09-14T10:46:19.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc81c0f7060 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c698ad0 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc81c0f7060 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.361+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc82c019040 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc81c0f7060 2024-09-14T10:46:19.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x556b3c69ecf0 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a16c0 con 0x7fc82c019040 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc824059040 con 0x556b3c698ad0 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc824059040 con 0x7fc81c0f7060 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:19.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c69d8d0 con 0x556b3c698ad0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c69e170 con 0x556b3c698ad0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c69e170 con 0x556b3c698ad0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 zone default found 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 4 Realm: () 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 zonegroup default 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a1b40 con 0x7fc81c0f7060 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a39d0 con 0x556b3c69ecf0 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a3e90 con 0x556b3c69ecf0 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.365+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc8351779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc8351779c0 20 started sync module instance, tier type = 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc8351779c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a2d70 con 0x7fc81c0f7060 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93919063454320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a2d70 con 0x7fc81c0f7060 2024-09-14T10:46:19.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a4950 con 0x556b3c698ad0 2024-09-14T10:46:19.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93919063454320] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93919063458912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a2d70 con 0x556b3c698ad0 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.369+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a5390 con 0x556b3c69ecf0 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.373+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93919063458912] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.373+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.373+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93919063451840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a2ce0 con 0x556b3c69ecf0 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.373+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a6090 con 0x7fc81c0f7060 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.373+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.373+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93919063465200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a67e0 con 0x7fc81c0f7060 2024-09-14T10:46:19.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.373+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a7300 con 0x556b3c698ad0 2024-09-14T10:46:19.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93919063451840] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93919063465200] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93919063469520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a72c0 con 0x556b3c698ad0 2024-09-14T10:46:19.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a7ba0 con 0x7fc82c019040 2024-09-14T10:46:19.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93919063470784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a7b90 con 0x7fc82c019040 2024-09-14T10:46:19.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93919063469520] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.377+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a8410 con 0x7fc82c019040 2024-09-14T10:46:19.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.381+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.381+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93919063470784] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.381+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93919063474016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a7b90 con 0x7fc82c019040 2024-09-14T10:46:19.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.381+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a8a60 con 0x7fc82c019040 2024-09-14T10:46:19.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93919063475488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a8f10 con 0x7fc82c019040 2024-09-14T10:46:19.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 add_watcher() i=0 2024-09-14T10:46:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 add_watcher() i=1 2024-09-14T10:46:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 add_watcher() i=2 2024-09-14T10:46:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 add_watcher() i=3 2024-09-14T10:46:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 add_watcher() i=4 2024-09-14T10:46:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 add_watcher() i=5 2024-09-14T10:46:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93919063474016] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 add_watcher() i=6 2024-09-14T10:46:19.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93919063475488] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 add_watcher() i=7 2024-09-14T10:46:19.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:19.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a8f10 con 0x556b3c698ad0 2024-09-14T10:46:19.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93919063476832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a8e80 con 0x556b3c698ad0 2024-09-14T10:46:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93919063476832] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc6e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 5 note: GC not initialized 2024-09-14T10:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc663fff640 20 reqs_thread_entry: start 2024-09-14T10:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 Filter name: none 2024-09-14T10:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc661ffb640 20 reqs_thread_entry: start 2024-09-14T10:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.385+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6cf6b0 con 0x7fc82c019040 2024-09-14T10:46:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 20 rados_obj.operate() r=0 bl.length=503 2024-09-14T10:46:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6d6440 con 0x7fc82c019040 2024-09-14T10:46:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93919063662256 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6d1b30 con 0x556b3c698ad0 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 93919063469520 notify 146028888107 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fc82404d040 con 0x556b3c698ad0 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc7167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 93919063469520 notifier 4893 bl.length()=636 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc7167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc7167fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc7167fc640 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc6f8003eb0 con 0x556b3c698ad0 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.389+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 93919063662256 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 93919063662256 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556b3c660fb0 con 0x556b3c698ad0 2024-09-14T10:46:19.394 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc6e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93919063476832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6cd240 con 0x556b3c698ad0 2024-09-14T10:46:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93919063476832] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93919063454320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6cd240 con 0x7fc81c0f7060 2024-09-14T10:46:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93919063454320] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc8351779c0 20 remove_watcher() i=0 2024-09-14T10:46:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc8351779c0 2 removed watcher, disabling cache 2024-09-14T10:46:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.393+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93919063458912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a3270 con 0x556b3c698ad0 2024-09-14T10:46:19.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.397+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93919063458912] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.397+0000 7fc8351779c0 20 remove_watcher() i=1 2024-09-14T10:46:19.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.397+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93919063451840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6cd240 con 0x556b3c69ecf0 2024-09-14T10:46:19.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.397+0000 7fc83247c640 1 -- 172.21.15.96:0/179570540 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93919063451840] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc81c0f4030 con 0x556b3c69ecf0 2024-09-14T10:46:19.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.397+0000 7fc8351779c0 20 remove_watcher() i=2 2024-09-14T10:46:19.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.397+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93919063465200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a4460 con 0x7fc81c0f7060 2024-09-14T10:46:19.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.401+0000 7fc83347e640 1 -- 172.21.15.96:0/179570540 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93919063465200] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82c02f040 con 0x7fc81c0f7060 2024-09-14T10:46:19.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.401+0000 7fc8351779c0 20 remove_watcher() i=3 2024-09-14T10:46:19.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.401+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93919063469520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a28c0 con 0x556b3c698ad0 2024-09-14T10:46:19.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.401+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93919063469520] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x556b3c698ad0 2024-09-14T10:46:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.401+0000 7fc8351779c0 20 remove_watcher() i=4 2024-09-14T10:46:19.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.401+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93919063470784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a5cf0 con 0x7fc82c019040 2024-09-14T10:46:19.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.405+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93919063470784] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.405+0000 7fc8351779c0 20 remove_watcher() i=5 2024-09-14T10:46:19.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.405+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93919063474016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a4460 con 0x7fc82c019040 2024-09-14T10:46:19.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.405+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93919063474016] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.405+0000 7fc8351779c0 20 remove_watcher() i=6 2024-09-14T10:46:19.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.405+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93919063475488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556b3c6a28c0 con 0x7fc82c019040 2024-09-14T10:46:19.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93919063475488] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc82400f070 con 0x7fc82c019040 2024-09-14T10:46:19.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 20 remove_watcher() i=7 2024-09-14T10:46:19.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc82c019040 msgr2=0x7fc82c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fc82c019040 0x7fc82c019930 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c698ad0 msgr2=0x556b3c69af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c698ad0 0x556b3c69af60 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc81c0f7060 msgr2=0x7fc81c0d77d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fc81c0f7060 0x7fc81c0d77d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b3c69ecf0 msgr2=0x556b3c6a10e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x556b3c69ecf0 0x556b3c6a10e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6fc03a150 msgr2=0x7fc6fc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc6fc03a150 0x7fc6fc03c610 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00f010 tx=0x7fc82c01b070 comp rx=0 tx=0).stop 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 msgr2=0x556b3c68d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc832c7d640 1 -- 172.21.15.96:0/179570540 reap_dead start 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c68d5e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0ccaf0 tx=0x7fc81c0ebab0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 shutdown_connections 2024-09-14T10:46:19.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/179570540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c6870c0 0x556b3c68d5e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 >> 172.21.15.96:0/179570540 conn(0x556b3c682480 msgr2=0x556b3c680690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 shutdown_connections 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/179570540 wait complete. 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/775608130 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70c03a1a0 msgr2=0x7fc70c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/775608130 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70c03a1a0 0x7fc70c03c660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x556b3c6687e0 tx=0x7fc82c003070 comp rx=0 tx=0).stop 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/775608130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c56d3f0 msgr2=0x556b3c56bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/775608130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c56d3f0 0x556b3c56bc90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc81c096e30 tx=0x7fc81c0180e0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/775608130 shutdown_connections 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/775608130 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc70c03a1a0 0x7fc70c03c660 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/775608130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c56d3f0 0x556b3c56bc90 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/775608130 >> 172.21.15.96:0/775608130 conn(0x556b3c66cfb0 msgr2=0x556b3c66d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/775608130 shutdown_connections 2024-09-14T10:46:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/775608130 wait complete. 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c5713b0 msgr2=0x556b3c666f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c5713b0 0x556b3c666f80 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71803a0e0 msgr2=0x7fc71803c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71803a0e0 0x7fc71803c5a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0ae000 tx=0x7fc81c0a6000 comp rx=0 tx=0).stop 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 msgr2=0x556b3c65fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c65fe10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x556b3c659530 tx=0x7fc824000f50 comp rx=0 tx=0).stop 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 shutdown_connections 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x556b3c5713b0 0x556b3c666f80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fc71803a0e0 0x7fc71803c5a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 --2- 172.21.15.96:0/714950284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b3c4e1260 0x556b3c65fe10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 >> 172.21.15.96:0/714950284 conn(0x556b3c567980 msgr2=0x556b3c6599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 shutdown_connections 2024-09-14T10:46:19.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.409+0000 7fc8351779c0 1 -- 172.21.15.96:0/714950284 wait complete. 2024-09-14T10:46:19.419 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.420 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.420 ERROR:root:0 2024-09-14T10:46:19.420 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-14T10:46:19.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-14T10:46:19.420 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-14T10:46:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa2082719c0 1 Processor -- start 2024-09-14T10:46:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa2082719c0 1 -- start start 2024-09-14T10:46:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa2082719c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55709294ab50 0x55709294af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa2082719c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55709287c7a0 con 0x557092949550 2024-09-14T10:46:19.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa2082719c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5570928d81b0 con 0x55709294ab50 2024-09-14T10:46:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa205d77640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55709294ab50 0x55709294af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa205d77640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55709294ab50 0x55709294af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51960/0 (socket says 172.21.15.96:51960) 2024-09-14T10:46:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa205576640 1 --1- 172.21.15.96:0/2377653194 >> v1:172.21.15.70:6789/0 conn(0x557092949550 0x557092949960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38366/0 (socket says 172.21.15.96:38366) 2024-09-14T10:46:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa205d77640 1 -- 172.21.15.96:0/2377653194 learned_addr learned my addr 172.21.15.96:0/2377653194 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa205d77640 1 -- 172.21.15.96:0/2377653194 >> v1:172.21.15.70:6789/0 conn(0x557092949550 legacy=0x557092949960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.497+0000 7fa205d77640 1 -- 172.21.15.96:0/2377653194 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557092856da0 con 0x55709294ab50 2024-09-14T10:46:19.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa205d77640 1 --2- 172.21.15.96:0/2377653194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55709294ab50 0x55709294af30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa20000a4e0 tx=0x7fa20001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfc837c8e498581 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa204d75640 1 -- 172.21.15.96:0/2377653194 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2000aa540 con 0x55709294ab50 2024-09-14T10:46:19.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa204d75640 1 -- 172.21.15.96:0/2377653194 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2000aa6e0 con 0x55709294ab50 2024-09-14T10:46:19.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa204d75640 1 -- 172.21.15.96:0/2377653194 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2000aaa40 con 0x55709294ab50 2024-09-14T10:46:19.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa2082719c0 1 -- 172.21.15.96:0/2377653194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55709294ab50 msgr2=0x55709294af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2377653194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55709294ab50 0x55709294af30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa20000a4e0 tx=0x7fa20001b090 comp rx=0 tx=0).stop 2024-09-14T10:46:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa2082719c0 1 -- 172.21.15.96:0/2377653194 shutdown_connections 2024-09-14T10:46:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2377653194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55709294ab50 0x55709294af30 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa2082719c0 1 -- 172.21.15.96:0/2377653194 >> 172.21.15.96:0/2377653194 conn(0x5570929cfb30 msgr2=0x5570929d1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa2082719c0 1 -- 172.21.15.96:0/2377653194 shutdown_connections 2024-09-14T10:46:19.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.501+0000 7fa2082719c0 1 -- 172.21.15.96:0/2377653194 wait complete. 2024-09-14T10:46:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa2082719c0 1 Processor -- start 2024-09-14T10:46:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa2082719c0 1 -- start start 2024-09-14T10:46:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa2082719c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa2082719c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5570928dbfc0 con 0x557092949550 2024-09-14T10:46:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa205d77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa205d77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51972/0 (socket says 172.21.15.96:51972) 2024-09-14T10:46:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa205d77640 1 -- 172.21.15.96:0/2548607633 learned_addr learned my addr 172.21.15.96:0/2548607633 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa205d77640 1 -- 172.21.15.96:0/2548607633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557092ac1e80 con 0x557092949550 2024-09-14T10:46:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.513+0000 7fa205d77640 1 --2- 172.21.15.96:0/2548607633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac1890 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa2000ac040 tx=0x7fa200003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ba86c8d2e48769 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa0f3e07640 1 -- 172.21.15.96:0/2548607633 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2000aaa80 con 0x557092949550 2024-09-14T10:46:19.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa0f3e07640 1 -- 172.21.15.96:0/2548607633 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2000aac20 con 0x557092949550 2024-09-14T10:46:19.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa0f3e07640 1 -- 172.21.15.96:0/2548607633 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2000b4460 con 0x557092949550 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 -- 172.21.15.96:0/2548607633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 msgr2=0x557092ac1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2548607633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac1890 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa2000ac040 tx=0x7fa200003340 comp rx=0 tx=0).stop 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 -- 172.21.15.96:0/2548607633 shutdown_connections 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2548607633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac1890 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 -- 172.21.15.96:0/2548607633 >> 172.21.15.96:0/2548607633 conn(0x5570929cfb30 msgr2=0x557092abd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 -- 172.21.15.96:0/2548607633 shutdown_connections 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 -- 172.21.15.96:0/2548607633 wait complete. 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 Processor -- start 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 -- start start 2024-09-14T10:46:19.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa2082719c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55709287da50 con 0x557092949550 2024-09-14T10:46:19.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa205d77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa205d77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:51988/0 (socket says 172.21.15.96:51988) 2024-09-14T10:46:19.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.517+0000 7fa205d77640 1 -- 172.21.15.96:0/2754525601 learned_addr learned my addr 172.21.15.96:0/2754525601 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa205d77640 1 -- 172.21.15.96:0/2754525601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557092ac9650 con 0x557092949550 2024-09-14T10:46:19.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa205d77640 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac90f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa20001b0d0 tx=0x55709294a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa0f2604640 1 -- 172.21.15.96:0/2754525601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2000b4860 con 0x557092949550 2024-09-14T10:46:19.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa0f2604640 1 -- 172.21.15.96:0/2754525601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2000c1070 con 0x557092949550 2024-09-14T10:46:19.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557092ac98e0 con 0x557092949550 2024-09-14T10:46:19.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa0f2604640 1 -- 172.21.15.96:0/2754525601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2000cd060 con 0x557092949550 2024-09-14T10:46:19.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557092aca290 con 0x557092949550 2024-09-14T10:46:19.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa0f2604640 1 -- 172.21.15.96:0/2754525601 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa2000b4b30 con 0x557092949550 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa0f2604640 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0ec03a150 0x7fa0ec03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa0f2604640 1 -- 172.21.15.96:0/2754525601 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa2000ebff0 con 0x557092949550 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa205576640 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0ec03a150 0x7fa0ec03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55709294ab50 0x557092ad0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092ad07a0 con 0x55709294ab50 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa206578640 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55709294ab50 0x557092ad0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa205576640 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0ec03a150 0x7fa0ec03c610 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc001e40 tx=0x7fa1fc0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa206578640 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55709294ab50 0x557092ad0260 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa206578640 1 -- 172.21.15.96:0/2754525601 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1f80083f0 con 0x55709294ab50 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092ad0c10 con 0x55709294ab50 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa206578640 1 -- 172.21.15.96:0/2754525601 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1f80083f0 con 0x55709294ab50 2024-09-14T10:46:19.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.521+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092ad2510 con 0x55709294ab50 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa206578640 1 -- 172.21.15.96:0/2754525601 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa1f80083f0 con 0x55709294ab50 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092ad1740 con 0x55709294ab50 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa206578640 1 -- 172.21.15.96:0/2754525601 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1f80083f0 con 0x55709294ab50 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092ad1b90 con 0x55709294ab50 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa206578640 1 -- 172.21.15.96:0/2754525601 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa1f80083f0 con 0x55709294ab50 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa2082719c0 1 Processor -- start 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa2082719c0 1 -- start start 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa2082719c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092ae08a0 0x557092ae0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa2082719c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5570928e8d80 con 0x557092ae08a0 2024-09-14T10:46:19.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa205576640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092ae08a0 0x557092ae0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa205576640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092ae08a0 0x557092ae0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52002/0 (socket says 172.21.15.96:52002) 2024-09-14T10:46:19.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa205576640 1 -- 172.21.15.96:0/318659491 learned_addr learned my addr 172.21.15.96:0/318659491 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa205576640 1 -- 172.21.15.96:0/318659491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557092ae1300 con 0x557092ae08a0 2024-09-14T10:46:19.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa205576640 1 --2- 172.21.15.96:0/318659491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092ae08a0 0x557092ae0cc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00e670 tx=0x7fa1fc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa0eb7fe640 1 -- 172.21.15.96:0/318659491 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1fc022070 con 0x557092ae08a0 2024-09-14T10:46:19.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa0eb7fe640 1 -- 172.21.15.96:0/318659491 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00d660 con 0x557092ae08a0 2024-09-14T10:46:19.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa2082719c0 1 -- 172.21.15.96:0/318659491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557092ae1b60 con 0x557092ae08a0 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa0eb7fe640 1 -- 172.21.15.96:0/318659491 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1fc006070 con 0x557092ae08a0 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa2082719c0 1 -- 172.21.15.96:0/318659491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557092ae20d0 con 0x557092ae08a0 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa0eb7fe640 1 -- 172.21.15.96:0/318659491 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa1fc025070 con 0x557092ae08a0 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa0eb7fe640 1 --2- 172.21.15.96:0/318659491 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0e003a150 0x7fa0e003c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.525+0000 7fa0eb7fe640 1 -- 172.21.15.96:0/318659491 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa1fc052500 con 0x557092ae08a0 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa206578640 1 --2- 172.21.15.96:0/318659491 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0e003a150 0x7fa0e003c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 Processor -- start 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- start start 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa206578640 1 --2- 172.21.15.96:0/318659491 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0e003a150 0x7fa0e003c610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800e3f0 tx=0x7fa1f8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092aee610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557092ac2250 con 0x557092aee210 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa205576640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092aee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa205576640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092aee610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52012/0 (socket says 172.21.15.96:52012) 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa205576640 1 -- 172.21.15.96:0/1742698162 learned_addr learned my addr 172.21.15.96:0/1742698162 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa205576640 1 -- 172.21.15.96:0/1742698162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557092aeec00 con 0x557092aee210 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa205576640 1 --2- 172.21.15.96:0/1742698162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092aee610 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0507c0 tx=0x7fa1fc024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3831cc5839f71806 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa0e97fa640 1 -- 172.21.15.96:0/1742698162 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1fc024770 con 0x557092aee210 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa0e97fa640 1 -- 172.21.15.96:0/1742698162 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00dcc0 con 0x557092aee210 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa0e97fa640 1 -- 172.21.15.96:0/1742698162 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1fc04f220 con 0x557092aee210 2024-09-14T10:46:19.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- 172.21.15.96:0/1742698162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 msgr2=0x557092aee610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 --2- 172.21.15.96:0/1742698162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092aee610 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0507c0 tx=0x7fa1fc024c90 comp rx=0 tx=0).stop 2024-09-14T10:46:19.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- 172.21.15.96:0/1742698162 shutdown_connections 2024-09-14T10:46:19.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 --2- 172.21.15.96:0/1742698162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092aee610 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- 172.21.15.96:0/1742698162 >> 172.21.15.96:0/1742698162 conn(0x557092ae9630 msgr2=0x557092ae7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- 172.21.15.96:0/1742698162 shutdown_connections 2024-09-14T10:46:19.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- 172.21.15.96:0/1742698162 wait complete. 2024-09-14T10:46:19.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 Processor -- start 2024-09-14T10:46:19.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- start start 2024-09-14T10:46:19.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092af47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa2082719c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557092aed160 con 0x557092aee210 2024-09-14T10:46:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa205576640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092af47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa205576640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092af47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52024/0 (socket says 172.21.15.96:52024) 2024-09-14T10:46:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.529+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 learned_addr learned my addr 172.21.15.96:0/744039666 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557092af4d00 con 0x557092aee210 2024-09-14T10:46:19.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205576640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092af47a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0266c0 tx=0x7fa1fc050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa0d77fe640 1 -- 172.21.15.96:0/744039666 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1fc024b30 con 0x557092aee210 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557092af4f90 con 0x557092aee210 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa0d77fe640 1 -- 172.21.15.96:0/744039666 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc0520f0 con 0x557092aee210 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa0d77fe640 1 -- 172.21.15.96:0/744039666 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1fc050ba0 con 0x557092aee210 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557092af4f90 con 0x557092aee210 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa0d77fe640 1 -- 172.21.15.96:0/744039666 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa1fc033070 con 0x557092aee210 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa0d77fe640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0d003a1a0 0x7fa0d003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa0d77fe640 1 -- 172.21.15.96:0/744039666 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa1fc045070 con 0x557092aee210 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa206578640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0d003a1a0 0x7fa0d003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557092affb50 0x557092b01fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b02730 con 0x557092affb50 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205d77640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557092affb50 0x557092b01fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa206578640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0d003a1a0 0x7fa0d003c660 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800f010 tx=0x7fa1f801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205d77640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557092affb50 0x557092b01fe0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 realm 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b02b90 con 0x557092affb50 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:19.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b03460 con 0x557092affb50 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b03800 con 0x557092affb50 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b04050 con 0x557092affb50 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 20 searching for the correct realm 2024-09-14T10:46:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557092b05dc0 0x557092b081b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.533+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205576640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557092b05dc0 0x557092b081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205576640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557092b05dc0 0x557092b081b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc03c070 con 0x557092b05dc0 2024-09-14T10:46:19.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205576640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa1fc035070 0x7fa1fc0494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1fc035070 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa206578640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa1fc035070 0x7fa1fc0494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa206578640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa1fc035070 0x7fa1fc0494d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa206578640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa1f8019040 0x7fa1f8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1f8019040 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205d77640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa1f8019040 0x7fa1f8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205d77640 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa1f8019040 0x7fa1f8019930 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092affb50 2024-09-14T10:46:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092affb50 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.537+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1f8019040 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1f8019040 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1fc035070 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc03c070 con 0x557092b05dc0 2024-09-14T10:46:19.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092affb50 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1f8019040 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092affb50 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1fc035070 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1f8019040 2024-09-14T10:46:19.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.541+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092affb50 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092affb50 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1f8019040 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1fc035070 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092affb50 2024-09-14T10:46:19.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1fc035070 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1f8019040 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1fc035070 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.545+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092b05dc0 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1f8019040 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x557092affb50 2024-09-14T10:46:19.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557092b08790 con 0x7fa1fc035070 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b049a0 con 0x557092affb50 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b05240 con 0x557092affb50 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b08bf0 con 0x557092affb50 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 zone default found 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 4 Realm: () 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:19.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 zonegroup default 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b08c10 con 0x7fa1fc035070 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b0aef0 con 0x557092b05dc0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b0b2e0 con 0x557092b05dc0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 started sync module instance, tier type = 2024-09-14T10:46:19.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:19.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.549+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0a380 con 0x7fa1fc035070 2024-09-14T10:46:19.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.553+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.553+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93941985749152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0a380 con 0x7fa1fc035070 2024-09-14T10:46:19.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.553+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0bdf0 con 0x557092affb50 2024-09-14T10:46:19.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.553+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93941985749152] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.553+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.553+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93941985753312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0a380 con 0x557092affb50 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.553+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0c800 con 0x557092b05dc0 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93941985753312] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93941985746640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0a2f0 con 0x557092b05dc0 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0d560 con 0x7fa1fc035070 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93941985759312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0de00 con 0x7fa1fc035070 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0e840 con 0x557092affb50 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93941985746640] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93941985759312] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93941985764112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0d950 con 0x557092affb50 2024-09-14T10:46:19.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.557+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0f0e0 con 0x7fa1f8019040 2024-09-14T10:46:19.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.561+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.561+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93941985765952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0f310 con 0x7fa1f8019040 2024-09-14T10:46:19.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.561+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0fb60 con 0x7fa1f8019040 2024-09-14T10:46:19.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.561+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93941985764112] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.561+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93941985765952] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93941985767008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0f730 con 0x7fa1f8019040 2024-09-14T10:46:19.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0ff80 con 0x7fa1f8019040 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93941985767008] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93941985768544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0fe10 con 0x7fa1f8019040 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 20 add_watcher() i=0 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 20 add_watcher() i=1 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 20 add_watcher() i=2 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 20 add_watcher() i=3 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 20 add_watcher() i=4 2024-09-14T10:46:19.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 20 add_watcher() i=5 2024-09-14T10:46:19.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.565+0000 7fa2082719c0 20 add_watcher() i=6 2024-09-14T10:46:19.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93941985768544] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 20 add_watcher() i=7 2024-09-14T10:46:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b13350 con 0x557092affb50 2024-09-14T10:46:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93941985769664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b10870 con 0x557092affb50 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93941985769664] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa0b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 5 note: GC not initialized 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa0b67fc640 20 reqs_thread_entry: start 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 20 Filter name: none 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa027fff640 20 reqs_thread_entry: start 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b36b00 con 0x7fa1f8019040 2024-09-14T10:46:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T10:46:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:19.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.569+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b3d500 con 0x7fa1f8019040 2024-09-14T10:46:19.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa2082719c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa2082719c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa2082719c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93941985955696 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557092b38b90 con 0x557092affb50 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 93941985764112 notify 146028888108 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fa2000d9040 con 0x557092affb50 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa0e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 93941985764112 notifier 4900 bl.length()=666 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa0e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa0e97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 93941985955696 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa0e97fa640 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa0c8003eb0 con 0x557092affb50 2024-09-14T10:46:19.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 93941985955696 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557092aca290 con 0x557092affb50 2024-09-14T10:46:19.576 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa0b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.573+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93941985769664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b346f0 con 0x557092affb50 2024-09-14T10:46:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.577+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93941985769664] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.577+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93941985749152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b346f0 con 0x7fa1fc035070 2024-09-14T10:46:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.577+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93941985749152] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.577+0000 7fa2082719c0 20 remove_watcher() i=0 2024-09-14T10:46:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.577+0000 7fa2082719c0 2 removed watcher, disabling cache 2024-09-14T10:46:19.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.577+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93941985753312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b346f0 con 0x557092affb50 2024-09-14T10:46:19.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93941985753312] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa2082719c0 20 remove_watcher() i=1 2024-09-14T10:46:19.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93941985746640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b346f0 con 0x557092b05dc0 2024-09-14T10:46:19.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa205576640 1 -- 172.21.15.96:0/744039666 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93941985746640] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1fc05f040 con 0x557092b05dc0 2024-09-14T10:46:19.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa2082719c0 20 remove_watcher() i=2 2024-09-14T10:46:19.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93941985759312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b09ed0 con 0x7fa1fc035070 2024-09-14T10:46:19.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa206578640 1 -- 172.21.15.96:0/744039666 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93941985759312] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1f802f040 con 0x7fa1fc035070 2024-09-14T10:46:19.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa2082719c0 20 remove_watcher() i=3 2024-09-14T10:46:19.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.581+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93941985764112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b09ed0 con 0x557092affb50 2024-09-14T10:46:19.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.585+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93941985764112] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x557092affb50 2024-09-14T10:46:19.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.585+0000 7fa2082719c0 20 remove_watcher() i=4 2024-09-14T10:46:19.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.585+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93941985765952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b0e310 con 0x7fa1f8019040 2024-09-14T10:46:19.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.585+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93941985765952] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.585+0000 7fa2082719c0 20 remove_watcher() i=5 2024-09-14T10:46:19.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.585+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93941985767008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b09ed0 con 0x7fa1f8019040 2024-09-14T10:46:19.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93941985767008] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 20 remove_watcher() i=6 2024-09-14T10:46:19.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93941985768544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557092b09ed0 con 0x7fa1f8019040 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93941985768544] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2000bbcc0 con 0x7fa1f8019040 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 20 remove_watcher() i=7 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa1f8019040 msgr2=0x7fa1f8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fa1f8019040 0x7fa1f8019930 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557092affb50 msgr2=0x557092b01fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x557092affb50 0x557092b01fe0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa1fc035070 msgr2=0x7fa1fc0494d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fa1fc035070 0x7fa1fc0494d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557092b05dc0 msgr2=0x557092b081b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.589+0000 7fa2082719c0 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x557092b05dc0 0x557092b081b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0d003a1a0 msgr2=0x7fa0d003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0d003a1a0 0x7fa0d003c660 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800f010 tx=0x7fa1f801b070 comp rx=0 tx=0).stop 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 msgr2=0x557092af47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/744039666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092aee210 0x557092af47a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0266c0 tx=0x7fa1fc050720 comp rx=0 tx=0).stop 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 reap_dead start 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa205d77640 1 -- 172.21.15.96:0/744039666 reap_dead start 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 shutdown_connections 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 >> 172.21.15.96:0/744039666 conn(0x557092ae9630 msgr2=0x557092ae7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 shutdown_connections 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/744039666 wait complete. 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/318659491 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0e003a150 msgr2=0x7fa0e003c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/318659491 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0e003a150 0x7fa0e003c610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800e3f0 tx=0x7fa1f8003070 comp rx=0 tx=0).stop 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/318659491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092ae08a0 msgr2=0x557092ae0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/318659491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092ae08a0 0x557092ae0cc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00e670 tx=0x7fa1fc00ea70 comp rx=0 tx=0).stop 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/318659491 shutdown_connections 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/318659491 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0e003a150 0x7fa0e003c610 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/318659491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092ae08a0 0x557092ae0cc0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/318659491 >> 172.21.15.96:0/318659491 conn(0x557092ad6250 msgr2=0x557092ad6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/318659491 shutdown_connections 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/318659491 wait complete. 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55709294ab50 msgr2=0x557092ad0260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55709294ab50 0x557092ad0260 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0ec03a150 msgr2=0x7fa0ec03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0ec03a150 0x7fa0ec03c610 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc001e40 tx=0x7fa1fc0013a0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 msgr2=0x557092ac90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac90f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa20001b0d0 tx=0x55709294a490 comp rx=0 tx=0).stop 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 shutdown_connections 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55709294ab50 0x557092ad0260 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa0ec03a150 0x7fa0ec03c610 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 --2- 172.21.15.96:0/2754525601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557092949550 0x557092ac90f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 >> 172.21.15.96:0/2754525601 conn(0x5570929cfb30 msgr2=0x557092ac2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 shutdown_connections 2024-09-14T10:46:19.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.593+0000 7fa2082719c0 1 -- 172.21.15.96:0/2754525601 wait complete. 2024-09-14T10:46:19.602 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.602 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.602 ERROR:root:0 2024-09-14T10:46:19.603 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:19.607 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000025c9d9e836db5f1e-0066e5697b-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:46:19.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-14T10:46:19.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-14T10:46:19.608 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-14T10:46:19.672 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:19.673 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:19.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd47bd2b9c0 1 Processor -- start 2024-09-14T10:46:19.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd47bd2b9c0 1 -- start start 2024-09-14T10:46:19.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd47bd2b9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x560350275640 0x5603503097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd47bd2b9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5603501a97a0 con 0x560350275260 2024-09-14T10:46:19.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd47bd2b9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5603502051b0 con 0x560350275640 2024-09-14T10:46:19.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd471030640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x560350275640 0x5603503097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd479831640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x560350275260 0x560350306090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38370/0 (socket says 172.21.15.96:38370) 2024-09-14T10:46:19.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd479831640 1 -- 172.21.15.96:0/2149643932 learned_addr learned my addr 172.21.15.96:0/2149643932 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:46:19.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd471030640 1 -- 172.21.15.96:0/2149643932 >> v1:172.21.15.70:6789/0 conn(0x560350275260 legacy=0x560350306090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.673+0000 7fd471030640 1 -- 172.21.15.96:0/2149643932 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560350183da0 con 0x560350275640 2024-09-14T10:46:19.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd471030640 1 --2- 172.21.15.96:0/2149643932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503097c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd46400a480 tx=0x7fd46401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1602a48bb846b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd479030640 1 -- 172.21.15.96:0/2149643932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4640b0070 con 0x560350275640 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd479030640 1 -- 172.21.15.96:0/2149643932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4640ab540 con 0x560350275640 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd479030640 1 -- 172.21.15.96:0/2149643932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4640ab840 con 0x560350275640 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2149643932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 msgr2=0x5603503097c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2149643932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503097c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd46400a480 tx=0x7fd46401b280 comp rx=0 tx=0).stop 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2149643932 shutdown_connections 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2149643932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503097c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2149643932 >> 172.21.15.96:0/2149643932 conn(0x5603502fb980 msgr2=0x5603502fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2149643932 shutdown_connections 2024-09-14T10:46:19.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.677+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2149643932 wait complete. 2024-09-14T10:46:19.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd47bd2b9c0 1 Processor -- start 2024-09-14T10:46:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd47bd2b9c0 1 -- start start 2024-09-14T10:46:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd47bd2b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275260 0x5603503ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd47bd2b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560350208fc0 con 0x560350275260 2024-09-14T10:46:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd479831640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275260 0x5603503ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd479831640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275260 0x5603503ee640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52028/0 (socket says 172.21.15.96:52028) 2024-09-14T10:46:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd479831640 1 -- 172.21.15.96:0/1093881507 learned_addr learned my addr 172.21.15.96:0/1093881507 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd479831640 1 -- 172.21.15.96:0/1093881507 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603503eec30 con 0x560350275260 2024-09-14T10:46:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd479831640 1 --2- 172.21.15.96:0/1093881507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275260 0x5603503ee640 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd46c001e00 tx=0x7fd46c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d9d734d21aad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.689+0000 7fd367e07640 1 -- 172.21.15.96:0/1093881507 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46c012020 con 0x560350275260 2024-09-14T10:46:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd367e07640 1 -- 172.21.15.96:0/1093881507 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c00e690 con 0x560350275260 2024-09-14T10:46:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd367e07640 1 -- 172.21.15.96:0/1093881507 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46c00ea10 con 0x560350275260 2024-09-14T10:46:19.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1093881507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275260 msgr2=0x5603503ee640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/1093881507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275260 0x5603503ee640 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd46c001e00 tx=0x7fd46c00b6d0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1093881507 shutdown_connections 2024-09-14T10:46:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/1093881507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275260 0x5603503ee640 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1093881507 >> 172.21.15.96:0/1093881507 conn(0x5603502fb980 msgr2=0x5603503ea230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1093881507 shutdown_connections 2024-09-14T10:46:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1093881507 wait complete. 2024-09-14T10:46:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 Processor -- start 2024-09-14T10:46:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- start start 2024-09-14T10:46:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5603501aaa50 con 0x560350275640 2024-09-14T10:46:19.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd479831640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd479831640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52038/0 (socket says 172.21.15.96:52038) 2024-09-14T10:46:19.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd479831640 1 -- 172.21.15.96:0/2064695977 learned_addr learned my addr 172.21.15.96:0/2064695977 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd479831640 1 -- 172.21.15.96:0/2064695977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603503f6790 con 0x560350275640 2024-09-14T10:46:19.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd479831640 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503f6230 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x5603503ef600 tx=0x7fd46c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd366604640 1 -- 172.21.15.96:0/2064695977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46c012030 con 0x560350275640 2024-09-14T10:46:19.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603503f6a20 con 0x560350275640 2024-09-14T10:46:19.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603503f72e0 con 0x560350275640 2024-09-14T10:46:19.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd366604640 1 -- 172.21.15.96:0/2064695977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c001460 con 0x560350275640 2024-09-14T10:46:19.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.693+0000 7fd366604640 1 -- 172.21.15.96:0/2064695977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd46c01a830 con 0x560350275640 2024-09-14T10:46:19.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd366604640 1 -- 172.21.15.96:0/2064695977 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd46c015020 con 0x560350275640 2024-09-14T10:46:19.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd366604640 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd36003a1a0 0x7fd36003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd366604640 1 -- 172.21.15.96:0/2064695977 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd46c020030 con 0x560350275640 2024-09-14T10:46:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd471030640 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd36003a1a0 0x7fd36003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5603503fb2a0 0x5603503fd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603503fdbd0 con 0x5603503fb2a0 2024-09-14T10:46:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47a032640 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5603503fb2a0 0x5603503fd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd471030640 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd36003a1a0 0x7fd36003c660 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd4640ad000 tx=0x7fd4640a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47a032640 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5603503fb2a0 0x5603503fd690 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47a032640 1 -- 172.21.15.96:0/2064695977 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd47400a4d0 con 0x5603503fb2a0 2024-09-14T10:46:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603503fdf90 con 0x5603503fb2a0 2024-09-14T10:46:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47a032640 1 -- 172.21.15.96:0/2064695977 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd47400a4d0 con 0x5603503fb2a0 2024-09-14T10:46:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603503ff890 con 0x5603503fb2a0 2024-09-14T10:46:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47a032640 1 -- 172.21.15.96:0/2064695977 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd47400a4d0 con 0x5603503fb2a0 2024-09-14T10:46:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603503feac0 con 0x5603503fb2a0 2024-09-14T10:46:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47a032640 1 -- 172.21.15.96:0/2064695977 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd47400a4d0 con 0x5603503fb2a0 2024-09-14T10:46:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603503feee0 con 0x5603503fb2a0 2024-09-14T10:46:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47a032640 1 -- 172.21.15.96:0/2064695977 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd47400a4d0 con 0x5603503fb2a0 2024-09-14T10:46:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 Processor -- start 2024-09-14T10:46:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 -- start start 2024-09-14T10:46:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035040dc90 0x56035040e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd47bd2b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560350215d80 con 0x56035040dc90 2024-09-14T10:46:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd471030640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035040dc90 0x56035040e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd471030640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035040dc90 0x56035040e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52044/0 (socket says 172.21.15.96:52044) 2024-09-14T10:46:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.697+0000 7fd471030640 1 -- 172.21.15.96:0/1388641663 learned_addr learned my addr 172.21.15.96:0/1388641663 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd471030640 1 -- 172.21.15.96:0/1388641663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035040e6f0 con 0x56035040dc90 2024-09-14T10:46:19.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd471030640 1 --2- 172.21.15.96:0/1388641663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035040dc90 0x56035040e0b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd46401b2c0 tx=0x7fd464018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd35f7fe640 1 -- 172.21.15.96:0/1388641663 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4640c7070 con 0x56035040dc90 2024-09-14T10:46:19.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd35f7fe640 1 -- 172.21.15.96:0/1388641663 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4640c2400 con 0x56035040dc90 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1388641663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56035040ef50 con 0x56035040dc90 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd35f7fe640 1 -- 172.21.15.96:0/1388641663 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4640b0040 con 0x56035040dc90 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1388641663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56035040f460 con 0x56035040dc90 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd35f7fe640 1 -- 172.21.15.96:0/1388641663 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd4640ca070 con 0x56035040dc90 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd35f7fe640 1 --2- 172.21.15.96:0/1388641663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd35403a150 0x7fd35403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd35f7fe640 1 -- 172.21.15.96:0/1388641663 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd4640a8070 con 0x56035040dc90 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd47a032640 1 --2- 172.21.15.96:0/1388641663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd35403a150 0x7fd35403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd47bd2b9c0 1 Processor -- start 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd47bd2b9c0 1 -- start start 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd47a032640 1 --2- 172.21.15.96:0/1388641663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd35403a150 0x7fd35403c610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5603503fee60 tx=0x7fd474005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd47bd2b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x56035041b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd47bd2b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5603503ef060 con 0x56035041b540 2024-09-14T10:46:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd471030640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x56035041b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd471030640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x56035041b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52052/0 (socket says 172.21.15.96:52052) 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.701+0000 7fd471030640 1 -- 172.21.15.96:0/3449046099 learned_addr learned my addr 172.21.15.96:0/3449046099 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd471030640 1 -- 172.21.15.96:0/3449046099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56035041bf30 con 0x56035041b540 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd471030640 1 --2- 172.21.15.96:0/3449046099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x56035041b940 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd4640eb760 tx=0x7fd4640eb960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc3ef64ca264d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd35d7fa640 1 -- 172.21.15.96:0/3449046099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4640dd070 con 0x56035041b540 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd35d7fa640 1 -- 172.21.15.96:0/3449046099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4640ca490 con 0x56035041b540 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd35d7fa640 1 -- 172.21.15.96:0/3449046099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4640ed1f0 con 0x56035041b540 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3449046099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 msgr2=0x56035041b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3449046099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x56035041b940 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd4640eb760 tx=0x7fd4640eb960 comp rx=0 tx=0).stop 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3449046099 shutdown_connections 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3449046099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x56035041b940 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3449046099 >> 172.21.15.96:0/3449046099 conn(0x560350416960 msgr2=0x560350414ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3449046099 shutdown_connections 2024-09-14T10:46:19.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3449046099 wait complete. 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 Processor -- start 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- start start 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x560350421ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56035041a490 con 0x56035041b540 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd471030640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x560350421ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd471030640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x560350421ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52066/0 (socket says 172.21.15.96:52066) 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 learned_addr learned my addr 172.21.15.96:0/3363684463 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560350422010 con 0x56035041b540 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd471030640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x560350421ab0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd4640ca8b0 tx=0x7fd4640eb6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd34b7fe640 1 -- 172.21.15.96:0/3363684463 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4640e5070 con 0x56035041b540 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603504222a0 con 0x56035041b540 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd34b7fe640 1 -- 172.21.15.96:0/3363684463 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4640cad60 con 0x56035041b540 2024-09-14T10:46:19.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd34b7fe640 1 -- 172.21.15.96:0/3363684463 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4640dd040 con 0x56035041b540 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.705+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560350422c50 con 0x56035041b540 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd34b7fe640 1 -- 172.21.15.96:0/3363684463 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd4640e8070 con 0x56035041b540 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd34b7fe640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd34b7fe640 1 -- 172.21.15.96:0/3363684463 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd4640b8040 con 0x56035041b540 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47a032640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56035042d080 0x56035042f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56035042fc60 con 0x56035042d080 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd479831640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56035042d080 0x56035042f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47a032640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5603503fe5e0 tx=0x7fd47401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd479831640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56035042d080 0x56035042f510 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 realm 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350430070 con 0x56035042d080 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350430940 con 0x56035042d080 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350430ce0 con 0x56035042d080 2024-09-14T10:46:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350431530 con 0x56035042d080 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 20 searching for the correct realm 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5603504332a0 0x560350435690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd471030640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5603504332a0 0x560350435690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd471030640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5603504332a0 0x560350435690 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd471030640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4640ea070 0x7fd4640e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd4640ea070 2024-09-14T10:46:19.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47a032640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4640ea070 0x7fd4640e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47a032640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4640ea070 0x7fd4640e1a50 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd47401f070 con 0x7fd4640ea070 2024-09-14T10:46:19.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47a032640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd474031040 0x7fd474032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.709+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd474031040 2024-09-14T10:46:19.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd474031040 0x7fd474032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd474031040 0x7fd474032430 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x56035042d080 2024-09-14T10:46:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x56035042d080 2024-09-14T10:46:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd474031040 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd474031040 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd4640ea070 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd47401f070 con 0x7fd4640ea070 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x56035042d080 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.713+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd474031040 2024-09-14T10:46:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x56035042d080 2024-09-14T10:46:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd4640ea070 2024-09-14T10:46:19.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd47401f070 con 0x7fd4640ea070 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd474031040 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x56035042d080 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x56035042d080 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd474031040 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd4640ea070 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd47401f070 con 0x7fd4640ea070 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.717+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x56035042d080 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd4640ea070 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd47401f070 con 0x7fd4640ea070 2024-09-14T10:46:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd474031040 2024-09-14T10:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd4640ea070 2024-09-14T10:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd47401f070 con 0x7fd4640ea070 2024-09-14T10:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x5603504332a0 2024-09-14T10:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd474031040 2024-09-14T10:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x56035042d080 2024-09-14T10:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560350435c20 con 0x7fd4640ea070 2024-09-14T10:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd474040040 con 0x7fd4640ea070 2024-09-14T10:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350431eb0 con 0x56035042d080 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350432750 con 0x56035042d080 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350432750 con 0x56035042d080 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 zone default found 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 4 Realm: () 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 zonegroup default 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.721+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350436080 con 0x7fd4640ea070 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd474040040 con 0x7fd4640ea070 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350437f70 con 0x5603504332a0 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603504384b0 con 0x5603504332a0 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 20 started sync module instance, tier type = 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504372b0 con 0x7fd4640ea070 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd474040040 con 0x7fd4640ea070 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94572231489488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504372b0 con 0x7fd4640ea070 2024-09-14T10:46:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560350438f70 con 0x56035042d080 2024-09-14T10:46:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94572231489488] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd474040040 con 0x7fd4640ea070 2024-09-14T10:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94572231494272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504372b0 con 0x56035042d080 2024-09-14T10:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.725+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560350439980 con 0x5603504332a0 2024-09-14T10:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.729+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.729+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94572231496912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043a1d0 con 0x5603504332a0 2024-09-14T10:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.729+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94572231494272] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.729+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560350436e00 con 0x7fd4640ea070 2024-09-14T10:46:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.729+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd474040040 con 0x7fd4640ea070 2024-09-14T10:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.729+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94572231501536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043afb0 con 0x7fd4640ea070 2024-09-14T10:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.729+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043b970 con 0x56035042d080 2024-09-14T10:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.729+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94572231496912] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.733+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94572231501536] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd474040040 con 0x7fd4640ea070 2024-09-14T10:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.733+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.733+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94572231505088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043afb0 con 0x56035042d080 2024-09-14T10:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.733+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043b8e0 con 0x7fd474031040 2024-09-14T10:46:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.733+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94572231505088] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.733+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.733+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94572231502592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043af20 con 0x7fd474031040 2024-09-14T10:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.733+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043c7a0 con 0x7fd474031040 2024-09-14T10:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94572231502592] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94572231507152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043c7a0 con 0x7fd474031040 2024-09-14T10:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043d160 con 0x7fd474031040 2024-09-14T10:46:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94572231507152] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94572231509200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043d160 con 0x7fd474031040 2024-09-14T10:46:19.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 20 add_watcher() i=0 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 20 add_watcher() i=1 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 20 add_watcher() i=2 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 20 add_watcher() i=3 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 20 add_watcher() i=4 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 20 add_watcher() i=5 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.737+0000 7fd47bd2b9c0 20 add_watcher() i=6 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94572231509200] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 20 add_watcher() i=7 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350440490 con 0x56035042d080 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94572231524032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043d2d0 con 0x56035042d080 2024-09-14T10:46:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94572231524032] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd32bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 5 note: GC not initialized 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd32affd640 20 reqs_thread_entry: start 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 20 Filter name: none 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd328ff9640 20 reqs_thread_entry: start 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.741+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350463d20 con 0x7fd474031040 2024-09-14T10:46:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-14T10:46:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035046aa90 con 0x7fd474031040 2024-09-14T10:46:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:19.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.745+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94572231697664 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560350466180 con 0x56035042d080 2024-09-14T10:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94572231505088 notify 146028888109 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fd46c033040 con 0x56035042d080 2024-09-14T10:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd35d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888109 cookie 94572231505088 notifier 4907 bl.length()=636 2024-09-14T10:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd35d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd35d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 94572231697664 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd35d7fa640 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd33c003eb0 con 0x56035042d080 2024-09-14T10:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94572231697664 notify 146028888109 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5603503f72e0 con 0x56035042d080 2024-09-14T10:46:19.750 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd32bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94572231524032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504618c0 con 0x56035042d080 2024-09-14T10:46:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94572231524032] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94572231489488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504618c0 con 0x7fd4640ea070 2024-09-14T10:46:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94572231489488] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd474040040 con 0x7fd4640ea070 2024-09-14T10:46:19.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd47bd2b9c0 20 remove_watcher() i=0 2024-09-14T10:46:19.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd47bd2b9c0 2 removed watcher, disabling cache 2024-09-14T10:46:19.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.749+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94572231494272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504618c0 con 0x56035042d080 2024-09-14T10:46:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.753+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94572231494272] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.753+0000 7fd47bd2b9c0 20 remove_watcher() i=1 2024-09-14T10:46:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.753+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94572231496912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504618c0 con 0x5603504332a0 2024-09-14T10:46:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.753+0000 7fd471030640 1 -- 172.21.15.96:0/3363684463 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94572231496912] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4640e7030 con 0x5603504332a0 2024-09-14T10:46:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.753+0000 7fd47bd2b9c0 20 remove_watcher() i=2 2024-09-14T10:46:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.753+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94572231501536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504394d0 con 0x7fd4640ea070 2024-09-14T10:46:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.757+0000 7fd47a032640 1 -- 172.21.15.96:0/3363684463 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94572231501536] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd474040040 con 0x7fd4640ea070 2024-09-14T10:46:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.757+0000 7fd47bd2b9c0 20 remove_watcher() i=3 2024-09-14T10:46:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.757+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94572231505088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603504394d0 con 0x56035042d080 2024-09-14T10:46:19.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.757+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94572231505088] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x56035042d080 2024-09-14T10:46:19.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.757+0000 7fd47bd2b9c0 20 remove_watcher() i=4 2024-09-14T10:46:19.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.757+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94572231502592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043b4c0 con 0x7fd474031040 2024-09-14T10:46:19.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.761+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94572231502592] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.761+0000 7fd47bd2b9c0 20 remove_watcher() i=5 2024-09-14T10:46:19.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.761+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94572231507152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043b4c0 con 0x7fd474031040 2024-09-14T10:46:19.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.761+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94572231507152] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.761+0000 7fd47bd2b9c0 20 remove_watcher() i=6 2024-09-14T10:46:19.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.761+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94572231509200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56035043bcd0 con 0x7fd474031040 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94572231509200] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46c008030 con 0x7fd474031040 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 20 remove_watcher() i=7 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd474031040 msgr2=0x7fd474032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fd474031040 0x7fd474032430 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56035042d080 msgr2=0x56035042f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x56035042d080 0x56035042f510 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4640ea070 msgr2=0x7fd4640e1a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fd4640ea070 0x7fd4640e1a50 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5603504332a0 msgr2=0x560350435690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5603504332a0 0x560350435690 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 msgr2=0x7fd34403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd34403a150 0x7fd34403c610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5603503fe5e0 tx=0x7fd47401f000 comp rx=0 tx=0).stop 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 msgr2=0x560350421ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd479831640 1 -- 172.21.15.96:0/3363684463 reap_dead start 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x560350421ab0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd4640ca8b0 tx=0x7fd4640eb6f0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 shutdown_connections 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/3363684463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035041b540 0x560350421ab0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 >> 172.21.15.96:0/3363684463 conn(0x560350416960 msgr2=0x560350414b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 shutdown_connections 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/3363684463 wait complete. 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1388641663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd35403a150 msgr2=0x7fd35403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/1388641663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd35403a150 0x7fd35403c610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5603503fee60 tx=0x7fd474005850 comp rx=0 tx=0).stop 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1388641663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035040dc90 msgr2=0x56035040e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/1388641663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035040dc90 0x56035040e0b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd46401b2c0 tx=0x7fd464018020 comp rx=0 tx=0).stop 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1388641663 shutdown_connections 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/1388641663 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd35403a150 0x7fd35403c610 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/1388641663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56035040dc90 0x56035040e0b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1388641663 >> 172.21.15.96:0/1388641663 conn(0x560350403640 msgr2=0x560350403a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1388641663 shutdown_connections 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/1388641663 wait complete. 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5603503fb2a0 msgr2=0x5603503fd690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5603503fb2a0 0x5603503fd690 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd36003a1a0 msgr2=0x7fd36003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd36003a1a0 0x7fd36003c660 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd4640ad000 tx=0x7fd4640a5040 comp rx=0 tx=0).stop 2024-09-14T10:46:19.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 msgr2=0x5603503f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503f6230 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x5603503ef600 tx=0x7fd46c000bd0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 shutdown_connections 2024-09-14T10:46:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5603503fb2a0 0x5603503fd690 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd36003a1a0 0x7fd36003c660 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 --2- 172.21.15.96:0/2064695977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560350275640 0x5603503f6230 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 >> 172.21.15.96:0/2064695977 conn(0x5603502fb980 msgr2=0x5603503efb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 shutdown_connections 2024-09-14T10:46:19.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.765+0000 7fd47bd2b9c0 1 -- 172.21.15.96:0/2064695977 wait complete. 2024-09-14T10:46:19.775 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.776 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.776 ERROR:root:0 2024-09-14T10:46:19.776 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:46:19.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:46:19.776 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-14T10:46:19.851 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:19.852 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:19.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9935a5f9c0 1 Processor -- start 2024-09-14T10:46:19.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9935a5f9c0 1 -- start start 2024-09-14T10:46:19.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9935a5f9c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5586e69e5260 0x5586e6a73c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9935a5f9c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5586e69197a0 con 0x5586e6a741d0 2024-09-14T10:46:19.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9935a5f9c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x5586e69751b0 con 0x5586e69e5260 2024-09-14T10:46:19.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9933565640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5586e69e5260 0x5586e6a73c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9933565640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x5586e69e5260 0x5586e6a73c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52070/0 (socket says 172.21.15.96:52070) 2024-09-14T10:46:19.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9933565640 1 -- 172.21.15.96:0/2470978192 learned_addr learned my addr 172.21.15.96:0/2470978192 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9932d64640 1 --1- 172.21.15.96:0/2470978192 >> v1:172.21.15.70:6789/0 conn(0x5586e6a741d0 0x5586e6a765c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38372/0 (socket says 172.21.15.96:38372) 2024-09-14T10:46:19.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9933565640 1 -- 172.21.15.96:0/2470978192 >> v1:172.21.15.70:6789/0 conn(0x5586e6a741d0 legacy=0x5586e6a765c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9933565640 1 -- 172.21.15.96:0/2470978192 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e68f3da0 con 0x5586e69e5260 2024-09-14T10:46:19.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.853+0000 7f9933565640 1 --2- 172.21.15.96:0/2470978192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a73c90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f992400a5c0 tx=0x7f992401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe63ff2634b05a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9932563640 1 -- 172.21.15.96:0/2470978192 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99240b1070 con 0x5586e69e5260 2024-09-14T10:46:19.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9932563640 1 -- 172.21.15.96:0/2470978192 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99240a8070 con 0x5586e69e5260 2024-09-14T10:46:19.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9932563640 1 -- 172.21.15.96:0/2470978192 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99240ac5b0 con 0x5586e69e5260 2024-09-14T10:46:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/2470978192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 msgr2=0x5586e6a73c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/2470978192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a73c90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f992400a5c0 tx=0x7f992401b340 comp rx=0 tx=0).stop 2024-09-14T10:46:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/2470978192 shutdown_connections 2024-09-14T10:46:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/2470978192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a73c90 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/2470978192 >> 172.21.15.96:0/2470978192 conn(0x5586e6a6b980 msgr2=0x5586e6a6dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/2470978192 shutdown_connections 2024-09-14T10:46:19.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.857+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/2470978192 wait complete. 2024-09-14T10:46:19.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9935a5f9c0 1 Processor -- start 2024-09-14T10:46:19.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9935a5f9c0 1 -- start start 2024-09-14T10:46:19.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9935a5f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a71270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9935a5f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5586e6978fc0 con 0x5586e69e5260 2024-09-14T10:46:19.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9933565640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a71270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9933565640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a71270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52074/0 (socket says 172.21.15.96:52074) 2024-09-14T10:46:19.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9933565640 1 -- 172.21.15.96:0/3996366643 learned_addr learned my addr 172.21.15.96:0/3996366643 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9933565640 1 -- 172.21.15.96:0/3996366643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e6a71860 con 0x5586e69e5260 2024-09-14T10:46:19.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f9933565640 1 --2- 172.21.15.96:0/3996366643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a71270 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f99240af040 tx=0x7f9924003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7960d921a51cee94 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f982160a640 1 -- 172.21.15.96:0/3996366643 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99240b1040 con 0x5586e69e5260 2024-09-14T10:46:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f982160a640 1 -- 172.21.15.96:0/3996366643 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99240ac820 con 0x5586e69e5260 2024-09-14T10:46:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.869+0000 7f982160a640 1 -- 172.21.15.96:0/3996366643 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99240acb00 con 0x5586e69e5260 2024-09-14T10:46:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3996366643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 msgr2=0x5586e6a71270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/3996366643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a71270 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f99240af040 tx=0x7f9924003030 comp rx=0 tx=0).stop 2024-09-14T10:46:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3996366643 shutdown_connections 2024-09-14T10:46:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/3996366643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6a71270 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3996366643 >> 172.21.15.96:0/3996366643 conn(0x5586e6a6b980 msgr2=0x5586e6b58140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3996366643 shutdown_connections 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3996366643 wait complete. 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 Processor -- start 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- start start 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6b65f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5586e691aa50 con 0x5586e69e5260 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9933565640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6b65f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9933565640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6b65f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52082/0 (socket says 172.21.15.96:52082) 2024-09-14T10:46:19.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9933565640 1 -- 172.21.15.96:0/1345790128 learned_addr learned my addr 172.21.15.96:0/1345790128 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9933565640 1 -- 172.21.15.96:0/1345790128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e6b66480 con 0x5586e69e5260 2024-09-14T10:46:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9933565640 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6b65f20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9924018f70 tx=0x7f9924019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f981fe07640 1 -- 172.21.15.96:0/1345790128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99240cd070 con 0x5586e69e5260 2024-09-14T10:46:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586e6b66710 con 0x5586e69e5260 2024-09-14T10:46:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e6b670c0 con 0x5586e69e5260 2024-09-14T10:46:19.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f981fe07640 1 -- 172.21.15.96:0/1345790128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99240b7a20 con 0x5586e69e5260 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f981fe07640 1 -- 172.21.15.96:0/1345790128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99240b1070 con 0x5586e69e5260 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f981fe07640 1 -- 172.21.15.96:0/1345790128 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f99240d0070 con 0x5586e69e5260 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f981fe07640 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f981803a150 0x7f981803c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f981fe07640 1 -- 172.21.15.96:0/1345790128 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f99240ebb70 con 0x5586e69e5260 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.873+0000 7f9932d64640 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f981803a150 0x7f981803c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6a741d0 0x5586e6b6d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6b6d5d0 con 0x5586e6a741d0 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9933d66640 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6a741d0 0x5586e6b6d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9932d64640 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f981803a150 0x7f981803c610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9928001e40 tx=0x7f99280013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9933d66640 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6a741d0 0x5586e6b6d090 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9933d66640 1 -- 172.21.15.96:0/1345790128 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f992c00a4d0 con 0x5586e6a741d0 2024-09-14T10:46:19.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6b67440 con 0x5586e6a741d0 2024-09-14T10:46:19.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9933d66640 1 -- 172.21.15.96:0/1345790128 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f992c00a4d0 con 0x5586e6a741d0 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6b6f380 con 0x5586e6a741d0 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9933d66640 1 -- 172.21.15.96:0/1345790128 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f992c00a4d0 con 0x5586e6a741d0 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6b6e5b0 con 0x5586e6a741d0 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9933d66640 1 -- 172.21.15.96:0/1345790128 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f992c00a4d0 con 0x5586e6a741d0 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6b6e9d0 con 0x5586e6a741d0 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9933d66640 1 -- 172.21.15.96:0/1345790128 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f992c00a4d0 con 0x5586e6a741d0 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 Processor -- start 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- start start 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b7d770 0x5586e6b7db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5586e6985d80 con 0x5586e6b7d770 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9932d64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b7d770 0x5586e6b7db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9932d64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b7d770 0x5586e6b7db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52094/0 (socket says 172.21.15.96:52094) 2024-09-14T10:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9932d64640 1 -- 172.21.15.96:0/3786280749 learned_addr learned my addr 172.21.15.96:0/3786280749 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9932d64640 1 -- 172.21.15.96:0/3786280749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e6b7e1d0 con 0x5586e6b7d770 2024-09-14T10:46:19.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9932d64640 1 --2- 172.21.15.96:0/3786280749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b7d770 0x5586e6b7db90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f992800e670 tx=0x7f992800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f981d602640 1 -- 172.21.15.96:0/3786280749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9928022070 con 0x5586e6b7d770 2024-09-14T10:46:19.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3786280749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586e6b7ea30 con 0x5586e6b7d770 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f981d602640 1 -- 172.21.15.96:0/3786280749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992800d660 con 0x5586e6b7d770 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f981d602640 1 -- 172.21.15.96:0/3786280749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9928006070 con 0x5586e6b7d770 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.877+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3786280749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e6b7efa0 con 0x5586e6b7d770 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f981d602640 1 -- 172.21.15.96:0/3786280749 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9928025070 con 0x5586e6b7d770 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f981d602640 1 --2- 172.21.15.96:0/3786280749 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f980c03a150 0x7f980c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f981d602640 1 -- 172.21.15.96:0/3786280749 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9928052440 con 0x5586e6b7d770 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9933d66640 1 --2- 172.21.15.96:0/3786280749 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f980c03a150 0x7f980c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 Processor -- start 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 -- start start 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9933d66640 1 --2- 172.21.15.96:0/3786280749 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f980c03a150 0x7f980c03c610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5586e6b6e950 tx=0x7f992c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b8b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5586e6a6fb40 con 0x5586e6b8b0e0 2024-09-14T10:46:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9932d64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b8b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9932d64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b8b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52096/0 (socket says 172.21.15.96:52096) 2024-09-14T10:46:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9932d64640 1 -- 172.21.15.96:0/1827872127 learned_addr learned my addr 172.21.15.96:0/1827872127 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9932d64640 1 -- 172.21.15.96:0/1827872127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e6b8bad0 con 0x5586e6b8b0e0 2024-09-14T10:46:19.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9932d64640 1 --2- 172.21.15.96:0/1827872127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b8b4e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f99280507c0 tx=0x7f9928024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7631fccbbef5e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9816ffd640 1 -- 172.21.15.96:0/1827872127 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992800dcc0 con 0x5586e6b8b0e0 2024-09-14T10:46:19.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9816ffd640 1 -- 172.21.15.96:0/1827872127 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992804f220 con 0x5586e6b8b0e0 2024-09-14T10:46:19.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9816ffd640 1 -- 172.21.15.96:0/1827872127 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992800de60 con 0x5586e6b8b0e0 2024-09-14T10:46:19.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1827872127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 msgr2=0x5586e6b8b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1827872127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b8b4e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f99280507c0 tx=0x7f9928024c90 comp rx=0 tx=0).stop 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1827872127 shutdown_connections 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1827872127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b8b4e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1827872127 >> 172.21.15.96:0/1827872127 conn(0x5586e6b86500 msgr2=0x5586e6b84740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1827872127 shutdown_connections 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.881+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1827872127 wait complete. 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 1 Processor -- start 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 1 -- start start 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b915f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5586e6b8a030 con 0x5586e6b8b0e0 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9932d64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9932d64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b915f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52108/0 (socket says 172.21.15.96:52108) 2024-09-14T10:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 learned_addr learned my addr 172.21.15.96:0/400161523 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e6b91b50 con 0x5586e6b8b0e0 2024-09-14T10:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9932d64640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b915f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f9928024d20 tx=0x7f9928050720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f98157fa640 1 -- 172.21.15.96:0/400161523 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9928025c80 con 0x5586e6b8b0e0 2024-09-14T10:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586e6b91de0 con 0x5586e6b8b0e0 2024-09-14T10:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f98157fa640 1 -- 172.21.15.96:0/400161523 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9928025e20 con 0x5586e6b8b0e0 2024-09-14T10:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f98157fa640 1 -- 172.21.15.96:0/400161523 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f992801a450 con 0x5586e6b8b0e0 2024-09-14T10:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e6b91de0 con 0x5586e6b8b0e0 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f98157fa640 1 -- 172.21.15.96:0/400161523 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f9928033070 con 0x5586e6b8b0e0 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f98157fa640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97fc03a150 0x7f97fc03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f98157fa640 1 -- 172.21.15.96:0/400161523 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9928045070 con 0x5586e6b8b0e0 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9933d66640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97fc03a150 0x7f97fc03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6b9c9a0 0x5586e6b9ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6b9f580 con 0x5586e6b9c9a0 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.885+0000 7f9933565640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6b9c9a0 0x5586e6b9ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933d66640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97fc03a150 0x7f97fc03c610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5586e6b6e0d0 tx=0x7f992c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933565640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6b9c9a0 0x5586e6b9ee30 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 realm 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6b9f9e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba02b0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba0650 con 0x5586e6b9c9a0 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba0ea0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 20 searching for the correct realm 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5586e6ba2c10 0x5586e6ba5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9932d64640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5586e6ba2c10 0x5586e6ba5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9932d64640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5586e6ba2c10 0x5586e6ba5000 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992803c070 con 0x5586e6ba2c10 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9932d64640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9928035070 0x7f9928029a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f9928035070 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933d66640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9928035070 0x7f9928029a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933d66640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9928035070 0x7f9928029a50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992c01f070 con 0x7f9928035070 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933d66640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f992c031040 0x7f992c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f992c031040 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933565640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f992c031040 0x7f992c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.889+0000 7f9933565640 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f992c031040 0x7f992c032430 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x7f992c031040 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f992c031040 2024-09-14T10:46:19.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x7f992c031040 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f992c031040 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x7f992c031040 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f9928035070 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992c01f070 con 0x7f9928035070 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992803c070 con 0x5586e6ba2c10 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f992c031040 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x7f992c031040 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.893+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f9928035070 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f992c01f070 con 0x7f9928035070 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f992c031040 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x7f992c031040 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f992c031040 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99240cf030 con 0x7f992c031040 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f9928035070 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992c01f070 con 0x7f9928035070 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f99240cf030 con 0x5586e6b9c9a0 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f9928035070 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992c01f070 con 0x7f9928035070 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.897+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f992c031040 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f9928035070 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992c01f070 con 0x7f9928035070 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6ba2c10 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f992c031040 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba55e0 con 0x7f9928035070 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f992c040040 con 0x7f9928035070 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:19.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba17f0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba2090 con 0x5586e6b9c9a0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba5a60 con 0x5586e6b9c9a0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 zone default found 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 4 Realm: () 2024-09-14T10:46:19.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 zonegroup default 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba5a60 con 0x7f9928035070 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f992c040040 con 0x7f9928035070 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba7d40 con 0x5586e6ba2c10 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.901+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba8130 con 0x5586e6ba2c10 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9935a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9935a5f9c0 20 started sync module instance, tier type = 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9935a5f9c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba71d0 con 0x7f9928035070 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992c040040 con 0x7f9928035070 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94037884958144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba6e30 con 0x7f9928035070 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba9060 con 0x5586e6b9c9a0 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94037884958144] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992c040040 con 0x7f9928035070 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94037884962192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba9060 con 0x5586e6b9c9a0 2024-09-14T10:46:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.905+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba9950 con 0x5586e6ba2c10 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94037884965264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6baa1f0 con 0x5586e6ba2c10 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94037884962192] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba8bb0 con 0x7f9928035070 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992c040040 con 0x7f9928035070 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94037884970752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6baafd0 con 0x7f9928035070 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bab990 con 0x5586e6b9c9a0 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94037884965264] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.909+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94037884970752] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992c040040 con 0x7f9928035070 2024-09-14T10:46:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.913+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.913+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94037884971808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6baaf40 con 0x5586e6b9c9a0 2024-09-14T10:46:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.913+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6babe40 con 0x7f992c031040 2024-09-14T10:46:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.913+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94037884971808] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.913+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.913+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94037884974304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6babdb0 con 0x7f992c031040 2024-09-14T10:46:19.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.913+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bac770 con 0x7f992c031040 2024-09-14T10:46:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94037884974304] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94037884975840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bac770 con 0x7f992c031040 2024-09-14T10:46:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bad130 con 0x7f992c031040 2024-09-14T10:46:19.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94037884980352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bad550 con 0x7f992c031040 2024-09-14T10:46:19.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 20 add_watcher() i=0 2024-09-14T10:46:19.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 20 add_watcher() i=1 2024-09-14T10:46:19.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 20 add_watcher() i=2 2024-09-14T10:46:19.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 20 add_watcher() i=3 2024-09-14T10:46:19.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 20 add_watcher() i=4 2024-09-14T10:46:19.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 20 add_watcher() i=5 2024-09-14T10:46:19.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94037884975840] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.917+0000 7f9935a5f9c0 20 add_watcher() i=6 2024-09-14T10:46:19.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94037884980352] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 20 add_watcher() i=7 2024-09-14T10:46:19.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:19.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bac2c0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94037884977856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bada20 con 0x5586e6b9c9a0 2024-09-14T10:46:19.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94037884977856] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f97e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 5 note: GC not initialized 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f97e8fe1640 20 reqs_thread_entry: start 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 20 Filter name: none 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f97627fc640 20 reqs_thread_entry: start 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:19.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.921+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bd3cd0 con 0x7f992c031040 2024-09-14T10:46:19.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T10:46:19.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:19.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:19.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bda6b0 con 0x7f992c031040 2024-09-14T10:46:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94037885165856 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bd5d60 con 0x5586e6b9c9a0 2024-09-14T10:46:19.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94037884971808 notify 146028888110 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5586e6b670c0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9816ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888110 cookie 94037884971808 notifier 4914 bl.length()=649 2024-09-14T10:46:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9816ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9816ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 94037885165856 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9816ffd640 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f97f8003eb0 con 0x5586e6b9c9a0 2024-09-14T10:46:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.925+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94037885165856 notify 146028888110 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5586e6b66710 con 0x5586e6b9c9a0 2024-09-14T10:46:19.928 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.929+0000 7f97e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.929+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94037884977856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bd2e40 con 0x5586e6b9c9a0 2024-09-14T10:46:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.929+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94037884977856] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.929+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94037884958144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bd2e40 con 0x7f9928035070 2024-09-14T10:46:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.929+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94037884958144] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992c040040 con 0x7f9928035070 2024-09-14T10:46:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.929+0000 7f9935a5f9c0 20 remove_watcher() i=0 2024-09-14T10:46:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.929+0000 7f9935a5f9c0 2 removed watcher, disabling cache 2024-09-14T10:46:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.929+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94037884962192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bd2e40 con 0x5586e6b9c9a0 2024-09-14T10:46:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94037884962192] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9935a5f9c0 20 remove_watcher() i=1 2024-09-14T10:46:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94037884965264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bd2e40 con 0x5586e6ba2c10 2024-09-14T10:46:19.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9932d64640 1 -- 172.21.15.96:0/400161523 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94037884965264] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9928060040 con 0x5586e6ba2c10 2024-09-14T10:46:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9935a5f9c0 20 remove_watcher() i=2 2024-09-14T10:46:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94037884970752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba75c0 con 0x7f9928035070 2024-09-14T10:46:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9933d66640 1 -- 172.21.15.96:0/400161523 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94037884970752] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f992c040040 con 0x7f9928035070 2024-09-14T10:46:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9935a5f9c0 20 remove_watcher() i=3 2024-09-14T10:46:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.933+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94037884971808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6baa700 con 0x5586e6b9c9a0 2024-09-14T10:46:19.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.937+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94037884971808] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x5586e6b9c9a0 2024-09-14T10:46:19.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.937+0000 7f9935a5f9c0 20 remove_watcher() i=4 2024-09-14T10:46:19.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.937+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94037884974304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba75c0 con 0x7f992c031040 2024-09-14T10:46:19.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.937+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94037884974304] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.937+0000 7f9935a5f9c0 20 remove_watcher() i=5 2024-09-14T10:46:19.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.937+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94037884975840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6bab4e0 con 0x7f992c031040 2024-09-14T10:46:19.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94037884975840] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 20 remove_watcher() i=6 2024-09-14T10:46:19.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94037884980352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586e6ba75c0 con 0x7f992c031040 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94037884980352] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9924104040 con 0x7f992c031040 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 20 remove_watcher() i=7 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f992c031040 msgr2=0x7f992c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f992c031040 0x7f992c032430 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6b9c9a0 msgr2=0x5586e6b9ee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6b9c9a0 0x5586e6b9ee30 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9928035070 msgr2=0x7f9928029a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f9928035070 0x7f9928029a50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5586e6ba2c10 msgr2=0x5586e6ba5000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x5586e6ba2c10 0x5586e6ba5000 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97fc03a150 msgr2=0x7f97fc03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f97fc03a150 0x7f97fc03c610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5586e6b6e0d0 tx=0x7f992c01f000 comp rx=0 tx=0).stop 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 msgr2=0x5586e6b915f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9933565640 1 -- 172.21.15.96:0/400161523 reap_dead start 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.941+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b915f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f9928024d20 tx=0x7f9928050720 comp rx=0 tx=0).stop 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 shutdown_connections 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/400161523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b8b0e0 0x5586e6b915f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 >> 172.21.15.96:0/400161523 conn(0x5586e6b86500 msgr2=0x5586e6b84710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 shutdown_connections 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/400161523 wait complete. 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3786280749 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f980c03a150 msgr2=0x7f980c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/3786280749 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f980c03a150 0x7f980c03c610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5586e6b6e950 tx=0x7f992c005850 comp rx=0 tx=0).stop 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3786280749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b7d770 msgr2=0x5586e6b7db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/3786280749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b7d770 0x5586e6b7db90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f992800e670 tx=0x7f992800ea70 comp rx=0 tx=0).stop 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3786280749 shutdown_connections 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/3786280749 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f980c03a150 0x7f980c03c610 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/3786280749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e6b7d770 0x5586e6b7db90 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3786280749 >> 172.21.15.96:0/3786280749 conn(0x5586e6b73120 msgr2=0x5586e6b73500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3786280749 shutdown_connections 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/3786280749 wait complete. 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6a741d0 msgr2=0x5586e6b6d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6a741d0 0x5586e6b6d090 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f981803a150 msgr2=0x7f981803c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f981803a150 0x7f981803c610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9928001e40 tx=0x7f99280013a0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 msgr2=0x5586e6b65f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:19.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6b65f20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9924018f70 tx=0x7f9924019b80 comp rx=0 tx=0).stop 2024-09-14T10:46:19.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 shutdown_connections 2024-09-14T10:46:19.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x5586e6a741d0 0x5586e6b6d090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f981803a150 0x7f981803c610 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 --2- 172.21.15.96:0/1345790128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5586e69e5260 0x5586e6b65f20 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:19.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 >> 172.21.15.96:0/1345790128 conn(0x5586e6a6b980 msgr2=0x5586e6b57c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:19.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 shutdown_connections 2024-09-14T10:46:19.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:19.945+0000 7f9935a5f9c0 1 -- 172.21.15.96:0/1345790128 wait complete. 2024-09-14T10:46:19.954 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.954 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:19.954 ERROR:root:0 2024-09-14T10:46:19.955 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:46:19.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:46:19.955 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-14T10:46:20.026 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:46:20.026 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:46:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.025+0000 7f1d75ed19c0 1 Processor -- start 2024-09-14T10:46:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.025+0000 7f1d75ed19c0 1 -- start start 2024-09-14T10:46:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.025+0000 7f1d75ed19c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c91836e260 0x55c91836e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.025+0000 7f1d75ed19c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9182147a0 con 0x55c9183713a0 2024-09-14T10:46:20.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.025+0000 7f1d75ed19c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55c9182701b0 con 0x55c91836e260 2024-09-14T10:46:20.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.025+0000 7f1d739d7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c91836e260 0x55c91836e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.025+0000 7f1d731d6640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55c9183713a0 0x55c918373790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:38374/0 (socket says 172.21.15.96:38374) 2024-09-14T10:46:20.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.025+0000 7f1d731d6640 1 -- 172.21.15.96:0/4113954222 learned_addr learned my addr 172.21.15.96:0/4113954222 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:46:20.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.029+0000 7f1d729d5640 1 -- 172.21.15.96:0/4113954222 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 981413354 0 0) 0x55c9182147a0 con 0x55c9183713a0 2024-09-14T10:46:20.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.029+0000 7f1d729d5640 1 -- 172.21.15.96:0/4113954222 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d5c001e20 con 0x55c9183713a0 2024-09-14T10:46:20.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.029+0000 7f1d739d7640 1 -- 172.21.15.96:0/4113954222 >> v1:172.21.15.70:6789/0 conn(0x55c9183713a0 legacy=0x55c918373790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.029+0000 7f1d739d7640 1 -- 172.21.15.96:0/4113954222 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9181eeda0 con 0x55c91836e260 2024-09-14T10:46:20.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.029+0000 7f1d739d7640 1 --2- 172.21.15.96:0/4113954222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c91836e640 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400a480 tx=0x7f1d6401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f199875166ca135 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.029+0000 7f1d729d5640 1 -- 172.21.15.96:0/4113954222 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d640b0070 con 0x55c91836e260 2024-09-14T10:46:20.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.029+0000 7f1d729d5640 1 -- 172.21.15.96:0/4113954222 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d640ab540 con 0x55c91836e260 2024-09-14T10:46:20.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.029+0000 7f1d729d5640 1 -- 172.21.15.96:0/4113954222 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d640ab820 con 0x55c91836e260 2024-09-14T10:46:20.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.033+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/4113954222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 msgr2=0x55c91836e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.033+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/4113954222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c91836e640 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400a480 tx=0x7f1d6401b280 comp rx=0 tx=0).stop 2024-09-14T10:46:20.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.033+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/4113954222 shutdown_connections 2024-09-14T10:46:20.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.033+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/4113954222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c91836e640 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.033+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/4113954222 >> 172.21.15.96:0/4113954222 conn(0x55c9182e1b70 msgr2=0x55c9182e1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:20.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.033+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/4113954222 shutdown_connections 2024-09-14T10:46:20.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.033+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/4113954222 wait complete. 2024-09-14T10:46:20.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 Processor -- start 2024-09-14T10:46:20.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 -- start start 2024-09-14T10:46:20.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918459410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c918273fc0 con 0x55c91836e260 2024-09-14T10:46:20.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d739d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918459410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d739d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918459410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52140/0 (socket says 172.21.15.96:52140) 2024-09-14T10:46:20.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d739d7640 1 -- 172.21.15.96:0/2883347675 learned_addr learned my addr 172.21.15.96:0/2883347675 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d739d7640 1 -- 172.21.15.96:0/2883347675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c918459a00 con 0x55c91836e260 2024-09-14T10:46:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d739d7640 1 --2- 172.21.15.96:0/2883347675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918459410 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1d640ae040 tx=0x7f1d64003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38006bb4e73d7e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1c61e0b640 1 -- 172.21.15.96:0/2883347675 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d640b0070 con 0x55c91836e260 2024-09-14T10:46:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1c61e0b640 1 -- 172.21.15.96:0/2883347675 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d640bc070 con 0x55c91836e260 2024-09-14T10:46:20.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1c61e0b640 1 -- 172.21.15.96:0/2883347675 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d640abaf0 con 0x55c91836e260 2024-09-14T10:46:20.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/2883347675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 msgr2=0x55c918459410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/2883347675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918459410 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1d640ae040 tx=0x7f1d64003030 comp rx=0 tx=0).stop 2024-09-14T10:46:20.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/2883347675 shutdown_connections 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/2883347675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918459410 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/2883347675 >> 172.21.15.96:0/2883347675 conn(0x55c9182e1b70 msgr2=0x55c918455050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/2883347675 shutdown_connections 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/2883347675 wait complete. 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 Processor -- start 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.045+0000 7f1d75ed19c0 1 -- start start 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d75ed19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918460ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d75ed19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c918215a50 con 0x55c91836e260 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d739d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918460ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d739d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918460ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52156/0 (socket says 172.21.15.96:52156) 2024-09-14T10:46:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d739d7640 1 -- 172.21.15.96:0/886098425 learned_addr learned my addr 172.21.15.96:0/886098425 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d739d7640 1 -- 172.21.15.96:0/886098425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c918461100 con 0x55c91836e260 2024-09-14T10:46:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d739d7640 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918460ba0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1d6401b0b0 tx=0x7f1d64018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1c5bfff640 1 -- 172.21.15.96:0/886098425 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d640cd070 con 0x55c91836e260 2024-09-14T10:46:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1c5bfff640 1 -- 172.21.15.96:0/886098425 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d640bc040 con 0x55c91836e260 2024-09-14T10:46:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1c5bfff640 1 -- 172.21.15.96:0/886098425 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d640b7970 con 0x55c91836e260 2024-09-14T10:46:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c918461390 con 0x55c91836e260 2024-09-14T10:46:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c918461cf0 con 0x55c91836e260 2024-09-14T10:46:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1c5bfff640 1 -- 172.21.15.96:0/886098425 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1d640d0070 con 0x55c91836e260 2024-09-14T10:46:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1c5bfff640 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c5c03a150 0x7f1c5c03c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1c5bfff640 1 -- 172.21.15.96:0/886098425 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1d640a8070 con 0x55c91836e260 2024-09-14T10:46:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d731d6640 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c5c03a150 0x7f1c5c03c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c9183713a0 0x55c918467cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.049+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c918468200 con 0x55c9183713a0 2024-09-14T10:46:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d741d8640 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c9183713a0 0x55c918467cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d731d6640 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c5c03a150 0x7f1c5c03c610 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1d68001dc0 tx=0x7f1d68001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d741d8640 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c9183713a0 0x55c918467cc0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d741d8640 1 -- 172.21.15.96:0/886098425 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d6c00a4d0 con 0x55c9183713a0 2024-09-14T10:46:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184685a0 con 0x55c9183713a0 2024-09-14T10:46:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d741d8640 1 -- 172.21.15.96:0/886098425 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d6c00a4d0 con 0x55c9183713a0 2024-09-14T10:46:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c918469ea0 con 0x55c9183713a0 2024-09-14T10:46:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d741d8640 1 -- 172.21.15.96:0/886098425 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d6c00a4d0 con 0x55c9183713a0 2024-09-14T10:46:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184690d0 con 0x55c9183713a0 2024-09-14T10:46:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d741d8640 1 -- 172.21.15.96:0/886098425 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d6c00a4d0 con 0x55c9183713a0 2024-09-14T10:46:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184694f0 con 0x55c9183713a0 2024-09-14T10:46:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d741d8640 1 -- 172.21.15.96:0/886098425 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d6c00a4d0 con 0x55c9183713a0 2024-09-14T10:46:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 Processor -- start 2024-09-14T10:46:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 -- start start 2024-09-14T10:46:20.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918478290 0x55c9184786b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c918280d80 con 0x55c918478290 2024-09-14T10:46:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d731d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918478290 0x55c9184786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d731d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918478290 0x55c9184786b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52158/0 (socket says 172.21.15.96:52158) 2024-09-14T10:46:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d731d6640 1 -- 172.21.15.96:0/3499108209 learned_addr learned my addr 172.21.15.96:0/3499108209 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d731d6640 1 -- 172.21.15.96:0/3499108209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c918478cf0 con 0x55c918478290 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d731d6640 1 --2- 172.21.15.96:0/3499108209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918478290 0x55c9184786b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800d460 tx=0x7f1d6800d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1c597fa640 1 -- 172.21.15.96:0/3499108209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6800c6b0 con 0x55c918478290 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3499108209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c918479550 con 0x55c918478290 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1c597fa640 1 -- 172.21.15.96:0/3499108209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d6800c850 con 0x55c918478290 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1c597fa640 1 -- 172.21.15.96:0/3499108209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d6800cb50 con 0x55c918478290 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.053+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3499108209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c918479ac0 con 0x55c918478290 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1c597fa640 1 -- 172.21.15.96:0/3499108209 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1d68023020 con 0x55c918478290 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1c597fa640 1 --2- 172.21.15.96:0/3499108209 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c4c03a1a0 0x7f1c4c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1c597fa640 1 -- 172.21.15.96:0/3499108209 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1d68021020 con 0x55c918478290 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d741d8640 1 --2- 172.21.15.96:0/3499108209 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c4c03a1a0 0x7f1c4c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 Processor -- start 2024-09-14T10:46:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d741d8640 1 --2- 172.21.15.96:0/3499108209 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c4c03a1a0 0x7f1c4c03c660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55c918469470 tx=0x7f1d6c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 -- start start 2024-09-14T10:46:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c918486020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c918459d70 con 0x55c918485c20 2024-09-14T10:46:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d731d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c918486020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d731d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c918486020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52164/0 (socket says 172.21.15.96:52164) 2024-09-14T10:46:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d731d6640 1 -- 172.21.15.96:0/3461503315 learned_addr learned my addr 172.21.15.96:0/3461503315 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d731d6640 1 -- 172.21.15.96:0/3461503315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c918486610 con 0x55c918485c20 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d731d6640 1 --2- 172.21.15.96:0/3461503315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c918486020 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1d680517f0 tx=0x7f1d680093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165dba72ed8116d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1c52ffd640 1 -- 172.21.15.96:0/3461503315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d68009690 con 0x55c918485c20 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1c52ffd640 1 -- 172.21.15.96:0/3461503315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d68050280 con 0x55c918485c20 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1c52ffd640 1 -- 172.21.15.96:0/3461503315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d680530d0 con 0x55c918485c20 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3461503315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 msgr2=0x55c918486020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3461503315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c918486020 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1d680517f0 tx=0x7f1d680093b0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3461503315 shutdown_connections 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3461503315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c918486020 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3461503315 >> 172.21.15.96:0/3461503315 conn(0x55c918481040 msgr2=0x55c91847f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.057+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3461503315 shutdown_connections 2024-09-14T10:46:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3461503315 wait complete. 2024-09-14T10:46:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 Processor -- start 2024-09-14T10:46:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 -- start start 2024-09-14T10:46:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c91848c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c918484b70 con 0x55c918485c20 2024-09-14T10:46:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d731d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c91848c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d731d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c91848c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:52174/0 (socket says 172.21.15.96:52174) 2024-09-14T10:46:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 learned_addr learned my addr 172.21.15.96:0/3360614373 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:46:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91848c6f0 con 0x55c918485c20 2024-09-14T10:46:20.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d731d6640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c91848c190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1d68024760 tx=0x7f1d68051780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1c517fa640 1 -- 172.21.15.96:0/3360614373 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d68032020 con 0x55c918485c20 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c91848c980 con 0x55c918485c20 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1c517fa640 1 -- 172.21.15.96:0/3360614373 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d68009690 con 0x55c918485c20 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1c517fa640 1 -- 172.21.15.96:0/3360614373 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d68019bc0 con 0x55c918485c20 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c91848c980 con 0x55c918485c20 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1c517fa640 1 -- 172.21.15.96:0/3360614373 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f1d68035020 con 0x55c918485c20 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1c517fa640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c3c03a1a0 0x7f1c3c03c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1c517fa640 1 -- 172.21.15.96:0/3360614373 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1d68005030 con 0x55c918485c20 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d741d8640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c3c03a1a0 0x7f1c3c03c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c918497500 0x55c918499990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91849a0e0 con 0x55c918497500 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d739d7640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c918497500 0x55c918499990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.061+0000 7f1d741d8640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c3c03a1a0 0x7f1c3c03c660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55c918468bf0 tx=0x7f1d6c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d739d7640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c918497500 0x55c918499990 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 realm 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91849a4f0 con 0x55c918497500 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:46:20.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91849adc0 con 0x55c918497500 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91849b160 con 0x55c918497500 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91849b9b0 con 0x55c918497500 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 20 searching for the correct realm 2024-09-14T10:46:20.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c91849d720 0x55c91849fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d731d6640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c91849d720 0x55c91849fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d731d6640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c91849d720 0x55c91849fb10 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d731d6640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1d68037020 0x7f1d68040050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d68037020 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d741d8640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1d68037020 0x7f1d68040050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d741d8640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1d68037020 0x7f1d68040050 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c01f070 con 0x7f1d68037020 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d741d8640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1d6c031040 0x7f1d6c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d6c031040 2024-09-14T10:46:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d739d7640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1d6c031040 0x7f1d6c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.065+0000 7f1d739d7640 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1d6c031040 0x7f1d6c032940 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c918497500 2024-09-14T10:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c918497500 2024-09-14T10:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d6c031040 2024-09-14T10:46:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d6c031040 2024-09-14T10:46:20.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d68037020 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c01f070 con 0x7f1d68037020 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c918497500 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d6c031040 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c918497500 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.069+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d68037020 2024-09-14T10:46:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d6c01f070 con 0x7f1d68037020 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d6c031040 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c918497500 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c918497500 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d6c031040 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d68037020 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c01f070 con 0x7f1d68037020 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c918497500 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d68037020 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c01f070 con 0x7f1d68037020 2024-09-14T10:46:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.073+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d6c031040 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d68037020 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c01f070 con 0x7f1d68037020 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c91849d720 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d6c031040 2024-09-14T10:46:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x55c918497500 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a00a0 con 0x7f1d68037020 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d6c040040 con 0x7f1d68037020 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91849c330 con 0x55c918497500 2024-09-14T10:46:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c91849cbd0 con 0x55c918497500 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a0500 con 0x55c918497500 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 zone default found 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 4 Realm: () 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:46:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 zonegroup default 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a0560 con 0x7f1d68037020 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d6c040040 con 0x7f1d68037020 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a2840 con 0x55c91849d720 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a2c60 con 0x55c91849d720 2024-09-14T10:46:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:46:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 started sync module instance, tier type = 2024-09-14T10:46:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:46:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.077+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a1cd0 con 0x7f1d68037020 2024-09-14T10:46:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.081+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c040040 con 0x7f1d68037020 2024-09-14T10:46:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.081+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94322184299040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a1cd0 con 0x7f1d68037020 2024-09-14T10:46:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.081+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a36e0 con 0x55c918497500 2024-09-14T10:46:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.081+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94322184299040] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c040040 con 0x7f1d68037020 2024-09-14T10:46:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.081+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.081+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94322184303456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a1cd0 con 0x55c918497500 2024-09-14T10:46:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.081+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a4120 con 0x55c91849d720 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94322184305776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a4970 con 0x55c91849d720 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a5330 con 0x7f1d68037020 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94322184303456] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c040040 con 0x7f1d68037020 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94322184310400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a52a0 con 0x7f1d68037020 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a61f0 con 0x55c918497500 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94322184305776] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.085+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94322184310400] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c040040 con 0x7f1d68037020 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.089+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.089+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94322184312608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a5d40 con 0x55c918497500 2024-09-14T10:46:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.089+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a6590 con 0x7f1d6c031040 2024-09-14T10:46:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.089+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94322184312608] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.089+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.089+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94322184314176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a6980 con 0x7f1d6c031040 2024-09-14T10:46:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.089+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a71d0 con 0x7f1d6c031040 2024-09-14T10:46:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94322184314176] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94322184315232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a6e30 con 0x7f1d6c031040 2024-09-14T10:46:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a78b0 con 0x7f1d6c031040 2024-09-14T10:46:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94322184319904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a7d20 con 0x7f1d6c031040 2024-09-14T10:46:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 20 add_watcher() i=0 2024-09-14T10:46:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 20 add_watcher() i=1 2024-09-14T10:46:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 20 add_watcher() i=2 2024-09-14T10:46:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 20 add_watcher() i=3 2024-09-14T10:46:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 20 add_watcher() i=4 2024-09-14T10:46:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 20 add_watcher() i=5 2024-09-14T10:46:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94322184315232] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.093+0000 7f1d75ed19c0 20 add_watcher() i=6 2024-09-14T10:46:20.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94322184319904] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 20 add_watcher() i=7 2024-09-14T10:46:20.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:46:20.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a7d20 con 0x55c918497500 2024-09-14T10:46:20.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94322184321136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a7c90 con 0x55c918497500 2024-09-14T10:46:20.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94322184321136] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:20.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:46:20.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:46:20.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 5 note: GC not initialized 2024-09-14T10:46:20.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1c28fe1640 20 reqs_thread_entry: start 2024-09-14T10:46:20.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 20 init_complete bucket index max shards: 11 2024-09-14T10:46:20.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 20 Filter name: none 2024-09-14T10:46:20.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1ba27fc640 20 reqs_thread_entry: start 2024-09-14T10:46:20.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:46:20.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 20 rados->read ofs=0 len=0 2024-09-14T10:46:20.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184ce5b0 con 0x7f1d6c031040 2024-09-14T10:46:20.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-14T10:46:20.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:46:20.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:20.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:46:20.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.097+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184d5290 con 0x7f1d6c031040 2024-09-14T10:46:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d75ed19c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d75ed19c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d75ed19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:46:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94322184506624 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9184d0940 con 0x55c918497500 2024-09-14T10:46:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== watch-notify(notify (1) cookie 94322184312608 notify 146028888111 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55c918461cf0 con 0x55c918497500 2024-09-14T10:46:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1c52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888111 cookie 94322184312608 notifier 4921 bl.length()=649 2024-09-14T10:46:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1c52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:46:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1c52ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:46:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1c52ffd640 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1c38003eb0 con 0x55c918497500 2024-09-14T10:46:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(64 notify.4 [notify cookie 94322184506624 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== watch-notify(notify_complete (2) cookie 94322184506624 notify 146028888111 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c918461390 con 0x55c918497500 2024-09-14T10:46:20.103 INFO:teuthology.orchestra.run.smithi096.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:46:17.605336Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:46:17.605320Z","tags":[],"group_ids":[]} 2024-09-14T10:46:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:46:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.101+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94322184321136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184d1100 con 0x55c918497500 2024-09-14T10:46:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94322184321136] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94322184299040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184d1100 con 0x7f1d68037020 2024-09-14T10:46:20.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94322184299040] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c040040 con 0x7f1d68037020 2024-09-14T10:46:20.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d75ed19c0 20 remove_watcher() i=0 2024-09-14T10:46:20.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d75ed19c0 2 removed watcher, disabling cache 2024-09-14T10:46:20.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94322184303456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184d1100 con 0x55c918497500 2024-09-14T10:46:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94322184303456] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d75ed19c0 20 remove_watcher() i=1 2024-09-14T10:46:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.105+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94322184305776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184d1100 con 0x55c91849d720 2024-09-14T10:46:20.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.109+0000 7f1d731d6640 1 -- 172.21.15.96:0/3360614373 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94322184305776] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6801ace0 con 0x55c91849d720 2024-09-14T10:46:20.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.109+0000 7f1d75ed19c0 20 remove_watcher() i=2 2024-09-14T10:46:20.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.109+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94322184310400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a7870 con 0x7f1d68037020 2024-09-14T10:46:20.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.109+0000 7f1d741d8640 1 -- 172.21.15.96:0/3360614373 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94322184310400] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d6c040040 con 0x7f1d68037020 2024-09-14T10:46:20.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.109+0000 7f1d75ed19c0 20 remove_watcher() i=3 2024-09-14T10:46:20.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.109+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94322184312608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a3c70 con 0x55c918497500 2024-09-14T10:46:20.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.113+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94322184312608] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x55c918497500 2024-09-14T10:46:20.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.113+0000 7f1d75ed19c0 20 remove_watcher() i=4 2024-09-14T10:46:20.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.113+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94322184314176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a4e80 con 0x7f1d6c031040 2024-09-14T10:46:20.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.113+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94322184314176] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.113+0000 7f1d75ed19c0 20 remove_watcher() i=5 2024-09-14T10:46:20.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.113+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94322184315232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a7870 con 0x7f1d6c031040 2024-09-14T10:46:20.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94322184315232] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 20 remove_watcher() i=6 2024-09-14T10:46:20.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94322184319904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9184a3c70 con 0x7f1d6c031040 2024-09-14T10:46:20.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94322184319904] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d640cf030 con 0x7f1d6c031040 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 20 remove_watcher() i=7 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1d6c031040 msgr2=0x7f1d6c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f1d6c031040 0x7f1d6c032940 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c918497500 msgr2=0x55c918499990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c918497500 0x55c918499990 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1d68037020 msgr2=0x7f1d68040050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f1d68037020 0x7f1d68040050 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c91849d720 msgr2=0x55c91849fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c91849d720 0x55c91849fb10 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c3c03a1a0 msgr2=0x7f1c3c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c3c03a1a0 0x7f1c3c03c660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55c918468bf0 tx=0x7f1d6c01f000 comp rx=0 tx=0).stop 2024-09-14T10:46:20.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 msgr2=0x55c91848c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c91848c190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1d68024760 tx=0x7f1d68051780 comp rx=0 tx=0).stop 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d739d7640 1 -- 172.21.15.96:0/3360614373 reap_dead start 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 shutdown_connections 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3360614373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918485c20 0x55c91848c190 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 >> 172.21.15.96:0/3360614373 conn(0x55c918481040 msgr2=0x55c91847f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 shutdown_connections 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3360614373 wait complete. 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3499108209 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c4c03a1a0 msgr2=0x7f1c4c03c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3499108209 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c4c03a1a0 0x7f1c4c03c660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55c918469470 tx=0x7f1d6c005850 comp rx=0 tx=0).stop 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3499108209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918478290 msgr2=0x55c9184786b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3499108209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918478290 0x55c9184786b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800d460 tx=0x7f1d6800d860 comp rx=0 tx=0).stop 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3499108209 shutdown_connections 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3499108209 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c4c03a1a0 0x7f1c4c03c660 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/3499108209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c918478290 0x55c9184786b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3499108209 >> 172.21.15.96:0/3499108209 conn(0x55c91846dc40 msgr2=0x55c91846e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3499108209 shutdown_connections 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/3499108209 wait complete. 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c9183713a0 msgr2=0x55c918467cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c9183713a0 0x55c918467cc0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c5c03a150 msgr2=0x7f1c5c03c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c5c03a150 0x7f1c5c03c610 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1d68001dc0 tx=0x7f1d68001320 comp rx=0 tx=0).stop 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 msgr2=0x55c918460ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918460ba0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1d6401b0b0 tx=0x7f1d64018020 comp rx=0 tx=0).stop 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 shutdown_connections 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c9183713a0 0x55c918467cc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f1c5c03a150 0x7f1c5c03c610 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 --2- 172.21.15.96:0/886098425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c91836e260 0x55c918460ba0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:46:20.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 >> 172.21.15.96:0/886098425 conn(0x55c9182e1b70 msgr2=0x55c91845a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:46:20.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 shutdown_connections 2024-09-14T10:46:20.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:46:20.117+0000 7f1d75ed19c0 1 -- 172.21.15.96:0/886098425 wait complete. 2024-09-14T10:46:20.129 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:20.129 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:46:17.605336Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:46:17.605320Z', 'tags': [], 'group_ids': []} 2024-09-14T10:46:20.129 ERROR:root:0 2024-09-14T10:46:20.129 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-14T10:46:20.137 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.137 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.140 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.141 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-14T10:46:20.146 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.146 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.150 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.150 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-14T10:46:20.159 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-14T10:46:20.160 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.163 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.163 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-14T10:46:20.171 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.171 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.174 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.175 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-14T10:46:20.182 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-14T10:46:20.182 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.186 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.186 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-14T10:46:20.196 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-14T10:46:20.196 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.200 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.200 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-14T10:46:20.208 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.208 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.212 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.213 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-14T10:46:20.218 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.218 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.222 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.222 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-14T10:46:20.231 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.232 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.236 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.236 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.240 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-14T10:46:20.241 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-14T10:46:20.245 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-14T10:46:20.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-14T10:46:20.336 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-14T10:46:20.336 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-14T10:46:20.343 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:46:20.259425Z', 'creation_time': '2024-09-14T10:46:20.254696Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-14T10:46:20.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-14T10:46:20.350 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:46:20.259425Z', 'creation_time': '2024-09-14T10:46:20.254696Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-14T10:46:20.360 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-14T10:46:20.367 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:46:20.259425Z', 'creation_time': '2024-09-14T10:46:20.254696Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-14T10:46:20.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-14T10:46:20.372 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx0000083ac8dc9dc716b59-0066e5697c-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:46:20.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-14T10:46:20.393 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.393 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-14T10:46:20.410 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:46:20.430 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11'} 2024-09-14T10:46:20.450 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.501 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11'} 2024-09-14T10:46:20.523 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.524 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-14T10:46:20.547 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.561 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-14T10:46:20.574 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:46:20.574 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-14T10:46:20.582 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '81c91f69-c086-4f6e-b0d8-6162f65a1a15', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11', 'marker': '67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:46:20.514368Z', 'creation_time': '2024-09-14T10:46:20.254696Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-14T10:47:20.702 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-14T10:47:20.737 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:47:20.737 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-14T10:47:20.766 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:47:20.767 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-14T10:47:20.773 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:47:20.773 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-14T10:47:20.780 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:47:20.780 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-14T10:47:20.786 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:47:20.786 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-14T10:47:20.792 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:47:20.792 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-14T10:47:20.798 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:47:20.799 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-14T10:47:20.810 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:47:20.810 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-14T10:47:20.816 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-14T10:47:20.817 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-14T10:47:20.833 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:47:20.838 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-14T10:47:20.855 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:47:21.251 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-14T10:47:21.257 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000a7f9fbc37a1a8a80-0066e569b9-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:21.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-14T10:47:21.491 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-14T10:47:21.502 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-14T10:47:21.507 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-14T10:47:21.649 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-14T10:47:21.742 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:47:21.742 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-14T10:47:21.752 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-14T10:47:21.752 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-14T10:47:21.762 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-14T10:47:21.789 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-14T10:47:21.795 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000ae1c891dee6cbc74-0066e569b9-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:21.843 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-14T10:47:21.922 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:47:21.922 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:47:21.928 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000fb1f89e9bab46f5d-0066e569b9-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:21.928 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-14T10:47:21.932 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '2e314bd0-9070-44fa-a8ec-a9266c5de294'}]}} 2024-09-14T10:47:21.933 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-14T10:47:21.956 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:47:21.956 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-14T10:47:21.960 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-14T10:47:21.961 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-14T10:47:21.966 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000a53648d688f98828-0066e569b9-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:21.967 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-14T10:47:21.971 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000220229dc700c53c5-0066e569b9-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:21.996 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-14T10:47:22.000 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-14T10:47:22.001 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-14T10:47:22.005 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000922f77e70c163f43-0066e569ba-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:22.006 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-14T10:47:22.010 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000f9a8278cb6dc67fa-0066e569ba-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:22.010 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-14T10:47:22.015 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-14T10:47:22.015 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-14T10:47:22.019 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000d17205e1e3fbc0a7-0066e569ba-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:22.019 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-14T10:47:22.024 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000216fc1a85a679827-0066e569ba-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:22.024 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-14T10:47:22.028 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000fd6ea2b0df3f7041-0066e569ba-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:22.028 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-14T10:47:22.033 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000095615d3f80ded79f-0066e569ba-4228-default', 'HostId': '4228-default-default'} 2024-09-14T10:47:22.033 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-14T10:47:22.055 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:47:22.055 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-14T10:47:22.059 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-14T10:47:22.060 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-14T10:47:22.070 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:47:22.070 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-14T10:47:22.074 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-14T10:47:22.075 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-14T10:47:22.083 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:47:22.088 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T10:47:22.096 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T10:47:22.096 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T10:47:22.097 INFO:tasks.rgw.client.0.smithi096.stdout:2024-09-14T10:47:22.099+0000 7f615262e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29015) UID: 0 2024-09-14T10:47:22.098 INFO:tasks.rgw.client.0.smithi096.stdout:2024-09-14T10:47:22.099+0000 7f6155e76a40 -1 shutting down 2024-09-14T10:47:51.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-14T10:47:52.605 INFO:tasks.rgw.client.0:Stopped 2024-09-14T10:47:52.605 DEBUG:teuthology.orchestra.run.smithi096:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T10:47:52.612 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T10:47:52.668 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T10:47:52.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T10:47:52.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T10:47:52.725 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T10:47:52.805 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:52.806 INFO:teuthology.orchestra.run.smithi096.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:52.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.807+0000 7f483bf459c0 1 Processor -- start 2024-09-14T10:47:52.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.807+0000 7f483bf459c0 1 -- start start 2024-09-14T10:47:52.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.807+0000 7f483bf459c0 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c509698fd0 0x55c5096993b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.807+0000 7f483bf459c0 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5095417a0 con 0x55c50969c110 2024-09-14T10:47:52.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.807+0000 7f483bf459c0 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x55c50959d1b0 con 0x55c509698fd0 2024-09-14T10:47:52.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.807+0000 7f4839a4b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x55c509698fd0 0x55c5096993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.807+0000 7f483924a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x55c50969c110 0x55c50969e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.96:60590/0 (socket says 172.21.15.96:60590) 2024-09-14T10:47:52.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.807+0000 7f483924a640 1 -- 172.21.15.96:0/3742305948 learned_addr learned my addr 172.21.15.96:0/3742305948 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-14T10:47:52.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f4839a4b640 1 -- 172.21.15.96:0/3742305948 >> v1:172.21.15.70:6789/0 conn(0x55c50969c110 legacy=0x55c50969e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:52.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f4839a4b640 1 -- 172.21.15.96:0/3742305948 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c50951bda0 con 0x55c509698fd0 2024-09-14T10:47:52.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f4839a4b640 1 --2- 172.21.15.96:0/3742305948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c5096993b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f482c00a420 tx=0x7f482c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd41c2131b558795 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f4838a49640 1 -- 172.21.15.96:0/3742305948 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f482c0af070 con 0x55c509698fd0 2024-09-14T10:47:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f4838a49640 1 -- 172.21.15.96:0/3742305948 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482c0aa530 con 0x55c509698fd0 2024-09-14T10:47:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f4838a49640 1 -- 172.21.15.96:0/3742305948 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f482c0aa850 con 0x55c509698fd0 2024-09-14T10:47:52.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f483bf459c0 1 -- 172.21.15.96:0/3742305948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 msgr2=0x55c5096993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f483bf459c0 1 --2- 172.21.15.96:0/3742305948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c5096993b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f482c00a420 tx=0x7f482c01afd0 comp rx=0 tx=0).stop 2024-09-14T10:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f483bf459c0 1 -- 172.21.15.96:0/3742305948 shutdown_connections 2024-09-14T10:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f483bf459c0 1 --2- 172.21.15.96:0/3742305948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c5096993b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f483bf459c0 1 -- 172.21.15.96:0/3742305948 >> 172.21.15.96:0/3742305948 conn(0x55c509694af0 msgr2=0x55c509696f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f483bf459c0 1 -- 172.21.15.96:0/3742305948 shutdown_connections 2024-09-14T10:47:52.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.811+0000 7f483bf459c0 1 -- 172.21.15.96:0/3742305948 wait complete. 2024-09-14T10:47:52.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.827+0000 7f483bf459c0 1 Processor -- start 2024-09-14T10:47:52.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.827+0000 7f483bf459c0 1 -- start start 2024-09-14T10:47:52.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.827+0000 7f483bf459c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c509784330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.827+0000 7f483bf459c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c5095a0fc0 con 0x55c509698fd0 2024-09-14T10:47:52.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.827+0000 7f4839a4b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c509784330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4839a4b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c509784330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45732/0 (socket says 172.21.15.96:45732) 2024-09-14T10:47:52.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4839a4b640 1 -- 172.21.15.96:0/3761395701 learned_addr learned my addr 172.21.15.96:0/3761395701 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:47:52.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4839a4b640 1 -- 172.21.15.96:0/3761395701 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c509784920 con 0x55c509698fd0 2024-09-14T10:47:52.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4839a4b640 1 --2- 172.21.15.96:0/3761395701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c509784330 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f482c018c00 tx=0x7f482c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48300820f20c8d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4727e07640 1 -- 172.21.15.96:0/3761395701 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f482c0af040 con 0x55c509698fd0 2024-09-14T10:47:52.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4727e07640 1 -- 172.21.15.96:0/3761395701 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482c0aaa00 con 0x55c509698fd0 2024-09-14T10:47:52.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4727e07640 1 -- 172.21.15.96:0/3761395701 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f482c0aace0 con 0x55c509698fd0 2024-09-14T10:47:52.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 -- 172.21.15.96:0/3761395701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 msgr2=0x55c509784330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:52.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 --2- 172.21.15.96:0/3761395701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c509784330 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f482c018c00 tx=0x7f482c0033b0 comp rx=0 tx=0).stop 2024-09-14T10:47:52.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 -- 172.21.15.96:0/3761395701 shutdown_connections 2024-09-14T10:47:52.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 --2- 172.21.15.96:0/3761395701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c509784330 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:52.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 -- 172.21.15.96:0/3761395701 >> 172.21.15.96:0/3761395701 conn(0x55c509694af0 msgr2=0x55c50977ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:52.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 -- 172.21.15.96:0/3761395701 shutdown_connections 2024-09-14T10:47:52.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 -- 172.21.15.96:0/3761395701 wait complete. 2024-09-14T10:47:52.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 Processor -- start 2024-09-14T10:47:52.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 -- start start 2024-09-14T10:47:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c50978bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f483bf459c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c509542a50 con 0x55c509698fd0 2024-09-14T10:47:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4839a4b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c50978bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4839a4b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c50978bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45742/0 (socket says 172.21.15.96:45742) 2024-09-14T10:47:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4839a4b640 1 -- 172.21.15.96:0/91424445 learned_addr learned my addr 172.21.15.96:0/91424445 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:47:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.831+0000 7f4839a4b640 1 -- 172.21.15.96:0/91424445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c50978c120 con 0x55c509698fd0 2024-09-14T10:47:52.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f4839a4b640 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c50978bbc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f482c018c00 tx=0x7f482c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f4726604640 1 -- 172.21.15.96:0/91424445 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f482c0c5070 con 0x55c509698fd0 2024-09-14T10:47:52.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c50978c3b0 con 0x55c509698fd0 2024-09-14T10:47:52.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f4726604640 1 -- 172.21.15.96:0/91424445 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482c0c17c0 con 0x55c509698fd0 2024-09-14T10:47:52.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f4726604640 1 -- 172.21.15.96:0/91424445 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f482c0c1ae0 con 0x55c509698fd0 2024-09-14T10:47:52.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c50978cd90 con 0x55c509698fd0 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f4726604640 1 -- 172.21.15.96:0/91424445 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f482c0b5470 con 0x55c509698fd0 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f4726604640 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f472003a1a0 0x7f472003c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f4726604640 1 -- 172.21.15.96:0/91424445 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f482c0bb070 con 0x55c509698fd0 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483924a640 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f472003a1a0 0x7f472003c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483bf459c0 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c50969c110 0x55c509792ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509793220 con 0x55c50969c110 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483a24c640 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c50969c110 0x55c509792ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483924a640 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f472003a1a0 0x7f472003c660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4830004180 tx=0x7f4830001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483a24c640 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c50969c110 0x55c509792ce0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483a24c640 1 -- 172.21.15.96:0/91424445 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48340083f0 con 0x55c50969c110 2024-09-14T10:47:52.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509793620 con 0x55c50969c110 2024-09-14T10:47:52.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483a24c640 1 -- 172.21.15.96:0/91424445 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48340083f0 con 0x55c50969c110 2024-09-14T10:47:52.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.835+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509794f20 con 0x55c50969c110 2024-09-14T10:47:52.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483a24c640 1 -- 172.21.15.96:0/91424445 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f48340083f0 con 0x55c50969c110 2024-09-14T10:47:52.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509794150 con 0x55c50969c110 2024-09-14T10:47:52.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483a24c640 1 -- 172.21.15.96:0/91424445 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48340083f0 con 0x55c50969c110 2024-09-14T10:47:52.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097945a0 con 0x55c50969c110 2024-09-14T10:47:52.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483a24c640 1 -- 172.21.15.96:0/91424445 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48340083f0 con 0x55c50969c110 2024-09-14T10:47:52.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483bf459c0 1 Processor -- start 2024-09-14T10:47:52.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483bf459c0 1 -- start start 2024-09-14T10:47:52.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483bf459c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097a32e0 0x55c5097a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483bf459c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c5095add80 con 0x55c5097a32e0 2024-09-14T10:47:52.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483924a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097a32e0 0x55c5097a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483924a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097a32e0 0x55c5097a3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45752/0 (socket says 172.21.15.96:45752) 2024-09-14T10:47:52.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483924a640 1 -- 172.21.15.96:0/3098175707 learned_addr learned my addr 172.21.15.96:0/3098175707 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:47:52.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483924a640 1 -- 172.21.15.96:0/3098175707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5097a3d40 con 0x55c5097a32e0 2024-09-14T10:47:52.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483924a640 1 --2- 172.21.15.96:0/3098175707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097a32e0 0x55c5097a3700 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f483000d660 tx=0x7f483000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f471f7fe640 1 -- 172.21.15.96:0/3098175707 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f483000c6b0 con 0x55c5097a32e0 2024-09-14T10:47:52.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483bf459c0 1 -- 172.21.15.96:0/3098175707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5097a45a0 con 0x55c5097a32e0 2024-09-14T10:47:52.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f471f7fe640 1 -- 172.21.15.96:0/3098175707 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483000c850 con 0x55c5097a32e0 2024-09-14T10:47:52.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f471f7fe640 1 -- 172.21.15.96:0/3098175707 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f483000cb30 con 0x55c5097a32e0 2024-09-14T10:47:52.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.839+0000 7f483bf459c0 1 -- 172.21.15.96:0/3098175707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5097a4b10 con 0x55c5097a32e0 2024-09-14T10:47:52.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f471f7fe640 1 -- 172.21.15.96:0/3098175707 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f4830023020 con 0x55c5097a32e0 2024-09-14T10:47:52.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f471f7fe640 1 --2- 172.21.15.96:0/3098175707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f471403a190 0x7f471403c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f471f7fe640 1 -- 172.21.15.96:0/3098175707 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4830021020 con 0x55c5097a32e0 2024-09-14T10:47:52.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483a24c640 1 --2- 172.21.15.96:0/3098175707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f471403a190 0x7f471403c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 Processor -- start 2024-09-14T10:47:52.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 -- start start 2024-09-14T10:47:52.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483a24c640 1 --2- 172.21.15.96:0/3098175707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f471403a190 0x7f471403c650 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f483400e3f0 tx=0x7f4834003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c5097b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c509784c90 con 0x55c5097afc40 2024-09-14T10:47:52.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483924a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c5097b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483924a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c5097b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45754/0 (socket says 172.21.15.96:45754) 2024-09-14T10:47:52.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483924a640 1 -- 172.21.15.96:0/4279722991 learned_addr learned my addr 172.21.15.96:0/4279722991 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:47:52.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483924a640 1 -- 172.21.15.96:0/4279722991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5097b05f0 con 0x55c5097afc40 2024-09-14T10:47:52.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483924a640 1 --2- 172.21.15.96:0/4279722991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c5097b0020 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4830051820 tx=0x7f4830044760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b369e93b0f1ab7a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f471d7fa640 1 -- 172.21.15.96:0/4279722991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f483001bcc0 con 0x55c5097afc40 2024-09-14T10:47:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f471d7fa640 1 -- 172.21.15.96:0/4279722991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483004ae50 con 0x55c5097afc40 2024-09-14T10:47:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f471d7fa640 1 -- 172.21.15.96:0/4279722991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4830050270 con 0x55c5097afc40 2024-09-14T10:47:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 -- 172.21.15.96:0/4279722991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 msgr2=0x55c5097b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 --2- 172.21.15.96:0/4279722991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c5097b0020 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4830051820 tx=0x7f4830044760 comp rx=0 tx=0).stop 2024-09-14T10:47:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 -- 172.21.15.96:0/4279722991 shutdown_connections 2024-09-14T10:47:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 --2- 172.21.15.96:0/4279722991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c5097b0020 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:52.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 -- 172.21.15.96:0/4279722991 >> 172.21.15.96:0/4279722991 conn(0x55c5097ac070 msgr2=0x55c5097aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 -- 172.21.15.96:0/4279722991 shutdown_connections 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.843+0000 7f483bf459c0 1 -- 172.21.15.96:0/4279722991 wait complete. 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 1 Processor -- start 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 1 -- start start 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c50960f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c5097b0c50 con 0x55c5097afc40 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483924a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c50960f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483924a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c50960f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.96:45762/0 (socket says 172.21.15.96:45762) 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 learned_addr learned my addr 172.21.15.96:0/1068641551 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-14T10:47:52.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c50960f980 con 0x55c5097afc40 2024-09-14T10:47:52.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483924a640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c50960f420 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4830023850 tx=0x7f48300517b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f470b7fe640 1 -- 172.21.15.96:0/1068641551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4830034020 con 0x55c5097afc40 2024-09-14T10:47:52.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c50960dd60 con 0x55c5097afc40 2024-09-14T10:47:52.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c50960dd60 con 0x55c5097afc40 2024-09-14T10:47:52.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f470b7fe640 1 -- 172.21.15.96:0/1068641551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4830043380 con 0x55c5097afc40 2024-09-14T10:47:52.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f470b7fe640 1 -- 172.21.15.96:0/1068641551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4830019ba0 con 0x55c5097afc40 2024-09-14T10:47:52.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f470b7fe640 1 -- 172.21.15.96:0/1068641551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f4830037020 con 0x55c5097afc40 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f470b7fe640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f470403a150 0x7f470403c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f470b7fe640 1 -- 172.21.15.96:0/1068641551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4830050070 con 0x55c5097afc40 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483a24c640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f470403a150 0x7f470403c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5097c4770 0x55c5097c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c7350 con 0x55c5097c4770 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.847+0000 7f4839a4b640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5097c4770 0x55c5097c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f4839a4b640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5097c4770 0x55c5097c6c00 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483a24c640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f470403a150 0x7f470403c610 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f483400f010 tx=0x7f483401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 realm 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c7760 con 0x55c5097c4770 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8030 con 0x55c5097c4770 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c83d0 con 0x55c5097c4770 2024-09-14T10:47:52.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:5 5.1a 5:5c68846e:::zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097c4770 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 5 ==== osd_op_reply(5 zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 20 searching for the correct realm 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5097ca990 0x55c5097ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097cd360 con 0x55c5097ca990 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483924a640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5097ca990 0x55c5097ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483924a640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5097ca990 0x55c5097ccd80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483924a640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4830039020 0x7f48300507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097cd360 con 0x7f4830039020 2024-09-14T10:47:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483a24c640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4830039020 0x7f48300507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483a24c640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4830039020 0x7f48300507c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483a24c640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4834019040 0x7f4834019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.851+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097cd360 con 0x7f4834019040 2024-09-14T10:47:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4834019040 0x7f4834019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:52.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4834019040 0x7f4834019930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097c4770 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097c4770 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x7f4834019040 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x7f4834019040 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x7f4830039020 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.855+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097ca990 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097c4770 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x7f4834019040 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097c4770 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x7f4830039020 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097ca990 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097ca990 2024-09-14T10:47:52.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x7f4834019040 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097ca990 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097ca990 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097c4770 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.859+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097c4770 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x7f4834019040 2024-09-14T10:47:52.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097ca990 2024-09-14T10:47:52.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x7f4830039020 2024-09-14T10:47:52.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8c20 con 0x55c5097c4770 2024-09-14T10:47:52.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f482c0f4040 con 0x7f4830039020 2024-09-14T10:47:52.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f482c0f4040 con 0x55c5097ca990 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f482c0f4040 con 0x7f4834019040 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f482c0f4040 con 0x7f4830039020 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f482c0f4040 con 0x55c5097ca990 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.863+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f482c0f4040 con 0x7f4834019040 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f482c0f4040 con 0x55c5097c4770 2024-09-14T10:47:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f482c0f4040 con 0x7f4830039020 2024-09-14T10:47:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 RGWRados::pool_iterate: got zone_info.67d5d4ca-fcee-4ea2-925b-fcc0d92e249d 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 RGWRados::pool_iterate: got zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 RGWRados::pool_iterate: got period_config.default 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c90d0 con 0x55c5097c4770 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:52.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c94c0 con 0x55c5097c4770 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:40 5.1d 5:bf515f82:::zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c94c0 con 0x55c5097c4770 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 16 ==== osd_op_reply(40 zonegroup_info.81c91f69-c086-4f6e-b0d8-6162f65a1a15 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 zone default found 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 4 Realm: () 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 4 ZoneGroup: default (81c91f69-c086-4f6e-b0d8-6162f65a1a15) 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 4 Zone: default (67d5d4ca-fcee-4ea2-925b-fcc0d92e249d) 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:52.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 zonegroup default 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097c8d00 con 0x7f4830039020 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097cf1d0 con 0x55c5097ca990 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados->read ofs=0 len=0 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097cf570 con 0x55c5097ca990 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:52.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 started sync module instance, tier type = 2024-09-14T10:47:52.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 20 started zone id=67d5d4ca-fcee-4ea2-925b-fcc0d92e249d (name=default) with tier type = 2024-09-14T10:47:52.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.867+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097ce670 con 0x7f4830039020 2024-09-14T10:47:52.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.871+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 9 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.871+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94304756099984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097ce670 con 0x7f4830039020 2024-09-14T10:47:52.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.871+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097cffd0 con 0x55c5097c4770 2024-09-14T10:47:52.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.871+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94304756099984] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.871+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 17 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.871+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94304756104272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097ce670 con 0x55c5097c4770 2024-09-14T10:47:52.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.871+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d09e0 con 0x55c5097ca990 2024-09-14T10:47:52.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.875+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94304756104272] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.875+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 12 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.875+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94304756097472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097ce5e0 con 0x55c5097ca990 2024-09-14T10:47:52.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.875+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d1730 con 0x7f4830039020 2024-09-14T10:47:52.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.875+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 11 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.875+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94304756110224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d2000 con 0x7f4830039020 2024-09-14T10:47:52.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.875+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d2a40 con 0x55c5097c4770 2024-09-14T10:47:52.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.879+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94304756097472] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.879+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94304756110224] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.879+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 19 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.879+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94304756114704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d1b50 con 0x55c5097c4770 2024-09-14T10:47:52.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.879+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d32e0 con 0x7f4834019040 2024-09-14T10:47:52.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.879+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94304756114704] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.883+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 9 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.883+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94304756108752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d1b50 con 0x7f4834019040 2024-09-14T10:47:52.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.883+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d37b0 con 0x7f4834019040 2024-09-14T10:47:52.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.883+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94304756108752] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.883+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 11 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.883+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94304756118144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d3770 con 0x7f4834019040 2024-09-14T10:47:52.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.883+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d4130 con 0x7f4834019040 2024-09-14T10:47:52.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94304756118144] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 13 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94304756116496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d4130 con 0x7f4834019040 2024-09-14T10:47:52.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 20 add_watcher() i=0 2024-09-14T10:47:52.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 20 add_watcher() i=1 2024-09-14T10:47:52.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 20 add_watcher() i=2 2024-09-14T10:47:52.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 20 add_watcher() i=3 2024-09-14T10:47:52.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 20 add_watcher() i=4 2024-09-14T10:47:52.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 20 add_watcher() i=5 2024-09-14T10:47:52.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 20 add_watcher() i=6 2024-09-14T10:47:52.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94304756116496] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 20 add_watcher() i=7 2024-09-14T10:47:52.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:52.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d7470 con 0x55c5097c4770 2024-09-14T10:47:52.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.887+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94304756121072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d46c0 con 0x55c5097c4770 2024-09-14T10:47:52.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.891+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94304756121072] v34'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.891+0000 7f46eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:52.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.891+0000 7f483bf459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:52.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.891+0000 7f483bf459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:52.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.891+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097dfe90 con 0x55c5097c4770 2024-09-14T10:47:52.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.891+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.891+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e04c0 con 0x7f4834019040 2024-09-14T10:47:52.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.895+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.895+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e0470 con 0x55c5097ca990 2024-09-14T10:47:52.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.895+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.895+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e0860 con 0x55c5097c4770 2024-09-14T10:47:52.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.895+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.895+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e08a0 con 0x7f4830039020 2024-09-14T10:47:52.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.899+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.899+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e0ef0 con 0x55c5097ca990 2024-09-14T10:47:52.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.899+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.899+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e0ed0 con 0x55c5097c4770 2024-09-14T10:47:52.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.903+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.903+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e0ee0 con 0x7f4834019040 2024-09-14T10:47:52.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.903+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.903+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e1560 con 0x7f4830039020 2024-09-14T10:47:52.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.907+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.907+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e1ad0 con 0x55c5097ca990 2024-09-14T10:47:52.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.907+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.907+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e1ad0 con 0x7f4830039020 2024-09-14T10:47:52.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.911+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.911+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2040 con 0x7f4834019040 2024-09-14T10:47:52.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.911+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.911+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2040 con 0x7f4830039020 2024-09-14T10:47:52.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.911+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.911+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x7f4834019040 2024-09-14T10:47:52.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.915+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.915+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x55c5097c4770 2024-09-14T10:47:52.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.915+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.915+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x55c5097ca990 2024-09-14T10:47:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.919+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.919+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x7f4830039020 2024-09-14T10:47:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.919+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.919+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x55c5097ca990 2024-09-14T10:47:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.923+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.923+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x55c5097c4770 2024-09-14T10:47:52.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.923+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.923+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x55c5097c4770 2024-09-14T10:47:52.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.923+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.923+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x55c5097ca990 2024-09-14T10:47:52.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.927+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.927+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2280 con 0x7f4830039020 2024-09-14T10:47:52.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.927+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.927+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2360 con 0x55c5097ca990 2024-09-14T10:47:52.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.931+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.931+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2360 con 0x55c5097ca990 2024-09-14T10:47:52.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.931+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'39 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.931+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2360 con 0x55c5097ca990 2024-09-14T10:47:52.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.935+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.935+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2360 con 0x55c5097ca990 2024-09-14T10:47:52.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.935+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.935+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2360 con 0x7f4834019040 2024-09-14T10:47:52.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.939+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.939+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2360 con 0x55c5097ca990 2024-09-14T10:47:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.943+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.943+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2390 con 0x7f4834019040 2024-09-14T10:47:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.943+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.943+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2390 con 0x55c5097ca990 2024-09-14T10:47:52.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.947+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'80 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.947+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2360 con 0x7f4834019040 2024-09-14T10:47:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.951+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'64 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.951+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097e2360 con 0x7f4830039020 2024-09-14T10:47:52.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.951+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.951+0000 7f46ea7fc640 20 reqs_thread_entry: start 2024-09-14T10:47:52.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 20 init_complete bucket index max shards: 11 2024-09-14T10:47:52.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 20 Filter name: none 2024-09-14T10:47:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f465bfff640 20 reqs_thread_entry: start 2024-09-14T10:47:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T10:47:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:94 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097de0e0 con 0x55c5097ca990 2024-09-14T10:47:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 26 ==== osd_op_reply(94 gc.2 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:95 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097de0a0 con 0x55c5097ca990 2024-09-14T10:47:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 27 ==== osd_op_reply(95 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:96 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097dd020 con 0x55c5097ca990 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 28 ==== osd_op_reply(96 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:97 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097de030 con 0x55c5097ca990 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 29 ==== osd_op_reply(97 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:98 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c5097de030 con 0x55c5097ca990 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 30 ==== osd_op_reply(98 gc.2 [call out=1714b] v0'0 uv33 ondisk = 0) ==== 148+0+1714 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 20 garbage collection: RGWGC::process iterating over entry tag='67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.732905972676226036', time=2024-09-14T10:47:36.251966+0000, chain.objs.size()=7 2024-09-14T10:47:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_1 2024-09-14T10:47:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:99 3.19s0 3:9a5df49f:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_1:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097fe060 con 0x55c5097c4770 2024-09-14T10:47:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_2 2024-09-14T10:47:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:100 3.ds0 3:b1094887:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_2:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509801f50 con 0x55c5097ca990 2024-09-14T10:47:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_3 2024-09-14T10:47:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:101 3.14s0 3:297ce226:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_3:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097fe060 con 0x55c5097ca990 2024-09-14T10:47:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_4 2024-09-14T10:47:52.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:102 3.6s0 3:6305bcb5:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_4:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509801f50 con 0x55c5097c4770 2024-09-14T10:47:52.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_5 2024-09-14T10:47:52.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:103 3.1s0 3:811e74ac:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_5:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509809490 con 0x7f4834019040 2024-09-14T10:47:52.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_6 2024-09-14T10:47:52.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.955+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:104 3.2es0 3:77e0bef4:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_6:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c50980bd00 con 0x7f4830039020 2024-09-14T10:47:52.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.959+0000 7f483bf459c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_7 2024-09-14T10:47:52.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.959+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:105 3.30s0 3:0e96ca43:::67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_7:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c50980e570 con 0x55c5097ca990 2024-09-14T10:47:52.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.959+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 31 ==== osd_op_reply(101 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_3 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.963+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 32 ==== osd_op_reply(105 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_7 [call] v34'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.963+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 33 ==== osd_op_reply(100 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_2 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.963+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 22 ==== osd_op_reply(103 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_5 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.963+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 29 ==== osd_op_reply(102 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.963+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 20 ==== osd_op_reply(104 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_6 [call] v34'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.967+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 30 ==== osd_op_reply(99 67d5d4ca-fcee-4ea2-925b-fcc0d92e249d.4228.11__shadow_.RAC5a2_tVhEmrmclvSoFYtmhl_tQure_1 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.967+0000 7f483bf459c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T10:47:52.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.967+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:106 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fd0 con 0x55c5097ca990 2024-09-14T10:47:52.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.971+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 34 ==== osd_op_reply(106 gc.2 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.971+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:107 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fd0 con 0x55c5097ca990 2024-09-14T10:47:52.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.971+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 35 ==== osd_op_reply(107 gc.2 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T10:47:52.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:108 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fd0 con 0x55c5097c4770 2024-09-14T10:47:52.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 31 ==== osd_op_reply(108 gc.3 [call] v34'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:109 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fd0 con 0x55c5097c4770 2024-09-14T10:47:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 32 ==== osd_op_reply(109 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:110 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806fc0 con 0x55c5097c4770 2024-09-14T10:47:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 33 ==== osd_op_reply(110 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:111 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fd0 con 0x55c5097c4770 2024-09-14T10:47:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 34 ==== osd_op_reply(111 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:52.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.975+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:112 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fd0 con 0x55c5097c4770 2024-09-14T10:47:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 35 ==== osd_op_reply(112 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:113 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fd0 con 0x55c5097c4770 2024-09-14T10:47:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 36 ==== osd_op_reply(113 gc.3 [call] v34'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T10:47:52.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:114 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fd0 con 0x7f4830039020 2024-09-14T10:47:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 21 ==== osd_op_reply(114 gc.4 [call] v34'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:115 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fb0 con 0x7f4830039020 2024-09-14T10:47:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 22 ==== osd_op_reply(115 gc.4 [call out=15b] v0'0 uv87 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.979+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:116 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806fa0 con 0x7f4830039020 2024-09-14T10:47:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 23 ==== osd_op_reply(116 gc.4 [call out=24b] v0'0 uv87 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:117 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fb0 con 0x7f4830039020 2024-09-14T10:47:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 24 ==== osd_op_reply(117 gc.4 [call out=15b] v0'0 uv87 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:118 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fb0 con 0x7f4830039020 2024-09-14T10:47:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 25 ==== osd_op_reply(118 gc.4 [call out=15b] v0'0 uv87 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:119 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fb0 con 0x7f4830039020 2024-09-14T10:47:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 26 ==== osd_op_reply(119 gc.4 [call] v34'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T10:47:52.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:120 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807fb0 con 0x55c5097ca990 2024-09-14T10:47:52.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 36 ==== osd_op_reply(120 gc.5 [call] v34'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.983+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:121 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097ca990 2024-09-14T10:47:52.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 37 ==== osd_op_reply(121 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:122 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:52.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 38 ==== osd_op_reply(122 gc.5 [call out=24b] v0'0 uv58 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:123 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097ca990 2024-09-14T10:47:52.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 39 ==== osd_op_reply(123 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:52.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:124 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097ca990 2024-09-14T10:47:52.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 40 ==== osd_op_reply(124 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:125 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097ca990 2024-09-14T10:47:52.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 41 ==== osd_op_reply(125 gc.5 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:52.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T10:47:52.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.987+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:126 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097c4770 2024-09-14T10:47:52.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 37 ==== osd_op_reply(126 gc.6 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:127 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097c4770 2024-09-14T10:47:52.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 38 ==== osd_op_reply(127 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:128 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:52.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 39 ==== osd_op_reply(128 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.991 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:129 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097c4770 2024-09-14T10:47:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 40 ==== osd_op_reply(129 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:130 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097c4770 2024-09-14T10:47:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 41 ==== osd_op_reply(130 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.991+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:131 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x55c5097c4770 2024-09-14T10:47:52.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.995+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 42 ==== osd_op_reply(131 gc.6 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:52.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.995+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T10:47:52.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.995+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:132 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4834019040 2024-09-14T10:47:52.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.995+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 23 ==== osd_op_reply(132 gc.7 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.995+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:133 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4834019040 2024-09-14T10:47:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.995+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 24 ==== osd_op_reply(133 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.995+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.995+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:134 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:52.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.999+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 25 ==== osd_op_reply(134 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.999+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:135 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4834019040 2024-09-14T10:47:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.999+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 26 ==== osd_op_reply(135 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.999+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:52.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.999+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:136 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4834019040 2024-09-14T10:47:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.999+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 27 ==== osd_op_reply(136 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:52.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.999+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:52.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:52.999+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:137 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4834019040 2024-09-14T10:47:53.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.003+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 28 ==== osd_op_reply(137 gc.7 [call] v34'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.003+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T10:47:53.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.003+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:138 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.003+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 27 ==== osd_op_reply(138 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:139 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 28 ==== osd_op_reply(139 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:140 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x7f4830039020 2024-09-14T10:47:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 29 ==== osd_op_reply(140 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:141 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 30 ==== osd_op_reply(141 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:142 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 31 ==== osd_op_reply(142 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:143 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 32 ==== osd_op_reply(143 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T10:47:53.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.007+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:144 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 42 ==== osd_op_reply(144 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:145 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 43 ==== osd_op_reply(145 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:146 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x55c5097ca990 2024-09-14T10:47:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 44 ==== osd_op_reply(146 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:147 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 45 ==== osd_op_reply(147 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:148 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 46 ==== osd_op_reply(148 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.011+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:149 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 47 ==== osd_op_reply(149 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T10:47:53.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:150 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 33 ==== osd_op_reply(150 gc.10 [call] v34'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:151 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 34 ==== osd_op_reply(151 gc.10 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:152 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x7f4830039020 2024-09-14T10:47:53.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.015+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 35 ==== osd_op_reply(152 gc.10 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:153 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 36 ==== osd_op_reply(153 gc.10 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:154 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 37 ==== osd_op_reply(154 gc.10 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:155 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 38 ==== osd_op_reply(155 gc.10 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T10:47:53.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.019+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:156 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 29 ==== osd_op_reply(156 gc.11 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:157 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 30 ==== osd_op_reply(157 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:158 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x7f4834019040 2024-09-14T10:47:53.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 31 ==== osd_op_reply(158 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:159 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 32 ==== osd_op_reply(159 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.023+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:160 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.027+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 33 ==== osd_op_reply(160 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.027+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.027+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:161 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.027+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 34 ==== osd_op_reply(161 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.027+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T10:47:53.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.027+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:162 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 39 ==== osd_op_reply(162 gc.12 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:163 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 40 ==== osd_op_reply(163 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:164 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x7f4830039020 2024-09-14T10:47:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 41 ==== osd_op_reply(164 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:165 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 42 ==== osd_op_reply(165 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:166 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 43 ==== osd_op_reply(166 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:167 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 44 ==== osd_op_reply(167 gc.12 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.031+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T10:47:53.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.035+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:168 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.035+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 35 ==== osd_op_reply(168 gc.13 [call] v34'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.035+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:169 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.035+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 36 ==== osd_op_reply(169 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.035+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.035+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:170 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x7f4834019040 2024-09-14T10:47:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.039+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 37 ==== osd_op_reply(170 gc.13 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.039+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:171 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.039+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 38 ==== osd_op_reply(171 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.039+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.039+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:172 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.039+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 39 ==== osd_op_reply(172 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.039+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.039+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:173 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 40 ==== osd_op_reply(173 gc.13 [call] v34'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T10:47:53.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:174 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 43 ==== osd_op_reply(174 gc.14 [call] v34'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:175 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 44 ==== osd_op_reply(175 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:176 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x55c5097c4770 2024-09-14T10:47:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.043+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 45 ==== osd_op_reply(176 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:177 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 46 ==== osd_op_reply(177 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:178 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 47 ==== osd_op_reply(178 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:179 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 48 ==== osd_op_reply(179 gc.14 [call] v34'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T10:47:53.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.047+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:180 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 48 ==== osd_op_reply(180 gc.15 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:181 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 49 ==== osd_op_reply(181 gc.15 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:182 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x55c5097ca990 2024-09-14T10:47:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 50 ==== osd_op_reply(182 gc.15 [call out=24b] v0'0 uv81 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:183 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 51 ==== osd_op_reply(183 gc.15 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:184 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 52 ==== osd_op_reply(184 gc.15 [call out=15b] v0'0 uv81 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.051+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:185 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.055+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 53 ==== osd_op_reply(185 gc.15 [call] v34'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.055+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T10:47:53.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.055+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:186 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.055+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 45 ==== osd_op_reply(186 gc.16 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.055+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:187 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 46 ==== osd_op_reply(187 gc.16 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:188 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808370 con 0x7f4830039020 2024-09-14T10:47:53.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 47 ==== osd_op_reply(188 gc.16 [call out=24b] v0'0 uv91 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:189 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 48 ==== osd_op_reply(189 gc.16 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:190 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 49 ==== osd_op_reply(190 gc.16 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:191 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.059+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 50 ==== osd_op_reply(191 gc.16 [call] v34'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T10:47:53.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:192 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 54 ==== osd_op_reply(192 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:193 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 55 ==== osd_op_reply(193 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:194 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097ca990 2024-09-14T10:47:53.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 56 ==== osd_op_reply(194 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:195 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 57 ==== osd_op_reply(195 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:196 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 58 ==== osd_op_reply(196 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.063+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:197 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.067+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 59 ==== osd_op_reply(197 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.067+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T10:47:53.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.067+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:198 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.067+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 49 ==== osd_op_reply(198 gc.18 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.067+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:199 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 50 ==== osd_op_reply(199 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:200 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097c4770 2024-09-14T10:47:53.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 51 ==== osd_op_reply(200 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:201 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 52 ==== osd_op_reply(201 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:202 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 53 ==== osd_op_reply(202 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:203 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 54 ==== osd_op_reply(203 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T10:47:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.071+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:204 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 55 ==== osd_op_reply(204 gc.19 [call] v34'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:205 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 56 ==== osd_op_reply(205 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:206 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097c4770 2024-09-14T10:47:53.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 57 ==== osd_op_reply(206 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:207 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 58 ==== osd_op_reply(207 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:208 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 59 ==== osd_op_reply(208 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.075+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:209 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.079+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 60 ==== osd_op_reply(209 gc.19 [call] v34'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.079+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T10:47:53.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.079+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:210 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 60 ==== osd_op_reply(210 gc.20 [call] v34'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:211 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 61 ==== osd_op_reply(211 gc.20 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:212 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097ca990 2024-09-14T10:47:53.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 62 ==== osd_op_reply(212 gc.20 [call out=24b] v0'0 uv83 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:213 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 63 ==== osd_op_reply(213 gc.20 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:214 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 64 ==== osd_op_reply(214 gc.20 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.083+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:215 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 65 ==== osd_op_reply(215 gc.20 [call] v34'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T10:47:53.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:216 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 51 ==== osd_op_reply(216 gc.21 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:217 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 52 ==== osd_op_reply(217 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:218 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808370 con 0x7f4830039020 2024-09-14T10:47:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.087+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 53 ==== osd_op_reply(218 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:219 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 54 ==== osd_op_reply(219 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:220 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 55 ==== osd_op_reply(220 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:221 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 56 ==== osd_op_reply(221 gc.21 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T10:47:53.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.091+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:222 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 66 ==== osd_op_reply(222 gc.22 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:223 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 67 ==== osd_op_reply(223 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:224 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097ca990 2024-09-14T10:47:53.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 68 ==== osd_op_reply(224 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:225 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 69 ==== osd_op_reply(225 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:226 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 70 ==== osd_op_reply(226 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.095+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:227 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.099+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 71 ==== osd_op_reply(227 gc.22 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.099+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T10:47:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.099+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:228 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 72 ==== osd_op_reply(228 gc.23 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:229 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 73 ==== osd_op_reply(229 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:230 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097ca990 2024-09-14T10:47:53.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 74 ==== osd_op_reply(230 gc.23 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:231 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 75 ==== osd_op_reply(231 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:232 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 76 ==== osd_op_reply(232 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.103+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:233 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.107+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 77 ==== osd_op_reply(233 gc.23 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.107+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T10:47:53.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.107+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:234 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.107+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 78 ==== osd_op_reply(234 gc.24 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.107+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:235 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.107+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 79 ==== osd_op_reply(235 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.107+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.107+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:236 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097ca990 2024-09-14T10:47:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 80 ==== osd_op_reply(236 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:237 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 81 ==== osd_op_reply(237 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:238 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 82 ==== osd_op_reply(238 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:239 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 83 ==== osd_op_reply(239 gc.24 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T10:47:53.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.111+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:240 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 84 ==== osd_op_reply(240 gc.25 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:241 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 85 ==== osd_op_reply(241 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:242 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097ca990 2024-09-14T10:47:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 86 ==== osd_op_reply(242 gc.25 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:243 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 87 ==== osd_op_reply(243 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:244 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 88 ==== osd_op_reply(244 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.115+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:245 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.119+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 89 ==== osd_op_reply(245 gc.25 [call] v34'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.119+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T10:47:53.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.119+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:246 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.123+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 41 ==== osd_op_reply(246 gc.26 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.123+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:247 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.123+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 42 ==== osd_op_reply(247 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.123+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.123+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:248 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x7f4834019040 2024-09-14T10:47:53.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.123+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 43 ==== osd_op_reply(248 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.123+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:249 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.127+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 44 ==== osd_op_reply(249 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.127+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.127+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:250 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.127+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 45 ==== osd_op_reply(250 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.127+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.127+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:251 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 46 ==== osd_op_reply(251 gc.26 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T10:47:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:252 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 90 ==== osd_op_reply(252 gc.27 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:253 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 91 ==== osd_op_reply(253 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:254 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097ca990 2024-09-14T10:47:53.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 92 ==== osd_op_reply(254 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.131+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:255 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 93 ==== osd_op_reply(255 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:256 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 94 ==== osd_op_reply(256 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:257 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 95 ==== osd_op_reply(257 gc.27 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T10:47:53.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.135+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:258 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.139+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 47 ==== osd_op_reply(258 gc.28 [call] v34'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.139+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:259 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.139+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 48 ==== osd_op_reply(259 gc.28 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.139+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.139+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:260 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x7f4834019040 2024-09-14T10:47:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.139+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 49 ==== osd_op_reply(260 gc.28 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.139+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:261 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 50 ==== osd_op_reply(261 gc.28 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:262 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 51 ==== osd_op_reply(262 gc.28 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:263 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 52 ==== osd_op_reply(263 gc.28 [call] v34'62 uv62 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T10:47:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.143+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:264 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.147+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 96 ==== osd_op_reply(264 gc.29 [call] v34'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.147+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:265 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.147+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 97 ==== osd_op_reply(265 gc.29 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.147+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.147+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:266 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097ca990 2024-09-14T10:47:53.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.147+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 98 ==== osd_op_reply(266 gc.29 [call out=24b] v0'0 uv85 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.147+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:267 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 99 ==== osd_op_reply(267 gc.29 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:268 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 100 ==== osd_op_reply(268 gc.29 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:269 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097ca990 2024-09-14T10:47:53.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 101 ==== osd_op_reply(269 gc.29 [call] v34'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T10:47:53.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.151+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:270 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.155+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 53 ==== osd_op_reply(270 gc.30 [call] v34'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.155+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:271 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.155+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 54 ==== osd_op_reply(271 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.155+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.155+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:272 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x7f4834019040 2024-09-14T10:47:53.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.159+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 55 ==== osd_op_reply(272 gc.30 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.159+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:273 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.159+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 56 ==== osd_op_reply(273 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.159+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.159+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:274 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.159+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 57 ==== osd_op_reply(274 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.159+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.159+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:275 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.163+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 58 ==== osd_op_reply(275 gc.30 [call] v34'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.163+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T10:47:53.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.163+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:276 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 57 ==== osd_op_reply(276 gc.31 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:277 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 58 ==== osd_op_reply(277 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:278 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808350 con 0x7f4830039020 2024-09-14T10:47:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 59 ==== osd_op_reply(278 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:279 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 60 ==== osd_op_reply(279 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:280 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509807f30 con 0x7f4830039020 2024-09-14T10:47:53.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 61 ==== osd_op_reply(280 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.167+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:281 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4830039020 2024-09-14T10:47:53.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.171+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 62 ==== osd_op_reply(281 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.171+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T10:47:53.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.171+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:282 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.171+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 61 ==== osd_op_reply(282 gc.0 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.171+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:283 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 62 ==== osd_op_reply(283 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:284 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509808320 con 0x55c5097c4770 2024-09-14T10:47:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 63 ==== osd_op_reply(284 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:285 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 64 ==== osd_op_reply(285 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:286 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 65 ==== osd_op_reply(286 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:287 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x55c5097c4770 2024-09-14T10:47:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 66 ==== osd_op_reply(287 gc.0 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T10:47:53.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.175+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:288 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.179+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 59 ==== osd_op_reply(288 gc.1 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.179+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:289 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.179+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 60 ==== osd_op_reply(289 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.179+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.179+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:290 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.183+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 61 ==== osd_op_reply(290 gc.1 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.183+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:291 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.183+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 62 ==== osd_op_reply(291 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.183+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:47:53.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.183+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:292 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.183+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 63 ==== osd_op_reply(292 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.183+0000 7f483bf459c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:47:53.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.183+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:293 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c509806f20 con 0x7f4834019040 2024-09-14T10:47:53.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.187+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 64 ==== osd_op_reply(293 gc.1 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.187+0000 7f46eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:53.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.187+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94304756121072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d6420 con 0x55c5097c4770 2024-09-14T10:47:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.191+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 67 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94304756121072] v34'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.191+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94304756099984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d6420 con 0x7f4830039020 2024-09-14T10:47:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.195+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94304756099984] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.195+0000 7f483bf459c0 20 remove_watcher() i=0 2024-09-14T10:47:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.195+0000 7f483bf459c0 2 removed watcher, disabling cache 2024-09-14T10:47:53.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.195+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94304756104272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097ceb90 con 0x55c5097c4770 2024-09-14T10:47:53.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.195+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 68 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94304756104272] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.195+0000 7f483bf459c0 20 remove_watcher() i=1 2024-09-14T10:47:53.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.195+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94304756097472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d6420 con 0x55c5097ca990 2024-09-14T10:47:53.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.199+0000 7f483924a640 1 -- 172.21.15.96:0/1068641551 <== osd.3 v2:172.21.15.96:6800/3683402699 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94304756097472] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4830024c40 con 0x55c5097ca990 2024-09-14T10:47:53.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.199+0000 7f483bf459c0 20 remove_watcher() i=2 2024-09-14T10:47:53.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.199+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94304756110224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097ceb90 con 0x7f4830039020 2024-09-14T10:47:53.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.199+0000 7f483a24c640 1 -- 172.21.15.96:0/1068641551 <== osd.2 v2:172.21.15.96:6816/2312202642 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94304756110224] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f483402f040 con 0x7f4830039020 2024-09-14T10:47:53.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.199+0000 7f483bf459c0 20 remove_watcher() i=3 2024-09-14T10:47:53.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.199+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94304756114704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097ce1c0 con 0x55c5097c4770 2024-09-14T10:47:53.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.203+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.1 v2:172.21.15.96:6808/2339799699 69 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94304756114704] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x55c5097c4770 2024-09-14T10:47:53.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.203+0000 7f483bf459c0 20 remove_watcher() i=4 2024-09-14T10:47:53.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.203+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94304756108752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d6420 con 0x7f4834019040 2024-09-14T10:47:53.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.207+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94304756108752] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.207+0000 7f483bf459c0 20 remove_watcher() i=5 2024-09-14T10:47:53.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.207+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94304756118144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097ceb90 con 0x7f4834019040 2024-09-14T10:47:53.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.207+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94304756118144] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.207+0000 7f483bf459c0 20 remove_watcher() i=6 2024-09-14T10:47:53.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.207+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94304756116496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c5097d2510 con 0x7f4834019040 2024-09-14T10:47:53.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 <== osd.0 v2:172.21.15.70:6800/3481052616 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94304756116496] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f482c0b2040 con 0x7f4834019040 2024-09-14T10:47:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 20 remove_watcher() i=7 2024-09-14T10:47:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4834019040 msgr2=0x7f4834019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7f4834019040 0x7f4834019930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5097c4770 msgr2=0x55c5097c6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c5097c4770 0x55c5097c6c00 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4830039020 msgr2=0x7f48300507c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7f4830039020 0x7f48300507c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5097ca990 msgr2=0x55c5097ccd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x55c5097ca990 0x55c5097ccd80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f470403a150 msgr2=0x7f470403c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f470403a150 0x7f470403c610 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f483400f010 tx=0x7f483401b070 comp rx=0 tx=0).stop 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 msgr2=0x55c50960f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 --2- 172.21.15.96:0/1068641551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097afc40 0x55c50960f420 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4830023850 tx=0x7f48300517b0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f4839a4b640 1 -- 172.21.15.96:0/1068641551 reap_dead start 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 shutdown_connections 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 >> 172.21.15.96:0/1068641551 conn(0x55c5097ac070 msgr2=0x55c5097aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 shutdown_connections 2024-09-14T10:47:53.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.211+0000 7f483bf459c0 1 -- 172.21.15.96:0/1068641551 wait complete. 2024-09-14T10:47:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/3098175707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f471403a190 msgr2=0x7f471403c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/3098175707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f471403a190 0x7f471403c650 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f483400e3f0 tx=0x7f4834003070 comp rx=0 tx=0).stop 2024-09-14T10:47:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/3098175707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097a32e0 msgr2=0x55c5097a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/3098175707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097a32e0 0x55c5097a3700 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f483000d660 tx=0x7f483000da60 comp rx=0 tx=0).stop 2024-09-14T10:47:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/3098175707 shutdown_connections 2024-09-14T10:47:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/3098175707 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f471403a190 0x7f471403c650 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/3098175707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c5097a32e0 0x55c5097a3700 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/3098175707 >> 172.21.15.96:0/3098175707 conn(0x55c509798c90 msgr2=0x55c509799070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/3098175707 shutdown_connections 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/3098175707 wait complete. 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c50969c110 msgr2=0x55c509792ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c50969c110 0x55c509792ce0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f472003a1a0 msgr2=0x7f472003c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f472003a1a0 0x7f472003c660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4830004180 tx=0x7f4830001340 comp rx=0 tx=0).stop 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 msgr2=0x55c50978bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c50978bbc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f482c018c00 tx=0x7f482c017d70 comp rx=0 tx=0).stop 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 shutdown_connections 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x55c50969c110 0x55c509792ce0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f472003a1a0 0x7f472003c660 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 --2- 172.21.15.96:0/91424445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c509698fd0 0x55c50978bbc0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 >> 172.21.15.96:0/91424445 conn(0x55c509694af0 msgr2=0x55c5097856e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 shutdown_connections 2024-09-14T10:47:53.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-14T10:47:53.215+0000 7f483bf459c0 1 -- 172.21.15.96:0/91424445 wait complete. 2024-09-14T10:47:53.228 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T10:47:53.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:47:53.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:47:53.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.372+0000 7f431b212640 1 Processor -- start 2024-09-14T10:47:53.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.372+0000 7f431b212640 1 -- start start 2024-09-14T10:47:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.372+0000 7f431b212640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4314071d80 0x7f4314132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.372+0000 7f431b212640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140724f0 con 0x7f431412d390 2024-09-14T10:47:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.372+0000 7f431b212640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f4314099e20 con 0x7f4314071d80 2024-09-14T10:47:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.372+0000 7f4313fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4314071d80 0x7f4314132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.372+0000 7f4318fae640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f431412d390 0x7f431412d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:38930/0 (socket says 172.21.15.70:38930) 2024-09-14T10:47:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.372+0000 7f4318fae640 1 -- 172.21.15.70:0/788689276 learned_addr learned my addr 172.21.15.70:0/788689276 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f4313fff640 1 -- 172.21.15.70:0/788689276 >> v1:172.21.15.70:6789/0 conn(0x7f431412d390 legacy=0x7f431412d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f4313fff640 1 -- 172.21.15.70:0/788689276 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431412de80 con 0x7f4314071d80 2024-09-14T10:47:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f4313fff640 1 --2- 172.21.15.70:0/788689276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f4314132390 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4304009dc0 tx=0x7f430401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7969855597bd0fff server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f43137fe640 1 -- 172.21.15.70:0/788689276 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43040b2070 con 0x7f4314071d80 2024-09-14T10:47:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f43137fe640 1 -- 172.21.15.70:0/788689276 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43040a5830 con 0x7f4314071d80 2024-09-14T10:47:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f43137fe640 1 -- 172.21.15.70:0/788689276 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43040a5b30 con 0x7f4314071d80 2024-09-14T10:47:53.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f431b212640 1 -- 172.21.15.70:0/788689276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 msgr2=0x7f4314132390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f431b212640 1 --2- 172.21.15.70:0/788689276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f4314132390 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4304009dc0 tx=0x7f430401c8a0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f431b212640 1 -- 172.21.15.70:0/788689276 shutdown_connections 2024-09-14T10:47:53.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f431b212640 1 --2- 172.21.15.70:0/788689276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f4314132390 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f431b212640 1 -- 172.21.15.70:0/788689276 >> 172.21.15.70:0/788689276 conn(0x7f431409aba0 msgr2=0x7f43140984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:53.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f431b212640 1 -- 172.21.15.70:0/788689276 shutdown_connections 2024-09-14T10:47:53.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.376+0000 7f431b212640 1 -- 172.21.15.70:0/788689276 wait complete. 2024-09-14T10:47:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f431b212640 1 Processor -- start 2024-09-14T10:47:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f431b212640 1 -- start start 2024-09-14T10:47:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f431b212640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f43141297a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f431b212640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4314135480 con 0x7f4314071d80 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f4318fae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f43141297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f4318fae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f43141297a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47156/0 (socket says 172.21.15.70:47156) 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f4318fae640 1 -- 172.21.15.70:0/3705957370 learned_addr learned my addr 172.21.15.70:0/3705957370 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f4318fae640 1 -- 172.21.15.70:0/3705957370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4314127550 con 0x7f4314071d80 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f4318fae640 1 --2- 172.21.15.70:0/3705957370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f43141297a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c480 tx=0x7f42fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f43117fa640 1 -- 172.21.15.70:0/3705957370 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42fc017070 con 0x7f4314071d80 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f43117fa640 1 -- 172.21.15.70:0/3705957370 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42fc005c20 con 0x7f4314071d80 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4314129230 con 0x7f4314071d80 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f43117fa640 1 -- 172.21.15.70:0/3705957370 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42fc007070 con 0x7f4314071d80 2024-09-14T10:47:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4314129ce0 con 0x7f4314071d80 2024-09-14T10:47:53.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4314128150 con 0x7f4314071d80 2024-09-14T10:47:53.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f43117fa640 1 -- 172.21.15.70:0/3705957370 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f42fc01a070 con 0x7f4314071d80 2024-09-14T10:47:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f43117fa640 1 --2- 172.21.15.70:0/3705957370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42f403b8b0 0x7f42f403dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f43117fa640 1 -- 172.21.15.70:0/3705957370 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f42fc04f370 con 0x7f4314071d80 2024-09-14T10:47:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f4313fff640 1 --2- 172.21.15.70:0/3705957370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42f403b8b0 0x7f42f403dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:53.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.380+0000 7f4313fff640 1 --2- 172.21.15.70:0/3705957370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42f403b8b0 0x7f42f403dd70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f43040af000 tx=0x7f43040a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:53.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.384+0000 7f43117fa640 1 -- 172.21.15.70:0/3705957370 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f42fc01ac60 con 0x7f4314071d80 2024-09-14T10:47:53.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.552+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43141285e0 con 0x7f42f403b8b0 2024-09-14T10:47:53.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.592+0000 7f43117fa640 1 -- 172.21.15.70:0/3705957370 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666038 (secure 0 0 0) 0x7f43040a5800 con 0x7f42f403b8b0 2024-09-14T10:47:53.598 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:47:53.601 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:47:53.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42f403b8b0 msgr2=0x7f42f403dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 --2- 172.21.15.70:0/3705957370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42f403b8b0 0x7f42f403dd70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f43040af000 tx=0x7f43040a7070 comp rx=0 tx=0).stop 2024-09-14T10:47:53.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 msgr2=0x7f43141297a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 --2- 172.21.15.70:0/3705957370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f43141297a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c480 tx=0x7f42fc00c940 comp rx=0 tx=0).stop 2024-09-14T10:47:53.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 shutdown_connections 2024-09-14T10:47:53.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 --2- 172.21.15.70:0/3705957370 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f42f403b8b0 0x7f42f403dd70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 --2- 172.21.15.70:0/3705957370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4314071d80 0x7f43141297a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 >> 172.21.15.70:0/3705957370 conn(0x7f431409aba0 msgr2=0x7f431412e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:53.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 shutdown_connections 2024-09-14T10:47:53.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.600+0000 7f431b212640 1 -- 172.21.15.70:0/3705957370 wait complete. 2024-09-14T10:47:53.612 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-14T10:47:53.464430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416911,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4941,"num_read_kb":4479,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36213158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007414"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439387+0000","last_change":"2024-09-14T10:44:05.314727+0000","last_active":"2024-09-14T10:44:44.439387+0000","last_peered":"2024-09-14T10:44:44.439387+0000","last_clean":"2024-09-14T10:44:44.439387+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:44:44.439387+0000","last_undegraded":"2024-09-14T10:44:44.439387+0000","last_fullsized":"2024-09-14T10:44:44.439387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:33.017320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720305+0000","last_change":"2024-09-14T10:44:07.304568+0000","last_active":"2024-09-14T10:47:21.720305+0000","last_peered":"2024-09-14T10:47:21.720305+0000","last_clean":"2024-09-14T10:47:21.720305+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:47:21.720305+0000","last_undegraded":"2024-09-14T10:47:21.720305+0000","last_fullsized":"2024-09-14T10:47:21.720305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:11.798345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.674373+0000","last_change":"2024-09-14T10:44:05.320383+0000","last_active":"2024-09-14T10:47:21.674373+0000","last_peered":"2024-09-14T10:47:21.674373+0000","last_clean":"2024-09-14T10:47:21.674373+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:47:21.674373+0000","last_undegraded":"2024-09-14T10:47:21.674373+0000","last_fullsized":"2024-09-14T10:47:21.674373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:57.992699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720464+0000","last_change":"2024-09-14T10:44:07.311706+0000","last_active":"2024-09-14T10:47:21.720464+0000","last_peered":"2024-09-14T10:47:21.720464+0000","last_clean":"2024-09-14T10:47:21.720464+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:47:21.720464+0000","last_undegraded":"2024-09-14T10:47:21.720464+0000","last_fullsized":"2024-09-14T10:47:21.720464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:27.522929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.458276+0000","last_change":"2024-09-14T10:44:05.321748+0000","last_active":"2024-09-14T10:44:44.458276+0000","last_peered":"2024-09-14T10:44:44.458276+0000","last_clean":"2024-09-14T10:44:44.458276+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:44:44.458276+0000","last_undegraded":"2024-09-14T10:44:44.458276+0000","last_fullsized":"2024-09-14T10:44:44.458276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.177217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879810+0000","last_change":"2024-09-14T10:44:07.311756+0000","last_active":"2024-09-14T10:47:21.879810+0000","last_peered":"2024-09-14T10:47:21.879810+0000","last_clean":"2024-09-14T10:47:21.879810+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:47:21.879810+0000","last_undegraded":"2024-09-14T10:47:21.879810+0000","last_fullsized":"2024-09-14T10:47:21.879810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.711375+0000","last_change":"2024-09-14T10:44:05.316542+0000","last_active":"2024-09-14T10:44:50.711375+0000","last_peered":"2024-09-14T10:44:50.711375+0000","last_clean":"2024-09-14T10:44:50.711375+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:44:50.711375+0000","last_undegraded":"2024-09-14T10:44:50.711375+0000","last_fullsized":"2024-09-14T10:44:50.711375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:35.707595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600024+0000","last_change":"2024-09-14T10:44:07.312388+0000","last_active":"2024-09-14T10:45:35.600024+0000","last_peered":"2024-09-14T10:45:35.600024+0000","last_clean":"2024-09-14T10:45:35.600024+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:45:35.600024+0000","last_undegraded":"2024-09-14T10:45:35.600024+0000","last_fullsized":"2024-09-14T10:45:35.600024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:31.070464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454651+0000","last_change":"2024-09-14T10:44:05.329861+0000","last_active":"2024-09-14T10:44:44.454651+0000","last_peered":"2024-09-14T10:44:44.454651+0000","last_clean":"2024-09-14T10:44:44.454651+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:44:44.454651+0000","last_undegraded":"2024-09-14T10:44:44.454651+0000","last_fullsized":"2024-09-14T10:44:44.454651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:01.827439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.677760+0000","last_change":"2024-09-14T10:44:07.303712+0000","last_active":"2024-09-14T10:46:20.677760+0000","last_peered":"2024-09-14T10:46:20.677760+0000","last_clean":"2024-09-14T10:46:20.677760+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:46:20.677760+0000","last_undegraded":"2024-09-14T10:46:20.677760+0000","last_fullsized":"2024-09-14T10:46:20.677760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433524+0000","last_change":"2024-09-14T10:44:05.317002+0000","last_active":"2024-09-14T10:44:44.433524+0000","last_peered":"2024-09-14T10:44:44.433524+0000","last_clean":"2024-09-14T10:44:44.433524+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:44:44.433524+0000","last_undegraded":"2024-09-14T10:44:44.433524+0000","last_fullsized":"2024-09-14T10:44:44.433524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:24.606365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.373297+0000","last_change":"2024-09-14T10:44:44.462329+0000","last_active":"2024-09-14T10:47:21.373297+0000","last_peered":"2024-09-14T10:47:21.373297+0000","last_clean":"2024-09-14T10:47:21.373297+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:47:21.373297+0000","last_undegraded":"2024-09-14T10:47:21.373297+0000","last_fullsized":"2024-09-14T10:47:21.373297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:05.537374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.449407+0000","last_change":"2024-09-14T10:44:05.319096+0000","last_active":"2024-09-14T10:44:44.449407+0000","last_peered":"2024-09-14T10:44:44.449407+0000","last_clean":"2024-09-14T10:44:44.449407+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:44:44.449407+0000","last_undegraded":"2024-09-14T10:44:44.449407+0000","last_fullsized":"2024-09-14T10:44:44.449407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:07.843074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879838+0000","last_change":"2024-09-14T10:44:07.301357+0000","last_active":"2024-09-14T10:47:21.879838+0000","last_peered":"2024-09-14T10:47:21.879838+0000","last_clean":"2024-09-14T10:47:21.879838+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:47:21.879838+0000","last_undegraded":"2024-09-14T10:47:21.879838+0000","last_fullsized":"2024-09-14T10:47:21.879838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:49.933862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.869625+0000","last_change":"2024-09-14T10:44:05.315243+0000","last_active":"2024-09-14T10:47:21.869625+0000","last_peered":"2024-09-14T10:47:21.869625+0000","last_clean":"2024-09-14T10:47:21.869625+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:47:21.869625+0000","last_undegraded":"2024-09-14T10:47:21.869625+0000","last_fullsized":"2024-09-14T10:47:21.869625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:04.517080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.986354+0000","last_change":"2024-09-14T10:44:07.315054+0000","last_active":"2024-09-14T10:47:21.986354+0000","last_peered":"2024-09-14T10:47:21.986354+0000","last_clean":"2024-09-14T10:47:21.986354+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:47:21.986354+0000","last_undegraded":"2024-09-14T10:47:21.986354+0000","last_fullsized":"2024-09-14T10:47:21.986354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:46.799488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872805+0000","last_change":"2024-09-14T10:44:07.313852+0000","last_active":"2024-09-14T10:45:35.872805+0000","last_peered":"2024-09-14T10:45:35.872805+0000","last_clean":"2024-09-14T10:45:35.872805+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:45:35.872805+0000","last_undegraded":"2024-09-14T10:45:35.872805+0000","last_fullsized":"2024-09-14T10:45:35.872805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:54.012187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450856+0000","last_change":"2024-09-14T10:44:05.322752+0000","last_active":"2024-09-14T10:44:44.450856+0000","last_peered":"2024-09-14T10:44:44.450856+0000","last_clean":"2024-09-14T10:44:44.450856+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:44:44.450856+0000","last_undegraded":"2024-09-14T10:44:44.450856+0000","last_fullsized":"2024-09-14T10:44:44.450856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:08.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720065+0000","last_change":"2024-09-14T10:44:07.303444+0000","last_active":"2024-09-14T10:47:21.720065+0000","last_peered":"2024-09-14T10:47:21.720065+0000","last_clean":"2024-09-14T10:47:21.720065+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:47:21.720065+0000","last_undegraded":"2024-09-14T10:47:21.720065+0000","last_fullsized":"2024-09-14T10:47:21.720065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:42.771218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440693+0000","last_change":"2024-09-14T10:44:05.314433+0000","last_active":"2024-09-14T10:44:44.440693+0000","last_peered":"2024-09-14T10:44:44.440693+0000","last_clean":"2024-09-14T10:44:44.440693+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:44:44.440693+0000","last_undegraded":"2024-09-14T10:44:44.440693+0000","last_fullsized":"2024-09-14T10:44:44.440693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:30.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880404+0000","last_change":"2024-09-14T10:44:07.302716+0000","last_active":"2024-09-14T10:47:21.880404+0000","last_peered":"2024-09-14T10:47:21.880404+0000","last_clean":"2024-09-14T10:47:21.880404+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:47:21.880404+0000","last_undegraded":"2024-09-14T10:47:21.880404+0000","last_fullsized":"2024-09-14T10:47:21.880404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:36.213106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446820+0000","last_change":"2024-09-14T10:44:05.320439+0000","last_active":"2024-09-14T10:44:44.446820+0000","last_peered":"2024-09-14T10:44:44.446820+0000","last_clean":"2024-09-14T10:44:44.446820+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:44:44.446820+0000","last_undegraded":"2024-09-14T10:44:44.446820+0000","last_fullsized":"2024-09-14T10:44:44.446820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:30.093065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874276+0000","last_change":"2024-09-14T10:44:07.314159+0000","last_active":"2024-09-14T10:45:35.874276+0000","last_peered":"2024-09-14T10:45:35.874276+0000","last_clean":"2024-09-14T10:45:35.874276+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:45:35.874276+0000","last_undegraded":"2024-09-14T10:45:35.874276+0000","last_fullsized":"2024-09-14T10:45:35.874276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443974+0000","last_change":"2024-09-14T10:44:05.320368+0000","last_active":"2024-09-14T10:44:44.443974+0000","last_peered":"2024-09-14T10:44:44.443974+0000","last_clean":"2024-09-14T10:44:44.443974+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:44:44.443974+0000","last_undegraded":"2024-09-14T10:44:44.443974+0000","last_fullsized":"2024-09-14T10:44:44.443974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879927+0000","last_change":"2024-09-14T10:44:07.313819+0000","last_active":"2024-09-14T10:47:21.879927+0000","last_peered":"2024-09-14T10:47:21.879927+0000","last_clean":"2024-09-14T10:47:21.879927+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:47:21.879927+0000","last_undegraded":"2024-09-14T10:47:21.879927+0000","last_fullsized":"2024-09-14T10:47:21.879927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.226631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444169+0000","last_change":"2024-09-14T10:44:05.324714+0000","last_active":"2024-09-14T10:44:44.444169+0000","last_peered":"2024-09-14T10:44:44.444169+0000","last_clean":"2024-09-14T10:44:44.444169+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:44:44.444169+0000","last_undegraded":"2024-09-14T10:44:44.444169+0000","last_fullsized":"2024-09-14T10:44:44.444169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:41.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825511+0000","last_change":"2024-09-14T10:44:07.303481+0000","last_active":"2024-09-14T10:47:21.825511+0000","last_peered":"2024-09-14T10:47:21.825511+0000","last_clean":"2024-09-14T10:47:21.825511+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:47:21.825511+0000","last_undegraded":"2024-09-14T10:47:21.825511+0000","last_fullsized":"2024-09-14T10:47:21.825511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.685013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452678+0000","last_change":"2024-09-14T10:44:05.312131+0000","last_active":"2024-09-14T10:44:44.452678+0000","last_peered":"2024-09-14T10:44:44.452678+0000","last_clean":"2024-09-14T10:44:44.452678+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:44:44.452678+0000","last_undegraded":"2024-09-14T10:44:44.452678+0000","last_fullsized":"2024-09-14T10:44:44.452678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:20.004027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891282+0000","last_change":"2024-09-14T10:44:15.384222+0000","last_active":"2024-09-14T10:47:21.891282+0000","last_peered":"2024-09-14T10:47:21.891282+0000","last_clean":"2024-09-14T10:47:21.891282+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:47:21.891282+0000","last_undegraded":"2024-09-14T10:47:21.891282+0000","last_fullsized":"2024-09-14T10:47:21.891282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:52.493514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825066+0000","last_change":"2024-09-14T10:44:07.300223+0000","last_active":"2024-09-14T10:47:21.825066+0000","last_peered":"2024-09-14T10:47:21.825066+0000","last_clean":"2024-09-14T10:47:21.825066+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:47:21.825066+0000","last_undegraded":"2024-09-14T10:47:21.825066+0000","last_fullsized":"2024-09-14T10:47:21.825066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:41.299865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453614+0000","last_change":"2024-09-14T10:44:05.327015+0000","last_active":"2024-09-14T10:44:44.453614+0000","last_peered":"2024-09-14T10:44:44.453614+0000","last_clean":"2024-09-14T10:44:44.453614+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:44:44.453614+0000","last_undegraded":"2024-09-14T10:44:44.453614+0000","last_fullsized":"2024-09-14T10:44:44.453614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:24.855054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456793+0000","last_change":"2024-09-14T10:44:09.339751+0000","last_active":"2024-09-14T10:44:44.456793+0000","last_peered":"2024-09-14T10:44:44.456793+0000","last_clean":"2024-09-14T10:44:44.456793+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:44:44.456793+0000","last_undegraded":"2024-09-14T10:44:44.456793+0000","last_fullsized":"2024-09-14T10:44:44.456793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:31.250869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.638725+0000","last_change":"2024-09-14T10:44:11.366230+0000","last_active":"2024-09-14T10:46:18.638725+0000","last_peered":"2024-09-14T10:46:18.638725+0000","last_clean":"2024-09-14T10:46:18.638725+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:46:18.638725+0000","last_undegraded":"2024-09-14T10:46:18.638725+0000","last_fullsized":"2024-09-14T10:46:18.638725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446129+0000","last_change":"2024-09-14T10:44:13.370430+0000","last_active":"2024-09-14T10:44:44.446129+0000","last_peered":"2024-09-14T10:44:44.446129+0000","last_clean":"2024-09-14T10:44:44.446129+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:44:44.446129+0000","last_undegraded":"2024-09-14T10:44:44.446129+0000","last_fullsized":"2024-09-14T10:44:44.446129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.607941+0000","last_change":"2024-09-14T10:44:15.377551+0000","last_active":"2024-09-14T10:45:35.607941+0000","last_peered":"2024-09-14T10:45:35.607941+0000","last_clean":"2024-09-14T10:45:35.607941+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:45:35.607941+0000","last_undegraded":"2024-09-14T10:45:35.607941+0000","last_fullsized":"2024-09-14T10:45:35.607941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:02.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.739203+0000","last_change":"2024-09-14T10:44:07.309285+0000","last_active":"2024-09-14T10:47:21.739203+0000","last_peered":"2024-09-14T10:47:21.739203+0000","last_clean":"2024-09-14T10:47:21.739203+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:47:21.739203+0000","last_undegraded":"2024-09-14T10:47:21.739203+0000","last_fullsized":"2024-09-14T10:47:21.739203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433126+0000","last_change":"2024-09-14T10:44:05.323067+0000","last_active":"2024-09-14T10:44:44.433126+0000","last_peered":"2024-09-14T10:44:44.433126+0000","last_clean":"2024-09-14T10:44:44.433126+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:44:44.433126+0000","last_undegraded":"2024-09-14T10:44:44.433126+0000","last_fullsized":"2024-09-14T10:44:44.433126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:16.558078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440248+0000","last_change":"2024-09-14T10:44:09.318715+0000","last_active":"2024-09-14T10:44:44.440248+0000","last_peered":"2024-09-14T10:44:44.440248+0000","last_clean":"2024-09-14T10:44:44.440248+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:44:44.440248+0000","last_undegraded":"2024-09-14T10:44:44.440248+0000","last_fullsized":"2024-09-14T10:44:44.440248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:56.922877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444934+0000","last_change":"2024-09-14T10:44:11.327271+0000","last_active":"2024-09-14T10:44:44.444934+0000","last_peered":"2024-09-14T10:44:44.444934+0000","last_clean":"2024-09-14T10:44:44.444934+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:44:44.444934+0000","last_undegraded":"2024-09-14T10:44:44.444934+0000","last_fullsized":"2024-09-14T10:44:44.444934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.449635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444347+0000","last_change":"2024-09-14T10:44:13.360104+0000","last_active":"2024-09-14T10:44:44.444347+0000","last_peered":"2024-09-14T10:44:44.444347+0000","last_clean":"2024-09-14T10:44:44.444347+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:44:44.444347+0000","last_undegraded":"2024-09-14T10:44:44.444347+0000","last_fullsized":"2024-09-14T10:44:44.444347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438541+0000","last_change":"2024-09-14T10:44:15.385641+0000","last_active":"2024-09-14T10:44:44.438541+0000","last_peered":"2024-09-14T10:44:44.438541+0000","last_clean":"2024-09-14T10:44:44.438541+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:44:44.438541+0000","last_undegraded":"2024-09-14T10:44:44.438541+0000","last_fullsized":"2024-09-14T10:44:44.438541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.602221+0000","last_change":"2024-09-14T10:44:07.312266+0000","last_active":"2024-09-14T10:44:52.602221+0000","last_peered":"2024-09-14T10:44:52.602221+0000","last_clean":"2024-09-14T10:44:52.602221+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:44:52.602221+0000","last_undegraded":"2024-09-14T10:44:52.602221+0000","last_fullsized":"2024-09-14T10:44:52.602221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:05.421337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443044+0000","last_change":"2024-09-14T10:44:05.321201+0000","last_active":"2024-09-14T10:44:44.443044+0000","last_peered":"2024-09-14T10:44:44.443044+0000","last_clean":"2024-09-14T10:44:44.443044+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:44:44.443044+0000","last_undegraded":"2024-09-14T10:44:44.443044+0000","last_fullsized":"2024-09-14T10:44:44.443044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:05.963673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447321+0000","last_change":"2024-09-14T10:44:09.326103+0000","last_active":"2024-09-14T10:44:44.447321+0000","last_peered":"2024-09-14T10:44:44.447321+0000","last_clean":"2024-09-14T10:44:44.447321+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:44:44.447321+0000","last_undegraded":"2024-09-14T10:44:44.447321+0000","last_fullsized":"2024-09-14T10:44:44.447321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.437130+0000","last_change":"2024-09-14T10:44:11.355262+0000","last_active":"2024-09-14T10:44:44.437130+0000","last_peered":"2024-09-14T10:44:44.437130+0000","last_clean":"2024-09-14T10:44:44.437130+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:44:44.437130+0000","last_undegraded":"2024-09-14T10:44:44.437130+0000","last_fullsized":"2024-09-14T10:44:44.437130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:55.694768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566019+0000","last_change":"2024-09-14T10:44:13.370887+0000","last_active":"2024-09-14T10:47:19.566019+0000","last_peered":"2024-09-14T10:47:19.566019+0000","last_clean":"2024-09-14T10:47:19.566019+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:47:19.566019+0000","last_undegraded":"2024-09-14T10:47:19.566019+0000","last_fullsized":"2024-09-14T10:47:19.566019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433906+0000","last_change":"2024-09-14T10:44:15.393155+0000","last_active":"2024-09-14T10:44:44.433906+0000","last_peered":"2024-09-14T10:44:44.433906+0000","last_clean":"2024-09-14T10:44:44.433906+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:44:44.433906+0000","last_undegraded":"2024-09-14T10:44:44.433906+0000","last_fullsized":"2024-09-14T10:44:44.433906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:01.351429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:53.304550+0000","last_change":"2024-09-14T10:44:07.310193+0000","last_active":"2024-09-14T10:44:53.304550+0000","last_peered":"2024-09-14T10:44:53.304550+0000","last_clean":"2024-09-14T10:44:53.304550+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:44:53.304550+0000","last_undegraded":"2024-09-14T10:44:53.304550+0000","last_fullsized":"2024-09-14T10:44:53.304550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:15.726650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.564329+0000","last_change":"2024-09-14T10:44:05.315829+0000","last_active":"2024-09-14T10:44:52.564329+0000","last_peered":"2024-09-14T10:44:52.564329+0000","last_clean":"2024-09-14T10:44:52.564329+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:44:52.564329+0000","last_undegraded":"2024-09-14T10:44:52.564329+0000","last_fullsized":"2024-09-14T10:44:52.564329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:08.412821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455297+0000","last_change":"2024-09-14T10:44:09.341355+0000","last_active":"2024-09-14T10:44:44.455297+0000","last_peered":"2024-09-14T10:44:44.455297+0000","last_clean":"2024-09-14T10:44:44.455297+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:44:44.455297+0000","last_undegraded":"2024-09-14T10:44:44.455297+0000","last_fullsized":"2024-09-14T10:44:44.455297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:06.338264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.631745+0000","last_change":"2024-09-14T10:44:11.349869+0000","last_active":"2024-09-14T10:46:18.631745+0000","last_peered":"2024-09-14T10:46:18.631745+0000","last_clean":"2024-09-14T10:46:18.631745+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:46:18.631745+0000","last_undegraded":"2024-09-14T10:46:18.631745+0000","last_fullsized":"2024-09-14T10:46:18.631745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891629+0000","last_change":"2024-09-14T10:44:13.359625+0000","last_active":"2024-09-14T10:47:21.891629+0000","last_peered":"2024-09-14T10:47:21.891629+0000","last_clean":"2024-09-14T10:47:21.891629+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:47:21.891629+0000","last_undegraded":"2024-09-14T10:47:21.891629+0000","last_fullsized":"2024-09-14T10:47:21.891629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.828035+0000","last_change":"2024-09-14T10:44:07.313431+0000","last_active":"2024-09-14T10:47:21.828035+0000","last_peered":"2024-09-14T10:47:21.828035+0000","last_clean":"2024-09-14T10:47:21.828035+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:47:21.828035+0000","last_undegraded":"2024-09-14T10:47:21.828035+0000","last_fullsized":"2024-09-14T10:47:21.828035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:28.832046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438420+0000","last_change":"2024-09-14T10:44:05.319480+0000","last_active":"2024-09-14T10:44:44.438420+0000","last_peered":"2024-09-14T10:44:44.438420+0000","last_clean":"2024-09-14T10:44:44.438420+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:44:44.438420+0000","last_undegraded":"2024-09-14T10:44:44.438420+0000","last_fullsized":"2024-09-14T10:44:44.438420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:30.352842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447310+0000","last_change":"2024-09-14T10:44:09.321893+0000","last_active":"2024-09-14T10:44:44.447310+0000","last_peered":"2024-09-14T10:44:44.447310+0000","last_clean":"2024-09-14T10:44:44.447310+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:44:44.447310+0000","last_undegraded":"2024-09-14T10:44:44.447310+0000","last_fullsized":"2024-09-14T10:44:44.447310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:04.728659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.644500+0000","last_change":"2024-09-14T10:44:11.342017+0000","last_active":"2024-09-14T10:46:18.644500+0000","last_peered":"2024-09-14T10:46:18.644500+0000","last_clean":"2024-09-14T10:46:18.644500+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:46:18.644500+0000","last_undegraded":"2024-09-14T10:46:18.644500+0000","last_fullsized":"2024-09-14T10:46:18.644500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:22.056805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441567+0000","last_change":"2024-09-14T10:44:13.359612+0000","last_active":"2024-09-14T10:44:44.441567+0000","last_peered":"2024-09-14T10:44:44.441567+0000","last_clean":"2024-09-14T10:44:44.441567+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:44:44.441567+0000","last_undegraded":"2024-09-14T10:44:44.441567+0000","last_fullsized":"2024-09-14T10:44:44.441567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:40.424615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.610998+0000","last_change":"2024-09-14T10:44:15.384957+0000","last_active":"2024-09-14T10:45:35.610998+0000","last_peered":"2024-09-14T10:45:35.610998+0000","last_clean":"2024-09-14T10:45:35.610998+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:45:35.610998+0000","last_undegraded":"2024-09-14T10:45:35.610998+0000","last_fullsized":"2024-09-14T10:45:35.610998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.508508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.822961+0000","last_change":"2024-09-14T10:44:07.297475+0000","last_active":"2024-09-14T10:47:21.822961+0000","last_peered":"2024-09-14T10:47:21.822961+0000","last_clean":"2024-09-14T10:47:21.822961+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:47:21.822961+0000","last_undegraded":"2024-09-14T10:47:21.822961+0000","last_fullsized":"2024-09-14T10:47:21.822961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:38.470916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.697456+0000","last_change":"2024-09-14T10:44:05.322339+0000","last_active":"2024-09-14T10:47:21.697456+0000","last_peered":"2024-09-14T10:47:21.697456+0000","last_clean":"2024-09-14T10:47:21.697456+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:21.697456+0000","last_undegraded":"2024-09-14T10:47:21.697456+0000","last_fullsized":"2024-09-14T10:47:21.697456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:19.073960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439715+0000","last_change":"2024-09-14T10:44:09.315832+0000","last_active":"2024-09-14T10:44:44.439715+0000","last_peered":"2024-09-14T10:44:44.439715+0000","last_clean":"2024-09-14T10:44:44.439715+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:44:44.439715+0000","last_undegraded":"2024-09-14T10:44:44.439715+0000","last_fullsized":"2024-09-14T10:44:44.439715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:23.486222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.446040+0000","last_change":"2024-09-14T10:44:11.361862+0000","last_active":"2024-09-14T10:46:29.446040+0000","last_peered":"2024-09-14T10:46:29.446040+0000","last_clean":"2024-09-14T10:46:29.446040+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:46:29.446040+0000","last_undegraded":"2024-09-14T10:46:29.446040+0000","last_fullsized":"2024-09-14T10:46:29.446040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:38.109362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441326+0000","last_change":"2024-09-14T10:44:13.371521+0000","last_active":"2024-09-14T10:44:44.441326+0000","last_peered":"2024-09-14T10:44:44.441326+0000","last_clean":"2024-09-14T10:44:44.441326+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:44:44.441326+0000","last_undegraded":"2024-09-14T10:44:44.441326+0000","last_fullsized":"2024-09-14T10:44:44.441326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:22.520305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:29.960732+0000","last_change":"2024-09-14T10:44:15.387133+0000","last_active":"2024-09-14T10:45:29.960732+0000","last_peered":"2024-09-14T10:45:29.960732+0000","last_clean":"2024-09-14T10:45:29.960732+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:45:29.960732+0000","last_undegraded":"2024-09-14T10:45:29.960732+0000","last_fullsized":"2024-09-14T10:45:29.960732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.599443+0000","last_change":"2024-09-14T10:44:07.313496+0000","last_active":"2024-09-14T10:45:35.599443+0000","last_peered":"2024-09-14T10:45:35.599443+0000","last_clean":"2024-09-14T10:45:35.599443+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:45:35.599443+0000","last_undegraded":"2024-09-14T10:45:35.599443+0000","last_fullsized":"2024-09-14T10:45:35.599443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:25.073228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.443374+0000","last_change":"2024-09-14T10:44:05.333550+0000","last_active":"2024-09-14T10:46:19.443374+0000","last_peered":"2024-09-14T10:46:19.443374+0000","last_clean":"2024-09-14T10:46:19.443374+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:46:19.443374+0000","last_undegraded":"2024-09-14T10:46:19.443374+0000","last_fullsized":"2024-09-14T10:46:19.443374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.200851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440400+0000","last_change":"2024-09-14T10:44:09.327528+0000","last_active":"2024-09-14T10:44:44.440400+0000","last_peered":"2024-09-14T10:44:44.440400+0000","last_clean":"2024-09-14T10:44:44.440400+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:44:44.440400+0000","last_undegraded":"2024-09-14T10:44:44.440400+0000","last_fullsized":"2024-09-14T10:44:44.440400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:16.948139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444158+0000","last_change":"2024-09-14T10:44:11.356327+0000","last_active":"2024-09-14T10:46:24.444158+0000","last_peered":"2024-09-14T10:46:24.444158+0000","last_clean":"2024-09-14T10:46:24.444158+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:46:24.444158+0000","last_undegraded":"2024-09-14T10:46:24.444158+0000","last_fullsized":"2024-09-14T10:46:24.444158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":377,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.091563+0000","last_change":"2024-09-14T10:44:13.372565+0000","last_active":"2024-09-14T10:47:22.091563+0000","last_peered":"2024-09-14T10:47:22.091563+0000","last_clean":"2024-09-14T10:47:22.091563+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:47:22.091563+0000","last_undegraded":"2024-09-14T10:47:22.091563+0000","last_fullsized":"2024-09-14T10:47:22.091563+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443179+0000","last_change":"2024-09-14T10:44:15.386780+0000","last_active":"2024-09-14T10:44:44.443179+0000","last_peered":"2024-09-14T10:44:44.443179+0000","last_clean":"2024-09-14T10:44:44.443179+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:44:44.443179+0000","last_undegraded":"2024-09-14T10:44:44.443179+0000","last_fullsized":"2024-09-14T10:44:44.443179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:51.818783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880056+0000","last_change":"2024-09-14T10:44:07.297382+0000","last_active":"2024-09-14T10:47:21.880056+0000","last_peered":"2024-09-14T10:47:21.880056+0000","last_clean":"2024-09-14T10:47:21.880056+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:47:21.880056+0000","last_undegraded":"2024-09-14T10:47:21.880056+0000","last_fullsized":"2024-09-14T10:47:21.880056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:08.033376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.580206+0000","last_change":"2024-09-14T10:44:05.318622+0000","last_active":"2024-09-14T10:44:52.580206+0000","last_peered":"2024-09-14T10:44:52.580206+0000","last_clean":"2024-09-14T10:44:52.580206+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:44:52.580206+0000","last_undegraded":"2024-09-14T10:44:52.580206+0000","last_fullsized":"2024-09-14T10:44:52.580206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:45.181544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439156+0000","last_change":"2024-09-14T10:44:09.325802+0000","last_active":"2024-09-14T10:44:44.439156+0000","last_peered":"2024-09-14T10:44:44.439156+0000","last_clean":"2024-09-14T10:44:44.439156+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:44:44.439156+0000","last_undegraded":"2024-09-14T10:44:44.439156+0000","last_fullsized":"2024-09-14T10:44:44.439156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:35.589836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444298+0000","last_change":"2024-09-14T10:44:11.356796+0000","last_active":"2024-09-14T10:46:24.444298+0000","last_peered":"2024-09-14T10:46:24.444298+0000","last_clean":"2024-09-14T10:46:24.444298+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:46:24.444298+0000","last_undegraded":"2024-09-14T10:46:24.444298+0000","last_fullsized":"2024-09-14T10:46:24.444298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:34.815043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439158+0000","last_change":"2024-09-14T10:44:13.361258+0000","last_active":"2024-09-14T10:44:44.439158+0000","last_peered":"2024-09-14T10:44:44.439158+0000","last_clean":"2024-09-14T10:44:44.439158+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:44:44.439158+0000","last_undegraded":"2024-09-14T10:44:44.439158+0000","last_fullsized":"2024-09-14T10:44:44.439158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.050143+0000","last_change":"2024-09-14T10:44:15.362513+0000","last_active":"2024-09-14T10:47:22.050143+0000","last_peered":"2024-09-14T10:47:22.050143+0000","last_clean":"2024-09-14T10:47:22.050143+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:47:22.050143+0000","last_undegraded":"2024-09-14T10:47:22.050143+0000","last_fullsized":"2024-09-14T10:47:22.050143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.899211+0000","last_change":"2024-09-14T10:44:44.460040+0000","last_active":"2024-09-14T10:47:21.899211+0000","last_peered":"2024-09-14T10:47:21.899211+0000","last_clean":"2024-09-14T10:47:21.899211+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:47:21.899211+0000","last_undegraded":"2024-09-14T10:47:21.899211+0000","last_fullsized":"2024-09-14T10:47:21.899211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:12.929749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441032+0000","last_change":"2024-09-14T10:44:05.316384+0000","last_active":"2024-09-14T10:44:44.441032+0000","last_peered":"2024-09-14T10:44:44.441032+0000","last_clean":"2024-09-14T10:44:44.441032+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:44:44.441032+0000","last_undegraded":"2024-09-14T10:44:44.441032+0000","last_fullsized":"2024-09-14T10:44:44.441032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.127894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438276+0000","last_change":"2024-09-14T10:44:09.321636+0000","last_active":"2024-09-14T10:44:44.438276+0000","last_peered":"2024-09-14T10:44:44.438276+0000","last_clean":"2024-09-14T10:44:44.438276+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:44:44.438276+0000","last_undegraded":"2024-09-14T10:44:44.438276+0000","last_fullsized":"2024-09-14T10:44:44.438276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:18.793271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.622728+0000","last_change":"2024-09-14T10:44:11.337843+0000","last_active":"2024-09-14T10:46:18.622728+0000","last_peered":"2024-09-14T10:46:18.622728+0000","last_clean":"2024-09-14T10:46:18.622728+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:46:18.622728+0000","last_undegraded":"2024-09-14T10:46:18.622728+0000","last_fullsized":"2024-09-14T10:46:18.622728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:07.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460124+0000","last_change":"2024-09-14T10:44:13.368817+0000","last_active":"2024-09-14T10:44:44.460124+0000","last_peered":"2024-09-14T10:44:44.460124+0000","last_clean":"2024-09-14T10:44:44.460124+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:44:44.460124+0000","last_undegraded":"2024-09-14T10:44:44.460124+0000","last_fullsized":"2024-09-14T10:44:44.460124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:51.609983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.281368+0000","last_change":"2024-09-14T10:44:15.388555+0000","last_active":"2024-09-14T10:46:18.281368+0000","last_peered":"2024-09-14T10:46:18.281368+0000","last_clean":"2024-09-14T10:46:18.281368+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:46:18.281368+0000","last_undegraded":"2024-09-14T10:46:18.281368+0000","last_fullsized":"2024-09-14T10:46:18.281368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:16.672301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720978+0000","last_change":"2024-09-14T10:44:07.313823+0000","last_active":"2024-09-14T10:47:21.720978+0000","last_peered":"2024-09-14T10:47:21.720978+0000","last_clean":"2024-09-14T10:47:21.720978+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:47:21.720978+0000","last_undegraded":"2024-09-14T10:47:21.720978+0000","last_fullsized":"2024-09-14T10:47:21.720978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:40.529838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453896+0000","last_change":"2024-09-14T10:44:05.324895+0000","last_active":"2024-09-14T10:44:44.453896+0000","last_peered":"2024-09-14T10:44:44.453896+0000","last_clean":"2024-09-14T10:44:44.453896+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:44:44.453896+0000","last_undegraded":"2024-09-14T10:44:44.453896+0000","last_fullsized":"2024-09-14T10:44:44.453896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:31.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440536+0000","last_change":"2024-09-14T10:44:09.325353+0000","last_active":"2024-09-14T10:44:44.440536+0000","last_peered":"2024-09-14T10:44:44.440536+0000","last_clean":"2024-09-14T10:44:44.440536+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:44:44.440536+0000","last_undegraded":"2024-09-14T10:44:44.440536+0000","last_fullsized":"2024-09-14T10:44:44.440536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:24.409253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.659927+0000","last_change":"2024-09-14T10:44:11.324938+0000","last_active":"2024-09-14T10:46:18.659927+0000","last_peered":"2024-09-14T10:46:18.659927+0000","last_clean":"2024-09-14T10:46:18.659927+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:46:18.659927+0000","last_undegraded":"2024-09-14T10:46:18.659927+0000","last_fullsized":"2024-09-14T10:46:18.659927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:38.232131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":411,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.059218+0000","last_change":"2024-09-14T10:44:13.364819+0000","last_active":"2024-09-14T10:47:22.059218+0000","last_peered":"2024-09-14T10:47:22.059218+0000","last_clean":"2024-09-14T10:47:22.059218+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:47:22.059218+0000","last_undegraded":"2024-09-14T10:47:22.059218+0000","last_fullsized":"2024-09-14T10:47:22.059218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:29.703105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:22.442035+0000","last_change":"2024-09-14T10:44:15.389692+0000","last_active":"2024-09-14T10:46:22.442035+0000","last_peered":"2024-09-14T10:46:22.442035+0000","last_clean":"2024-09-14T10:46:22.442035+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:46:22.442035+0000","last_undegraded":"2024-09-14T10:46:22.442035+0000","last_fullsized":"2024-09-14T10:46:22.442035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699712+0000","last_change":"2024-09-14T10:44:07.315452+0000","last_active":"2024-09-14T10:46:20.699712+0000","last_peered":"2024-09-14T10:46:20.699712+0000","last_clean":"2024-09-14T10:46:20.699712+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:46:20.699712+0000","last_undegraded":"2024-09-14T10:46:20.699712+0000","last_fullsized":"2024-09-14T10:46:20.699712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.769639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451555+0000","last_change":"2024-09-14T10:44:05.323413+0000","last_active":"2024-09-14T10:44:44.451555+0000","last_peered":"2024-09-14T10:44:44.451555+0000","last_clean":"2024-09-14T10:44:44.451555+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:44:44.451555+0000","last_undegraded":"2024-09-14T10:44:44.451555+0000","last_fullsized":"2024-09-14T10:44:44.451555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:47.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.083604+0000","last_change":"2024-09-14T10:44:09.321263+0000","last_active":"2024-09-14T10:46:20.083604+0000","last_peered":"2024-09-14T10:46:20.083604+0000","last_clean":"2024-09-14T10:46:20.083604+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:46:20.083604+0000","last_undegraded":"2024-09-14T10:46:20.083604+0000","last_fullsized":"2024-09-14T10:46:20.083604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:48.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455520+0000","last_change":"2024-09-14T10:44:11.365421+0000","last_active":"2024-09-14T10:44:44.455520+0000","last_peered":"2024-09-14T10:44:44.455520+0000","last_clean":"2024-09-14T10:44:44.455520+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:44:44.455520+0000","last_undegraded":"2024-09-14T10:44:44.455520+0000","last_fullsized":"2024-09-14T10:44:44.455520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:56.792327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":501,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.997414+0000","last_change":"2024-09-14T10:44:13.362574+0000","last_active":"2024-09-14T10:47:21.997414+0000","last_peered":"2024-09-14T10:47:21.997414+0000","last_clean":"2024-09-14T10:47:21.997414+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:47:21.997414+0000","last_undegraded":"2024-09-14T10:47:21.997414+0000","last_fullsized":"2024-09-14T10:47:21.997414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.234975+0000","last_change":"2024-09-14T10:44:15.376191+0000","last_active":"2024-09-14T10:46:20.234975+0000","last_peered":"2024-09-14T10:46:20.234975+0000","last_clean":"2024-09-14T10:46:20.234975+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:46:20.234975+0000","last_undegraded":"2024-09-14T10:46:20.234975+0000","last_fullsized":"2024-09-14T10:46:20.234975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:57.673158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880744+0000","last_change":"2024-09-14T10:44:07.321079+0000","last_active":"2024-09-14T10:47:21.880744+0000","last_peered":"2024-09-14T10:47:21.880744+0000","last_clean":"2024-09-14T10:47:21.880744+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:47:21.880744+0000","last_undegraded":"2024-09-14T10:47:21.880744+0000","last_fullsized":"2024-09-14T10:47:21.880744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:01.445738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441663+0000","last_change":"2024-09-14T10:44:05.327190+0000","last_active":"2024-09-14T10:44:44.441663+0000","last_peered":"2024-09-14T10:44:44.441663+0000","last_clean":"2024-09-14T10:44:44.441663+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:44:44.441663+0000","last_undegraded":"2024-09-14T10:44:44.441663+0000","last_fullsized":"2024-09-14T10:44:44.441663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:46.537438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457361+0000","last_change":"2024-09-14T10:44:09.342479+0000","last_active":"2024-09-14T10:44:44.457361+0000","last_peered":"2024-09-14T10:44:44.457361+0000","last_clean":"2024-09-14T10:44:44.457361+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:44:44.457361+0000","last_undegraded":"2024-09-14T10:44:44.457361+0000","last_fullsized":"2024-09-14T10:44:44.457361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:27.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.640584+0000","last_change":"2024-09-14T10:44:11.332997+0000","last_active":"2024-09-14T10:46:18.640584+0000","last_peered":"2024-09-14T10:46:18.640584+0000","last_clean":"2024-09-14T10:46:18.640584+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:46:18.640584+0000","last_undegraded":"2024-09-14T10:46:18.640584+0000","last_fullsized":"2024-09-14T10:46:18.640584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:53.814557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436642+0000","last_change":"2024-09-14T10:44:13.374235+0000","last_active":"2024-09-14T10:44:44.436642+0000","last_peered":"2024-09-14T10:44:44.436642+0000","last_clean":"2024-09-14T10:44:44.436642+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:44:44.436642+0000","last_undegraded":"2024-09-14T10:44:44.436642+0000","last_fullsized":"2024-09-14T10:44:44.436642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:45.457582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.953427+0000","last_change":"2024-09-14T10:44:15.378896+0000","last_active":"2024-09-14T10:47:21.953427+0000","last_peered":"2024-09-14T10:47:21.953427+0000","last_clean":"2024-09-14T10:47:21.953427+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:47:21.953427+0000","last_undegraded":"2024-09-14T10:47:21.953427+0000","last_fullsized":"2024-09-14T10:47:21.953427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:41.435534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'13","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.402163+0000","last_change":"2024-09-14T10:44:07.313348+0000","last_active":"2024-09-14T10:47:21.402163+0000","last_peered":"2024-09-14T10:47:21.402163+0000","last_clean":"2024-09-14T10:47:21.402163+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:47:21.402163+0000","last_undegraded":"2024-09-14T10:47:21.402163+0000","last_fullsized":"2024-09-14T10:47:21.402163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:03.002533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436810+0000","last_change":"2024-09-14T10:43:50.584788+0000","last_active":"2024-09-14T10:44:44.436810+0000","last_peered":"2024-09-14T10:44:44.436810+0000","last_clean":"2024-09-14T10:44:44.436810+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:44:44.436810+0000","last_undegraded":"2024-09-14T10:44:44.436810+0000","last_fullsized":"2024-09-14T10:44:44.436810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_clean_scrub_stamp":"2024-09-14T10:43:49.418142+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:43.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455044+0000","last_change":"2024-09-14T10:43:57.466810+0000","last_active":"2024-09-14T10:44:44.455044+0000","last_peered":"2024-09-14T10:44:44.455044+0000","last_clean":"2024-09-14T10:44:44.455044+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:44:44.455044+0000","last_undegraded":"2024-09-14T10:44:44.455044+0000","last_fullsized":"2024-09-14T10:44:44.455044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:33.230423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.324672+0000","last_change":"2024-09-14T10:44:05.335883+0000","last_active":"2024-09-14T10:47:21.324672+0000","last_peered":"2024-09-14T10:47:21.324672+0000","last_clean":"2024-09-14T10:47:21.324672+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:47:21.324672+0000","last_undegraded":"2024-09-14T10:47:21.324672+0000","last_fullsized":"2024-09-14T10:47:21.324672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:49.876374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.467078+0000","last_change":"2024-09-14T10:44:44.463751+0000","last_active":"2024-09-14T10:44:44.467078+0000","last_peered":"2024-09-14T10:44:44.467078+0000","last_clean":"2024-09-14T10:44:44.467078+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:44:44.467078+0000","last_undegraded":"2024-09-14T10:44:44.467078+0000","last_fullsized":"2024-09-14T10:44:44.467078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.700138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'77","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.655935+0000","last_change":"2024-09-14T10:44:11.357369+0000","last_active":"2024-09-14T10:46:18.655935+0000","last_peered":"2024-09-14T10:46:18.655935+0000","last_clean":"2024-09-14T10:46:18.655935+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:46:18.655935+0000","last_undegraded":"2024-09-14T10:46:18.655935+0000","last_fullsized":"2024-09-14T10:46:18.655935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:20.733108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443564+0000","last_change":"2024-09-14T10:44:13.372619+0000","last_active":"2024-09-14T10:44:44.443564+0000","last_peered":"2024-09-14T10:44:44.443564+0000","last_clean":"2024-09-14T10:44:44.443564+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:44:44.443564+0000","last_undegraded":"2024-09-14T10:44:44.443564+0000","last_fullsized":"2024-09-14T10:44:44.443564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.209093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.907510+0000","last_change":"2024-09-14T10:44:15.380614+0000","last_active":"2024-09-14T10:47:21.907510+0000","last_peered":"2024-09-14T10:47:21.907510+0000","last_clean":"2024-09-14T10:47:21.907510+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:47:21.907510+0000","last_undegraded":"2024-09-14T10:47:21.907510+0000","last_fullsized":"2024-09-14T10:47:21.907510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:58.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825057+0000","last_change":"2024-09-14T10:44:07.316776+0000","last_active":"2024-09-14T10:47:21.825057+0000","last_peered":"2024-09-14T10:47:21.825057+0000","last_clean":"2024-09-14T10:47:21.825057+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:47:21.825057+0000","last_undegraded":"2024-09-14T10:47:21.825057+0000","last_fullsized":"2024-09-14T10:47:21.825057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.514426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440485+0000","last_change":"2024-09-14T10:43:57.465589+0000","last_active":"2024-09-14T10:44:44.440485+0000","last_peered":"2024-09-14T10:44:44.440485+0000","last_clean":"2024-09-14T10:44:44.440485+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:44:44.440485+0000","last_undegraded":"2024-09-14T10:44:44.440485+0000","last_fullsized":"2024-09-14T10:44:44.440485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.853418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:12.439603+0000","last_change":"2024-09-14T10:44:05.313733+0000","last_active":"2024-09-14T10:46:12.439603+0000","last_peered":"2024-09-14T10:46:12.439603+0000","last_clean":"2024-09-14T10:46:12.439603+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:46:12.439603+0000","last_undegraded":"2024-09-14T10:46:12.439603+0000","last_fullsized":"2024-09-14T10:46:12.439603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:29.804432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460368+0000","last_change":"2024-09-14T10:44:09.341477+0000","last_active":"2024-09-14T10:44:44.460368+0000","last_peered":"2024-09-14T10:44:44.460368+0000","last_clean":"2024-09-14T10:44:44.460368+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:44:44.460368+0000","last_undegraded":"2024-09-14T10:44:44.460368+0000","last_fullsized":"2024-09-14T10:44:44.460368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:45.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'273","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566682+0000","last_change":"2024-09-14T10:44:11.347623+0000","last_active":"2024-09-14T10:47:19.566682+0000","last_peered":"2024-09-14T10:47:19.566682+0000","last_clean":"2024-09-14T10:47:19.566682+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:47:19.566682+0000","last_undegraded":"2024-09-14T10:47:19.566682+0000","last_fullsized":"2024-09-14T10:47:19.566682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:58.040485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454445+0000","last_change":"2024-09-14T10:44:13.368580+0000","last_active":"2024-09-14T10:44:44.454445+0000","last_peered":"2024-09-14T10:44:44.454445+0000","last_clean":"2024-09-14T10:44:44.454445+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:44:44.454445+0000","last_undegraded":"2024-09-14T10:44:44.454445+0000","last_fullsized":"2024-09-14T10:44:44.454445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:45.985218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.604538+0000","last_change":"2024-09-14T10:44:15.392131+0000","last_active":"2024-09-14T10:45:35.604538+0000","last_peered":"2024-09-14T10:45:35.604538+0000","last_clean":"2024-09-14T10:45:35.604538+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:45:35.604538+0000","last_undegraded":"2024-09-14T10:45:35.604538+0000","last_fullsized":"2024-09-14T10:45:35.604538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:37.610953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.441166+0000","last_change":"2024-09-14T10:44:07.302744+0000","last_active":"2024-09-14T10:46:17.441166+0000","last_peered":"2024-09-14T10:46:17.441166+0000","last_clean":"2024-09-14T10:46:17.441166+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:46:17.441166+0000","last_undegraded":"2024-09-14T10:46:17.441166+0000","last_fullsized":"2024-09-14T10:46:17.441166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:44.363143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434243+0000","last_change":"2024-09-14T10:43:57.622013+0000","last_active":"2024-09-14T10:44:44.434243+0000","last_peered":"2024-09-14T10:44:44.434243+0000","last_clean":"2024-09-14T10:44:44.434243+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:44:44.434243+0000","last_undegraded":"2024-09-14T10:44:44.434243+0000","last_fullsized":"2024-09-14T10:44:44.434243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438450+0000","last_change":"2024-09-14T10:44:05.314187+0000","last_active":"2024-09-14T10:44:44.438450+0000","last_peered":"2024-09-14T10:44:44.438450+0000","last_clean":"2024-09-14T10:44:44.438450+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:44:44.438450+0000","last_undegraded":"2024-09-14T10:44:44.438450+0000","last_fullsized":"2024-09-14T10:44:44.438450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.919125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438356+0000","last_change":"2024-09-14T10:44:09.316504+0000","last_active":"2024-09-14T10:44:44.438356+0000","last_peered":"2024-09-14T10:44:44.438356+0000","last_clean":"2024-09-14T10:44:44.438356+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:44:44.438356+0000","last_undegraded":"2024-09-14T10:44:44.438356+0000","last_fullsized":"2024-09-14T10:44:44.438356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.594212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566236+0000","last_change":"2024-09-14T10:44:11.340123+0000","last_active":"2024-09-14T10:47:19.566236+0000","last_peered":"2024-09-14T10:47:19.566236+0000","last_clean":"2024-09-14T10:47:19.566236+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:47:19.566236+0000","last_undegraded":"2024-09-14T10:47:19.566236+0000","last_fullsized":"2024-09-14T10:47:19.566236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:55.570468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440972+0000","last_change":"2024-09-14T10:44:13.372401+0000","last_active":"2024-09-14T10:44:44.440972+0000","last_peered":"2024-09-14T10:44:44.440972+0000","last_clean":"2024-09-14T10:44:44.440972+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:44:44.440972+0000","last_undegraded":"2024-09-14T10:44:44.440972+0000","last_fullsized":"2024-09-14T10:44:44.440972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:48.551523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451974+0000","last_change":"2024-09-14T10:44:15.379368+0000","last_active":"2024-09-14T10:44:44.451974+0000","last_peered":"2024-09-14T10:44:44.451974+0000","last_clean":"2024-09-14T10:44:44.451974+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:44:44.451974+0000","last_undegraded":"2024-09-14T10:44:44.451974+0000","last_fullsized":"2024-09-14T10:44:44.451974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:11.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.510872+0000","last_change":"2024-09-14T10:44:07.307515+0000","last_active":"2024-09-14T10:46:16.510872+0000","last_peered":"2024-09-14T10:46:16.510872+0000","last_clean":"2024-09-14T10:46:16.510872+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:46:16.510872+0000","last_undegraded":"2024-09-14T10:46:16.510872+0000","last_fullsized":"2024-09-14T10:46:16.510872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:10.397230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452886+0000","last_change":"2024-09-14T10:43:57.466709+0000","last_active":"2024-09-14T10:44:44.452886+0000","last_peered":"2024-09-14T10:44:44.452886+0000","last_clean":"2024-09-14T10:44:44.452886+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:44:44.452886+0000","last_undegraded":"2024-09-14T10:44:44.452886+0000","last_fullsized":"2024-09-14T10:44:44.452886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:59.740099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.379318+0000","last_change":"2024-09-14T10:44:05.316730+0000","last_active":"2024-09-14T10:46:20.379318+0000","last_peered":"2024-09-14T10:46:20.379318+0000","last_clean":"2024-09-14T10:46:20.379318+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:46:20.379318+0000","last_undegraded":"2024-09-14T10:46:20.379318+0000","last_fullsized":"2024-09-14T10:46:20.379318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:52.869387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444568+0000","last_change":"2024-09-14T10:44:09.322206+0000","last_active":"2024-09-14T10:44:44.444568+0000","last_peered":"2024-09-14T10:44:44.444568+0000","last_clean":"2024-09-14T10:44:44.444568+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:44:44.444568+0000","last_undegraded":"2024-09-14T10:44:44.444568+0000","last_fullsized":"2024-09-14T10:44:44.444568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:42.879923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.719618+0000","last_change":"2024-09-14T10:44:11.362466+0000","last_active":"2024-09-14T10:47:20.719618+0000","last_peered":"2024-09-14T10:47:20.719618+0000","last_clean":"2024-09-14T10:47:20.719618+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:47:20.719618+0000","last_undegraded":"2024-09-14T10:47:20.719618+0000","last_fullsized":"2024-09-14T10:47:20.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.095069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460591+0000","last_change":"2024-09-14T10:44:13.368952+0000","last_active":"2024-09-14T10:44:44.460591+0000","last_peered":"2024-09-14T10:44:44.460591+0000","last_clean":"2024-09-14T10:44:44.460591+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:44:44.460591+0000","last_undegraded":"2024-09-14T10:44:44.460591+0000","last_fullsized":"2024-09-14T10:44:44.460591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.525259+0000","last_change":"2024-09-14T10:44:15.382665+0000","last_active":"2024-09-14T10:47:21.525259+0000","last_peered":"2024-09-14T10:47:21.525259+0000","last_clean":"2024-09-14T10:47:21.525259+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:47:21.525259+0000","last_undegraded":"2024-09-14T10:47:21.525259+0000","last_fullsized":"2024-09-14T10:47:21.525259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:18.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879962+0000","last_change":"2024-09-14T10:44:07.314873+0000","last_active":"2024-09-14T10:47:21.879962+0000","last_peered":"2024-09-14T10:47:21.879962+0000","last_clean":"2024-09-14T10:47:21.879962+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:47:21.879962+0000","last_undegraded":"2024-09-14T10:47:21.879962+0000","last_fullsized":"2024-09-14T10:47:21.879962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:56.862937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.805694+0000","last_change":"2024-09-14T10:44:05.319446+0000","last_active":"2024-09-14T10:44:51.805694+0000","last_peered":"2024-09-14T10:44:51.805694+0000","last_clean":"2024-09-14T10:44:51.805694+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:44:51.805694+0000","last_undegraded":"2024-09-14T10:44:51.805694+0000","last_fullsized":"2024-09-14T10:44:51.805694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:15.462869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440965+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:44:44.440965+0000","last_peered":"2024-09-14T10:44:44.440965+0000","last_clean":"2024-09-14T10:44:44.440965+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:44:44.440965+0000","last_undegraded":"2024-09-14T10:44:44.440965+0000","last_fullsized":"2024-09-14T10:44:44.440965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.379980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:50.451391+0000","last_change":"2024-09-14T10:44:44.455451+0000","last_active":"2024-09-14T10:46:50.451391+0000","last_peered":"2024-09-14T10:46:50.451391+0000","last_clean":"2024-09-14T10:46:50.451391+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:46:50.451391+0000","last_undegraded":"2024-09-14T10:46:50.451391+0000","last_fullsized":"2024-09-14T10:46:50.451391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:57.298667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'62","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.907486+0000","last_change":"2024-09-14T10:44:11.326152+0000","last_active":"2024-09-14T10:47:21.907486+0000","last_peered":"2024-09-14T10:47:21.907486+0000","last_clean":"2024-09-14T10:47:21.907486+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:47:21.907486+0000","last_undegraded":"2024-09-14T10:47:21.907486+0000","last_fullsized":"2024-09-14T10:47:21.907486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:41.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432731+0000","last_change":"2024-09-14T10:44:13.362954+0000","last_active":"2024-09-14T10:44:44.432731+0000","last_peered":"2024-09-14T10:44:44.432731+0000","last_clean":"2024-09-14T10:44:44.432731+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:44:44.432731+0000","last_undegraded":"2024-09-14T10:44:44.432731+0000","last_fullsized":"2024-09-14T10:44:44.432731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.191871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.551637+0000","last_change":"2024-09-14T10:44:15.380020+0000","last_active":"2024-09-14T10:46:20.551637+0000","last_peered":"2024-09-14T10:46:20.551637+0000","last_clean":"2024-09-14T10:46:20.551637+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:46:20.551637+0000","last_undegraded":"2024-09-14T10:46:20.551637+0000","last_fullsized":"2024-09-14T10:46:20.551637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:17.206749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.508788+0000","last_change":"2024-09-14T10:44:07.319078+0000","last_active":"2024-09-14T10:46:16.508788+0000","last_peered":"2024-09-14T10:46:16.508788+0000","last_clean":"2024-09-14T10:46:16.508788+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:46:16.508788+0000","last_undegraded":"2024-09-14T10:46:16.508788+0000","last_fullsized":"2024-09-14T10:46:16.508788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:20.214122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.692204+0000","last_change":"2024-09-14T10:44:05.323716+0000","last_active":"2024-09-14T10:47:21.692204+0000","last_peered":"2024-09-14T10:47:21.692204+0000","last_clean":"2024-09-14T10:47:21.692204+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:21.692204+0000","last_undegraded":"2024-09-14T10:47:21.692204+0000","last_fullsized":"2024-09-14T10:47:21.692204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:48.326362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456259+0000","last_change":"2024-09-14T10:43:57.465338+0000","last_active":"2024-09-14T10:44:44.456259+0000","last_peered":"2024-09-14T10:44:44.456259+0000","last_clean":"2024-09-14T10:44:44.456259+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:44:44.456259+0000","last_undegraded":"2024-09-14T10:44:44.456259+0000","last_fullsized":"2024-09-14T10:44:44.456259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.995453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450895+0000","last_change":"2024-09-14T10:44:09.332697+0000","last_active":"2024-09-14T10:44:44.450895+0000","last_peered":"2024-09-14T10:44:44.450895+0000","last_clean":"2024-09-14T10:44:44.450895+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:44:44.450895+0000","last_undegraded":"2024-09-14T10:44:44.450895+0000","last_fullsized":"2024-09-14T10:44:44.450895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:36.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451768+0000","last_change":"2024-09-14T10:44:11.338828+0000","last_active":"2024-09-14T10:44:44.451768+0000","last_peered":"2024-09-14T10:44:44.451768+0000","last_clean":"2024-09-14T10:44:44.451768+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:44:44.451768+0000","last_undegraded":"2024-09-14T10:44:44.451768+0000","last_fullsized":"2024-09-14T10:44:44.451768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:03.825369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.565979+0000","last_change":"2024-09-14T10:44:13.353577+0000","last_active":"2024-09-14T10:47:19.565979+0000","last_peered":"2024-09-14T10:47:19.565979+0000","last_clean":"2024-09-14T10:47:19.565979+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:47:19.565979+0000","last_undegraded":"2024-09-14T10:47:19.565979+0000","last_fullsized":"2024-09-14T10:47:19.565979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.459796+0000","last_change":"2024-09-14T10:44:15.371433+0000","last_active":"2024-09-14T10:44:44.459796+0000","last_peered":"2024-09-14T10:44:44.459796+0000","last_clean":"2024-09-14T10:44:44.459796+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:44:44.459796+0000","last_undegraded":"2024-09-14T10:44:44.459796+0000","last_fullsized":"2024-09-14T10:44:44.459796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:12.672256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.719980+0000","last_change":"2024-09-14T10:44:07.313506+0000","last_active":"2024-09-14T10:47:21.719980+0000","last_peered":"2024-09-14T10:47:21.719980+0000","last_clean":"2024-09-14T10:47:21.719980+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:47:21.719980+0000","last_undegraded":"2024-09-14T10:47:21.719980+0000","last_fullsized":"2024-09-14T10:47:21.719980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:57.847452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.461911+0000","last_change":"2024-09-14T10:44:05.318013+0000","last_active":"2024-09-14T10:44:44.461911+0000","last_peered":"2024-09-14T10:44:44.461911+0000","last_clean":"2024-09-14T10:44:44.461911+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:44:44.461911+0000","last_undegraded":"2024-09-14T10:44:44.461911+0000","last_fullsized":"2024-09-14T10:44:44.461911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:54.849665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444188+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:44:44.444188+0000","last_peered":"2024-09-14T10:44:44.444188+0000","last_clean":"2024-09-14T10:44:44.444188+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:44:44.444188+0000","last_undegraded":"2024-09-14T10:44:44.444188+0000","last_fullsized":"2024-09-14T10:44:44.444188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.947188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442798+0000","last_change":"2024-09-14T10:44:09.334472+0000","last_active":"2024-09-14T10:44:44.442798+0000","last_peered":"2024-09-14T10:44:44.442798+0000","last_clean":"2024-09-14T10:44:44.442798+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:44:44.442798+0000","last_undegraded":"2024-09-14T10:44:44.442798+0000","last_fullsized":"2024-09-14T10:44:44.442798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:18.491213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453618+0000","last_change":"2024-09-14T10:44:11.360311+0000","last_active":"2024-09-14T10:44:44.453618+0000","last_peered":"2024-09-14T10:44:44.453618+0000","last_clean":"2024-09-14T10:44:44.453618+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:44:44.453618+0000","last_undegraded":"2024-09-14T10:44:44.453618+0000","last_fullsized":"2024-09-14T10:44:44.453618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:18.907361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":419,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.052270+0000","last_change":"2024-09-14T10:44:13.349515+0000","last_active":"2024-09-14T10:47:22.052270+0000","last_peered":"2024-09-14T10:47:22.052270+0000","last_clean":"2024-09-14T10:47:22.052270+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:47:22.052270+0000","last_undegraded":"2024-09-14T10:47:22.052270+0000","last_fullsized":"2024-09-14T10:47:22.052270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.867987+0000","last_change":"2024-09-14T10:44:15.380474+0000","last_active":"2024-09-14T10:45:35.867987+0000","last_peered":"2024-09-14T10:45:35.867987+0000","last_clean":"2024-09-14T10:45:35.867987+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:45:35.867987+0000","last_undegraded":"2024-09-14T10:45:35.867987+0000","last_fullsized":"2024-09-14T10:45:35.867987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:15.535271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433094+0000","last_change":"2024-09-14T10:44:07.314957+0000","last_active":"2024-09-14T10:44:44.433094+0000","last_peered":"2024-09-14T10:44:44.433094+0000","last_clean":"2024-09-14T10:44:44.433094+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:44:44.433094+0000","last_undegraded":"2024-09-14T10:44:44.433094+0000","last_fullsized":"2024-09-14T10:44:44.433094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.570663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.440796+0000","last_change":"2024-09-14T10:44:05.322609+0000","last_active":"2024-09-14T10:46:14.440796+0000","last_peered":"2024-09-14T10:46:14.440796+0000","last_clean":"2024-09-14T10:46:14.440796+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:46:14.440796+0000","last_undegraded":"2024-09-14T10:46:14.440796+0000","last_fullsized":"2024-09-14T10:46:14.440796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:49.133099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.461469+0000","last_change":"2024-09-14T10:43:57.467362+0000","last_active":"2024-09-14T10:44:44.461469+0000","last_peered":"2024-09-14T10:44:44.461469+0000","last_clean":"2024-09-14T10:44:44.461469+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:44:44.461469+0000","last_undegraded":"2024-09-14T10:44:44.461469+0000","last_fullsized":"2024-09-14T10:44:44.461469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.939647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440109+0000","last_change":"2024-09-14T10:44:09.335319+0000","last_active":"2024-09-14T10:44:44.440109+0000","last_peered":"2024-09-14T10:44:44.440109+0000","last_clean":"2024-09-14T10:44:44.440109+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:44:44.440109+0000","last_undegraded":"2024-09-14T10:44:44.440109+0000","last_fullsized":"2024-09-14T10:44:44.440109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:44.522431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'83","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.628711+0000","last_change":"2024-09-14T10:44:11.359272+0000","last_active":"2024-09-14T10:46:18.628711+0000","last_peered":"2024-09-14T10:46:18.628711+0000","last_clean":"2024-09-14T10:46:18.628711+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:46:18.628711+0000","last_undegraded":"2024-09-14T10:46:18.628711+0000","last_fullsized":"2024-09-14T10:46:18.628711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438836+0000","last_change":"2024-09-14T10:44:13.361050+0000","last_active":"2024-09-14T10:44:44.438836+0000","last_peered":"2024-09-14T10:44:44.438836+0000","last_clean":"2024-09-14T10:44:44.438836+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:44:44.438836+0000","last_undegraded":"2024-09-14T10:44:44.438836+0000","last_fullsized":"2024-09-14T10:44:44.438836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.597367+0000","last_change":"2024-09-14T10:44:15.376175+0000","last_active":"2024-09-14T10:44:52.597367+0000","last_peered":"2024-09-14T10:44:52.597367+0000","last_clean":"2024-09-14T10:44:52.597367+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:44:52.597367+0000","last_undegraded":"2024-09-14T10:44:52.597367+0000","last_fullsized":"2024-09-14T10:44:52.597367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.409508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.990797+0000","last_change":"2024-09-14T10:44:15.381865+0000","last_active":"2024-09-14T10:47:21.990797+0000","last_peered":"2024-09-14T10:47:21.990797+0000","last_clean":"2024-09-14T10:47:21.990797+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:47:21.990797+0000","last_undegraded":"2024-09-14T10:47:21.990797+0000","last_fullsized":"2024-09-14T10:47:21.990797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:55.550930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.520688+0000","last_change":"2024-09-14T10:44:07.314638+0000","last_active":"2024-09-14T10:47:21.520688+0000","last_peered":"2024-09-14T10:47:21.520688+0000","last_clean":"2024-09-14T10:47:21.520688+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:47:21.520688+0000","last_undegraded":"2024-09-14T10:47:21.520688+0000","last_fullsized":"2024-09-14T10:47:21.520688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:49.986512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444504+0000","last_change":"2024-09-14T10:44:05.315040+0000","last_active":"2024-09-14T10:46:24.444504+0000","last_peered":"2024-09-14T10:46:24.444504+0000","last_clean":"2024-09-14T10:46:24.444504+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:46:24.444504+0000","last_undegraded":"2024-09-14T10:46:24.444504+0000","last_fullsized":"2024-09-14T10:46:24.444504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:41.172912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:02.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.645619+0000","last_change":"2024-09-14T10:44:11.356682+0000","last_active":"2024-09-14T10:46:18.645619+0000","last_peered":"2024-09-14T10:46:18.645619+0000","last_clean":"2024-09-14T10:46:18.645619+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:46:18.645619+0000","last_undegraded":"2024-09-14T10:46:18.645619+0000","last_fullsized":"2024-09-14T10:46:18.645619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:36.580622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442491+0000","last_change":"2024-09-14T10:44:13.370490+0000","last_active":"2024-09-14T10:44:44.442491+0000","last_peered":"2024-09-14T10:44:44.442491+0000","last_clean":"2024-09-14T10:44:44.442491+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:44:44.442491+0000","last_undegraded":"2024-09-14T10:44:44.442491+0000","last_fullsized":"2024-09-14T10:44:44.442491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:34.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.285933+0000","last_change":"2024-09-14T10:44:15.361905+0000","last_active":"2024-09-14T10:46:18.285933+0000","last_peered":"2024-09-14T10:46:18.285933+0000","last_clean":"2024-09-14T10:46:18.285933+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:46:18.285933+0000","last_undegraded":"2024-09-14T10:46:18.285933+0000","last_fullsized":"2024-09-14T10:46:18.285933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:48.673933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699026+0000","last_change":"2024-09-14T10:44:44.460104+0000","last_active":"2024-09-14T10:46:20.699026+0000","last_peered":"2024-09-14T10:46:20.699026+0000","last_clean":"2024-09-14T10:46:20.699026+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:46:20.699026+0000","last_undegraded":"2024-09-14T10:46:20.699026+0000","last_fullsized":"2024-09-14T10:46:20.699026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:13.899780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.708947+0000","last_change":"2024-09-14T10:44:05.320160+0000","last_active":"2024-09-14T10:44:50.708947+0000","last_peered":"2024-09-14T10:44:50.708947+0000","last_clean":"2024-09-14T10:44:50.708947+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:44:50.708947+0000","last_undegraded":"2024-09-14T10:44:50.708947+0000","last_fullsized":"2024-09-14T10:44:50.708947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:09.975430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.464537+0000","last_change":"2024-09-14T10:44:44.463214+0000","last_active":"2024-09-14T10:44:44.464537+0000","last_peered":"2024-09-14T10:44:44.464537+0000","last_clean":"2024-09-14T10:44:44.464537+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:44:44.464537+0000","last_undegraded":"2024-09-14T10:44:44.464537+0000","last_fullsized":"2024-09-14T10:44:44.464537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:34.009805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.732910+0000","last_change":"2024-09-14T10:44:11.323585+0000","last_active":"2024-09-14T10:47:20.732910+0000","last_peered":"2024-09-14T10:47:20.732910+0000","last_clean":"2024-09-14T10:47:20.732910+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:47:20.732910+0000","last_undegraded":"2024-09-14T10:47:20.732910+0000","last_fullsized":"2024-09-14T10:47:20.732910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:36.664992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434000+0000","last_change":"2024-09-14T10:44:13.371900+0000","last_active":"2024-09-14T10:44:44.434000+0000","last_peered":"2024-09-14T10:44:44.434000+0000","last_clean":"2024-09-14T10:44:44.434000+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:44:44.434000+0000","last_undegraded":"2024-09-14T10:44:44.434000+0000","last_fullsized":"2024-09-14T10:44:44.434000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:29.727463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440980+0000","last_change":"2024-09-14T10:44:15.386483+0000","last_active":"2024-09-14T10:44:44.440980+0000","last_peered":"2024-09-14T10:44:44.440980+0000","last_clean":"2024-09-14T10:44:44.440980+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:44:44.440980+0000","last_undegraded":"2024-09-14T10:44:44.440980+0000","last_fullsized":"2024-09-14T10:44:44.440980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.723831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.523634+0000","last_change":"2024-09-14T10:44:07.316643+0000","last_active":"2024-09-14T10:47:21.523634+0000","last_peered":"2024-09-14T10:47:21.523634+0000","last_clean":"2024-09-14T10:47:21.523634+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:47:21.523634+0000","last_undegraded":"2024-09-14T10:47:21.523634+0000","last_fullsized":"2024-09-14T10:47:21.523634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:51.889645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439378+0000","last_change":"2024-09-14T10:44:05.322513+0000","last_active":"2024-09-14T10:44:44.439378+0000","last_peered":"2024-09-14T10:44:44.439378+0000","last_clean":"2024-09-14T10:44:44.439378+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:44:44.439378+0000","last_undegraded":"2024-09-14T10:44:44.439378+0000","last_fullsized":"2024-09-14T10:44:44.439378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:39.441568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432334+0000","last_change":"2024-09-14T10:44:09.318542+0000","last_active":"2024-09-14T10:44:44.432334+0000","last_peered":"2024-09-14T10:44:44.432334+0000","last_clean":"2024-09-14T10:44:44.432334+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:44:44.432334+0000","last_undegraded":"2024-09-14T10:44:44.432334+0000","last_fullsized":"2024-09-14T10:44:44.432334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:29.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.823759+0000","last_change":"2024-09-14T10:44:11.336124+0000","last_active":"2024-09-14T10:47:20.823759+0000","last_peered":"2024-09-14T10:47:20.823759+0000","last_clean":"2024-09-14T10:47:20.823759+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:47:20.823759+0000","last_undegraded":"2024-09-14T10:47:20.823759+0000","last_fullsized":"2024-09-14T10:47:20.823759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:04.242694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444917+0000","last_change":"2024-09-14T10:44:13.354345+0000","last_active":"2024-09-14T10:44:44.444917+0000","last_peered":"2024-09-14T10:44:44.444917+0000","last_clean":"2024-09-14T10:44:44.444917+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:44:44.444917+0000","last_undegraded":"2024-09-14T10:44:44.444917+0000","last_fullsized":"2024-09-14T10:44:44.444917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451891+0000","last_change":"2024-09-14T10:44:15.378526+0000","last_active":"2024-09-14T10:44:44.451891+0000","last_peered":"2024-09-14T10:44:44.451891+0000","last_clean":"2024-09-14T10:44:44.451891+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:44:44.451891+0000","last_undegraded":"2024-09-14T10:44:44.451891+0000","last_fullsized":"2024-09-14T10:44:44.451891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:34.239574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872753+0000","last_change":"2024-09-14T10:44:07.313804+0000","last_active":"2024-09-14T10:45:35.872753+0000","last_peered":"2024-09-14T10:45:35.872753+0000","last_clean":"2024-09-14T10:45:35.872753+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:45:35.872753+0000","last_undegraded":"2024-09-14T10:45:35.872753+0000","last_fullsized":"2024-09-14T10:45:35.872753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:24.864032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:05.322391+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442567+0000","last_change":"2024-09-14T10:44:09.338478+0000","last_active":"2024-09-14T10:44:44.442567+0000","last_peered":"2024-09-14T10:44:44.442567+0000","last_clean":"2024-09-14T10:44:44.442567+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:44:44.442567+0000","last_undegraded":"2024-09-14T10:44:44.442567+0000","last_fullsized":"2024-09-14T10:44:44.442567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:42.543570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.626754+0000","last_change":"2024-09-14T10:44:11.321761+0000","last_active":"2024-09-14T10:46:18.626754+0000","last_peered":"2024-09-14T10:46:18.626754+0000","last_clean":"2024-09-14T10:46:18.626754+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:46:18.626754+0000","last_undegraded":"2024-09-14T10:46:18.626754+0000","last_fullsized":"2024-09-14T10:46:18.626754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.326575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434240+0000","last_change":"2024-09-14T10:44:13.356507+0000","last_active":"2024-09-14T10:44:44.434240+0000","last_peered":"2024-09-14T10:44:44.434240+0000","last_clean":"2024-09-14T10:44:44.434240+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:44:44.434240+0000","last_undegraded":"2024-09-14T10:44:44.434240+0000","last_fullsized":"2024-09-14T10:44:44.434240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.808772+0000","last_change":"2024-09-14T10:44:07.313195+0000","last_active":"2024-09-14T10:47:21.808772+0000","last_peered":"2024-09-14T10:47:21.808772+0000","last_clean":"2024-09-14T10:47:21.808772+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:47:21.808772+0000","last_undegraded":"2024-09-14T10:47:21.808772+0000","last_fullsized":"2024-09-14T10:47:21.808772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:53.410685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440632+0000","last_change":"2024-09-14T10:44:05.324942+0000","last_active":"2024-09-14T10:44:44.440632+0000","last_peered":"2024-09-14T10:44:44.440632+0000","last_clean":"2024-09-14T10:44:44.440632+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:44:44.440632+0000","last_undegraded":"2024-09-14T10:44:44.440632+0000","last_fullsized":"2024-09-14T10:44:44.440632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:09.809429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443876+0000","last_change":"2024-09-14T10:44:09.332885+0000","last_active":"2024-09-14T10:44:44.443876+0000","last_peered":"2024-09-14T10:44:44.443876+0000","last_clean":"2024-09-14T10:44:44.443876+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:44:44.443876+0000","last_undegraded":"2024-09-14T10:44:44.443876+0000","last_fullsized":"2024-09-14T10:44:44.443876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:29.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.655962+0000","last_change":"2024-09-14T10:44:11.340857+0000","last_active":"2024-09-14T10:46:18.655962+0000","last_peered":"2024-09-14T10:46:18.655962+0000","last_clean":"2024-09-14T10:46:18.655962+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:46:18.655962+0000","last_undegraded":"2024-09-14T10:46:18.655962+0000","last_fullsized":"2024-09-14T10:46:18.655962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:58.117101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436429+0000","last_change":"2024-09-14T10:44:13.356783+0000","last_active":"2024-09-14T10:44:44.436429+0000","last_peered":"2024-09-14T10:44:44.436429+0000","last_clean":"2024-09-14T10:44:44.436429+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:44:44.436429+0000","last_undegraded":"2024-09-14T10:44:44.436429+0000","last_fullsized":"2024-09-14T10:44:44.436429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:57.886038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.426338+0000","last_change":"2024-09-14T10:44:15.390085+0000","last_active":"2024-09-14T10:47:21.426338+0000","last_peered":"2024-09-14T10:47:21.426338+0000","last_clean":"2024-09-14T10:47:21.426338+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:47:21.426338+0000","last_undegraded":"2024-09-14T10:47:21.426338+0000","last_fullsized":"2024-09-14T10:47:21.426338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:09.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882763+0000","last_change":"2024-09-14T10:44:07.305111+0000","last_active":"2024-09-14T10:47:21.882763+0000","last_peered":"2024-09-14T10:47:21.882763+0000","last_clean":"2024-09-14T10:47:21.882763+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:47:21.882763+0000","last_undegraded":"2024-09-14T10:47:21.882763+0000","last_fullsized":"2024-09-14T10:47:21.882763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:28.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.443685+0000","last_change":"2024-09-14T10:44:05.316373+0000","last_active":"2024-09-14T10:46:29.443685+0000","last_peered":"2024-09-14T10:46:29.443685+0000","last_clean":"2024-09-14T10:46:29.443685+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:46:29.443685+0000","last_undegraded":"2024-09-14T10:46:29.443685+0000","last_fullsized":"2024-09-14T10:46:29.443685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:20.065314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439696+0000","last_change":"2024-09-14T10:44:09.313053+0000","last_active":"2024-09-14T10:44:44.439696+0000","last_peered":"2024-09-14T10:44:44.439696+0000","last_clean":"2024-09-14T10:44:44.439696+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:44:44.439696+0000","last_undegraded":"2024-09-14T10:44:44.439696+0000","last_fullsized":"2024-09-14T10:44:44.439696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.375123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.627786+0000","last_change":"2024-09-14T10:44:11.359808+0000","last_active":"2024-09-14T10:46:18.627786+0000","last_peered":"2024-09-14T10:46:18.627786+0000","last_clean":"2024-09-14T10:46:18.627786+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:46:18.627786+0000","last_undegraded":"2024-09-14T10:46:18.627786+0000","last_fullsized":"2024-09-14T10:46:18.627786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:51.224366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445366+0000","last_change":"2024-09-14T10:44:13.371652+0000","last_active":"2024-09-14T10:44:44.445366+0000","last_peered":"2024-09-14T10:44:44.445366+0000","last_clean":"2024-09-14T10:44:44.445366+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:44:44.445366+0000","last_undegraded":"2024-09-14T10:44:44.445366+0000","last_fullsized":"2024-09-14T10:44:44.445366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450551+0000","last_change":"2024-09-14T10:44:15.379606+0000","last_active":"2024-09-14T10:44:44.450551+0000","last_peered":"2024-09-14T10:44:44.450551+0000","last_clean":"2024-09-14T10:44:44.450551+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:44:44.450551+0000","last_undegraded":"2024-09-14T10:44:44.450551+0000","last_fullsized":"2024-09-14T10:44:44.450551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:37.639739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.298696+0000","last_change":"2024-09-14T10:44:07.317281+0000","last_active":"2024-09-14T10:44:52.298696+0000","last_peered":"2024-09-14T10:44:52.298696+0000","last_clean":"2024-09-14T10:44:52.298696+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:44:52.298696+0000","last_undegraded":"2024-09-14T10:44:52.298696+0000","last_fullsized":"2024-09-14T10:44:52.298696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:19.569186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446007+0000","last_change":"2024-09-14T10:44:05.319971+0000","last_active":"2024-09-14T10:44:44.446007+0000","last_peered":"2024-09-14T10:44:44.446007+0000","last_clean":"2024-09-14T10:44:44.446007+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:44:44.446007+0000","last_undegraded":"2024-09-14T10:44:44.446007+0000","last_fullsized":"2024-09-14T10:44:44.446007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:30.432326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438372+0000","last_change":"2024-09-14T10:44:09.316331+0000","last_active":"2024-09-14T10:44:44.438372+0000","last_peered":"2024-09-14T10:44:44.438372+0000","last_clean":"2024-09-14T10:44:44.438372+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:44:44.438372+0000","last_undegraded":"2024-09-14T10:44:44.438372+0000","last_fullsized":"2024-09-14T10:44:44.438372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.269872+0000","last_change":"2024-09-14T10:44:11.330416+0000","last_active":"2024-09-14T10:46:18.269872+0000","last_peered":"2024-09-14T10:46:18.269872+0000","last_clean":"2024-09-14T10:46:18.269872+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:46:18.269872+0000","last_undegraded":"2024-09-14T10:46:18.269872+0000","last_fullsized":"2024-09-14T10:46:18.269872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:58.265390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443419+0000","last_change":"2024-09-14T10:44:13.364526+0000","last_active":"2024-09-14T10:44:44.443419+0000","last_peered":"2024-09-14T10:44:44.443419+0000","last_clean":"2024-09-14T10:44:44.443419+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:44:44.443419+0000","last_undegraded":"2024-09-14T10:44:44.443419+0000","last_fullsized":"2024-09-14T10:44:44.443419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:46.572662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.685006+0000","last_change":"2024-09-14T10:44:15.379535+0000","last_active":"2024-09-14T10:46:20.685006+0000","last_peered":"2024-09-14T10:46:20.685006+0000","last_clean":"2024-09-14T10:46:20.685006+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:46:20.685006+0000","last_undegraded":"2024-09-14T10:46:20.685006+0000","last_fullsized":"2024-09-14T10:46:20.685006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:20.408629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.380036+0000","last_change":"2024-09-14T10:44:07.306266+0000","last_active":"2024-09-14T10:47:21.380036+0000","last_peered":"2024-09-14T10:47:21.380036+0000","last_clean":"2024-09-14T10:47:21.380036+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:47:21.380036+0000","last_undegraded":"2024-09-14T10:47:21.380036+0000","last_fullsized":"2024-09-14T10:47:21.380036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:57.380845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454069+0000","last_change":"2024-09-14T10:44:05.324788+0000","last_active":"2024-09-14T10:44:44.454069+0000","last_peered":"2024-09-14T10:44:44.454069+0000","last_clean":"2024-09-14T10:44:44.454069+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:44:44.454069+0000","last_undegraded":"2024-09-14T10:44:44.454069+0000","last_fullsized":"2024-09-14T10:44:44.454069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:56.141828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.083888+0000","last_change":"2024-09-14T10:44:09.313857+0000","last_active":"2024-09-14T10:46:20.083888+0000","last_peered":"2024-09-14T10:46:20.083888+0000","last_clean":"2024-09-14T10:46:20.083888+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:46:20.083888+0000","last_undegraded":"2024-09-14T10:46:20.083888+0000","last_fullsized":"2024-09-14T10:46:20.083888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:53.790922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'12","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.442571+0000","last_change":"2024-09-14T10:44:11.365067+0000","last_active":"2024-09-14T10:46:14.442571+0000","last_peered":"2024-09-14T10:46:14.442571+0000","last_clean":"2024-09-14T10:46:14.442571+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:46:14.442571+0000","last_undegraded":"2024-09-14T10:46:14.442571+0000","last_fullsized":"2024-09-14T10:46:14.442571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:24.755831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566159+0000","last_change":"2024-09-14T10:44:13.372845+0000","last_active":"2024-09-14T10:47:19.566159+0000","last_peered":"2024-09-14T10:47:19.566159+0000","last_clean":"2024-09-14T10:47:19.566159+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:47:19.566159+0000","last_undegraded":"2024-09-14T10:47:19.566159+0000","last_fullsized":"2024-09-14T10:47:19.566159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:44.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.813949+0000","last_change":"2024-09-14T10:44:15.388635+0000","last_active":"2024-09-14T10:47:21.813949+0000","last_peered":"2024-09-14T10:47:21.813949+0000","last_clean":"2024-09-14T10:47:21.813949+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:47:21.813949+0000","last_undegraded":"2024-09-14T10:47:21.813949+0000","last_fullsized":"2024-09-14T10:47:21.813949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:00.563368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.297384+0000","last_change":"2024-09-14T10:44:07.297715+0000","last_active":"2024-09-14T10:44:52.297384+0000","last_peered":"2024-09-14T10:44:52.297384+0000","last_clean":"2024-09-14T10:44:52.297384+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:44:52.297384+0000","last_undegraded":"2024-09-14T10:44:52.297384+0000","last_fullsized":"2024-09-14T10:44:52.297384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:13.693037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.857406+0000","last_change":"2024-09-14T10:44:05.320001+0000","last_active":"2024-09-14T10:45:35.857406+0000","last_peered":"2024-09-14T10:45:35.857406+0000","last_clean":"2024-09-14T10:45:35.857406+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:45:35.857406+0000","last_undegraded":"2024-09-14T10:45:35.857406+0000","last_fullsized":"2024-09-14T10:45:35.857406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:36.390217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.070178+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:46:20.070178+0000","last_peered":"2024-09-14T10:46:20.070178+0000","last_clean":"2024-09-14T10:46:20.070178+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:46:20.070178+0000","last_undegraded":"2024-09-14T10:46:20.070178+0000","last_fullsized":"2024-09-14T10:46:20.070178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:58.082949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.614388+0000","last_change":"2024-09-14T10:44:11.327509+0000","last_active":"2024-09-14T10:46:18.614388+0000","last_peered":"2024-09-14T10:46:18.614388+0000","last_clean":"2024-09-14T10:46:18.614388+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:46:18.614388+0000","last_undegraded":"2024-09-14T10:46:18.614388+0000","last_fullsized":"2024-09-14T10:46:18.614388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.860344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438767+0000","last_change":"2024-09-14T10:44:13.376040+0000","last_active":"2024-09-14T10:44:44.438767+0000","last_peered":"2024-09-14T10:44:44.438767+0000","last_clean":"2024-09-14T10:44:44.438767+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:44:44.438767+0000","last_undegraded":"2024-09-14T10:44:44.438767+0000","last_fullsized":"2024-09-14T10:44:44.438767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452541+0000","last_change":"2024-09-14T10:44:15.388404+0000","last_active":"2024-09-14T10:44:44.452541+0000","last_peered":"2024-09-14T10:44:44.452541+0000","last_clean":"2024-09-14T10:44:44.452541+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:44:44.452541+0000","last_undegraded":"2024-09-14T10:44:44.452541+0000","last_fullsized":"2024-09-14T10:44:44.452541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720287+0000","last_change":"2024-09-14T10:44:07.301782+0000","last_active":"2024-09-14T10:47:21.720287+0000","last_peered":"2024-09-14T10:47:21.720287+0000","last_clean":"2024-09-14T10:47:21.720287+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:47:21.720287+0000","last_undegraded":"2024-09-14T10:47:21.720287+0000","last_fullsized":"2024-09-14T10:47:21.720287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:43.671200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456552+0000","last_change":"2024-09-14T10:44:05.321255+0000","last_active":"2024-09-14T10:44:44.456552+0000","last_peered":"2024-09-14T10:44:44.456552+0000","last_clean":"2024-09-14T10:44:44.456552+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:44:44.456552+0000","last_undegraded":"2024-09-14T10:44:44.456552+0000","last_fullsized":"2024-09-14T10:44:44.456552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:08.383959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436064+0000","last_change":"2024-09-14T10:44:09.320830+0000","last_active":"2024-09-14T10:44:44.436064+0000","last_peered":"2024-09-14T10:44:44.436064+0000","last_clean":"2024-09-14T10:44:44.436064+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:44:44.436064+0000","last_undegraded":"2024-09-14T10:44:44.436064+0000","last_fullsized":"2024-09-14T10:44:44.436064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:33.277860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.618426+0000","last_change":"2024-09-14T10:44:11.325995+0000","last_active":"2024-09-14T10:46:18.618426+0000","last_peered":"2024-09-14T10:46:18.618426+0000","last_clean":"2024-09-14T10:46:18.618426+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:46:18.618426+0000","last_undegraded":"2024-09-14T10:46:18.618426+0000","last_fullsized":"2024-09-14T10:46:18.618426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:19.897508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441744+0000","last_change":"2024-09-14T10:44:13.369101+0000","last_active":"2024-09-14T10:44:44.441744+0000","last_peered":"2024-09-14T10:44:44.441744+0000","last_clean":"2024-09-14T10:44:44.441744+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:44:44.441744+0000","last_undegraded":"2024-09-14T10:44:44.441744+0000","last_fullsized":"2024-09-14T10:44:44.441744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:12.164053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457651+0000","last_change":"2024-09-14T10:44:15.386917+0000","last_active":"2024-09-14T10:44:44.457651+0000","last_peered":"2024-09-14T10:44:44.457651+0000","last_clean":"2024-09-14T10:44:44.457651+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:44:44.457651+0000","last_undegraded":"2024-09-14T10:44:44.457651+0000","last_fullsized":"2024-09-14T10:44:44.457651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:38.536486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600974+0000","last_change":"2024-09-14T10:44:44.464149+0000","last_active":"2024-09-14T10:45:35.600974+0000","last_peered":"2024-09-14T10:45:35.600974+0000","last_clean":"2024-09-14T10:45:35.600974+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:45:35.600974+0000","last_undegraded":"2024-09-14T10:45:35.600974+0000","last_fullsized":"2024-09-14T10:45:35.600974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:26.594110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.245635+0000","last_change":"2024-09-14T10:44:05.314583+0000","last_active":"2024-09-14T10:47:21.245635+0000","last_peered":"2024-09-14T10:47:21.245635+0000","last_clean":"2024-09-14T10:47:21.245635+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:21.245635+0000","last_undegraded":"2024-09-14T10:47:21.245635+0000","last_fullsized":"2024-09-14T10:47:21.245635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:24.166852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436523+0000","last_change":"2024-09-14T10:44:09.318111+0000","last_active":"2024-09-14T10:44:44.436523+0000","last_peered":"2024-09-14T10:44:44.436523+0000","last_clean":"2024-09-14T10:44:44.436523+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:44:44.436523+0000","last_undegraded":"2024-09-14T10:44:44.436523+0000","last_fullsized":"2024-09-14T10:44:44.436523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:12.821605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.647577+0000","last_change":"2024-09-14T10:44:11.356523+0000","last_active":"2024-09-14T10:46:18.647577+0000","last_peered":"2024-09-14T10:46:18.647577+0000","last_clean":"2024-09-14T10:46:18.647577+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:46:18.647577+0000","last_undegraded":"2024-09-14T10:46:18.647577+0000","last_fullsized":"2024-09-14T10:46:18.647577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:30.747229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451553+0000","last_change":"2024-09-14T10:44:13.367321+0000","last_active":"2024-09-14T10:44:44.451553+0000","last_peered":"2024-09-14T10:44:44.451553+0000","last_clean":"2024-09-14T10:44:44.451553+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:44:44.451553+0000","last_undegraded":"2024-09-14T10:44:44.451553+0000","last_fullsized":"2024-09-14T10:44:44.451553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:58.066611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.662711+0000","last_change":"2024-09-14T10:44:15.385986+0000","last_active":"2024-09-14T10:46:18.662711+0000","last_peered":"2024-09-14T10:46:18.662711+0000","last_clean":"2024-09-14T10:46:18.662711+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:46:18.662711+0000","last_undegraded":"2024-09-14T10:46:18.662711+0000","last_fullsized":"2024-09-14T10:46:18.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:58.059454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.522356+0000","last_change":"2024-09-14T10:44:07.295202+0000","last_active":"2024-09-14T10:46:16.522356+0000","last_peered":"2024-09-14T10:46:16.522356+0000","last_clean":"2024-09-14T10:46:16.522356+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:46:16.522356+0000","last_undegraded":"2024-09-14T10:46:16.522356+0000","last_fullsized":"2024-09-14T10:46:16.522356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:40.711930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451048+0000","last_change":"2024-09-14T10:44:05.323017+0000","last_active":"2024-09-14T10:44:44.451048+0000","last_peered":"2024-09-14T10:44:44.451048+0000","last_clean":"2024-09-14T10:44:44.451048+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:44:44.451048+0000","last_undegraded":"2024-09-14T10:44:44.451048+0000","last_fullsized":"2024-09-14T10:44:44.451048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:48.326362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.016574+0000","last_change":"2024-09-14T10:44:09.327924+0000","last_active":"2024-09-14T10:46:17.016574+0000","last_peered":"2024-09-14T10:46:17.016574+0000","last_clean":"2024-09-14T10:46:17.016574+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:46:17.016574+0000","last_undegraded":"2024-09-14T10:46:17.016574+0000","last_fullsized":"2024-09-14T10:46:17.016574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:38.718169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.731485+0000","last_change":"2024-09-14T10:44:11.357069+0000","last_active":"2024-09-14T10:47:20.731485+0000","last_peered":"2024-09-14T10:47:20.731485+0000","last_clean":"2024-09-14T10:47:20.731485+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:47:20.731485+0000","last_undegraded":"2024-09-14T10:47:20.731485+0000","last_fullsized":"2024-09-14T10:47:20.731485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439393+0000","last_change":"2024-09-14T10:44:13.373389+0000","last_active":"2024-09-14T10:44:44.439393+0000","last_peered":"2024-09-14T10:44:44.439393+0000","last_clean":"2024-09-14T10:44:44.439393+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:44:44.439393+0000","last_undegraded":"2024-09-14T10:44:44.439393+0000","last_fullsized":"2024-09-14T10:44:44.439393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:34.517874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.852899+0000","last_change":"2024-09-14T10:44:15.386649+0000","last_active":"2024-09-14T10:47:20.852899+0000","last_peered":"2024-09-14T10:47:20.852899+0000","last_clean":"2024-09-14T10:47:20.852899+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:47:20.852899+0000","last_undegraded":"2024-09-14T10:47:20.852899+0000","last_fullsized":"2024-09-14T10:47:20.852899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:48.236396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.826073+0000","last_change":"2024-09-14T10:44:07.319333+0000","last_active":"2024-09-14T10:47:21.826073+0000","last_peered":"2024-09-14T10:47:21.826073+0000","last_clean":"2024-09-14T10:47:21.826073+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:47:21.826073+0000","last_undegraded":"2024-09-14T10:47:21.826073+0000","last_fullsized":"2024-09-14T10:47:21.826073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:14.561201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.679774+0000","last_change":"2024-09-14T10:44:05.319396+0000","last_active":"2024-09-14T10:47:21.679774+0000","last_peered":"2024-09-14T10:47:21.679774+0000","last_clean":"2024-09-14T10:47:21.679774+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:47:21.679774+0000","last_undegraded":"2024-09-14T10:47:21.679774+0000","last_fullsized":"2024-09-14T10:47:21.679774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:14.729286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.601482+0000","last_change":"2024-09-14T10:44:07.305165+0000","last_active":"2024-09-14T10:45:35.601482+0000","last_peered":"2024-09-14T10:45:35.601482+0000","last_clean":"2024-09-14T10:45:35.601482+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:45:35.601482+0000","last_undegraded":"2024-09-14T10:45:35.601482+0000","last_fullsized":"2024-09-14T10:45:35.601482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.572269+0000","last_change":"2024-09-14T10:44:05.323992+0000","last_active":"2024-09-14T10:44:52.572269+0000","last_peered":"2024-09-14T10:44:52.572269+0000","last_clean":"2024-09-14T10:44:52.572269+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:44:52.572269+0000","last_undegraded":"2024-09-14T10:44:52.572269+0000","last_fullsized":"2024-09-14T10:44:52.572269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:52.517695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.377995+0000","last_change":"2024-09-14T10:44:07.300105+0000","last_active":"2024-09-14T10:47:21.377995+0000","last_peered":"2024-09-14T10:47:21.377995+0000","last_clean":"2024-09-14T10:47:21.377995+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:47:21.377995+0000","last_undegraded":"2024-09-14T10:47:21.377995+0000","last_fullsized":"2024-09-14T10:47:21.377995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:48.852285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452056+0000","last_change":"2024-09-14T10:44:05.327542+0000","last_active":"2024-09-14T10:44:44.452056+0000","last_peered":"2024-09-14T10:44:44.452056+0000","last_clean":"2024-09-14T10:44:44.452056+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:44:44.452056+0000","last_undegraded":"2024-09-14T10:44:44.452056+0000","last_fullsized":"2024-09-14T10:44:44.452056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:23.168081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441253+0000","last_change":"2024-09-14T10:44:07.306382+0000","last_active":"2024-09-14T10:44:44.441253+0000","last_peered":"2024-09-14T10:44:44.441253+0000","last_clean":"2024-09-14T10:44:44.441253+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:44:44.441253+0000","last_undegraded":"2024-09-14T10:44:44.441253+0000","last_fullsized":"2024-09-14T10:44:44.441253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:58.925922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.713765+0000","last_change":"2024-09-14T10:44:05.323524+0000","last_active":"2024-09-14T10:44:50.713765+0000","last_peered":"2024-09-14T10:44:50.713765+0000","last_clean":"2024-09-14T10:44:50.713765+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:44:50.713765+0000","last_undegraded":"2024-09-14T10:44:50.713765+0000","last_fullsized":"2024-09-14T10:44:50.713765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441282+0000","last_change":"2024-09-14T10:44:07.316775+0000","last_active":"2024-09-14T10:44:44.441282+0000","last_peered":"2024-09-14T10:44:44.441282+0000","last_clean":"2024-09-14T10:44:44.441282+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:44:44.441282+0000","last_undegraded":"2024-09-14T10:44:44.441282+0000","last_fullsized":"2024-09-14T10:44:44.441282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.078507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441499+0000","last_change":"2024-09-14T10:44:05.320107+0000","last_active":"2024-09-14T10:44:44.441499+0000","last_peered":"2024-09-14T10:44:44.441499+0000","last_clean":"2024-09-14T10:44:44.441499+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:44:44.441499+0000","last_undegraded":"2024-09-14T10:44:44.441499+0000","last_fullsized":"2024-09-14T10:44:44.441499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:08.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880716+0000","last_change":"2024-09-14T10:44:07.315346+0000","last_active":"2024-09-14T10:47:21.880716+0000","last_peered":"2024-09-14T10:47:21.880716+0000","last_clean":"2024-09-14T10:47:21.880716+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:47:21.880716+0000","last_undegraded":"2024-09-14T10:47:21.880716+0000","last_fullsized":"2024-09-14T10:47:21.880716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:34.364814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446125+0000","last_change":"2024-09-14T10:44:05.316250+0000","last_active":"2024-09-14T10:44:44.446125+0000","last_peered":"2024-09-14T10:44:44.446125+0000","last_clean":"2024-09-14T10:44:44.446125+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:44:44.446125+0000","last_undegraded":"2024-09-14T10:44:44.446125+0000","last_fullsized":"2024-09-14T10:44:44.446125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:41.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.873291+0000","last_change":"2024-09-14T10:44:07.302298+0000","last_active":"2024-09-14T10:45:35.873291+0000","last_peered":"2024-09-14T10:45:35.873291+0000","last_clean":"2024-09-14T10:45:35.873291+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:45:35.873291+0000","last_undegraded":"2024-09-14T10:45:35.873291+0000","last_fullsized":"2024-09-14T10:45:35.873291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:05.444889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439490+0000","last_change":"2024-09-14T10:44:05.321993+0000","last_active":"2024-09-14T10:44:44.439490+0000","last_peered":"2024-09-14T10:44:44.439490+0000","last_clean":"2024-09-14T10:44:44.439490+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:44:44.439490+0000","last_undegraded":"2024-09-14T10:44:44.439490+0000","last_fullsized":"2024-09-14T10:44:44.439490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:11.032280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.523024+0000","last_change":"2024-09-14T10:44:07.304072+0000","last_active":"2024-09-14T10:46:16.523024+0000","last_peered":"2024-09-14T10:46:16.523024+0000","last_clean":"2024-09-14T10:46:16.523024+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:46:16.523024+0000","last_undegraded":"2024-09-14T10:46:16.523024+0000","last_fullsized":"2024-09-14T10:46:16.523024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444660+0000","last_change":"2024-09-14T10:44:05.314790+0000","last_active":"2024-09-14T10:44:44.444660+0000","last_peered":"2024-09-14T10:44:44.444660+0000","last_clean":"2024-09-14T10:44:44.444660+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:44:44.444660+0000","last_undegraded":"2024-09-14T10:44:44.444660+0000","last_fullsized":"2024-09-14T10:44:44.444660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:08.523198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452649+0000","last_change":"2024-09-14T10:44:07.302967+0000","last_active":"2024-09-14T10:44:44.452649+0000","last_peered":"2024-09-14T10:44:44.452649+0000","last_clean":"2024-09-14T10:44:44.452649+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:44:44.452649+0000","last_undegraded":"2024-09-14T10:44:44.452649+0000","last_fullsized":"2024-09-14T10:44:44.452649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:58.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.707392+0000","last_change":"2024-09-14T10:44:05.326780+0000","last_active":"2024-09-14T10:44:50.707392+0000","last_peered":"2024-09-14T10:44:50.707392+0000","last_clean":"2024-09-14T10:44:50.707392+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:44:50.707392+0000","last_undegraded":"2024-09-14T10:44:50.707392+0000","last_fullsized":"2024-09-14T10:44:50.707392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:30.583609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.848468+0000","last_change":"2024-09-14T10:44:07.309384+0000","last_active":"2024-09-14T10:44:51.848468+0000","last_peered":"2024-09-14T10:44:51.848468+0000","last_clean":"2024-09-14T10:44:51.848468+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:44:51.848468+0000","last_undegraded":"2024-09-14T10:44:51.848468+0000","last_fullsized":"2024-09-14T10:44:51.848468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:20.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440181+0000","last_change":"2024-09-14T10:44:05.324016+0000","last_active":"2024-09-14T10:44:44.440181+0000","last_peered":"2024-09-14T10:44:44.440181+0000","last_clean":"2024-09-14T10:44:44.440181+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:44:44.440181+0000","last_undegraded":"2024-09-14T10:44:44.440181+0000","last_fullsized":"2024-09-14T10:44:44.440181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874270+0000","last_change":"2024-09-14T10:44:07.314041+0000","last_active":"2024-09-14T10:45:35.874270+0000","last_peered":"2024-09-14T10:45:35.874270+0000","last_clean":"2024-09-14T10:45:35.874270+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:45:35.874270+0000","last_undegraded":"2024-09-14T10:45:35.874270+0000","last_fullsized":"2024-09-14T10:45:35.874270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:27.185091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447387+0000","last_change":"2024-09-14T10:44:05.316396+0000","last_active":"2024-09-14T10:44:44.447387+0000","last_peered":"2024-09-14T10:44:44.447387+0000","last_clean":"2024-09-14T10:44:44.447387+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:44:44.447387+0000","last_undegraded":"2024-09-14T10:44:44.447387+0000","last_fullsized":"2024-09-14T10:44:44.447387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:31.844881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600757+0000","last_change":"2024-09-14T10:44:07.303238+0000","last_active":"2024-09-14T10:45:35.600757+0000","last_peered":"2024-09-14T10:45:35.600757+0000","last_clean":"2024-09-14T10:45:35.600757+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:45:35.600757+0000","last_undegraded":"2024-09-14T10:45:35.600757+0000","last_fullsized":"2024-09-14T10:45:35.600757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:49.401193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443767+0000","last_change":"2024-09-14T10:44:05.313950+0000","last_active":"2024-09-14T10:44:44.443767+0000","last_peered":"2024-09-14T10:44:44.443767+0000","last_clean":"2024-09-14T10:44:44.443767+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:44:44.443767+0000","last_undegraded":"2024-09-14T10:44:44.443767+0000","last_fullsized":"2024-09-14T10:44:44.443767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.127894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.375016+0000","last_change":"2024-09-14T10:44:07.319354+0000","last_active":"2024-09-14T10:47:21.375016+0000","last_peered":"2024-09-14T10:47:21.375016+0000","last_clean":"2024-09-14T10:47:21.375016+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:47:21.375016+0000","last_undegraded":"2024-09-14T10:47:21.375016+0000","last_fullsized":"2024-09-14T10:47:21.375016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:26.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453814+0000","last_change":"2024-09-14T10:44:05.318285+0000","last_active":"2024-09-14T10:44:44.453814+0000","last_peered":"2024-09-14T10:44:44.453814+0000","last_clean":"2024-09-14T10:44:44.453814+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:44:44.453814+0000","last_undegraded":"2024-09-14T10:44:44.453814+0000","last_fullsized":"2024-09-14T10:44:44.453814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:09.785074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.697003+0000","last_change":"2024-09-14T10:44:07.304891+0000","last_active":"2024-09-14T10:46:20.697003+0000","last_peered":"2024-09-14T10:46:20.697003+0000","last_clean":"2024-09-14T10:46:20.697003+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:46:20.697003+0000","last_undegraded":"2024-09-14T10:46:20.697003+0000","last_fullsized":"2024-09-14T10:46:20.697003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.594544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457554+0000","last_change":"2024-09-14T10:44:05.324335+0000","last_active":"2024-09-14T10:44:44.457554+0000","last_peered":"2024-09-14T10:44:44.457554+0000","last_clean":"2024-09-14T10:44:44.457554+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:44:44.457554+0000","last_undegraded":"2024-09-14T10:44:44.457554+0000","last_fullsized":"2024-09-14T10:44:44.457554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:36.457645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.521412+0000","last_change":"2024-09-14T10:44:07.309006+0000","last_active":"2024-09-14T10:47:21.521412+0000","last_peered":"2024-09-14T10:47:21.521412+0000","last_clean":"2024-09-14T10:47:21.521412+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:47:21.521412+0000","last_undegraded":"2024-09-14T10:47:21.521412+0000","last_fullsized":"2024-09-14T10:47:21.521412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:25.445644+0000","last_change":"2024-09-14T10:44:05.321869+0000","last_active":"2024-09-14T10:46:25.445644+0000","last_peered":"2024-09-14T10:46:25.445644+0000","last_clean":"2024-09-14T10:46:25.445644+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:46:25.445644+0000","last_undegraded":"2024-09-14T10:46:25.445644+0000","last_fullsized":"2024-09-14T10:46:25.445644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:52.091145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":13,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.537179+0000","last_change":"2024-09-14T10:44:07.303706+0000","last_active":"2024-09-14T10:47:21.537179+0000","last_peered":"2024-09-14T10:47:21.537179+0000","last_clean":"2024-09-14T10:47:21.537179+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:47:21.537179+0000","last_undegraded":"2024-09-14T10:47:21.537179+0000","last_fullsized":"2024-09-14T10:47:21.537179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:47.194815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460745+0000","last_change":"2024-09-14T10:44:05.318005+0000","last_active":"2024-09-14T10:44:44.460745+0000","last_peered":"2024-09-14T10:44:44.460745+0000","last_clean":"2024-09-14T10:44:44.460745+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:44:44.460745+0000","last_undegraded":"2024-09-14T10:44:44.460745+0000","last_fullsized":"2024-09-14T10:44:44.460745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:40.757947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.706195+0000","last_change":"2024-09-14T10:44:05.321634+0000","last_active":"2024-09-14T10:47:21.706195+0000","last_peered":"2024-09-14T10:47:21.706195+0000","last_clean":"2024-09-14T10:47:21.706195+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:47:21.706195+0000","last_undegraded":"2024-09-14T10:47:21.706195+0000","last_fullsized":"2024-09-14T10:47:21.706195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:01.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":29,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882780+0000","last_change":"2024-09-14T10:44:07.310127+0000","last_active":"2024-09-14T10:47:21.882780+0000","last_peered":"2024-09-14T10:47:21.882780+0000","last_clean":"2024-09-14T10:47:21.882780+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:47:21.882780+0000","last_undegraded":"2024-09-14T10:47:21.882780+0000","last_fullsized":"2024-09-14T10:47:21.882780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.606750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.713544+0000","last_change":"2024-09-14T10:44:05.325170+0000","last_active":"2024-09-14T10:44:50.713544+0000","last_peered":"2024-09-14T10:44:50.713544+0000","last_clean":"2024-09-14T10:44:50.713544+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:44:50.713544+0000","last_undegraded":"2024-09-14T10:44:50.713544+0000","last_fullsized":"2024-09-14T10:44:50.713544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:31.844881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.521493+0000","last_change":"2024-09-14T10:44:07.318886+0000","last_active":"2024-09-14T10:46:16.521493+0000","last_peered":"2024-09-14T10:46:16.521493+0000","last_clean":"2024-09-14T10:46:16.521493+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:46:16.521493+0000","last_undegraded":"2024-09-14T10:46:16.521493+0000","last_fullsized":"2024-09-14T10:46:16.521493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:08.926626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13383,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640309,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48896,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322944,"statfs":{"total":96636764160,"available":96586694656,"internally_reserved":0,"allocated":9617408,"data_stored":9346322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44220,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327620,"statfs":{"total":96636764160,"available":96591482880,"internally_reserved":0,"allocated":9089024,"data_stored":8759345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44768,"kb_used_data":9424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327072,"statfs":{"total":96636764160,"available":96590921728,"internally_reserved":0,"allocated":9650176,"data_stored":9349617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":9056256,"data_stored":8757874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:47:53.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:47:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.784+0000 7f40f1707640 1 Processor -- start 2024-09-14T10:47:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.784+0000 7f40f1707640 1 -- start start 2024-09-14T10:47:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.784+0000 7f40f1707640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40ec071d80 0x7f40ec132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.784+0000 7f40f1707640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40ec0724f0 con 0x7f40ec12d390 2024-09-14T10:47:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.784+0000 7f40f1707640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f40ec099e20 con 0x7f40ec071d80 2024-09-14T10:47:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40ea7fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40ec071d80 0x7f40ec132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40eaffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f40ec12d390 0x7f40ec12d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:38938/0 (socket says 172.21.15.70:38938) 2024-09-14T10:47:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40eaffd640 1 -- 172.21.15.70:0/509357904 learned_addr learned my addr 172.21.15.70:0/509357904 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40e9ffb640 1 -- 172.21.15.70:0/509357904 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729984722 0 0) 0x7f40ec0724f0 con 0x7f40ec12d390 2024-09-14T10:47:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40e9ffb640 1 -- 172.21.15.70:0/509357904 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40d8003530 con 0x7f40ec12d390 2024-09-14T10:47:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40ea7fc640 1 -- 172.21.15.70:0/509357904 >> v1:172.21.15.70:6789/0 conn(0x7f40ec12d390 legacy=0x7f40ec12d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40ea7fc640 1 -- 172.21.15.70:0/509357904 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec12de80 con 0x7f40ec071d80 2024-09-14T10:47:53.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40ea7fc640 1 --2- 172.21.15.70:0/509357904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec132390 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009dc0 tx=0x7f40d401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a952f0cf6336855b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:53.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40e9ffb640 1 -- 172.21.15.70:0/509357904 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d40b2070 con 0x7f40ec071d80 2024-09-14T10:47:53.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40e9ffb640 1 -- 172.21.15.70:0/509357904 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d40a5830 con 0x7f40ec071d80 2024-09-14T10:47:53.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40e9ffb640 1 -- 172.21.15.70:0/509357904 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d40a5b10 con 0x7f40ec071d80 2024-09-14T10:47:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40f1707640 1 -- 172.21.15.70:0/509357904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 msgr2=0x7f40ec132390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40f1707640 1 --2- 172.21.15.70:0/509357904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec132390 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009dc0 tx=0x7f40d401c8a0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40f1707640 1 -- 172.21.15.70:0/509357904 shutdown_connections 2024-09-14T10:47:53.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40f1707640 1 --2- 172.21.15.70:0/509357904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec132390 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40f1707640 1 -- 172.21.15.70:0/509357904 >> 172.21.15.70:0/509357904 conn(0x7f40ec09aba0 msgr2=0x7f40ec0984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40f1707640 1 -- 172.21.15.70:0/509357904 shutdown_connections 2024-09-14T10:47:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.788+0000 7f40f1707640 1 -- 172.21.15.70:0/509357904 wait complete. 2024-09-14T10:47:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40f1707640 1 Processor -- start 2024-09-14T10:47:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40f1707640 1 -- start start 2024-09-14T10:47:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40f1707640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec1258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40f1707640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec135480 con 0x7f40ec071d80 2024-09-14T10:47:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40eaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec1258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40eaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec1258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47170/0 (socket says 172.21.15.70:47170) 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40eaffd640 1 -- 172.21.15.70:0/1258494768 learned_addr learned my addr 172.21.15.70:0/1258494768 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40eaffd640 1 -- 172.21.15.70:0/1258494768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec127d20 con 0x7f40ec071d80 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40eaffd640 1 --2- 172.21.15.70:0/1258494768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec1258b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f40e400c470 tx=0x7f40e400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40e37fe640 1 -- 172.21.15.70:0/1258494768 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e4017070 con 0x7f40ec071d80 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40e37fe640 1 -- 172.21.15.70:0/1258494768 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e4005c20 con 0x7f40ec071d80 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec12a980 con 0x7f40ec071d80 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40e37fe640 1 -- 172.21.15.70:0/1258494768 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40e40070d0 con 0x7f40ec071d80 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec128e00 con 0x7f40ec071d80 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ec1281b0 con 0x7f40ec071d80 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40e37fe640 1 -- 172.21.15.70:0/1258494768 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f40e401a070 con 0x7f40ec071d80 2024-09-14T10:47:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40e37fe640 1 --2- 172.21.15.70:0/1258494768 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f40cc03b8b0 0x7f40cc03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40e37fe640 1 -- 172.21.15.70:0/1258494768 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f40e404f490 con 0x7f40ec071d80 2024-09-14T10:47:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.792+0000 7f40ea7fc640 1 --2- 172.21.15.70:0/1258494768 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f40cc03b8b0 0x7f40cc03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.796+0000 7f40ea7fc640 1 --2- 172.21.15.70:0/1258494768 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f40cc03b8b0 0x7f40cc03dd70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f40d40af000 tx=0x7f40d40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:53.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.796+0000 7f40e37fe640 1 -- 172.21.15.70:0/1258494768 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f40e4012450 con 0x7f40ec071d80 2024-09-14T10:47:53.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.964+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40ec050ef0 con 0x7f40cc03b8b0 2024-09-14T10:47:53.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:53.992+0000 7f40e37fe640 1 -- 172.21.15.70:0/1258494768 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666038 (secure 0 0 0) 0x7f40ec050ef0 con 0x7f40cc03b8b0 2024-09-14T10:47:53.994 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:47:54.001 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:47:54.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f40cc03b8b0 msgr2=0x7f40cc03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 --2- 172.21.15.70:0/1258494768 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f40cc03b8b0 0x7f40cc03dd70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f40d40af000 tx=0x7f40d40a7070 comp rx=0 tx=0).stop 2024-09-14T10:47:54.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 msgr2=0x7f40ec1258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 --2- 172.21.15.70:0/1258494768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec1258b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f40e400c470 tx=0x7f40e400c930 comp rx=0 tx=0).stop 2024-09-14T10:47:54.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 shutdown_connections 2024-09-14T10:47:54.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 --2- 172.21.15.70:0/1258494768 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f40cc03b8b0 0x7f40cc03dd70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 --2- 172.21.15.70:0/1258494768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40ec071d80 0x7f40ec1258b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 >> 172.21.15.70:0/1258494768 conn(0x7f40ec09aba0 msgr2=0x7f40ec12e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:54.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 shutdown_connections 2024-09-14T10:47:54.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.000+0000 7f40f1707640 1 -- 172.21.15.70:0/1258494768 wait complete. 2024-09-14T10:47:54.015 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-14T10:47:53.464430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416911,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4941,"num_read_kb":4479,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36213158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007414"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439387+0000","last_change":"2024-09-14T10:44:05.314727+0000","last_active":"2024-09-14T10:44:44.439387+0000","last_peered":"2024-09-14T10:44:44.439387+0000","last_clean":"2024-09-14T10:44:44.439387+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:44:44.439387+0000","last_undegraded":"2024-09-14T10:44:44.439387+0000","last_fullsized":"2024-09-14T10:44:44.439387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:33.017320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720305+0000","last_change":"2024-09-14T10:44:07.304568+0000","last_active":"2024-09-14T10:47:21.720305+0000","last_peered":"2024-09-14T10:47:21.720305+0000","last_clean":"2024-09-14T10:47:21.720305+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:47:21.720305+0000","last_undegraded":"2024-09-14T10:47:21.720305+0000","last_fullsized":"2024-09-14T10:47:21.720305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:11.798345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.674373+0000","last_change":"2024-09-14T10:44:05.320383+0000","last_active":"2024-09-14T10:47:21.674373+0000","last_peered":"2024-09-14T10:47:21.674373+0000","last_clean":"2024-09-14T10:47:21.674373+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:47:21.674373+0000","last_undegraded":"2024-09-14T10:47:21.674373+0000","last_fullsized":"2024-09-14T10:47:21.674373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:57.992699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720464+0000","last_change":"2024-09-14T10:44:07.311706+0000","last_active":"2024-09-14T10:47:21.720464+0000","last_peered":"2024-09-14T10:47:21.720464+0000","last_clean":"2024-09-14T10:47:21.720464+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:47:21.720464+0000","last_undegraded":"2024-09-14T10:47:21.720464+0000","last_fullsized":"2024-09-14T10:47:21.720464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:27.522929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.458276+0000","last_change":"2024-09-14T10:44:05.321748+0000","last_active":"2024-09-14T10:44:44.458276+0000","last_peered":"2024-09-14T10:44:44.458276+0000","last_clean":"2024-09-14T10:44:44.458276+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:44:44.458276+0000","last_undegraded":"2024-09-14T10:44:44.458276+0000","last_fullsized":"2024-09-14T10:44:44.458276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.177217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879810+0000","last_change":"2024-09-14T10:44:07.311756+0000","last_active":"2024-09-14T10:47:21.879810+0000","last_peered":"2024-09-14T10:47:21.879810+0000","last_clean":"2024-09-14T10:47:21.879810+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:47:21.879810+0000","last_undegraded":"2024-09-14T10:47:21.879810+0000","last_fullsized":"2024-09-14T10:47:21.879810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.711375+0000","last_change":"2024-09-14T10:44:05.316542+0000","last_active":"2024-09-14T10:44:50.711375+0000","last_peered":"2024-09-14T10:44:50.711375+0000","last_clean":"2024-09-14T10:44:50.711375+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:44:50.711375+0000","last_undegraded":"2024-09-14T10:44:50.711375+0000","last_fullsized":"2024-09-14T10:44:50.711375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:35.707595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600024+0000","last_change":"2024-09-14T10:44:07.312388+0000","last_active":"2024-09-14T10:45:35.600024+0000","last_peered":"2024-09-14T10:45:35.600024+0000","last_clean":"2024-09-14T10:45:35.600024+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:45:35.600024+0000","last_undegraded":"2024-09-14T10:45:35.600024+0000","last_fullsized":"2024-09-14T10:45:35.600024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:31.070464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454651+0000","last_change":"2024-09-14T10:44:05.329861+0000","last_active":"2024-09-14T10:44:44.454651+0000","last_peered":"2024-09-14T10:44:44.454651+0000","last_clean":"2024-09-14T10:44:44.454651+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:44:44.454651+0000","last_undegraded":"2024-09-14T10:44:44.454651+0000","last_fullsized":"2024-09-14T10:44:44.454651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:01.827439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.677760+0000","last_change":"2024-09-14T10:44:07.303712+0000","last_active":"2024-09-14T10:46:20.677760+0000","last_peered":"2024-09-14T10:46:20.677760+0000","last_clean":"2024-09-14T10:46:20.677760+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:46:20.677760+0000","last_undegraded":"2024-09-14T10:46:20.677760+0000","last_fullsized":"2024-09-14T10:46:20.677760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433524+0000","last_change":"2024-09-14T10:44:05.317002+0000","last_active":"2024-09-14T10:44:44.433524+0000","last_peered":"2024-09-14T10:44:44.433524+0000","last_clean":"2024-09-14T10:44:44.433524+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:44:44.433524+0000","last_undegraded":"2024-09-14T10:44:44.433524+0000","last_fullsized":"2024-09-14T10:44:44.433524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:24.606365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.373297+0000","last_change":"2024-09-14T10:44:44.462329+0000","last_active":"2024-09-14T10:47:21.373297+0000","last_peered":"2024-09-14T10:47:21.373297+0000","last_clean":"2024-09-14T10:47:21.373297+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:47:21.373297+0000","last_undegraded":"2024-09-14T10:47:21.373297+0000","last_fullsized":"2024-09-14T10:47:21.373297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:05.537374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.449407+0000","last_change":"2024-09-14T10:44:05.319096+0000","last_active":"2024-09-14T10:44:44.449407+0000","last_peered":"2024-09-14T10:44:44.449407+0000","last_clean":"2024-09-14T10:44:44.449407+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:44:44.449407+0000","last_undegraded":"2024-09-14T10:44:44.449407+0000","last_fullsized":"2024-09-14T10:44:44.449407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:07.843074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879838+0000","last_change":"2024-09-14T10:44:07.301357+0000","last_active":"2024-09-14T10:47:21.879838+0000","last_peered":"2024-09-14T10:47:21.879838+0000","last_clean":"2024-09-14T10:47:21.879838+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:47:21.879838+0000","last_undegraded":"2024-09-14T10:47:21.879838+0000","last_fullsized":"2024-09-14T10:47:21.879838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:49.933862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.869625+0000","last_change":"2024-09-14T10:44:05.315243+0000","last_active":"2024-09-14T10:47:21.869625+0000","last_peered":"2024-09-14T10:47:21.869625+0000","last_clean":"2024-09-14T10:47:21.869625+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:47:21.869625+0000","last_undegraded":"2024-09-14T10:47:21.869625+0000","last_fullsized":"2024-09-14T10:47:21.869625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:04.517080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.986354+0000","last_change":"2024-09-14T10:44:07.315054+0000","last_active":"2024-09-14T10:47:21.986354+0000","last_peered":"2024-09-14T10:47:21.986354+0000","last_clean":"2024-09-14T10:47:21.986354+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:47:21.986354+0000","last_undegraded":"2024-09-14T10:47:21.986354+0000","last_fullsized":"2024-09-14T10:47:21.986354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:46.799488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872805+0000","last_change":"2024-09-14T10:44:07.313852+0000","last_active":"2024-09-14T10:45:35.872805+0000","last_peered":"2024-09-14T10:45:35.872805+0000","last_clean":"2024-09-14T10:45:35.872805+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:45:35.872805+0000","last_undegraded":"2024-09-14T10:45:35.872805+0000","last_fullsized":"2024-09-14T10:45:35.872805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:54.012187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450856+0000","last_change":"2024-09-14T10:44:05.322752+0000","last_active":"2024-09-14T10:44:44.450856+0000","last_peered":"2024-09-14T10:44:44.450856+0000","last_clean":"2024-09-14T10:44:44.450856+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:44:44.450856+0000","last_undegraded":"2024-09-14T10:44:44.450856+0000","last_fullsized":"2024-09-14T10:44:44.450856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:08.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720065+0000","last_change":"2024-09-14T10:44:07.303444+0000","last_active":"2024-09-14T10:47:21.720065+0000","last_peered":"2024-09-14T10:47:21.720065+0000","last_clean":"2024-09-14T10:47:21.720065+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:47:21.720065+0000","last_undegraded":"2024-09-14T10:47:21.720065+0000","last_fullsized":"2024-09-14T10:47:21.720065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:42.771218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440693+0000","last_change":"2024-09-14T10:44:05.314433+0000","last_active":"2024-09-14T10:44:44.440693+0000","last_peered":"2024-09-14T10:44:44.440693+0000","last_clean":"2024-09-14T10:44:44.440693+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:44:44.440693+0000","last_undegraded":"2024-09-14T10:44:44.440693+0000","last_fullsized":"2024-09-14T10:44:44.440693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:30.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880404+0000","last_change":"2024-09-14T10:44:07.302716+0000","last_active":"2024-09-14T10:47:21.880404+0000","last_peered":"2024-09-14T10:47:21.880404+0000","last_clean":"2024-09-14T10:47:21.880404+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:47:21.880404+0000","last_undegraded":"2024-09-14T10:47:21.880404+0000","last_fullsized":"2024-09-14T10:47:21.880404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:36.213106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446820+0000","last_change":"2024-09-14T10:44:05.320439+0000","last_active":"2024-09-14T10:44:44.446820+0000","last_peered":"2024-09-14T10:44:44.446820+0000","last_clean":"2024-09-14T10:44:44.446820+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:44:44.446820+0000","last_undegraded":"2024-09-14T10:44:44.446820+0000","last_fullsized":"2024-09-14T10:44:44.446820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:30.093065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874276+0000","last_change":"2024-09-14T10:44:07.314159+0000","last_active":"2024-09-14T10:45:35.874276+0000","last_peered":"2024-09-14T10:45:35.874276+0000","last_clean":"2024-09-14T10:45:35.874276+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:45:35.874276+0000","last_undegraded":"2024-09-14T10:45:35.874276+0000","last_fullsized":"2024-09-14T10:45:35.874276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443974+0000","last_change":"2024-09-14T10:44:05.320368+0000","last_active":"2024-09-14T10:44:44.443974+0000","last_peered":"2024-09-14T10:44:44.443974+0000","last_clean":"2024-09-14T10:44:44.443974+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:44:44.443974+0000","last_undegraded":"2024-09-14T10:44:44.443974+0000","last_fullsized":"2024-09-14T10:44:44.443974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879927+0000","last_change":"2024-09-14T10:44:07.313819+0000","last_active":"2024-09-14T10:47:21.879927+0000","last_peered":"2024-09-14T10:47:21.879927+0000","last_clean":"2024-09-14T10:47:21.879927+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:47:21.879927+0000","last_undegraded":"2024-09-14T10:47:21.879927+0000","last_fullsized":"2024-09-14T10:47:21.879927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.226631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444169+0000","last_change":"2024-09-14T10:44:05.324714+0000","last_active":"2024-09-14T10:44:44.444169+0000","last_peered":"2024-09-14T10:44:44.444169+0000","last_clean":"2024-09-14T10:44:44.444169+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:44:44.444169+0000","last_undegraded":"2024-09-14T10:44:44.444169+0000","last_fullsized":"2024-09-14T10:44:44.444169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:41.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825511+0000","last_change":"2024-09-14T10:44:07.303481+0000","last_active":"2024-09-14T10:47:21.825511+0000","last_peered":"2024-09-14T10:47:21.825511+0000","last_clean":"2024-09-14T10:47:21.825511+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:47:21.825511+0000","last_undegraded":"2024-09-14T10:47:21.825511+0000","last_fullsized":"2024-09-14T10:47:21.825511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.685013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452678+0000","last_change":"2024-09-14T10:44:05.312131+0000","last_active":"2024-09-14T10:44:44.452678+0000","last_peered":"2024-09-14T10:44:44.452678+0000","last_clean":"2024-09-14T10:44:44.452678+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:44:44.452678+0000","last_undegraded":"2024-09-14T10:44:44.452678+0000","last_fullsized":"2024-09-14T10:44:44.452678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:20.004027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891282+0000","last_change":"2024-09-14T10:44:15.384222+0000","last_active":"2024-09-14T10:47:21.891282+0000","last_peered":"2024-09-14T10:47:21.891282+0000","last_clean":"2024-09-14T10:47:21.891282+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:47:21.891282+0000","last_undegraded":"2024-09-14T10:47:21.891282+0000","last_fullsized":"2024-09-14T10:47:21.891282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:52.493514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825066+0000","last_change":"2024-09-14T10:44:07.300223+0000","last_active":"2024-09-14T10:47:21.825066+0000","last_peered":"2024-09-14T10:47:21.825066+0000","last_clean":"2024-09-14T10:47:21.825066+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:47:21.825066+0000","last_undegraded":"2024-09-14T10:47:21.825066+0000","last_fullsized":"2024-09-14T10:47:21.825066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:41.299865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453614+0000","last_change":"2024-09-14T10:44:05.327015+0000","last_active":"2024-09-14T10:44:44.453614+0000","last_peered":"2024-09-14T10:44:44.453614+0000","last_clean":"2024-09-14T10:44:44.453614+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:44:44.453614+0000","last_undegraded":"2024-09-14T10:44:44.453614+0000","last_fullsized":"2024-09-14T10:44:44.453614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:24.855054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456793+0000","last_change":"2024-09-14T10:44:09.339751+0000","last_active":"2024-09-14T10:44:44.456793+0000","last_peered":"2024-09-14T10:44:44.456793+0000","last_clean":"2024-09-14T10:44:44.456793+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:44:44.456793+0000","last_undegraded":"2024-09-14T10:44:44.456793+0000","last_fullsized":"2024-09-14T10:44:44.456793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:31.250869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.638725+0000","last_change":"2024-09-14T10:44:11.366230+0000","last_active":"2024-09-14T10:46:18.638725+0000","last_peered":"2024-09-14T10:46:18.638725+0000","last_clean":"2024-09-14T10:46:18.638725+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:46:18.638725+0000","last_undegraded":"2024-09-14T10:46:18.638725+0000","last_fullsized":"2024-09-14T10:46:18.638725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446129+0000","last_change":"2024-09-14T10:44:13.370430+0000","last_active":"2024-09-14T10:44:44.446129+0000","last_peered":"2024-09-14T10:44:44.446129+0000","last_clean":"2024-09-14T10:44:44.446129+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:44:44.446129+0000","last_undegraded":"2024-09-14T10:44:44.446129+0000","last_fullsized":"2024-09-14T10:44:44.446129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.607941+0000","last_change":"2024-09-14T10:44:15.377551+0000","last_active":"2024-09-14T10:45:35.607941+0000","last_peered":"2024-09-14T10:45:35.607941+0000","last_clean":"2024-09-14T10:45:35.607941+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:45:35.607941+0000","last_undegraded":"2024-09-14T10:45:35.607941+0000","last_fullsized":"2024-09-14T10:45:35.607941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:02.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.739203+0000","last_change":"2024-09-14T10:44:07.309285+0000","last_active":"2024-09-14T10:47:21.739203+0000","last_peered":"2024-09-14T10:47:21.739203+0000","last_clean":"2024-09-14T10:47:21.739203+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:47:21.739203+0000","last_undegraded":"2024-09-14T10:47:21.739203+0000","last_fullsized":"2024-09-14T10:47:21.739203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433126+0000","last_change":"2024-09-14T10:44:05.323067+0000","last_active":"2024-09-14T10:44:44.433126+0000","last_peered":"2024-09-14T10:44:44.433126+0000","last_clean":"2024-09-14T10:44:44.433126+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:44:44.433126+0000","last_undegraded":"2024-09-14T10:44:44.433126+0000","last_fullsized":"2024-09-14T10:44:44.433126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:16.558078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440248+0000","last_change":"2024-09-14T10:44:09.318715+0000","last_active":"2024-09-14T10:44:44.440248+0000","last_peered":"2024-09-14T10:44:44.440248+0000","last_clean":"2024-09-14T10:44:44.440248+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:44:44.440248+0000","last_undegraded":"2024-09-14T10:44:44.440248+0000","last_fullsized":"2024-09-14T10:44:44.440248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:56.922877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444934+0000","last_change":"2024-09-14T10:44:11.327271+0000","last_active":"2024-09-14T10:44:44.444934+0000","last_peered":"2024-09-14T10:44:44.444934+0000","last_clean":"2024-09-14T10:44:44.444934+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:44:44.444934+0000","last_undegraded":"2024-09-14T10:44:44.444934+0000","last_fullsized":"2024-09-14T10:44:44.444934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.449635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444347+0000","last_change":"2024-09-14T10:44:13.360104+0000","last_active":"2024-09-14T10:44:44.444347+0000","last_peered":"2024-09-14T10:44:44.444347+0000","last_clean":"2024-09-14T10:44:44.444347+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:44:44.444347+0000","last_undegraded":"2024-09-14T10:44:44.444347+0000","last_fullsized":"2024-09-14T10:44:44.444347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438541+0000","last_change":"2024-09-14T10:44:15.385641+0000","last_active":"2024-09-14T10:44:44.438541+0000","last_peered":"2024-09-14T10:44:44.438541+0000","last_clean":"2024-09-14T10:44:44.438541+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:44:44.438541+0000","last_undegraded":"2024-09-14T10:44:44.438541+0000","last_fullsized":"2024-09-14T10:44:44.438541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.602221+0000","last_change":"2024-09-14T10:44:07.312266+0000","last_active":"2024-09-14T10:44:52.602221+0000","last_peered":"2024-09-14T10:44:52.602221+0000","last_clean":"2024-09-14T10:44:52.602221+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:44:52.602221+0000","last_undegraded":"2024-09-14T10:44:52.602221+0000","last_fullsized":"2024-09-14T10:44:52.602221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:05.421337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443044+0000","last_change":"2024-09-14T10:44:05.321201+0000","last_active":"2024-09-14T10:44:44.443044+0000","last_peered":"2024-09-14T10:44:44.443044+0000","last_clean":"2024-09-14T10:44:44.443044+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:44:44.443044+0000","last_undegraded":"2024-09-14T10:44:44.443044+0000","last_fullsized":"2024-09-14T10:44:44.443044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:05.963673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447321+0000","last_change":"2024-09-14T10:44:09.326103+0000","last_active":"2024-09-14T10:44:44.447321+0000","last_peered":"2024-09-14T10:44:44.447321+0000","last_clean":"2024-09-14T10:44:44.447321+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:44:44.447321+0000","last_undegraded":"2024-09-14T10:44:44.447321+0000","last_fullsized":"2024-09-14T10:44:44.447321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.437130+0000","last_change":"2024-09-14T10:44:11.355262+0000","last_active":"2024-09-14T10:44:44.437130+0000","last_peered":"2024-09-14T10:44:44.437130+0000","last_clean":"2024-09-14T10:44:44.437130+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:44:44.437130+0000","last_undegraded":"2024-09-14T10:44:44.437130+0000","last_fullsized":"2024-09-14T10:44:44.437130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:55.694768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566019+0000","last_change":"2024-09-14T10:44:13.370887+0000","last_active":"2024-09-14T10:47:19.566019+0000","last_peered":"2024-09-14T10:47:19.566019+0000","last_clean":"2024-09-14T10:47:19.566019+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:47:19.566019+0000","last_undegraded":"2024-09-14T10:47:19.566019+0000","last_fullsized":"2024-09-14T10:47:19.566019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433906+0000","last_change":"2024-09-14T10:44:15.393155+0000","last_active":"2024-09-14T10:44:44.433906+0000","last_peered":"2024-09-14T10:44:44.433906+0000","last_clean":"2024-09-14T10:44:44.433906+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:44:44.433906+0000","last_undegraded":"2024-09-14T10:44:44.433906+0000","last_fullsized":"2024-09-14T10:44:44.433906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:01.351429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:53.304550+0000","last_change":"2024-09-14T10:44:07.310193+0000","last_active":"2024-09-14T10:44:53.304550+0000","last_peered":"2024-09-14T10:44:53.304550+0000","last_clean":"2024-09-14T10:44:53.304550+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:44:53.304550+0000","last_undegraded":"2024-09-14T10:44:53.304550+0000","last_fullsized":"2024-09-14T10:44:53.304550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:15.726650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.564329+0000","last_change":"2024-09-14T10:44:05.315829+0000","last_active":"2024-09-14T10:44:52.564329+0000","last_peered":"2024-09-14T10:44:52.564329+0000","last_clean":"2024-09-14T10:44:52.564329+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:44:52.564329+0000","last_undegraded":"2024-09-14T10:44:52.564329+0000","last_fullsized":"2024-09-14T10:44:52.564329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:08.412821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455297+0000","last_change":"2024-09-14T10:44:09.341355+0000","last_active":"2024-09-14T10:44:44.455297+0000","last_peered":"2024-09-14T10:44:44.455297+0000","last_clean":"2024-09-14T10:44:44.455297+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:44:44.455297+0000","last_undegraded":"2024-09-14T10:44:44.455297+0000","last_fullsized":"2024-09-14T10:44:44.455297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:06.338264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.631745+0000","last_change":"2024-09-14T10:44:11.349869+0000","last_active":"2024-09-14T10:46:18.631745+0000","last_peered":"2024-09-14T10:46:18.631745+0000","last_clean":"2024-09-14T10:46:18.631745+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:46:18.631745+0000","last_undegraded":"2024-09-14T10:46:18.631745+0000","last_fullsized":"2024-09-14T10:46:18.631745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891629+0000","last_change":"2024-09-14T10:44:13.359625+0000","last_active":"2024-09-14T10:47:21.891629+0000","last_peered":"2024-09-14T10:47:21.891629+0000","last_clean":"2024-09-14T10:47:21.891629+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:47:21.891629+0000","last_undegraded":"2024-09-14T10:47:21.891629+0000","last_fullsized":"2024-09-14T10:47:21.891629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.828035+0000","last_change":"2024-09-14T10:44:07.313431+0000","last_active":"2024-09-14T10:47:21.828035+0000","last_peered":"2024-09-14T10:47:21.828035+0000","last_clean":"2024-09-14T10:47:21.828035+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:47:21.828035+0000","last_undegraded":"2024-09-14T10:47:21.828035+0000","last_fullsized":"2024-09-14T10:47:21.828035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:28.832046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438420+0000","last_change":"2024-09-14T10:44:05.319480+0000","last_active":"2024-09-14T10:44:44.438420+0000","last_peered":"2024-09-14T10:44:44.438420+0000","last_clean":"2024-09-14T10:44:44.438420+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:44:44.438420+0000","last_undegraded":"2024-09-14T10:44:44.438420+0000","last_fullsized":"2024-09-14T10:44:44.438420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:30.352842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447310+0000","last_change":"2024-09-14T10:44:09.321893+0000","last_active":"2024-09-14T10:44:44.447310+0000","last_peered":"2024-09-14T10:44:44.447310+0000","last_clean":"2024-09-14T10:44:44.447310+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:44:44.447310+0000","last_undegraded":"2024-09-14T10:44:44.447310+0000","last_fullsized":"2024-09-14T10:44:44.447310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:04.728659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.644500+0000","last_change":"2024-09-14T10:44:11.342017+0000","last_active":"2024-09-14T10:46:18.644500+0000","last_peered":"2024-09-14T10:46:18.644500+0000","last_clean":"2024-09-14T10:46:18.644500+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:46:18.644500+0000","last_undegraded":"2024-09-14T10:46:18.644500+0000","last_fullsized":"2024-09-14T10:46:18.644500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:22.056805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441567+0000","last_change":"2024-09-14T10:44:13.359612+0000","last_active":"2024-09-14T10:44:44.441567+0000","last_peered":"2024-09-14T10:44:44.441567+0000","last_clean":"2024-09-14T10:44:44.441567+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:44:44.441567+0000","last_undegraded":"2024-09-14T10:44:44.441567+0000","last_fullsized":"2024-09-14T10:44:44.441567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:40.424615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.610998+0000","last_change":"2024-09-14T10:44:15.384957+0000","last_active":"2024-09-14T10:45:35.610998+0000","last_peered":"2024-09-14T10:45:35.610998+0000","last_clean":"2024-09-14T10:45:35.610998+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:45:35.610998+0000","last_undegraded":"2024-09-14T10:45:35.610998+0000","last_fullsized":"2024-09-14T10:45:35.610998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.508508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.822961+0000","last_change":"2024-09-14T10:44:07.297475+0000","last_active":"2024-09-14T10:47:21.822961+0000","last_peered":"2024-09-14T10:47:21.822961+0000","last_clean":"2024-09-14T10:47:21.822961+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:47:21.822961+0000","last_undegraded":"2024-09-14T10:47:21.822961+0000","last_fullsized":"2024-09-14T10:47:21.822961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:38.470916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.697456+0000","last_change":"2024-09-14T10:44:05.322339+0000","last_active":"2024-09-14T10:47:21.697456+0000","last_peered":"2024-09-14T10:47:21.697456+0000","last_clean":"2024-09-14T10:47:21.697456+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:21.697456+0000","last_undegraded":"2024-09-14T10:47:21.697456+0000","last_fullsized":"2024-09-14T10:47:21.697456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:19.073960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439715+0000","last_change":"2024-09-14T10:44:09.315832+0000","last_active":"2024-09-14T10:44:44.439715+0000","last_peered":"2024-09-14T10:44:44.439715+0000","last_clean":"2024-09-14T10:44:44.439715+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:44:44.439715+0000","last_undegraded":"2024-09-14T10:44:44.439715+0000","last_fullsized":"2024-09-14T10:44:44.439715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:23.486222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.446040+0000","last_change":"2024-09-14T10:44:11.361862+0000","last_active":"2024-09-14T10:46:29.446040+0000","last_peered":"2024-09-14T10:46:29.446040+0000","last_clean":"2024-09-14T10:46:29.446040+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:46:29.446040+0000","last_undegraded":"2024-09-14T10:46:29.446040+0000","last_fullsized":"2024-09-14T10:46:29.446040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:38.109362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441326+0000","last_change":"2024-09-14T10:44:13.371521+0000","last_active":"2024-09-14T10:44:44.441326+0000","last_peered":"2024-09-14T10:44:44.441326+0000","last_clean":"2024-09-14T10:44:44.441326+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:44:44.441326+0000","last_undegraded":"2024-09-14T10:44:44.441326+0000","last_fullsized":"2024-09-14T10:44:44.441326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:22.520305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:29.960732+0000","last_change":"2024-09-14T10:44:15.387133+0000","last_active":"2024-09-14T10:45:29.960732+0000","last_peered":"2024-09-14T10:45:29.960732+0000","last_clean":"2024-09-14T10:45:29.960732+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:45:29.960732+0000","last_undegraded":"2024-09-14T10:45:29.960732+0000","last_fullsized":"2024-09-14T10:45:29.960732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.599443+0000","last_change":"2024-09-14T10:44:07.313496+0000","last_active":"2024-09-14T10:45:35.599443+0000","last_peered":"2024-09-14T10:45:35.599443+0000","last_clean":"2024-09-14T10:45:35.599443+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:45:35.599443+0000","last_undegraded":"2024-09-14T10:45:35.599443+0000","last_fullsized":"2024-09-14T10:45:35.599443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:25.073228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.443374+0000","last_change":"2024-09-14T10:44:05.333550+0000","last_active":"2024-09-14T10:46:19.443374+0000","last_peered":"2024-09-14T10:46:19.443374+0000","last_clean":"2024-09-14T10:46:19.443374+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:46:19.443374+0000","last_undegraded":"2024-09-14T10:46:19.443374+0000","last_fullsized":"2024-09-14T10:46:19.443374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.200851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440400+0000","last_change":"2024-09-14T10:44:09.327528+0000","last_active":"2024-09-14T10:44:44.440400+0000","last_peered":"2024-09-14T10:44:44.440400+0000","last_clean":"2024-09-14T10:44:44.440400+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:44:44.440400+0000","last_undegraded":"2024-09-14T10:44:44.440400+0000","last_fullsized":"2024-09-14T10:44:44.440400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:16.948139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444158+0000","last_change":"2024-09-14T10:44:11.356327+0000","last_active":"2024-09-14T10:46:24.444158+0000","last_peered":"2024-09-14T10:46:24.444158+0000","last_clean":"2024-09-14T10:46:24.444158+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:46:24.444158+0000","last_undegraded":"2024-09-14T10:46:24.444158+0000","last_fullsized":"2024-09-14T10:46:24.444158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":377,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.091563+0000","last_change":"2024-09-14T10:44:13.372565+0000","last_active":"2024-09-14T10:47:22.091563+0000","last_peered":"2024-09-14T10:47:22.091563+0000","last_clean":"2024-09-14T10:47:22.091563+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:47:22.091563+0000","last_undegraded":"2024-09-14T10:47:22.091563+0000","last_fullsized":"2024-09-14T10:47:22.091563+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443179+0000","last_change":"2024-09-14T10:44:15.386780+0000","last_active":"2024-09-14T10:44:44.443179+0000","last_peered":"2024-09-14T10:44:44.443179+0000","last_clean":"2024-09-14T10:44:44.443179+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:44:44.443179+0000","last_undegraded":"2024-09-14T10:44:44.443179+0000","last_fullsized":"2024-09-14T10:44:44.443179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:51.818783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880056+0000","last_change":"2024-09-14T10:44:07.297382+0000","last_active":"2024-09-14T10:47:21.880056+0000","last_peered":"2024-09-14T10:47:21.880056+0000","last_clean":"2024-09-14T10:47:21.880056+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:47:21.880056+0000","last_undegraded":"2024-09-14T10:47:21.880056+0000","last_fullsized":"2024-09-14T10:47:21.880056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:08.033376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.580206+0000","last_change":"2024-09-14T10:44:05.318622+0000","last_active":"2024-09-14T10:44:52.580206+0000","last_peered":"2024-09-14T10:44:52.580206+0000","last_clean":"2024-09-14T10:44:52.580206+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:44:52.580206+0000","last_undegraded":"2024-09-14T10:44:52.580206+0000","last_fullsized":"2024-09-14T10:44:52.580206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:45.181544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439156+0000","last_change":"2024-09-14T10:44:09.325802+0000","last_active":"2024-09-14T10:44:44.439156+0000","last_peered":"2024-09-14T10:44:44.439156+0000","last_clean":"2024-09-14T10:44:44.439156+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:44:44.439156+0000","last_undegraded":"2024-09-14T10:44:44.439156+0000","last_fullsized":"2024-09-14T10:44:44.439156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:35.589836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444298+0000","last_change":"2024-09-14T10:44:11.356796+0000","last_active":"2024-09-14T10:46:24.444298+0000","last_peered":"2024-09-14T10:46:24.444298+0000","last_clean":"2024-09-14T10:46:24.444298+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:46:24.444298+0000","last_undegraded":"2024-09-14T10:46:24.444298+0000","last_fullsized":"2024-09-14T10:46:24.444298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:34.815043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439158+0000","last_change":"2024-09-14T10:44:13.361258+0000","last_active":"2024-09-14T10:44:44.439158+0000","last_peered":"2024-09-14T10:44:44.439158+0000","last_clean":"2024-09-14T10:44:44.439158+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:44:44.439158+0000","last_undegraded":"2024-09-14T10:44:44.439158+0000","last_fullsized":"2024-09-14T10:44:44.439158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.050143+0000","last_change":"2024-09-14T10:44:15.362513+0000","last_active":"2024-09-14T10:47:22.050143+0000","last_peered":"2024-09-14T10:47:22.050143+0000","last_clean":"2024-09-14T10:47:22.050143+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:47:22.050143+0000","last_undegraded":"2024-09-14T10:47:22.050143+0000","last_fullsized":"2024-09-14T10:47:22.050143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.899211+0000","last_change":"2024-09-14T10:44:44.460040+0000","last_active":"2024-09-14T10:47:21.899211+0000","last_peered":"2024-09-14T10:47:21.899211+0000","last_clean":"2024-09-14T10:47:21.899211+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:47:21.899211+0000","last_undegraded":"2024-09-14T10:47:21.899211+0000","last_fullsized":"2024-09-14T10:47:21.899211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:12.929749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441032+0000","last_change":"2024-09-14T10:44:05.316384+0000","last_active":"2024-09-14T10:44:44.441032+0000","last_peered":"2024-09-14T10:44:44.441032+0000","last_clean":"2024-09-14T10:44:44.441032+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:44:44.441032+0000","last_undegraded":"2024-09-14T10:44:44.441032+0000","last_fullsized":"2024-09-14T10:44:44.441032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.127894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438276+0000","last_change":"2024-09-14T10:44:09.321636+0000","last_active":"2024-09-14T10:44:44.438276+0000","last_peered":"2024-09-14T10:44:44.438276+0000","last_clean":"2024-09-14T10:44:44.438276+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:44:44.438276+0000","last_undegraded":"2024-09-14T10:44:44.438276+0000","last_fullsized":"2024-09-14T10:44:44.438276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:18.793271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.622728+0000","last_change":"2024-09-14T10:44:11.337843+0000","last_active":"2024-09-14T10:46:18.622728+0000","last_peered":"2024-09-14T10:46:18.622728+0000","last_clean":"2024-09-14T10:46:18.622728+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:46:18.622728+0000","last_undegraded":"2024-09-14T10:46:18.622728+0000","last_fullsized":"2024-09-14T10:46:18.622728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:07.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460124+0000","last_change":"2024-09-14T10:44:13.368817+0000","last_active":"2024-09-14T10:44:44.460124+0000","last_peered":"2024-09-14T10:44:44.460124+0000","last_clean":"2024-09-14T10:44:44.460124+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:44:44.460124+0000","last_undegraded":"2024-09-14T10:44:44.460124+0000","last_fullsized":"2024-09-14T10:44:44.460124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:51.609983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.281368+0000","last_change":"2024-09-14T10:44:15.388555+0000","last_active":"2024-09-14T10:46:18.281368+0000","last_peered":"2024-09-14T10:46:18.281368+0000","last_clean":"2024-09-14T10:46:18.281368+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:46:18.281368+0000","last_undegraded":"2024-09-14T10:46:18.281368+0000","last_fullsized":"2024-09-14T10:46:18.281368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:16.672301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720978+0000","last_change":"2024-09-14T10:44:07.313823+0000","last_active":"2024-09-14T10:47:21.720978+0000","last_peered":"2024-09-14T10:47:21.720978+0000","last_clean":"2024-09-14T10:47:21.720978+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:47:21.720978+0000","last_undegraded":"2024-09-14T10:47:21.720978+0000","last_fullsized":"2024-09-14T10:47:21.720978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:40.529838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453896+0000","last_change":"2024-09-14T10:44:05.324895+0000","last_active":"2024-09-14T10:44:44.453896+0000","last_peered":"2024-09-14T10:44:44.453896+0000","last_clean":"2024-09-14T10:44:44.453896+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:44:44.453896+0000","last_undegraded":"2024-09-14T10:44:44.453896+0000","last_fullsized":"2024-09-14T10:44:44.453896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:31.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440536+0000","last_change":"2024-09-14T10:44:09.325353+0000","last_active":"2024-09-14T10:44:44.440536+0000","last_peered":"2024-09-14T10:44:44.440536+0000","last_clean":"2024-09-14T10:44:44.440536+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:44:44.440536+0000","last_undegraded":"2024-09-14T10:44:44.440536+0000","last_fullsized":"2024-09-14T10:44:44.440536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:24.409253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.659927+0000","last_change":"2024-09-14T10:44:11.324938+0000","last_active":"2024-09-14T10:46:18.659927+0000","last_peered":"2024-09-14T10:46:18.659927+0000","last_clean":"2024-09-14T10:46:18.659927+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:46:18.659927+0000","last_undegraded":"2024-09-14T10:46:18.659927+0000","last_fullsized":"2024-09-14T10:46:18.659927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:38.232131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":411,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.059218+0000","last_change":"2024-09-14T10:44:13.364819+0000","last_active":"2024-09-14T10:47:22.059218+0000","last_peered":"2024-09-14T10:47:22.059218+0000","last_clean":"2024-09-14T10:47:22.059218+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:47:22.059218+0000","last_undegraded":"2024-09-14T10:47:22.059218+0000","last_fullsized":"2024-09-14T10:47:22.059218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:29.703105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:22.442035+0000","last_change":"2024-09-14T10:44:15.389692+0000","last_active":"2024-09-14T10:46:22.442035+0000","last_peered":"2024-09-14T10:46:22.442035+0000","last_clean":"2024-09-14T10:46:22.442035+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:46:22.442035+0000","last_undegraded":"2024-09-14T10:46:22.442035+0000","last_fullsized":"2024-09-14T10:46:22.442035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699712+0000","last_change":"2024-09-14T10:44:07.315452+0000","last_active":"2024-09-14T10:46:20.699712+0000","last_peered":"2024-09-14T10:46:20.699712+0000","last_clean":"2024-09-14T10:46:20.699712+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:46:20.699712+0000","last_undegraded":"2024-09-14T10:46:20.699712+0000","last_fullsized":"2024-09-14T10:46:20.699712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.769639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451555+0000","last_change":"2024-09-14T10:44:05.323413+0000","last_active":"2024-09-14T10:44:44.451555+0000","last_peered":"2024-09-14T10:44:44.451555+0000","last_clean":"2024-09-14T10:44:44.451555+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:44:44.451555+0000","last_undegraded":"2024-09-14T10:44:44.451555+0000","last_fullsized":"2024-09-14T10:44:44.451555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:47.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.083604+0000","last_change":"2024-09-14T10:44:09.321263+0000","last_active":"2024-09-14T10:46:20.083604+0000","last_peered":"2024-09-14T10:46:20.083604+0000","last_clean":"2024-09-14T10:46:20.083604+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:46:20.083604+0000","last_undegraded":"2024-09-14T10:46:20.083604+0000","last_fullsized":"2024-09-14T10:46:20.083604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:48.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455520+0000","last_change":"2024-09-14T10:44:11.365421+0000","last_active":"2024-09-14T10:44:44.455520+0000","last_peered":"2024-09-14T10:44:44.455520+0000","last_clean":"2024-09-14T10:44:44.455520+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:44:44.455520+0000","last_undegraded":"2024-09-14T10:44:44.455520+0000","last_fullsized":"2024-09-14T10:44:44.455520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:56.792327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":501,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.997414+0000","last_change":"2024-09-14T10:44:13.362574+0000","last_active":"2024-09-14T10:47:21.997414+0000","last_peered":"2024-09-14T10:47:21.997414+0000","last_clean":"2024-09-14T10:47:21.997414+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:47:21.997414+0000","last_undegraded":"2024-09-14T10:47:21.997414+0000","last_fullsized":"2024-09-14T10:47:21.997414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.234975+0000","last_change":"2024-09-14T10:44:15.376191+0000","last_active":"2024-09-14T10:46:20.234975+0000","last_peered":"2024-09-14T10:46:20.234975+0000","last_clean":"2024-09-14T10:46:20.234975+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:46:20.234975+0000","last_undegraded":"2024-09-14T10:46:20.234975+0000","last_fullsized":"2024-09-14T10:46:20.234975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:57.673158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880744+0000","last_change":"2024-09-14T10:44:07.321079+0000","last_active":"2024-09-14T10:47:21.880744+0000","last_peered":"2024-09-14T10:47:21.880744+0000","last_clean":"2024-09-14T10:47:21.880744+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:47:21.880744+0000","last_undegraded":"2024-09-14T10:47:21.880744+0000","last_fullsized":"2024-09-14T10:47:21.880744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:01.445738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441663+0000","last_change":"2024-09-14T10:44:05.327190+0000","last_active":"2024-09-14T10:44:44.441663+0000","last_peered":"2024-09-14T10:44:44.441663+0000","last_clean":"2024-09-14T10:44:44.441663+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:44:44.441663+0000","last_undegraded":"2024-09-14T10:44:44.441663+0000","last_fullsized":"2024-09-14T10:44:44.441663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:46.537438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457361+0000","last_change":"2024-09-14T10:44:09.342479+0000","last_active":"2024-09-14T10:44:44.457361+0000","last_peered":"2024-09-14T10:44:44.457361+0000","last_clean":"2024-09-14T10:44:44.457361+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:44:44.457361+0000","last_undegraded":"2024-09-14T10:44:44.457361+0000","last_fullsized":"2024-09-14T10:44:44.457361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:27.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.640584+0000","last_change":"2024-09-14T10:44:11.332997+0000","last_active":"2024-09-14T10:46:18.640584+0000","last_peered":"2024-09-14T10:46:18.640584+0000","last_clean":"2024-09-14T10:46:18.640584+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:46:18.640584+0000","last_undegraded":"2024-09-14T10:46:18.640584+0000","last_fullsized":"2024-09-14T10:46:18.640584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:53.814557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436642+0000","last_change":"2024-09-14T10:44:13.374235+0000","last_active":"2024-09-14T10:44:44.436642+0000","last_peered":"2024-09-14T10:44:44.436642+0000","last_clean":"2024-09-14T10:44:44.436642+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:44:44.436642+0000","last_undegraded":"2024-09-14T10:44:44.436642+0000","last_fullsized":"2024-09-14T10:44:44.436642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:45.457582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.953427+0000","last_change":"2024-09-14T10:44:15.378896+0000","last_active":"2024-09-14T10:47:21.953427+0000","last_peered":"2024-09-14T10:47:21.953427+0000","last_clean":"2024-09-14T10:47:21.953427+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:47:21.953427+0000","last_undegraded":"2024-09-14T10:47:21.953427+0000","last_fullsized":"2024-09-14T10:47:21.953427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:41.435534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'13","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.402163+0000","last_change":"2024-09-14T10:44:07.313348+0000","last_active":"2024-09-14T10:47:21.402163+0000","last_peered":"2024-09-14T10:47:21.402163+0000","last_clean":"2024-09-14T10:47:21.402163+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:47:21.402163+0000","last_undegraded":"2024-09-14T10:47:21.402163+0000","last_fullsized":"2024-09-14T10:47:21.402163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:03.002533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436810+0000","last_change":"2024-09-14T10:43:50.584788+0000","last_active":"2024-09-14T10:44:44.436810+0000","last_peered":"2024-09-14T10:44:44.436810+0000","last_clean":"2024-09-14T10:44:44.436810+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:44:44.436810+0000","last_undegraded":"2024-09-14T10:44:44.436810+0000","last_fullsized":"2024-09-14T10:44:44.436810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_clean_scrub_stamp":"2024-09-14T10:43:49.418142+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:43.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455044+0000","last_change":"2024-09-14T10:43:57.466810+0000","last_active":"2024-09-14T10:44:44.455044+0000","last_peered":"2024-09-14T10:44:44.455044+0000","last_clean":"2024-09-14T10:44:44.455044+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:44:44.455044+0000","last_undegraded":"2024-09-14T10:44:44.455044+0000","last_fullsized":"2024-09-14T10:44:44.455044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:33.230423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.324672+0000","last_change":"2024-09-14T10:44:05.335883+0000","last_active":"2024-09-14T10:47:21.324672+0000","last_peered":"2024-09-14T10:47:21.324672+0000","last_clean":"2024-09-14T10:47:21.324672+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:47:21.324672+0000","last_undegraded":"2024-09-14T10:47:21.324672+0000","last_fullsized":"2024-09-14T10:47:21.324672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:49.876374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.467078+0000","last_change":"2024-09-14T10:44:44.463751+0000","last_active":"2024-09-14T10:44:44.467078+0000","last_peered":"2024-09-14T10:44:44.467078+0000","last_clean":"2024-09-14T10:44:44.467078+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:44:44.467078+0000","last_undegraded":"2024-09-14T10:44:44.467078+0000","last_fullsized":"2024-09-14T10:44:44.467078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.700138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'77","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.655935+0000","last_change":"2024-09-14T10:44:11.357369+0000","last_active":"2024-09-14T10:46:18.655935+0000","last_peered":"2024-09-14T10:46:18.655935+0000","last_clean":"2024-09-14T10:46:18.655935+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:46:18.655935+0000","last_undegraded":"2024-09-14T10:46:18.655935+0000","last_fullsized":"2024-09-14T10:46:18.655935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:20.733108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443564+0000","last_change":"2024-09-14T10:44:13.372619+0000","last_active":"2024-09-14T10:44:44.443564+0000","last_peered":"2024-09-14T10:44:44.443564+0000","last_clean":"2024-09-14T10:44:44.443564+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:44:44.443564+0000","last_undegraded":"2024-09-14T10:44:44.443564+0000","last_fullsized":"2024-09-14T10:44:44.443564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.209093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.907510+0000","last_change":"2024-09-14T10:44:15.380614+0000","last_active":"2024-09-14T10:47:21.907510+0000","last_peered":"2024-09-14T10:47:21.907510+0000","last_clean":"2024-09-14T10:47:21.907510+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:47:21.907510+0000","last_undegraded":"2024-09-14T10:47:21.907510+0000","last_fullsized":"2024-09-14T10:47:21.907510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:58.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825057+0000","last_change":"2024-09-14T10:44:07.316776+0000","last_active":"2024-09-14T10:47:21.825057+0000","last_peered":"2024-09-14T10:47:21.825057+0000","last_clean":"2024-09-14T10:47:21.825057+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:47:21.825057+0000","last_undegraded":"2024-09-14T10:47:21.825057+0000","last_fullsized":"2024-09-14T10:47:21.825057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.514426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440485+0000","last_change":"2024-09-14T10:43:57.465589+0000","last_active":"2024-09-14T10:44:44.440485+0000","last_peered":"2024-09-14T10:44:44.440485+0000","last_clean":"2024-09-14T10:44:44.440485+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:44:44.440485+0000","last_undegraded":"2024-09-14T10:44:44.440485+0000","last_fullsized":"2024-09-14T10:44:44.440485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.853418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:12.439603+0000","last_change":"2024-09-14T10:44:05.313733+0000","last_active":"2024-09-14T10:46:12.439603+0000","last_peered":"2024-09-14T10:46:12.439603+0000","last_clean":"2024-09-14T10:46:12.439603+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:46:12.439603+0000","last_undegraded":"2024-09-14T10:46:12.439603+0000","last_fullsized":"2024-09-14T10:46:12.439603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:29.804432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460368+0000","last_change":"2024-09-14T10:44:09.341477+0000","last_active":"2024-09-14T10:44:44.460368+0000","last_peered":"2024-09-14T10:44:44.460368+0000","last_clean":"2024-09-14T10:44:44.460368+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:44:44.460368+0000","last_undegraded":"2024-09-14T10:44:44.460368+0000","last_fullsized":"2024-09-14T10:44:44.460368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:45.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'273","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566682+0000","last_change":"2024-09-14T10:44:11.347623+0000","last_active":"2024-09-14T10:47:19.566682+0000","last_peered":"2024-09-14T10:47:19.566682+0000","last_clean":"2024-09-14T10:47:19.566682+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:47:19.566682+0000","last_undegraded":"2024-09-14T10:47:19.566682+0000","last_fullsized":"2024-09-14T10:47:19.566682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:58.040485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454445+0000","last_change":"2024-09-14T10:44:13.368580+0000","last_active":"2024-09-14T10:44:44.454445+0000","last_peered":"2024-09-14T10:44:44.454445+0000","last_clean":"2024-09-14T10:44:44.454445+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:44:44.454445+0000","last_undegraded":"2024-09-14T10:44:44.454445+0000","last_fullsized":"2024-09-14T10:44:44.454445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:45.985218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.604538+0000","last_change":"2024-09-14T10:44:15.392131+0000","last_active":"2024-09-14T10:45:35.604538+0000","last_peered":"2024-09-14T10:45:35.604538+0000","last_clean":"2024-09-14T10:45:35.604538+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:45:35.604538+0000","last_undegraded":"2024-09-14T10:45:35.604538+0000","last_fullsized":"2024-09-14T10:45:35.604538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:37.610953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.441166+0000","last_change":"2024-09-14T10:44:07.302744+0000","last_active":"2024-09-14T10:46:17.441166+0000","last_peered":"2024-09-14T10:46:17.441166+0000","last_clean":"2024-09-14T10:46:17.441166+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:46:17.441166+0000","last_undegraded":"2024-09-14T10:46:17.441166+0000","last_fullsized":"2024-09-14T10:46:17.441166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:44.363143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434243+0000","last_change":"2024-09-14T10:43:57.622013+0000","last_active":"2024-09-14T10:44:44.434243+0000","last_peered":"2024-09-14T10:44:44.434243+0000","last_clean":"2024-09-14T10:44:44.434243+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:44:44.434243+0000","last_undegraded":"2024-09-14T10:44:44.434243+0000","last_fullsized":"2024-09-14T10:44:44.434243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438450+0000","last_change":"2024-09-14T10:44:05.314187+0000","last_active":"2024-09-14T10:44:44.438450+0000","last_peered":"2024-09-14T10:44:44.438450+0000","last_clean":"2024-09-14T10:44:44.438450+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:44:44.438450+0000","last_undegraded":"2024-09-14T10:44:44.438450+0000","last_fullsized":"2024-09-14T10:44:44.438450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.919125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438356+0000","last_change":"2024-09-14T10:44:09.316504+0000","last_active":"2024-09-14T10:44:44.438356+0000","last_peered":"2024-09-14T10:44:44.438356+0000","last_clean":"2024-09-14T10:44:44.438356+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:44:44.438356+0000","last_undegraded":"2024-09-14T10:44:44.438356+0000","last_fullsized":"2024-09-14T10:44:44.438356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.594212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566236+0000","last_change":"2024-09-14T10:44:11.340123+0000","last_active":"2024-09-14T10:47:19.566236+0000","last_peered":"2024-09-14T10:47:19.566236+0000","last_clean":"2024-09-14T10:47:19.566236+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:47:19.566236+0000","last_undegraded":"2024-09-14T10:47:19.566236+0000","last_fullsized":"2024-09-14T10:47:19.566236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:55.570468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440972+0000","last_change":"2024-09-14T10:44:13.372401+0000","last_active":"2024-09-14T10:44:44.440972+0000","last_peered":"2024-09-14T10:44:44.440972+0000","last_clean":"2024-09-14T10:44:44.440972+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:44:44.440972+0000","last_undegraded":"2024-09-14T10:44:44.440972+0000","last_fullsized":"2024-09-14T10:44:44.440972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:48.551523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451974+0000","last_change":"2024-09-14T10:44:15.379368+0000","last_active":"2024-09-14T10:44:44.451974+0000","last_peered":"2024-09-14T10:44:44.451974+0000","last_clean":"2024-09-14T10:44:44.451974+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:44:44.451974+0000","last_undegraded":"2024-09-14T10:44:44.451974+0000","last_fullsized":"2024-09-14T10:44:44.451974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:11.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.510872+0000","last_change":"2024-09-14T10:44:07.307515+0000","last_active":"2024-09-14T10:46:16.510872+0000","last_peered":"2024-09-14T10:46:16.510872+0000","last_clean":"2024-09-14T10:46:16.510872+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:46:16.510872+0000","last_undegraded":"2024-09-14T10:46:16.510872+0000","last_fullsized":"2024-09-14T10:46:16.510872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:10.397230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452886+0000","last_change":"2024-09-14T10:43:57.466709+0000","last_active":"2024-09-14T10:44:44.452886+0000","last_peered":"2024-09-14T10:44:44.452886+0000","last_clean":"2024-09-14T10:44:44.452886+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:44:44.452886+0000","last_undegraded":"2024-09-14T10:44:44.452886+0000","last_fullsized":"2024-09-14T10:44:44.452886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:59.740099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.379318+0000","last_change":"2024-09-14T10:44:05.316730+0000","last_active":"2024-09-14T10:46:20.379318+0000","last_peered":"2024-09-14T10:46:20.379318+0000","last_clean":"2024-09-14T10:46:20.379318+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:46:20.379318+0000","last_undegraded":"2024-09-14T10:46:20.379318+0000","last_fullsized":"2024-09-14T10:46:20.379318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:52.869387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444568+0000","last_change":"2024-09-14T10:44:09.322206+0000","last_active":"2024-09-14T10:44:44.444568+0000","last_peered":"2024-09-14T10:44:44.444568+0000","last_clean":"2024-09-14T10:44:44.444568+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:44:44.444568+0000","last_undegraded":"2024-09-14T10:44:44.444568+0000","last_fullsized":"2024-09-14T10:44:44.444568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:42.879923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.719618+0000","last_change":"2024-09-14T10:44:11.362466+0000","last_active":"2024-09-14T10:47:20.719618+0000","last_peered":"2024-09-14T10:47:20.719618+0000","last_clean":"2024-09-14T10:47:20.719618+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:47:20.719618+0000","last_undegraded":"2024-09-14T10:47:20.719618+0000","last_fullsized":"2024-09-14T10:47:20.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.095069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460591+0000","last_change":"2024-09-14T10:44:13.368952+0000","last_active":"2024-09-14T10:44:44.460591+0000","last_peered":"2024-09-14T10:44:44.460591+0000","last_clean":"2024-09-14T10:44:44.460591+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:44:44.460591+0000","last_undegraded":"2024-09-14T10:44:44.460591+0000","last_fullsized":"2024-09-14T10:44:44.460591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.525259+0000","last_change":"2024-09-14T10:44:15.382665+0000","last_active":"2024-09-14T10:47:21.525259+0000","last_peered":"2024-09-14T10:47:21.525259+0000","last_clean":"2024-09-14T10:47:21.525259+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:47:21.525259+0000","last_undegraded":"2024-09-14T10:47:21.525259+0000","last_fullsized":"2024-09-14T10:47:21.525259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:18.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879962+0000","last_change":"2024-09-14T10:44:07.314873+0000","last_active":"2024-09-14T10:47:21.879962+0000","last_peered":"2024-09-14T10:47:21.879962+0000","last_clean":"2024-09-14T10:47:21.879962+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:47:21.879962+0000","last_undegraded":"2024-09-14T10:47:21.879962+0000","last_fullsized":"2024-09-14T10:47:21.879962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:56.862937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.805694+0000","last_change":"2024-09-14T10:44:05.319446+0000","last_active":"2024-09-14T10:44:51.805694+0000","last_peered":"2024-09-14T10:44:51.805694+0000","last_clean":"2024-09-14T10:44:51.805694+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:44:51.805694+0000","last_undegraded":"2024-09-14T10:44:51.805694+0000","last_fullsized":"2024-09-14T10:44:51.805694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:15.462869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440965+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:44:44.440965+0000","last_peered":"2024-09-14T10:44:44.440965+0000","last_clean":"2024-09-14T10:44:44.440965+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:44:44.440965+0000","last_undegraded":"2024-09-14T10:44:44.440965+0000","last_fullsized":"2024-09-14T10:44:44.440965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.379980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:50.451391+0000","last_change":"2024-09-14T10:44:44.455451+0000","last_active":"2024-09-14T10:46:50.451391+0000","last_peered":"2024-09-14T10:46:50.451391+0000","last_clean":"2024-09-14T10:46:50.451391+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:46:50.451391+0000","last_undegraded":"2024-09-14T10:46:50.451391+0000","last_fullsized":"2024-09-14T10:46:50.451391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:57.298667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'62","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.907486+0000","last_change":"2024-09-14T10:44:11.326152+0000","last_active":"2024-09-14T10:47:21.907486+0000","last_peered":"2024-09-14T10:47:21.907486+0000","last_clean":"2024-09-14T10:47:21.907486+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:47:21.907486+0000","last_undegraded":"2024-09-14T10:47:21.907486+0000","last_fullsized":"2024-09-14T10:47:21.907486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:41.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432731+0000","last_change":"2024-09-14T10:44:13.362954+0000","last_active":"2024-09-14T10:44:44.432731+0000","last_peered":"2024-09-14T10:44:44.432731+0000","last_clean":"2024-09-14T10:44:44.432731+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:44:44.432731+0000","last_undegraded":"2024-09-14T10:44:44.432731+0000","last_fullsized":"2024-09-14T10:44:44.432731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.191871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.551637+0000","last_change":"2024-09-14T10:44:15.380020+0000","last_active":"2024-09-14T10:46:20.551637+0000","last_peered":"2024-09-14T10:46:20.551637+0000","last_clean":"2024-09-14T10:46:20.551637+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:46:20.551637+0000","last_undegraded":"2024-09-14T10:46:20.551637+0000","last_fullsized":"2024-09-14T10:46:20.551637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:17.206749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.508788+0000","last_change":"2024-09-14T10:44:07.319078+0000","last_active":"2024-09-14T10:46:16.508788+0000","last_peered":"2024-09-14T10:46:16.508788+0000","last_clean":"2024-09-14T10:46:16.508788+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:46:16.508788+0000","last_undegraded":"2024-09-14T10:46:16.508788+0000","last_fullsized":"2024-09-14T10:46:16.508788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:20.214122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.692204+0000","last_change":"2024-09-14T10:44:05.323716+0000","last_active":"2024-09-14T10:47:21.692204+0000","last_peered":"2024-09-14T10:47:21.692204+0000","last_clean":"2024-09-14T10:47:21.692204+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:21.692204+0000","last_undegraded":"2024-09-14T10:47:21.692204+0000","last_fullsized":"2024-09-14T10:47:21.692204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:48.326362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456259+0000","last_change":"2024-09-14T10:43:57.465338+0000","last_active":"2024-09-14T10:44:44.456259+0000","last_peered":"2024-09-14T10:44:44.456259+0000","last_clean":"2024-09-14T10:44:44.456259+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:44:44.456259+0000","last_undegraded":"2024-09-14T10:44:44.456259+0000","last_fullsized":"2024-09-14T10:44:44.456259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.995453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450895+0000","last_change":"2024-09-14T10:44:09.332697+0000","last_active":"2024-09-14T10:44:44.450895+0000","last_peered":"2024-09-14T10:44:44.450895+0000","last_clean":"2024-09-14T10:44:44.450895+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:44:44.450895+0000","last_undegraded":"2024-09-14T10:44:44.450895+0000","last_fullsized":"2024-09-14T10:44:44.450895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:36.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451768+0000","last_change":"2024-09-14T10:44:11.338828+0000","last_active":"2024-09-14T10:44:44.451768+0000","last_peered":"2024-09-14T10:44:44.451768+0000","last_clean":"2024-09-14T10:44:44.451768+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:44:44.451768+0000","last_undegraded":"2024-09-14T10:44:44.451768+0000","last_fullsized":"2024-09-14T10:44:44.451768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:03.825369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.565979+0000","last_change":"2024-09-14T10:44:13.353577+0000","last_active":"2024-09-14T10:47:19.565979+0000","last_peered":"2024-09-14T10:47:19.565979+0000","last_clean":"2024-09-14T10:47:19.565979+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:47:19.565979+0000","last_undegraded":"2024-09-14T10:47:19.565979+0000","last_fullsized":"2024-09-14T10:47:19.565979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.459796+0000","last_change":"2024-09-14T10:44:15.371433+0000","last_active":"2024-09-14T10:44:44.459796+0000","last_peered":"2024-09-14T10:44:44.459796+0000","last_clean":"2024-09-14T10:44:44.459796+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:44:44.459796+0000","last_undegraded":"2024-09-14T10:44:44.459796+0000","last_fullsized":"2024-09-14T10:44:44.459796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:12.672256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.719980+0000","last_change":"2024-09-14T10:44:07.313506+0000","last_active":"2024-09-14T10:47:21.719980+0000","last_peered":"2024-09-14T10:47:21.719980+0000","last_clean":"2024-09-14T10:47:21.719980+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:47:21.719980+0000","last_undegraded":"2024-09-14T10:47:21.719980+0000","last_fullsized":"2024-09-14T10:47:21.719980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:57.847452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.461911+0000","last_change":"2024-09-14T10:44:05.318013+0000","last_active":"2024-09-14T10:44:44.461911+0000","last_peered":"2024-09-14T10:44:44.461911+0000","last_clean":"2024-09-14T10:44:44.461911+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:44:44.461911+0000","last_undegraded":"2024-09-14T10:44:44.461911+0000","last_fullsized":"2024-09-14T10:44:44.461911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:54.849665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444188+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:44:44.444188+0000","last_peered":"2024-09-14T10:44:44.444188+0000","last_clean":"2024-09-14T10:44:44.444188+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:44:44.444188+0000","last_undegraded":"2024-09-14T10:44:44.444188+0000","last_fullsized":"2024-09-14T10:44:44.444188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.947188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442798+0000","last_change":"2024-09-14T10:44:09.334472+0000","last_active":"2024-09-14T10:44:44.442798+0000","last_peered":"2024-09-14T10:44:44.442798+0000","last_clean":"2024-09-14T10:44:44.442798+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:44:44.442798+0000","last_undegraded":"2024-09-14T10:44:44.442798+0000","last_fullsized":"2024-09-14T10:44:44.442798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:18.491213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453618+0000","last_change":"2024-09-14T10:44:11.360311+0000","last_active":"2024-09-14T10:44:44.453618+0000","last_peered":"2024-09-14T10:44:44.453618+0000","last_clean":"2024-09-14T10:44:44.453618+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:44:44.453618+0000","last_undegraded":"2024-09-14T10:44:44.453618+0000","last_fullsized":"2024-09-14T10:44:44.453618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:18.907361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":419,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.052270+0000","last_change":"2024-09-14T10:44:13.349515+0000","last_active":"2024-09-14T10:47:22.052270+0000","last_peered":"2024-09-14T10:47:22.052270+0000","last_clean":"2024-09-14T10:47:22.052270+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:47:22.052270+0000","last_undegraded":"2024-09-14T10:47:22.052270+0000","last_fullsized":"2024-09-14T10:47:22.052270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.867987+0000","last_change":"2024-09-14T10:44:15.380474+0000","last_active":"2024-09-14T10:45:35.867987+0000","last_peered":"2024-09-14T10:45:35.867987+0000","last_clean":"2024-09-14T10:45:35.867987+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:45:35.867987+0000","last_undegraded":"2024-09-14T10:45:35.867987+0000","last_fullsized":"2024-09-14T10:45:35.867987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:15.535271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433094+0000","last_change":"2024-09-14T10:44:07.314957+0000","last_active":"2024-09-14T10:44:44.433094+0000","last_peered":"2024-09-14T10:44:44.433094+0000","last_clean":"2024-09-14T10:44:44.433094+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:44:44.433094+0000","last_undegraded":"2024-09-14T10:44:44.433094+0000","last_fullsized":"2024-09-14T10:44:44.433094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.570663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.440796+0000","last_change":"2024-09-14T10:44:05.322609+0000","last_active":"2024-09-14T10:46:14.440796+0000","last_peered":"2024-09-14T10:46:14.440796+0000","last_clean":"2024-09-14T10:46:14.440796+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:46:14.440796+0000","last_undegraded":"2024-09-14T10:46:14.440796+0000","last_fullsized":"2024-09-14T10:46:14.440796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:49.133099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.461469+0000","last_change":"2024-09-14T10:43:57.467362+0000","last_active":"2024-09-14T10:44:44.461469+0000","last_peered":"2024-09-14T10:44:44.461469+0000","last_clean":"2024-09-14T10:44:44.461469+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:44:44.461469+0000","last_undegraded":"2024-09-14T10:44:44.461469+0000","last_fullsized":"2024-09-14T10:44:44.461469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.939647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440109+0000","last_change":"2024-09-14T10:44:09.335319+0000","last_active":"2024-09-14T10:44:44.440109+0000","last_peered":"2024-09-14T10:44:44.440109+0000","last_clean":"2024-09-14T10:44:44.440109+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:44:44.440109+0000","last_undegraded":"2024-09-14T10:44:44.440109+0000","last_fullsized":"2024-09-14T10:44:44.440109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:44.522431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'83","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.628711+0000","last_change":"2024-09-14T10:44:11.359272+0000","last_active":"2024-09-14T10:46:18.628711+0000","last_peered":"2024-09-14T10:46:18.628711+0000","last_clean":"2024-09-14T10:46:18.628711+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:46:18.628711+0000","last_undegraded":"2024-09-14T10:46:18.628711+0000","last_fullsized":"2024-09-14T10:46:18.628711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438836+0000","last_change":"2024-09-14T10:44:13.361050+0000","last_active":"2024-09-14T10:44:44.438836+0000","last_peered":"2024-09-14T10:44:44.438836+0000","last_clean":"2024-09-14T10:44:44.438836+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:44:44.438836+0000","last_undegraded":"2024-09-14T10:44:44.438836+0000","last_fullsized":"2024-09-14T10:44:44.438836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.597367+0000","last_change":"2024-09-14T10:44:15.376175+0000","last_active":"2024-09-14T10:44:52.597367+0000","last_peered":"2024-09-14T10:44:52.597367+0000","last_clean":"2024-09-14T10:44:52.597367+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:44:52.597367+0000","last_undegraded":"2024-09-14T10:44:52.597367+0000","last_fullsized":"2024-09-14T10:44:52.597367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.409508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.990797+0000","last_change":"2024-09-14T10:44:15.381865+0000","last_active":"2024-09-14T10:47:21.990797+0000","last_peered":"2024-09-14T10:47:21.990797+0000","last_clean":"2024-09-14T10:47:21.990797+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:47:21.990797+0000","last_undegraded":"2024-09-14T10:47:21.990797+0000","last_fullsized":"2024-09-14T10:47:21.990797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:55.550930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.520688+0000","last_change":"2024-09-14T10:44:07.314638+0000","last_active":"2024-09-14T10:47:21.520688+0000","last_peered":"2024-09-14T10:47:21.520688+0000","last_clean":"2024-09-14T10:47:21.520688+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:47:21.520688+0000","last_undegraded":"2024-09-14T10:47:21.520688+0000","last_fullsized":"2024-09-14T10:47:21.520688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:49.986512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444504+0000","last_change":"2024-09-14T10:44:05.315040+0000","last_active":"2024-09-14T10:46:24.444504+0000","last_peered":"2024-09-14T10:46:24.444504+0000","last_clean":"2024-09-14T10:46:24.444504+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:46:24.444504+0000","last_undegraded":"2024-09-14T10:46:24.444504+0000","last_fullsized":"2024-09-14T10:46:24.444504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:41.172912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:02.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.645619+0000","last_change":"2024-09-14T10:44:11.356682+0000","last_active":"2024-09-14T10:46:18.645619+0000","last_peered":"2024-09-14T10:46:18.645619+0000","last_clean":"2024-09-14T10:46:18.645619+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:46:18.645619+0000","last_undegraded":"2024-09-14T10:46:18.645619+0000","last_fullsized":"2024-09-14T10:46:18.645619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:36.580622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442491+0000","last_change":"2024-09-14T10:44:13.370490+0000","last_active":"2024-09-14T10:44:44.442491+0000","last_peered":"2024-09-14T10:44:44.442491+0000","last_clean":"2024-09-14T10:44:44.442491+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:44:44.442491+0000","last_undegraded":"2024-09-14T10:44:44.442491+0000","last_fullsized":"2024-09-14T10:44:44.442491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:34.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.285933+0000","last_change":"2024-09-14T10:44:15.361905+0000","last_active":"2024-09-14T10:46:18.285933+0000","last_peered":"2024-09-14T10:46:18.285933+0000","last_clean":"2024-09-14T10:46:18.285933+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:46:18.285933+0000","last_undegraded":"2024-09-14T10:46:18.285933+0000","last_fullsized":"2024-09-14T10:46:18.285933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:48.673933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699026+0000","last_change":"2024-09-14T10:44:44.460104+0000","last_active":"2024-09-14T10:46:20.699026+0000","last_peered":"2024-09-14T10:46:20.699026+0000","last_clean":"2024-09-14T10:46:20.699026+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:46:20.699026+0000","last_undegraded":"2024-09-14T10:46:20.699026+0000","last_fullsized":"2024-09-14T10:46:20.699026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:13.899780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.708947+0000","last_change":"2024-09-14T10:44:05.320160+0000","last_active":"2024-09-14T10:44:50.708947+0000","last_peered":"2024-09-14T10:44:50.708947+0000","last_clean":"2024-09-14T10:44:50.708947+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:44:50.708947+0000","last_undegraded":"2024-09-14T10:44:50.708947+0000","last_fullsized":"2024-09-14T10:44:50.708947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:09.975430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.464537+0000","last_change":"2024-09-14T10:44:44.463214+0000","last_active":"2024-09-14T10:44:44.464537+0000","last_peered":"2024-09-14T10:44:44.464537+0000","last_clean":"2024-09-14T10:44:44.464537+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:44:44.464537+0000","last_undegraded":"2024-09-14T10:44:44.464537+0000","last_fullsized":"2024-09-14T10:44:44.464537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:34.009805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.732910+0000","last_change":"2024-09-14T10:44:11.323585+0000","last_active":"2024-09-14T10:47:20.732910+0000","last_peered":"2024-09-14T10:47:20.732910+0000","last_clean":"2024-09-14T10:47:20.732910+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:47:20.732910+0000","last_undegraded":"2024-09-14T10:47:20.732910+0000","last_fullsized":"2024-09-14T10:47:20.732910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:36.664992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434000+0000","last_change":"2024-09-14T10:44:13.371900+0000","last_active":"2024-09-14T10:44:44.434000+0000","last_peered":"2024-09-14T10:44:44.434000+0000","last_clean":"2024-09-14T10:44:44.434000+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:44:44.434000+0000","last_undegraded":"2024-09-14T10:44:44.434000+0000","last_fullsized":"2024-09-14T10:44:44.434000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:29.727463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440980+0000","last_change":"2024-09-14T10:44:15.386483+0000","last_active":"2024-09-14T10:44:44.440980+0000","last_peered":"2024-09-14T10:44:44.440980+0000","last_clean":"2024-09-14T10:44:44.440980+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:44:44.440980+0000","last_undegraded":"2024-09-14T10:44:44.440980+0000","last_fullsized":"2024-09-14T10:44:44.440980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.723831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.523634+0000","last_change":"2024-09-14T10:44:07.316643+0000","last_active":"2024-09-14T10:47:21.523634+0000","last_peered":"2024-09-14T10:47:21.523634+0000","last_clean":"2024-09-14T10:47:21.523634+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:47:21.523634+0000","last_undegraded":"2024-09-14T10:47:21.523634+0000","last_fullsized":"2024-09-14T10:47:21.523634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:51.889645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439378+0000","last_change":"2024-09-14T10:44:05.322513+0000","last_active":"2024-09-14T10:44:44.439378+0000","last_peered":"2024-09-14T10:44:44.439378+0000","last_clean":"2024-09-14T10:44:44.439378+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:44:44.439378+0000","last_undegraded":"2024-09-14T10:44:44.439378+0000","last_fullsized":"2024-09-14T10:44:44.439378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:39.441568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432334+0000","last_change":"2024-09-14T10:44:09.318542+0000","last_active":"2024-09-14T10:44:44.432334+0000","last_peered":"2024-09-14T10:44:44.432334+0000","last_clean":"2024-09-14T10:44:44.432334+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:44:44.432334+0000","last_undegraded":"2024-09-14T10:44:44.432334+0000","last_fullsized":"2024-09-14T10:44:44.432334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:29.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.823759+0000","last_change":"2024-09-14T10:44:11.336124+0000","last_active":"2024-09-14T10:47:20.823759+0000","last_peered":"2024-09-14T10:47:20.823759+0000","last_clean":"2024-09-14T10:47:20.823759+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:47:20.823759+0000","last_undegraded":"2024-09-14T10:47:20.823759+0000","last_fullsized":"2024-09-14T10:47:20.823759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:04.242694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444917+0000","last_change":"2024-09-14T10:44:13.354345+0000","last_active":"2024-09-14T10:44:44.444917+0000","last_peered":"2024-09-14T10:44:44.444917+0000","last_clean":"2024-09-14T10:44:44.444917+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:44:44.444917+0000","last_undegraded":"2024-09-14T10:44:44.444917+0000","last_fullsized":"2024-09-14T10:44:44.444917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451891+0000","last_change":"2024-09-14T10:44:15.378526+0000","last_active":"2024-09-14T10:44:44.451891+0000","last_peered":"2024-09-14T10:44:44.451891+0000","last_clean":"2024-09-14T10:44:44.451891+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:44:44.451891+0000","last_undegraded":"2024-09-14T10:44:44.451891+0000","last_fullsized":"2024-09-14T10:44:44.451891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:34.239574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872753+0000","last_change":"2024-09-14T10:44:07.313804+0000","last_active":"2024-09-14T10:45:35.872753+0000","last_peered":"2024-09-14T10:45:35.872753+0000","last_clean":"2024-09-14T10:45:35.872753+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:45:35.872753+0000","last_undegraded":"2024-09-14T10:45:35.872753+0000","last_fullsized":"2024-09-14T10:45:35.872753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:24.864032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:05.322391+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442567+0000","last_change":"2024-09-14T10:44:09.338478+0000","last_active":"2024-09-14T10:44:44.442567+0000","last_peered":"2024-09-14T10:44:44.442567+0000","last_clean":"2024-09-14T10:44:44.442567+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:44:44.442567+0000","last_undegraded":"2024-09-14T10:44:44.442567+0000","last_fullsized":"2024-09-14T10:44:44.442567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:42.543570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.626754+0000","last_change":"2024-09-14T10:44:11.321761+0000","last_active":"2024-09-14T10:46:18.626754+0000","last_peered":"2024-09-14T10:46:18.626754+0000","last_clean":"2024-09-14T10:46:18.626754+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:46:18.626754+0000","last_undegraded":"2024-09-14T10:46:18.626754+0000","last_fullsized":"2024-09-14T10:46:18.626754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.326575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434240+0000","last_change":"2024-09-14T10:44:13.356507+0000","last_active":"2024-09-14T10:44:44.434240+0000","last_peered":"2024-09-14T10:44:44.434240+0000","last_clean":"2024-09-14T10:44:44.434240+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:44:44.434240+0000","last_undegraded":"2024-09-14T10:44:44.434240+0000","last_fullsized":"2024-09-14T10:44:44.434240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.808772+0000","last_change":"2024-09-14T10:44:07.313195+0000","last_active":"2024-09-14T10:47:21.808772+0000","last_peered":"2024-09-14T10:47:21.808772+0000","last_clean":"2024-09-14T10:47:21.808772+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:47:21.808772+0000","last_undegraded":"2024-09-14T10:47:21.808772+0000","last_fullsized":"2024-09-14T10:47:21.808772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:53.410685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440632+0000","last_change":"2024-09-14T10:44:05.324942+0000","last_active":"2024-09-14T10:44:44.440632+0000","last_peered":"2024-09-14T10:44:44.440632+0000","last_clean":"2024-09-14T10:44:44.440632+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:44:44.440632+0000","last_undegraded":"2024-09-14T10:44:44.440632+0000","last_fullsized":"2024-09-14T10:44:44.440632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:09.809429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443876+0000","last_change":"2024-09-14T10:44:09.332885+0000","last_active":"2024-09-14T10:44:44.443876+0000","last_peered":"2024-09-14T10:44:44.443876+0000","last_clean":"2024-09-14T10:44:44.443876+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:44:44.443876+0000","last_undegraded":"2024-09-14T10:44:44.443876+0000","last_fullsized":"2024-09-14T10:44:44.443876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:29.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.655962+0000","last_change":"2024-09-14T10:44:11.340857+0000","last_active":"2024-09-14T10:46:18.655962+0000","last_peered":"2024-09-14T10:46:18.655962+0000","last_clean":"2024-09-14T10:46:18.655962+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:46:18.655962+0000","last_undegraded":"2024-09-14T10:46:18.655962+0000","last_fullsized":"2024-09-14T10:46:18.655962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:58.117101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436429+0000","last_change":"2024-09-14T10:44:13.356783+0000","last_active":"2024-09-14T10:44:44.436429+0000","last_peered":"2024-09-14T10:44:44.436429+0000","last_clean":"2024-09-14T10:44:44.436429+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:44:44.436429+0000","last_undegraded":"2024-09-14T10:44:44.436429+0000","last_fullsized":"2024-09-14T10:44:44.436429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:57.886038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.426338+0000","last_change":"2024-09-14T10:44:15.390085+0000","last_active":"2024-09-14T10:47:21.426338+0000","last_peered":"2024-09-14T10:47:21.426338+0000","last_clean":"2024-09-14T10:47:21.426338+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:47:21.426338+0000","last_undegraded":"2024-09-14T10:47:21.426338+0000","last_fullsized":"2024-09-14T10:47:21.426338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:09.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882763+0000","last_change":"2024-09-14T10:44:07.305111+0000","last_active":"2024-09-14T10:47:21.882763+0000","last_peered":"2024-09-14T10:47:21.882763+0000","last_clean":"2024-09-14T10:47:21.882763+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:47:21.882763+0000","last_undegraded":"2024-09-14T10:47:21.882763+0000","last_fullsized":"2024-09-14T10:47:21.882763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:28.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.443685+0000","last_change":"2024-09-14T10:44:05.316373+0000","last_active":"2024-09-14T10:46:29.443685+0000","last_peered":"2024-09-14T10:46:29.443685+0000","last_clean":"2024-09-14T10:46:29.443685+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:46:29.443685+0000","last_undegraded":"2024-09-14T10:46:29.443685+0000","last_fullsized":"2024-09-14T10:46:29.443685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:20.065314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439696+0000","last_change":"2024-09-14T10:44:09.313053+0000","last_active":"2024-09-14T10:44:44.439696+0000","last_peered":"2024-09-14T10:44:44.439696+0000","last_clean":"2024-09-14T10:44:44.439696+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:44:44.439696+0000","last_undegraded":"2024-09-14T10:44:44.439696+0000","last_fullsized":"2024-09-14T10:44:44.439696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.375123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.627786+0000","last_change":"2024-09-14T10:44:11.359808+0000","last_active":"2024-09-14T10:46:18.627786+0000","last_peered":"2024-09-14T10:46:18.627786+0000","last_clean":"2024-09-14T10:46:18.627786+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:46:18.627786+0000","last_undegraded":"2024-09-14T10:46:18.627786+0000","last_fullsized":"2024-09-14T10:46:18.627786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:51.224366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445366+0000","last_change":"2024-09-14T10:44:13.371652+0000","last_active":"2024-09-14T10:44:44.445366+0000","last_peered":"2024-09-14T10:44:44.445366+0000","last_clean":"2024-09-14T10:44:44.445366+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:44:44.445366+0000","last_undegraded":"2024-09-14T10:44:44.445366+0000","last_fullsized":"2024-09-14T10:44:44.445366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450551+0000","last_change":"2024-09-14T10:44:15.379606+0000","last_active":"2024-09-14T10:44:44.450551+0000","last_peered":"2024-09-14T10:44:44.450551+0000","last_clean":"2024-09-14T10:44:44.450551+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:44:44.450551+0000","last_undegraded":"2024-09-14T10:44:44.450551+0000","last_fullsized":"2024-09-14T10:44:44.450551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:37.639739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.298696+0000","last_change":"2024-09-14T10:44:07.317281+0000","last_active":"2024-09-14T10:44:52.298696+0000","last_peered":"2024-09-14T10:44:52.298696+0000","last_clean":"2024-09-14T10:44:52.298696+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:44:52.298696+0000","last_undegraded":"2024-09-14T10:44:52.298696+0000","last_fullsized":"2024-09-14T10:44:52.298696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:19.569186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446007+0000","last_change":"2024-09-14T10:44:05.319971+0000","last_active":"2024-09-14T10:44:44.446007+0000","last_peered":"2024-09-14T10:44:44.446007+0000","last_clean":"2024-09-14T10:44:44.446007+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:44:44.446007+0000","last_undegraded":"2024-09-14T10:44:44.446007+0000","last_fullsized":"2024-09-14T10:44:44.446007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:30.432326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438372+0000","last_change":"2024-09-14T10:44:09.316331+0000","last_active":"2024-09-14T10:44:44.438372+0000","last_peered":"2024-09-14T10:44:44.438372+0000","last_clean":"2024-09-14T10:44:44.438372+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:44:44.438372+0000","last_undegraded":"2024-09-14T10:44:44.438372+0000","last_fullsized":"2024-09-14T10:44:44.438372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.269872+0000","last_change":"2024-09-14T10:44:11.330416+0000","last_active":"2024-09-14T10:46:18.269872+0000","last_peered":"2024-09-14T10:46:18.269872+0000","last_clean":"2024-09-14T10:46:18.269872+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:46:18.269872+0000","last_undegraded":"2024-09-14T10:46:18.269872+0000","last_fullsized":"2024-09-14T10:46:18.269872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:58.265390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443419+0000","last_change":"2024-09-14T10:44:13.364526+0000","last_active":"2024-09-14T10:44:44.443419+0000","last_peered":"2024-09-14T10:44:44.443419+0000","last_clean":"2024-09-14T10:44:44.443419+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:44:44.443419+0000","last_undegraded":"2024-09-14T10:44:44.443419+0000","last_fullsized":"2024-09-14T10:44:44.443419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:46.572662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.685006+0000","last_change":"2024-09-14T10:44:15.379535+0000","last_active":"2024-09-14T10:46:20.685006+0000","last_peered":"2024-09-14T10:46:20.685006+0000","last_clean":"2024-09-14T10:46:20.685006+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:46:20.685006+0000","last_undegraded":"2024-09-14T10:46:20.685006+0000","last_fullsized":"2024-09-14T10:46:20.685006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:20.408629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.380036+0000","last_change":"2024-09-14T10:44:07.306266+0000","last_active":"2024-09-14T10:47:21.380036+0000","last_peered":"2024-09-14T10:47:21.380036+0000","last_clean":"2024-09-14T10:47:21.380036+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:47:21.380036+0000","last_undegraded":"2024-09-14T10:47:21.380036+0000","last_fullsized":"2024-09-14T10:47:21.380036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:57.380845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454069+0000","last_change":"2024-09-14T10:44:05.324788+0000","last_active":"2024-09-14T10:44:44.454069+0000","last_peered":"2024-09-14T10:44:44.454069+0000","last_clean":"2024-09-14T10:44:44.454069+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:44:44.454069+0000","last_undegraded":"2024-09-14T10:44:44.454069+0000","last_fullsized":"2024-09-14T10:44:44.454069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:56.141828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.083888+0000","last_change":"2024-09-14T10:44:09.313857+0000","last_active":"2024-09-14T10:46:20.083888+0000","last_peered":"2024-09-14T10:46:20.083888+0000","last_clean":"2024-09-14T10:46:20.083888+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:46:20.083888+0000","last_undegraded":"2024-09-14T10:46:20.083888+0000","last_fullsized":"2024-09-14T10:46:20.083888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:53.790922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'12","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.442571+0000","last_change":"2024-09-14T10:44:11.365067+0000","last_active":"2024-09-14T10:46:14.442571+0000","last_peered":"2024-09-14T10:46:14.442571+0000","last_clean":"2024-09-14T10:46:14.442571+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:46:14.442571+0000","last_undegraded":"2024-09-14T10:46:14.442571+0000","last_fullsized":"2024-09-14T10:46:14.442571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:24.755831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566159+0000","last_change":"2024-09-14T10:44:13.372845+0000","last_active":"2024-09-14T10:47:19.566159+0000","last_peered":"2024-09-14T10:47:19.566159+0000","last_clean":"2024-09-14T10:47:19.566159+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:47:19.566159+0000","last_undegraded":"2024-09-14T10:47:19.566159+0000","last_fullsized":"2024-09-14T10:47:19.566159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:44.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.813949+0000","last_change":"2024-09-14T10:44:15.388635+0000","last_active":"2024-09-14T10:47:21.813949+0000","last_peered":"2024-09-14T10:47:21.813949+0000","last_clean":"2024-09-14T10:47:21.813949+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:47:21.813949+0000","last_undegraded":"2024-09-14T10:47:21.813949+0000","last_fullsized":"2024-09-14T10:47:21.813949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:00.563368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.297384+0000","last_change":"2024-09-14T10:44:07.297715+0000","last_active":"2024-09-14T10:44:52.297384+0000","last_peered":"2024-09-14T10:44:52.297384+0000","last_clean":"2024-09-14T10:44:52.297384+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:44:52.297384+0000","last_undegraded":"2024-09-14T10:44:52.297384+0000","last_fullsized":"2024-09-14T10:44:52.297384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:13.693037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.857406+0000","last_change":"2024-09-14T10:44:05.320001+0000","last_active":"2024-09-14T10:45:35.857406+0000","last_peered":"2024-09-14T10:45:35.857406+0000","last_clean":"2024-09-14T10:45:35.857406+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:45:35.857406+0000","last_undegraded":"2024-09-14T10:45:35.857406+0000","last_fullsized":"2024-09-14T10:45:35.857406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:36.390217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.070178+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:46:20.070178+0000","last_peered":"2024-09-14T10:46:20.070178+0000","last_clean":"2024-09-14T10:46:20.070178+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:46:20.070178+0000","last_undegraded":"2024-09-14T10:46:20.070178+0000","last_fullsized":"2024-09-14T10:46:20.070178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:58.082949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.614388+0000","last_change":"2024-09-14T10:44:11.327509+0000","last_active":"2024-09-14T10:46:18.614388+0000","last_peered":"2024-09-14T10:46:18.614388+0000","last_clean":"2024-09-14T10:46:18.614388+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:46:18.614388+0000","last_undegraded":"2024-09-14T10:46:18.614388+0000","last_fullsized":"2024-09-14T10:46:18.614388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.860344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438767+0000","last_change":"2024-09-14T10:44:13.376040+0000","last_active":"2024-09-14T10:44:44.438767+0000","last_peered":"2024-09-14T10:44:44.438767+0000","last_clean":"2024-09-14T10:44:44.438767+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:44:44.438767+0000","last_undegraded":"2024-09-14T10:44:44.438767+0000","last_fullsized":"2024-09-14T10:44:44.438767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452541+0000","last_change":"2024-09-14T10:44:15.388404+0000","last_active":"2024-09-14T10:44:44.452541+0000","last_peered":"2024-09-14T10:44:44.452541+0000","last_clean":"2024-09-14T10:44:44.452541+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:44:44.452541+0000","last_undegraded":"2024-09-14T10:44:44.452541+0000","last_fullsized":"2024-09-14T10:44:44.452541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720287+0000","last_change":"2024-09-14T10:44:07.301782+0000","last_active":"2024-09-14T10:47:21.720287+0000","last_peered":"2024-09-14T10:47:21.720287+0000","last_clean":"2024-09-14T10:47:21.720287+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:47:21.720287+0000","last_undegraded":"2024-09-14T10:47:21.720287+0000","last_fullsized":"2024-09-14T10:47:21.720287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:43.671200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456552+0000","last_change":"2024-09-14T10:44:05.321255+0000","last_active":"2024-09-14T10:44:44.456552+0000","last_peered":"2024-09-14T10:44:44.456552+0000","last_clean":"2024-09-14T10:44:44.456552+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:44:44.456552+0000","last_undegraded":"2024-09-14T10:44:44.456552+0000","last_fullsized":"2024-09-14T10:44:44.456552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:08.383959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436064+0000","last_change":"2024-09-14T10:44:09.320830+0000","last_active":"2024-09-14T10:44:44.436064+0000","last_peered":"2024-09-14T10:44:44.436064+0000","last_clean":"2024-09-14T10:44:44.436064+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:44:44.436064+0000","last_undegraded":"2024-09-14T10:44:44.436064+0000","last_fullsized":"2024-09-14T10:44:44.436064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:33.277860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.618426+0000","last_change":"2024-09-14T10:44:11.325995+0000","last_active":"2024-09-14T10:46:18.618426+0000","last_peered":"2024-09-14T10:46:18.618426+0000","last_clean":"2024-09-14T10:46:18.618426+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:46:18.618426+0000","last_undegraded":"2024-09-14T10:46:18.618426+0000","last_fullsized":"2024-09-14T10:46:18.618426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:19.897508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441744+0000","last_change":"2024-09-14T10:44:13.369101+0000","last_active":"2024-09-14T10:44:44.441744+0000","last_peered":"2024-09-14T10:44:44.441744+0000","last_clean":"2024-09-14T10:44:44.441744+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:44:44.441744+0000","last_undegraded":"2024-09-14T10:44:44.441744+0000","last_fullsized":"2024-09-14T10:44:44.441744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:12.164053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457651+0000","last_change":"2024-09-14T10:44:15.386917+0000","last_active":"2024-09-14T10:44:44.457651+0000","last_peered":"2024-09-14T10:44:44.457651+0000","last_clean":"2024-09-14T10:44:44.457651+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:44:44.457651+0000","last_undegraded":"2024-09-14T10:44:44.457651+0000","last_fullsized":"2024-09-14T10:44:44.457651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:38.536486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600974+0000","last_change":"2024-09-14T10:44:44.464149+0000","last_active":"2024-09-14T10:45:35.600974+0000","last_peered":"2024-09-14T10:45:35.600974+0000","last_clean":"2024-09-14T10:45:35.600974+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:45:35.600974+0000","last_undegraded":"2024-09-14T10:45:35.600974+0000","last_fullsized":"2024-09-14T10:45:35.600974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:26.594110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.245635+0000","last_change":"2024-09-14T10:44:05.314583+0000","last_active":"2024-09-14T10:47:21.245635+0000","last_peered":"2024-09-14T10:47:21.245635+0000","last_clean":"2024-09-14T10:47:21.245635+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:21.245635+0000","last_undegraded":"2024-09-14T10:47:21.245635+0000","last_fullsized":"2024-09-14T10:47:21.245635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:24.166852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436523+0000","last_change":"2024-09-14T10:44:09.318111+0000","last_active":"2024-09-14T10:44:44.436523+0000","last_peered":"2024-09-14T10:44:44.436523+0000","last_clean":"2024-09-14T10:44:44.436523+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:44:44.436523+0000","last_undegraded":"2024-09-14T10:44:44.436523+0000","last_fullsized":"2024-09-14T10:44:44.436523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:12.821605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.647577+0000","last_change":"2024-09-14T10:44:11.356523+0000","last_active":"2024-09-14T10:46:18.647577+0000","last_peered":"2024-09-14T10:46:18.647577+0000","last_clean":"2024-09-14T10:46:18.647577+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:46:18.647577+0000","last_undegraded":"2024-09-14T10:46:18.647577+0000","last_fullsized":"2024-09-14T10:46:18.647577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:30.747229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451553+0000","last_change":"2024-09-14T10:44:13.367321+0000","last_active":"2024-09-14T10:44:44.451553+0000","last_peered":"2024-09-14T10:44:44.451553+0000","last_clean":"2024-09-14T10:44:44.451553+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:44:44.451553+0000","last_undegraded":"2024-09-14T10:44:44.451553+0000","last_fullsized":"2024-09-14T10:44:44.451553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:58.066611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.662711+0000","last_change":"2024-09-14T10:44:15.385986+0000","last_active":"2024-09-14T10:46:18.662711+0000","last_peered":"2024-09-14T10:46:18.662711+0000","last_clean":"2024-09-14T10:46:18.662711+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:46:18.662711+0000","last_undegraded":"2024-09-14T10:46:18.662711+0000","last_fullsized":"2024-09-14T10:46:18.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:58.059454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.522356+0000","last_change":"2024-09-14T10:44:07.295202+0000","last_active":"2024-09-14T10:46:16.522356+0000","last_peered":"2024-09-14T10:46:16.522356+0000","last_clean":"2024-09-14T10:46:16.522356+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:46:16.522356+0000","last_undegraded":"2024-09-14T10:46:16.522356+0000","last_fullsized":"2024-09-14T10:46:16.522356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:40.711930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451048+0000","last_change":"2024-09-14T10:44:05.323017+0000","last_active":"2024-09-14T10:44:44.451048+0000","last_peered":"2024-09-14T10:44:44.451048+0000","last_clean":"2024-09-14T10:44:44.451048+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:44:44.451048+0000","last_undegraded":"2024-09-14T10:44:44.451048+0000","last_fullsized":"2024-09-14T10:44:44.451048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:48.326362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.016574+0000","last_change":"2024-09-14T10:44:09.327924+0000","last_active":"2024-09-14T10:46:17.016574+0000","last_peered":"2024-09-14T10:46:17.016574+0000","last_clean":"2024-09-14T10:46:17.016574+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:46:17.016574+0000","last_undegraded":"2024-09-14T10:46:17.016574+0000","last_fullsized":"2024-09-14T10:46:17.016574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:38.718169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.731485+0000","last_change":"2024-09-14T10:44:11.357069+0000","last_active":"2024-09-14T10:47:20.731485+0000","last_peered":"2024-09-14T10:47:20.731485+0000","last_clean":"2024-09-14T10:47:20.731485+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:47:20.731485+0000","last_undegraded":"2024-09-14T10:47:20.731485+0000","last_fullsized":"2024-09-14T10:47:20.731485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439393+0000","last_change":"2024-09-14T10:44:13.373389+0000","last_active":"2024-09-14T10:44:44.439393+0000","last_peered":"2024-09-14T10:44:44.439393+0000","last_clean":"2024-09-14T10:44:44.439393+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:44:44.439393+0000","last_undegraded":"2024-09-14T10:44:44.439393+0000","last_fullsized":"2024-09-14T10:44:44.439393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:34.517874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.852899+0000","last_change":"2024-09-14T10:44:15.386649+0000","last_active":"2024-09-14T10:47:20.852899+0000","last_peered":"2024-09-14T10:47:20.852899+0000","last_clean":"2024-09-14T10:47:20.852899+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:47:20.852899+0000","last_undegraded":"2024-09-14T10:47:20.852899+0000","last_fullsized":"2024-09-14T10:47:20.852899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:48.236396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.826073+0000","last_change":"2024-09-14T10:44:07.319333+0000","last_active":"2024-09-14T10:47:21.826073+0000","last_peered":"2024-09-14T10:47:21.826073+0000","last_clean":"2024-09-14T10:47:21.826073+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:47:21.826073+0000","last_undegraded":"2024-09-14T10:47:21.826073+0000","last_fullsized":"2024-09-14T10:47:21.826073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:14.561201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.679774+0000","last_change":"2024-09-14T10:44:05.319396+0000","last_active":"2024-09-14T10:47:21.679774+0000","last_peered":"2024-09-14T10:47:21.679774+0000","last_clean":"2024-09-14T10:47:21.679774+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:47:21.679774+0000","last_undegraded":"2024-09-14T10:47:21.679774+0000","last_fullsized":"2024-09-14T10:47:21.679774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:14.729286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.601482+0000","last_change":"2024-09-14T10:44:07.305165+0000","last_active":"2024-09-14T10:45:35.601482+0000","last_peered":"2024-09-14T10:45:35.601482+0000","last_clean":"2024-09-14T10:45:35.601482+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:45:35.601482+0000","last_undegraded":"2024-09-14T10:45:35.601482+0000","last_fullsized":"2024-09-14T10:45:35.601482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.572269+0000","last_change":"2024-09-14T10:44:05.323992+0000","last_active":"2024-09-14T10:44:52.572269+0000","last_peered":"2024-09-14T10:44:52.572269+0000","last_clean":"2024-09-14T10:44:52.572269+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:44:52.572269+0000","last_undegraded":"2024-09-14T10:44:52.572269+0000","last_fullsized":"2024-09-14T10:44:52.572269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:52.517695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.377995+0000","last_change":"2024-09-14T10:44:07.300105+0000","last_active":"2024-09-14T10:47:21.377995+0000","last_peered":"2024-09-14T10:47:21.377995+0000","last_clean":"2024-09-14T10:47:21.377995+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:47:21.377995+0000","last_undegraded":"2024-09-14T10:47:21.377995+0000","last_fullsized":"2024-09-14T10:47:21.377995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:48.852285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452056+0000","last_change":"2024-09-14T10:44:05.327542+0000","last_active":"2024-09-14T10:44:44.452056+0000","last_peered":"2024-09-14T10:44:44.452056+0000","last_clean":"2024-09-14T10:44:44.452056+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:44:44.452056+0000","last_undegraded":"2024-09-14T10:44:44.452056+0000","last_fullsized":"2024-09-14T10:44:44.452056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:23.168081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441253+0000","last_change":"2024-09-14T10:44:07.306382+0000","last_active":"2024-09-14T10:44:44.441253+0000","last_peered":"2024-09-14T10:44:44.441253+0000","last_clean":"2024-09-14T10:44:44.441253+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:44:44.441253+0000","last_undegraded":"2024-09-14T10:44:44.441253+0000","last_fullsized":"2024-09-14T10:44:44.441253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:58.925922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.713765+0000","last_change":"2024-09-14T10:44:05.323524+0000","last_active":"2024-09-14T10:44:50.713765+0000","last_peered":"2024-09-14T10:44:50.713765+0000","last_clean":"2024-09-14T10:44:50.713765+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:44:50.713765+0000","last_undegraded":"2024-09-14T10:44:50.713765+0000","last_fullsized":"2024-09-14T10:44:50.713765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441282+0000","last_change":"2024-09-14T10:44:07.316775+0000","last_active":"2024-09-14T10:44:44.441282+0000","last_peered":"2024-09-14T10:44:44.441282+0000","last_clean":"2024-09-14T10:44:44.441282+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:44:44.441282+0000","last_undegraded":"2024-09-14T10:44:44.441282+0000","last_fullsized":"2024-09-14T10:44:44.441282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.078507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441499+0000","last_change":"2024-09-14T10:44:05.320107+0000","last_active":"2024-09-14T10:44:44.441499+0000","last_peered":"2024-09-14T10:44:44.441499+0000","last_clean":"2024-09-14T10:44:44.441499+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:44:44.441499+0000","last_undegraded":"2024-09-14T10:44:44.441499+0000","last_fullsized":"2024-09-14T10:44:44.441499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:08.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880716+0000","last_change":"2024-09-14T10:44:07.315346+0000","last_active":"2024-09-14T10:47:21.880716+0000","last_peered":"2024-09-14T10:47:21.880716+0000","last_clean":"2024-09-14T10:47:21.880716+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:47:21.880716+0000","last_undegraded":"2024-09-14T10:47:21.880716+0000","last_fullsized":"2024-09-14T10:47:21.880716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:34.364814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446125+0000","last_change":"2024-09-14T10:44:05.316250+0000","last_active":"2024-09-14T10:44:44.446125+0000","last_peered":"2024-09-14T10:44:44.446125+0000","last_clean":"2024-09-14T10:44:44.446125+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:44:44.446125+0000","last_undegraded":"2024-09-14T10:44:44.446125+0000","last_fullsized":"2024-09-14T10:44:44.446125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:41.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.873291+0000","last_change":"2024-09-14T10:44:07.302298+0000","last_active":"2024-09-14T10:45:35.873291+0000","last_peered":"2024-09-14T10:45:35.873291+0000","last_clean":"2024-09-14T10:45:35.873291+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:45:35.873291+0000","last_undegraded":"2024-09-14T10:45:35.873291+0000","last_fullsized":"2024-09-14T10:45:35.873291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:05.444889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439490+0000","last_change":"2024-09-14T10:44:05.321993+0000","last_active":"2024-09-14T10:44:44.439490+0000","last_peered":"2024-09-14T10:44:44.439490+0000","last_clean":"2024-09-14T10:44:44.439490+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:44:44.439490+0000","last_undegraded":"2024-09-14T10:44:44.439490+0000","last_fullsized":"2024-09-14T10:44:44.439490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:11.032280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.523024+0000","last_change":"2024-09-14T10:44:07.304072+0000","last_active":"2024-09-14T10:46:16.523024+0000","last_peered":"2024-09-14T10:46:16.523024+0000","last_clean":"2024-09-14T10:46:16.523024+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:46:16.523024+0000","last_undegraded":"2024-09-14T10:46:16.523024+0000","last_fullsized":"2024-09-14T10:46:16.523024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444660+0000","last_change":"2024-09-14T10:44:05.314790+0000","last_active":"2024-09-14T10:44:44.444660+0000","last_peered":"2024-09-14T10:44:44.444660+0000","last_clean":"2024-09-14T10:44:44.444660+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:44:44.444660+0000","last_undegraded":"2024-09-14T10:44:44.444660+0000","last_fullsized":"2024-09-14T10:44:44.444660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:08.523198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452649+0000","last_change":"2024-09-14T10:44:07.302967+0000","last_active":"2024-09-14T10:44:44.452649+0000","last_peered":"2024-09-14T10:44:44.452649+0000","last_clean":"2024-09-14T10:44:44.452649+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:44:44.452649+0000","last_undegraded":"2024-09-14T10:44:44.452649+0000","last_fullsized":"2024-09-14T10:44:44.452649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:58.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.707392+0000","last_change":"2024-09-14T10:44:05.326780+0000","last_active":"2024-09-14T10:44:50.707392+0000","last_peered":"2024-09-14T10:44:50.707392+0000","last_clean":"2024-09-14T10:44:50.707392+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:44:50.707392+0000","last_undegraded":"2024-09-14T10:44:50.707392+0000","last_fullsized":"2024-09-14T10:44:50.707392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:30.583609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.848468+0000","last_change":"2024-09-14T10:44:07.309384+0000","last_active":"2024-09-14T10:44:51.848468+0000","last_peered":"2024-09-14T10:44:51.848468+0000","last_clean":"2024-09-14T10:44:51.848468+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:44:51.848468+0000","last_undegraded":"2024-09-14T10:44:51.848468+0000","last_fullsized":"2024-09-14T10:44:51.848468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:20.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440181+0000","last_change":"2024-09-14T10:44:05.324016+0000","last_active":"2024-09-14T10:44:44.440181+0000","last_peered":"2024-09-14T10:44:44.440181+0000","last_clean":"2024-09-14T10:44:44.440181+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:44:44.440181+0000","last_undegraded":"2024-09-14T10:44:44.440181+0000","last_fullsized":"2024-09-14T10:44:44.440181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874270+0000","last_change":"2024-09-14T10:44:07.314041+0000","last_active":"2024-09-14T10:45:35.874270+0000","last_peered":"2024-09-14T10:45:35.874270+0000","last_clean":"2024-09-14T10:45:35.874270+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:45:35.874270+0000","last_undegraded":"2024-09-14T10:45:35.874270+0000","last_fullsized":"2024-09-14T10:45:35.874270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:27.185091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447387+0000","last_change":"2024-09-14T10:44:05.316396+0000","last_active":"2024-09-14T10:44:44.447387+0000","last_peered":"2024-09-14T10:44:44.447387+0000","last_clean":"2024-09-14T10:44:44.447387+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:44:44.447387+0000","last_undegraded":"2024-09-14T10:44:44.447387+0000","last_fullsized":"2024-09-14T10:44:44.447387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:31.844881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600757+0000","last_change":"2024-09-14T10:44:07.303238+0000","last_active":"2024-09-14T10:45:35.600757+0000","last_peered":"2024-09-14T10:45:35.600757+0000","last_clean":"2024-09-14T10:45:35.600757+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:45:35.600757+0000","last_undegraded":"2024-09-14T10:45:35.600757+0000","last_fullsized":"2024-09-14T10:45:35.600757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:49.401193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443767+0000","last_change":"2024-09-14T10:44:05.313950+0000","last_active":"2024-09-14T10:44:44.443767+0000","last_peered":"2024-09-14T10:44:44.443767+0000","last_clean":"2024-09-14T10:44:44.443767+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:44:44.443767+0000","last_undegraded":"2024-09-14T10:44:44.443767+0000","last_fullsized":"2024-09-14T10:44:44.443767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.127894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.375016+0000","last_change":"2024-09-14T10:44:07.319354+0000","last_active":"2024-09-14T10:47:21.375016+0000","last_peered":"2024-09-14T10:47:21.375016+0000","last_clean":"2024-09-14T10:47:21.375016+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:47:21.375016+0000","last_undegraded":"2024-09-14T10:47:21.375016+0000","last_fullsized":"2024-09-14T10:47:21.375016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:26.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453814+0000","last_change":"2024-09-14T10:44:05.318285+0000","last_active":"2024-09-14T10:44:44.453814+0000","last_peered":"2024-09-14T10:44:44.453814+0000","last_clean":"2024-09-14T10:44:44.453814+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:44:44.453814+0000","last_undegraded":"2024-09-14T10:44:44.453814+0000","last_fullsized":"2024-09-14T10:44:44.453814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:09.785074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.697003+0000","last_change":"2024-09-14T10:44:07.304891+0000","last_active":"2024-09-14T10:46:20.697003+0000","last_peered":"2024-09-14T10:46:20.697003+0000","last_clean":"2024-09-14T10:46:20.697003+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:46:20.697003+0000","last_undegraded":"2024-09-14T10:46:20.697003+0000","last_fullsized":"2024-09-14T10:46:20.697003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.594544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457554+0000","last_change":"2024-09-14T10:44:05.324335+0000","last_active":"2024-09-14T10:44:44.457554+0000","last_peered":"2024-09-14T10:44:44.457554+0000","last_clean":"2024-09-14T10:44:44.457554+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:44:44.457554+0000","last_undegraded":"2024-09-14T10:44:44.457554+0000","last_fullsized":"2024-09-14T10:44:44.457554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:36.457645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.521412+0000","last_change":"2024-09-14T10:44:07.309006+0000","last_active":"2024-09-14T10:47:21.521412+0000","last_peered":"2024-09-14T10:47:21.521412+0000","last_clean":"2024-09-14T10:47:21.521412+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:47:21.521412+0000","last_undegraded":"2024-09-14T10:47:21.521412+0000","last_fullsized":"2024-09-14T10:47:21.521412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:25.445644+0000","last_change":"2024-09-14T10:44:05.321869+0000","last_active":"2024-09-14T10:46:25.445644+0000","last_peered":"2024-09-14T10:46:25.445644+0000","last_clean":"2024-09-14T10:46:25.445644+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:46:25.445644+0000","last_undegraded":"2024-09-14T10:46:25.445644+0000","last_fullsized":"2024-09-14T10:46:25.445644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:52.091145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":13,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.537179+0000","last_change":"2024-09-14T10:44:07.303706+0000","last_active":"2024-09-14T10:47:21.537179+0000","last_peered":"2024-09-14T10:47:21.537179+0000","last_clean":"2024-09-14T10:47:21.537179+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:47:21.537179+0000","last_undegraded":"2024-09-14T10:47:21.537179+0000","last_fullsized":"2024-09-14T10:47:21.537179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:47.194815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460745+0000","last_change":"2024-09-14T10:44:05.318005+0000","last_active":"2024-09-14T10:44:44.460745+0000","last_peered":"2024-09-14T10:44:44.460745+0000","last_clean":"2024-09-14T10:44:44.460745+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:44:44.460745+0000","last_undegraded":"2024-09-14T10:44:44.460745+0000","last_fullsized":"2024-09-14T10:44:44.460745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:40.757947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.706195+0000","last_change":"2024-09-14T10:44:05.321634+0000","last_active":"2024-09-14T10:47:21.706195+0000","last_peered":"2024-09-14T10:47:21.706195+0000","last_clean":"2024-09-14T10:47:21.706195+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:47:21.706195+0000","last_undegraded":"2024-09-14T10:47:21.706195+0000","last_fullsized":"2024-09-14T10:47:21.706195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:01.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":29,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882780+0000","last_change":"2024-09-14T10:44:07.310127+0000","last_active":"2024-09-14T10:47:21.882780+0000","last_peered":"2024-09-14T10:47:21.882780+0000","last_clean":"2024-09-14T10:47:21.882780+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:47:21.882780+0000","last_undegraded":"2024-09-14T10:47:21.882780+0000","last_fullsized":"2024-09-14T10:47:21.882780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.606750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.713544+0000","last_change":"2024-09-14T10:44:05.325170+0000","last_active":"2024-09-14T10:44:50.713544+0000","last_peered":"2024-09-14T10:44:50.713544+0000","last_clean":"2024-09-14T10:44:50.713544+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:44:50.713544+0000","last_undegraded":"2024-09-14T10:44:50.713544+0000","last_fullsized":"2024-09-14T10:44:50.713544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:31.844881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.521493+0000","last_change":"2024-09-14T10:44:07.318886+0000","last_active":"2024-09-14T10:46:16.521493+0000","last_peered":"2024-09-14T10:46:16.521493+0000","last_clean":"2024-09-14T10:46:16.521493+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:46:16.521493+0000","last_undegraded":"2024-09-14T10:46:16.521493+0000","last_fullsized":"2024-09-14T10:46:16.521493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:08.926626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13383,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640309,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48896,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322944,"statfs":{"total":96636764160,"available":96586694656,"internally_reserved":0,"allocated":9617408,"data_stored":9346322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44220,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327620,"statfs":{"total":96636764160,"available":96591482880,"internally_reserved":0,"allocated":9089024,"data_stored":8759345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44768,"kb_used_data":9424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327072,"statfs":{"total":96636764160,"available":96590921728,"internally_reserved":0,"allocated":9650176,"data_stored":9349617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":9056256,"data_stored":8757874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:47:54.026 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:47:54.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:47:54.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac940b640 1 Processor -- start 2024-09-14T10:47:54.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac940b640 1 -- start start 2024-09-14T10:47:54.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac940b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2ac412f8b0 0x7f2ac412fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:54.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac940b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac4070a60 con 0x7f2ac41301d0 2024-09-14T10:47:54.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac940b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac412f4f0 con 0x7f2ac412f8b0 2024-09-14T10:47:54.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac2ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2ac412f8b0 0x7f2ac412fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:54.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac27fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2ac41301d0 0x7f2ac406f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:38948/0 (socket says 172.21.15.70:38948) 2024-09-14T10:47:54.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac27fc640 1 -- 172.21.15.70:0/271105398 learned_addr learned my addr 172.21.15.70:0/271105398 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:54.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac2ffd640 1 -- 172.21.15.70:0/271105398 >> v1:172.21.15.70:6789/0 conn(0x7f2ac41301d0 legacy=0x7f2ac406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac1ffb640 1 -- 172.21.15.70:0/271105398 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897379363 0 0) 0x7f2ac4070a60 con 0x7f2ac41301d0 2024-09-14T10:47:54.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac2ffd640 1 -- 172.21.15.70:0/271105398 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac409f300 con 0x7f2ac412f8b0 2024-09-14T10:47:54.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac2ffd640 1 --2- 172.21.15.70:0/271105398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac412fc90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009740 tx=0x7f2abc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4747703e29177ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:54.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac1ffb640 1 -- 172.21.15.70:0/271105398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2abc0b0070 con 0x7f2ac412f8b0 2024-09-14T10:47:54.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac1ffb640 1 -- 172.21.15.70:0/271105398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2abc0ab530 con 0x7f2ac412f8b0 2024-09-14T10:47:54.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.184+0000 7f2ac1ffb640 1 -- 172.21.15.70:0/271105398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2abc0ab830 con 0x7f2ac412f8b0 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- 172.21.15.70:0/271105398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 msgr2=0x7f2ac412fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 --2- 172.21.15.70:0/271105398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac412fc90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009740 tx=0x7f2abc01c370 comp rx=0 tx=0).stop 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- 172.21.15.70:0/271105398 shutdown_connections 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 --2- 172.21.15.70:0/271105398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac412fc90 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- 172.21.15.70:0/271105398 >> 172.21.15.70:0/271105398 conn(0x7f2ac40a2520 msgr2=0x7f2ac409ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- 172.21.15.70:0/271105398 shutdown_connections 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- 172.21.15.70:0/271105398 wait complete. 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 Processor -- start 2024-09-14T10:47:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- start start 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac4130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac4138250 con 0x7f2ac412f8b0 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac4130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac4130840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47186/0 (socket says 172.21.15.70:47186) 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac2ffd640 1 -- 172.21.15.70:0/3874392977 learned_addr learned my addr 172.21.15.70:0/3874392977 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac2ffd640 1 -- 172.21.15.70:0/3874392977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac41333b0 con 0x7f2ac412f8b0 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac2ffd640 1 --2- 172.21.15.70:0/3874392977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac4130840 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0ae040 tx=0x7f2abc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2abb7fe640 1 -- 172.21.15.70:0/3874392977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2abc0b0050 con 0x7f2ac412f8b0 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2abb7fe640 1 -- 172.21.15.70:0/3874392977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2abc0b1040 con 0x7f2ac412f8b0 2024-09-14T10:47:54.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac4132710 con 0x7f2ac412f8b0 2024-09-14T10:47:54.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2abb7fe640 1 -- 172.21.15.70:0/3874392977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2abc0aab80 con 0x7f2ac412f8b0 2024-09-14T10:47:54.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac4130d80 con 0x7f2ac412f8b0 2024-09-14T10:47:54.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac4129fd0 con 0x7f2ac412f8b0 2024-09-14T10:47:54.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2abb7fe640 1 -- 172.21.15.70:0/3874392977 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f2abc0be030 con 0x7f2ac412f8b0 2024-09-14T10:47:54.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2abb7fe640 1 --2- 172.21.15.70:0/3874392977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2aa403b8b0 0x7f2aa403dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:54.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.188+0000 7f2abb7fe640 1 -- 172.21.15.70:0/3874392977 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2abc0bc070 con 0x7f2ac412f8b0 2024-09-14T10:47:54.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.192+0000 7f2ac27fc640 1 --2- 172.21.15.70:0/3874392977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2aa403b8b0 0x7f2aa403dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:54.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.192+0000 7f2ac27fc640 1 --2- 172.21.15.70:0/3874392977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2aa403b8b0 0x7f2aa403dd70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4005c10 tx=0x7f2ab4001700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:54.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.196+0000 7f2abb7fe640 1 -- 172.21.15.70:0/3874392977 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f2abc0c5060 con 0x7f2ac412f8b0 2024-09-14T10:47:54.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.360+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ac4133580 con 0x7f2aa403b8b0 2024-09-14T10:47:54.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.388+0000 7f2abb7fe640 1 -- 172.21.15.70:0/3874392977 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666038 (secure 0 0 0) 0x7f2ac4133580 con 0x7f2aa403b8b0 2024-09-14T10:47:54.392 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:47:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:47:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2aa403b8b0 msgr2=0x7f2aa403dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 --2- 172.21.15.70:0/3874392977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2aa403b8b0 0x7f2aa403dd70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4005c10 tx=0x7f2ab4001700 comp rx=0 tx=0).stop 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 msgr2=0x7f2ac4130840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 --2- 172.21.15.70:0/3874392977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac4130840 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0ae040 tx=0x7f2abc01abb0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 shutdown_connections 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 --2- 172.21.15.70:0/3874392977 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f2aa403b8b0 0x7f2aa403dd70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 --2- 172.21.15.70:0/3874392977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac412f8b0 0x7f2ac4130840 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 >> 172.21.15.70:0/3874392977 conn(0x7f2ac40a2520 msgr2=0x7f2ac4128ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 shutdown_connections 2024-09-14T10:47:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.396+0000 7f2ac940b640 1 -- 172.21.15.70:0/3874392977 wait complete. 2024-09-14T10:47:54.410 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-14T10:47:53.464430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416911,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4941,"num_read_kb":4479,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36213158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007414"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439387+0000","last_change":"2024-09-14T10:44:05.314727+0000","last_active":"2024-09-14T10:44:44.439387+0000","last_peered":"2024-09-14T10:44:44.439387+0000","last_clean":"2024-09-14T10:44:44.439387+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:44:44.439387+0000","last_undegraded":"2024-09-14T10:44:44.439387+0000","last_fullsized":"2024-09-14T10:44:44.439387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:33.017320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720305+0000","last_change":"2024-09-14T10:44:07.304568+0000","last_active":"2024-09-14T10:47:21.720305+0000","last_peered":"2024-09-14T10:47:21.720305+0000","last_clean":"2024-09-14T10:47:21.720305+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:47:21.720305+0000","last_undegraded":"2024-09-14T10:47:21.720305+0000","last_fullsized":"2024-09-14T10:47:21.720305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:11.798345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.674373+0000","last_change":"2024-09-14T10:44:05.320383+0000","last_active":"2024-09-14T10:47:21.674373+0000","last_peered":"2024-09-14T10:47:21.674373+0000","last_clean":"2024-09-14T10:47:21.674373+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:47:21.674373+0000","last_undegraded":"2024-09-14T10:47:21.674373+0000","last_fullsized":"2024-09-14T10:47:21.674373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:57.992699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720464+0000","last_change":"2024-09-14T10:44:07.311706+0000","last_active":"2024-09-14T10:47:21.720464+0000","last_peered":"2024-09-14T10:47:21.720464+0000","last_clean":"2024-09-14T10:47:21.720464+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:47:21.720464+0000","last_undegraded":"2024-09-14T10:47:21.720464+0000","last_fullsized":"2024-09-14T10:47:21.720464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:27.522929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.458276+0000","last_change":"2024-09-14T10:44:05.321748+0000","last_active":"2024-09-14T10:44:44.458276+0000","last_peered":"2024-09-14T10:44:44.458276+0000","last_clean":"2024-09-14T10:44:44.458276+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:44:44.458276+0000","last_undegraded":"2024-09-14T10:44:44.458276+0000","last_fullsized":"2024-09-14T10:44:44.458276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.177217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879810+0000","last_change":"2024-09-14T10:44:07.311756+0000","last_active":"2024-09-14T10:47:21.879810+0000","last_peered":"2024-09-14T10:47:21.879810+0000","last_clean":"2024-09-14T10:47:21.879810+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:47:21.879810+0000","last_undegraded":"2024-09-14T10:47:21.879810+0000","last_fullsized":"2024-09-14T10:47:21.879810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.711375+0000","last_change":"2024-09-14T10:44:05.316542+0000","last_active":"2024-09-14T10:44:50.711375+0000","last_peered":"2024-09-14T10:44:50.711375+0000","last_clean":"2024-09-14T10:44:50.711375+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:44:50.711375+0000","last_undegraded":"2024-09-14T10:44:50.711375+0000","last_fullsized":"2024-09-14T10:44:50.711375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:35.707595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600024+0000","last_change":"2024-09-14T10:44:07.312388+0000","last_active":"2024-09-14T10:45:35.600024+0000","last_peered":"2024-09-14T10:45:35.600024+0000","last_clean":"2024-09-14T10:45:35.600024+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:45:35.600024+0000","last_undegraded":"2024-09-14T10:45:35.600024+0000","last_fullsized":"2024-09-14T10:45:35.600024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:31.070464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454651+0000","last_change":"2024-09-14T10:44:05.329861+0000","last_active":"2024-09-14T10:44:44.454651+0000","last_peered":"2024-09-14T10:44:44.454651+0000","last_clean":"2024-09-14T10:44:44.454651+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:44:44.454651+0000","last_undegraded":"2024-09-14T10:44:44.454651+0000","last_fullsized":"2024-09-14T10:44:44.454651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:01.827439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.677760+0000","last_change":"2024-09-14T10:44:07.303712+0000","last_active":"2024-09-14T10:46:20.677760+0000","last_peered":"2024-09-14T10:46:20.677760+0000","last_clean":"2024-09-14T10:46:20.677760+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:46:20.677760+0000","last_undegraded":"2024-09-14T10:46:20.677760+0000","last_fullsized":"2024-09-14T10:46:20.677760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433524+0000","last_change":"2024-09-14T10:44:05.317002+0000","last_active":"2024-09-14T10:44:44.433524+0000","last_peered":"2024-09-14T10:44:44.433524+0000","last_clean":"2024-09-14T10:44:44.433524+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:44:44.433524+0000","last_undegraded":"2024-09-14T10:44:44.433524+0000","last_fullsized":"2024-09-14T10:44:44.433524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:24.606365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.373297+0000","last_change":"2024-09-14T10:44:44.462329+0000","last_active":"2024-09-14T10:47:21.373297+0000","last_peered":"2024-09-14T10:47:21.373297+0000","last_clean":"2024-09-14T10:47:21.373297+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:47:21.373297+0000","last_undegraded":"2024-09-14T10:47:21.373297+0000","last_fullsized":"2024-09-14T10:47:21.373297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:05.537374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.449407+0000","last_change":"2024-09-14T10:44:05.319096+0000","last_active":"2024-09-14T10:44:44.449407+0000","last_peered":"2024-09-14T10:44:44.449407+0000","last_clean":"2024-09-14T10:44:44.449407+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:44:44.449407+0000","last_undegraded":"2024-09-14T10:44:44.449407+0000","last_fullsized":"2024-09-14T10:44:44.449407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:07.843074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879838+0000","last_change":"2024-09-14T10:44:07.301357+0000","last_active":"2024-09-14T10:47:21.879838+0000","last_peered":"2024-09-14T10:47:21.879838+0000","last_clean":"2024-09-14T10:47:21.879838+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:47:21.879838+0000","last_undegraded":"2024-09-14T10:47:21.879838+0000","last_fullsized":"2024-09-14T10:47:21.879838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:49.933862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.869625+0000","last_change":"2024-09-14T10:44:05.315243+0000","last_active":"2024-09-14T10:47:21.869625+0000","last_peered":"2024-09-14T10:47:21.869625+0000","last_clean":"2024-09-14T10:47:21.869625+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:47:21.869625+0000","last_undegraded":"2024-09-14T10:47:21.869625+0000","last_fullsized":"2024-09-14T10:47:21.869625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:04.517080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.986354+0000","last_change":"2024-09-14T10:44:07.315054+0000","last_active":"2024-09-14T10:47:21.986354+0000","last_peered":"2024-09-14T10:47:21.986354+0000","last_clean":"2024-09-14T10:47:21.986354+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:47:21.986354+0000","last_undegraded":"2024-09-14T10:47:21.986354+0000","last_fullsized":"2024-09-14T10:47:21.986354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:46.799488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872805+0000","last_change":"2024-09-14T10:44:07.313852+0000","last_active":"2024-09-14T10:45:35.872805+0000","last_peered":"2024-09-14T10:45:35.872805+0000","last_clean":"2024-09-14T10:45:35.872805+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:45:35.872805+0000","last_undegraded":"2024-09-14T10:45:35.872805+0000","last_fullsized":"2024-09-14T10:45:35.872805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:54.012187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450856+0000","last_change":"2024-09-14T10:44:05.322752+0000","last_active":"2024-09-14T10:44:44.450856+0000","last_peered":"2024-09-14T10:44:44.450856+0000","last_clean":"2024-09-14T10:44:44.450856+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:44:44.450856+0000","last_undegraded":"2024-09-14T10:44:44.450856+0000","last_fullsized":"2024-09-14T10:44:44.450856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:08.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720065+0000","last_change":"2024-09-14T10:44:07.303444+0000","last_active":"2024-09-14T10:47:21.720065+0000","last_peered":"2024-09-14T10:47:21.720065+0000","last_clean":"2024-09-14T10:47:21.720065+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:47:21.720065+0000","last_undegraded":"2024-09-14T10:47:21.720065+0000","last_fullsized":"2024-09-14T10:47:21.720065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:42.771218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440693+0000","last_change":"2024-09-14T10:44:05.314433+0000","last_active":"2024-09-14T10:44:44.440693+0000","last_peered":"2024-09-14T10:44:44.440693+0000","last_clean":"2024-09-14T10:44:44.440693+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:44:44.440693+0000","last_undegraded":"2024-09-14T10:44:44.440693+0000","last_fullsized":"2024-09-14T10:44:44.440693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:30.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880404+0000","last_change":"2024-09-14T10:44:07.302716+0000","last_active":"2024-09-14T10:47:21.880404+0000","last_peered":"2024-09-14T10:47:21.880404+0000","last_clean":"2024-09-14T10:47:21.880404+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:47:21.880404+0000","last_undegraded":"2024-09-14T10:47:21.880404+0000","last_fullsized":"2024-09-14T10:47:21.880404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:36.213106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446820+0000","last_change":"2024-09-14T10:44:05.320439+0000","last_active":"2024-09-14T10:44:44.446820+0000","last_peered":"2024-09-14T10:44:44.446820+0000","last_clean":"2024-09-14T10:44:44.446820+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:44:44.446820+0000","last_undegraded":"2024-09-14T10:44:44.446820+0000","last_fullsized":"2024-09-14T10:44:44.446820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:30.093065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874276+0000","last_change":"2024-09-14T10:44:07.314159+0000","last_active":"2024-09-14T10:45:35.874276+0000","last_peered":"2024-09-14T10:45:35.874276+0000","last_clean":"2024-09-14T10:45:35.874276+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:45:35.874276+0000","last_undegraded":"2024-09-14T10:45:35.874276+0000","last_fullsized":"2024-09-14T10:45:35.874276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443974+0000","last_change":"2024-09-14T10:44:05.320368+0000","last_active":"2024-09-14T10:44:44.443974+0000","last_peered":"2024-09-14T10:44:44.443974+0000","last_clean":"2024-09-14T10:44:44.443974+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:44:44.443974+0000","last_undegraded":"2024-09-14T10:44:44.443974+0000","last_fullsized":"2024-09-14T10:44:44.443974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879927+0000","last_change":"2024-09-14T10:44:07.313819+0000","last_active":"2024-09-14T10:47:21.879927+0000","last_peered":"2024-09-14T10:47:21.879927+0000","last_clean":"2024-09-14T10:47:21.879927+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:47:21.879927+0000","last_undegraded":"2024-09-14T10:47:21.879927+0000","last_fullsized":"2024-09-14T10:47:21.879927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.226631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444169+0000","last_change":"2024-09-14T10:44:05.324714+0000","last_active":"2024-09-14T10:44:44.444169+0000","last_peered":"2024-09-14T10:44:44.444169+0000","last_clean":"2024-09-14T10:44:44.444169+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:44:44.444169+0000","last_undegraded":"2024-09-14T10:44:44.444169+0000","last_fullsized":"2024-09-14T10:44:44.444169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:41.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825511+0000","last_change":"2024-09-14T10:44:07.303481+0000","last_active":"2024-09-14T10:47:21.825511+0000","last_peered":"2024-09-14T10:47:21.825511+0000","last_clean":"2024-09-14T10:47:21.825511+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:47:21.825511+0000","last_undegraded":"2024-09-14T10:47:21.825511+0000","last_fullsized":"2024-09-14T10:47:21.825511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.685013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452678+0000","last_change":"2024-09-14T10:44:05.312131+0000","last_active":"2024-09-14T10:44:44.452678+0000","last_peered":"2024-09-14T10:44:44.452678+0000","last_clean":"2024-09-14T10:44:44.452678+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:44:44.452678+0000","last_undegraded":"2024-09-14T10:44:44.452678+0000","last_fullsized":"2024-09-14T10:44:44.452678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:20.004027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891282+0000","last_change":"2024-09-14T10:44:15.384222+0000","last_active":"2024-09-14T10:47:21.891282+0000","last_peered":"2024-09-14T10:47:21.891282+0000","last_clean":"2024-09-14T10:47:21.891282+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:47:21.891282+0000","last_undegraded":"2024-09-14T10:47:21.891282+0000","last_fullsized":"2024-09-14T10:47:21.891282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:52.493514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825066+0000","last_change":"2024-09-14T10:44:07.300223+0000","last_active":"2024-09-14T10:47:21.825066+0000","last_peered":"2024-09-14T10:47:21.825066+0000","last_clean":"2024-09-14T10:47:21.825066+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:47:21.825066+0000","last_undegraded":"2024-09-14T10:47:21.825066+0000","last_fullsized":"2024-09-14T10:47:21.825066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:41.299865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453614+0000","last_change":"2024-09-14T10:44:05.327015+0000","last_active":"2024-09-14T10:44:44.453614+0000","last_peered":"2024-09-14T10:44:44.453614+0000","last_clean":"2024-09-14T10:44:44.453614+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:44:44.453614+0000","last_undegraded":"2024-09-14T10:44:44.453614+0000","last_fullsized":"2024-09-14T10:44:44.453614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:24.855054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456793+0000","last_change":"2024-09-14T10:44:09.339751+0000","last_active":"2024-09-14T10:44:44.456793+0000","last_peered":"2024-09-14T10:44:44.456793+0000","last_clean":"2024-09-14T10:44:44.456793+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:44:44.456793+0000","last_undegraded":"2024-09-14T10:44:44.456793+0000","last_fullsized":"2024-09-14T10:44:44.456793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:31.250869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.638725+0000","last_change":"2024-09-14T10:44:11.366230+0000","last_active":"2024-09-14T10:46:18.638725+0000","last_peered":"2024-09-14T10:46:18.638725+0000","last_clean":"2024-09-14T10:46:18.638725+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:46:18.638725+0000","last_undegraded":"2024-09-14T10:46:18.638725+0000","last_fullsized":"2024-09-14T10:46:18.638725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446129+0000","last_change":"2024-09-14T10:44:13.370430+0000","last_active":"2024-09-14T10:44:44.446129+0000","last_peered":"2024-09-14T10:44:44.446129+0000","last_clean":"2024-09-14T10:44:44.446129+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:44:44.446129+0000","last_undegraded":"2024-09-14T10:44:44.446129+0000","last_fullsized":"2024-09-14T10:44:44.446129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.607941+0000","last_change":"2024-09-14T10:44:15.377551+0000","last_active":"2024-09-14T10:45:35.607941+0000","last_peered":"2024-09-14T10:45:35.607941+0000","last_clean":"2024-09-14T10:45:35.607941+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:45:35.607941+0000","last_undegraded":"2024-09-14T10:45:35.607941+0000","last_fullsized":"2024-09-14T10:45:35.607941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:02.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.739203+0000","last_change":"2024-09-14T10:44:07.309285+0000","last_active":"2024-09-14T10:47:21.739203+0000","last_peered":"2024-09-14T10:47:21.739203+0000","last_clean":"2024-09-14T10:47:21.739203+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:47:21.739203+0000","last_undegraded":"2024-09-14T10:47:21.739203+0000","last_fullsized":"2024-09-14T10:47:21.739203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433126+0000","last_change":"2024-09-14T10:44:05.323067+0000","last_active":"2024-09-14T10:44:44.433126+0000","last_peered":"2024-09-14T10:44:44.433126+0000","last_clean":"2024-09-14T10:44:44.433126+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:44:44.433126+0000","last_undegraded":"2024-09-14T10:44:44.433126+0000","last_fullsized":"2024-09-14T10:44:44.433126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:16.558078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440248+0000","last_change":"2024-09-14T10:44:09.318715+0000","last_active":"2024-09-14T10:44:44.440248+0000","last_peered":"2024-09-14T10:44:44.440248+0000","last_clean":"2024-09-14T10:44:44.440248+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:44:44.440248+0000","last_undegraded":"2024-09-14T10:44:44.440248+0000","last_fullsized":"2024-09-14T10:44:44.440248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:56.922877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444934+0000","last_change":"2024-09-14T10:44:11.327271+0000","last_active":"2024-09-14T10:44:44.444934+0000","last_peered":"2024-09-14T10:44:44.444934+0000","last_clean":"2024-09-14T10:44:44.444934+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:44:44.444934+0000","last_undegraded":"2024-09-14T10:44:44.444934+0000","last_fullsized":"2024-09-14T10:44:44.444934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.449635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444347+0000","last_change":"2024-09-14T10:44:13.360104+0000","last_active":"2024-09-14T10:44:44.444347+0000","last_peered":"2024-09-14T10:44:44.444347+0000","last_clean":"2024-09-14T10:44:44.444347+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:44:44.444347+0000","last_undegraded":"2024-09-14T10:44:44.444347+0000","last_fullsized":"2024-09-14T10:44:44.444347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438541+0000","last_change":"2024-09-14T10:44:15.385641+0000","last_active":"2024-09-14T10:44:44.438541+0000","last_peered":"2024-09-14T10:44:44.438541+0000","last_clean":"2024-09-14T10:44:44.438541+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:44:44.438541+0000","last_undegraded":"2024-09-14T10:44:44.438541+0000","last_fullsized":"2024-09-14T10:44:44.438541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.602221+0000","last_change":"2024-09-14T10:44:07.312266+0000","last_active":"2024-09-14T10:44:52.602221+0000","last_peered":"2024-09-14T10:44:52.602221+0000","last_clean":"2024-09-14T10:44:52.602221+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:44:52.602221+0000","last_undegraded":"2024-09-14T10:44:52.602221+0000","last_fullsized":"2024-09-14T10:44:52.602221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:05.421337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443044+0000","last_change":"2024-09-14T10:44:05.321201+0000","last_active":"2024-09-14T10:44:44.443044+0000","last_peered":"2024-09-14T10:44:44.443044+0000","last_clean":"2024-09-14T10:44:44.443044+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:44:44.443044+0000","last_undegraded":"2024-09-14T10:44:44.443044+0000","last_fullsized":"2024-09-14T10:44:44.443044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:05.963673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447321+0000","last_change":"2024-09-14T10:44:09.326103+0000","last_active":"2024-09-14T10:44:44.447321+0000","last_peered":"2024-09-14T10:44:44.447321+0000","last_clean":"2024-09-14T10:44:44.447321+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:44:44.447321+0000","last_undegraded":"2024-09-14T10:44:44.447321+0000","last_fullsized":"2024-09-14T10:44:44.447321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.437130+0000","last_change":"2024-09-14T10:44:11.355262+0000","last_active":"2024-09-14T10:44:44.437130+0000","last_peered":"2024-09-14T10:44:44.437130+0000","last_clean":"2024-09-14T10:44:44.437130+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:44:44.437130+0000","last_undegraded":"2024-09-14T10:44:44.437130+0000","last_fullsized":"2024-09-14T10:44:44.437130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:55.694768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566019+0000","last_change":"2024-09-14T10:44:13.370887+0000","last_active":"2024-09-14T10:47:19.566019+0000","last_peered":"2024-09-14T10:47:19.566019+0000","last_clean":"2024-09-14T10:47:19.566019+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:47:19.566019+0000","last_undegraded":"2024-09-14T10:47:19.566019+0000","last_fullsized":"2024-09-14T10:47:19.566019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433906+0000","last_change":"2024-09-14T10:44:15.393155+0000","last_active":"2024-09-14T10:44:44.433906+0000","last_peered":"2024-09-14T10:44:44.433906+0000","last_clean":"2024-09-14T10:44:44.433906+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:44:44.433906+0000","last_undegraded":"2024-09-14T10:44:44.433906+0000","last_fullsized":"2024-09-14T10:44:44.433906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:01.351429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:53.304550+0000","last_change":"2024-09-14T10:44:07.310193+0000","last_active":"2024-09-14T10:44:53.304550+0000","last_peered":"2024-09-14T10:44:53.304550+0000","last_clean":"2024-09-14T10:44:53.304550+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:44:53.304550+0000","last_undegraded":"2024-09-14T10:44:53.304550+0000","last_fullsized":"2024-09-14T10:44:53.304550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:15.726650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.564329+0000","last_change":"2024-09-14T10:44:05.315829+0000","last_active":"2024-09-14T10:44:52.564329+0000","last_peered":"2024-09-14T10:44:52.564329+0000","last_clean":"2024-09-14T10:44:52.564329+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:44:52.564329+0000","last_undegraded":"2024-09-14T10:44:52.564329+0000","last_fullsized":"2024-09-14T10:44:52.564329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:08.412821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455297+0000","last_change":"2024-09-14T10:44:09.341355+0000","last_active":"2024-09-14T10:44:44.455297+0000","last_peered":"2024-09-14T10:44:44.455297+0000","last_clean":"2024-09-14T10:44:44.455297+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:44:44.455297+0000","last_undegraded":"2024-09-14T10:44:44.455297+0000","last_fullsized":"2024-09-14T10:44:44.455297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:06.338264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.631745+0000","last_change":"2024-09-14T10:44:11.349869+0000","last_active":"2024-09-14T10:46:18.631745+0000","last_peered":"2024-09-14T10:46:18.631745+0000","last_clean":"2024-09-14T10:46:18.631745+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:46:18.631745+0000","last_undegraded":"2024-09-14T10:46:18.631745+0000","last_fullsized":"2024-09-14T10:46:18.631745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891629+0000","last_change":"2024-09-14T10:44:13.359625+0000","last_active":"2024-09-14T10:47:21.891629+0000","last_peered":"2024-09-14T10:47:21.891629+0000","last_clean":"2024-09-14T10:47:21.891629+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:47:21.891629+0000","last_undegraded":"2024-09-14T10:47:21.891629+0000","last_fullsized":"2024-09-14T10:47:21.891629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.828035+0000","last_change":"2024-09-14T10:44:07.313431+0000","last_active":"2024-09-14T10:47:21.828035+0000","last_peered":"2024-09-14T10:47:21.828035+0000","last_clean":"2024-09-14T10:47:21.828035+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:47:21.828035+0000","last_undegraded":"2024-09-14T10:47:21.828035+0000","last_fullsized":"2024-09-14T10:47:21.828035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:28.832046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438420+0000","last_change":"2024-09-14T10:44:05.319480+0000","last_active":"2024-09-14T10:44:44.438420+0000","last_peered":"2024-09-14T10:44:44.438420+0000","last_clean":"2024-09-14T10:44:44.438420+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:44:44.438420+0000","last_undegraded":"2024-09-14T10:44:44.438420+0000","last_fullsized":"2024-09-14T10:44:44.438420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:30.352842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447310+0000","last_change":"2024-09-14T10:44:09.321893+0000","last_active":"2024-09-14T10:44:44.447310+0000","last_peered":"2024-09-14T10:44:44.447310+0000","last_clean":"2024-09-14T10:44:44.447310+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:44:44.447310+0000","last_undegraded":"2024-09-14T10:44:44.447310+0000","last_fullsized":"2024-09-14T10:44:44.447310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:04.728659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.644500+0000","last_change":"2024-09-14T10:44:11.342017+0000","last_active":"2024-09-14T10:46:18.644500+0000","last_peered":"2024-09-14T10:46:18.644500+0000","last_clean":"2024-09-14T10:46:18.644500+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:46:18.644500+0000","last_undegraded":"2024-09-14T10:46:18.644500+0000","last_fullsized":"2024-09-14T10:46:18.644500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:22.056805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441567+0000","last_change":"2024-09-14T10:44:13.359612+0000","last_active":"2024-09-14T10:44:44.441567+0000","last_peered":"2024-09-14T10:44:44.441567+0000","last_clean":"2024-09-14T10:44:44.441567+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:44:44.441567+0000","last_undegraded":"2024-09-14T10:44:44.441567+0000","last_fullsized":"2024-09-14T10:44:44.441567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:40.424615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.610998+0000","last_change":"2024-09-14T10:44:15.384957+0000","last_active":"2024-09-14T10:45:35.610998+0000","last_peered":"2024-09-14T10:45:35.610998+0000","last_clean":"2024-09-14T10:45:35.610998+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:45:35.610998+0000","last_undegraded":"2024-09-14T10:45:35.610998+0000","last_fullsized":"2024-09-14T10:45:35.610998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.508508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.822961+0000","last_change":"2024-09-14T10:44:07.297475+0000","last_active":"2024-09-14T10:47:21.822961+0000","last_peered":"2024-09-14T10:47:21.822961+0000","last_clean":"2024-09-14T10:47:21.822961+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:47:21.822961+0000","last_undegraded":"2024-09-14T10:47:21.822961+0000","last_fullsized":"2024-09-14T10:47:21.822961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:38.470916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.697456+0000","last_change":"2024-09-14T10:44:05.322339+0000","last_active":"2024-09-14T10:47:21.697456+0000","last_peered":"2024-09-14T10:47:21.697456+0000","last_clean":"2024-09-14T10:47:21.697456+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:21.697456+0000","last_undegraded":"2024-09-14T10:47:21.697456+0000","last_fullsized":"2024-09-14T10:47:21.697456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:19.073960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439715+0000","last_change":"2024-09-14T10:44:09.315832+0000","last_active":"2024-09-14T10:44:44.439715+0000","last_peered":"2024-09-14T10:44:44.439715+0000","last_clean":"2024-09-14T10:44:44.439715+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:44:44.439715+0000","last_undegraded":"2024-09-14T10:44:44.439715+0000","last_fullsized":"2024-09-14T10:44:44.439715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:23.486222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.446040+0000","last_change":"2024-09-14T10:44:11.361862+0000","last_active":"2024-09-14T10:46:29.446040+0000","last_peered":"2024-09-14T10:46:29.446040+0000","last_clean":"2024-09-14T10:46:29.446040+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:46:29.446040+0000","last_undegraded":"2024-09-14T10:46:29.446040+0000","last_fullsized":"2024-09-14T10:46:29.446040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:38.109362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441326+0000","last_change":"2024-09-14T10:44:13.371521+0000","last_active":"2024-09-14T10:44:44.441326+0000","last_peered":"2024-09-14T10:44:44.441326+0000","last_clean":"2024-09-14T10:44:44.441326+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:44:44.441326+0000","last_undegraded":"2024-09-14T10:44:44.441326+0000","last_fullsized":"2024-09-14T10:44:44.441326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:22.520305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:29.960732+0000","last_change":"2024-09-14T10:44:15.387133+0000","last_active":"2024-09-14T10:45:29.960732+0000","last_peered":"2024-09-14T10:45:29.960732+0000","last_clean":"2024-09-14T10:45:29.960732+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:45:29.960732+0000","last_undegraded":"2024-09-14T10:45:29.960732+0000","last_fullsized":"2024-09-14T10:45:29.960732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.599443+0000","last_change":"2024-09-14T10:44:07.313496+0000","last_active":"2024-09-14T10:45:35.599443+0000","last_peered":"2024-09-14T10:45:35.599443+0000","last_clean":"2024-09-14T10:45:35.599443+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:45:35.599443+0000","last_undegraded":"2024-09-14T10:45:35.599443+0000","last_fullsized":"2024-09-14T10:45:35.599443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:25.073228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.443374+0000","last_change":"2024-09-14T10:44:05.333550+0000","last_active":"2024-09-14T10:46:19.443374+0000","last_peered":"2024-09-14T10:46:19.443374+0000","last_clean":"2024-09-14T10:46:19.443374+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:46:19.443374+0000","last_undegraded":"2024-09-14T10:46:19.443374+0000","last_fullsized":"2024-09-14T10:46:19.443374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.200851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440400+0000","last_change":"2024-09-14T10:44:09.327528+0000","last_active":"2024-09-14T10:44:44.440400+0000","last_peered":"2024-09-14T10:44:44.440400+0000","last_clean":"2024-09-14T10:44:44.440400+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:44:44.440400+0000","last_undegraded":"2024-09-14T10:44:44.440400+0000","last_fullsized":"2024-09-14T10:44:44.440400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:16.948139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444158+0000","last_change":"2024-09-14T10:44:11.356327+0000","last_active":"2024-09-14T10:46:24.444158+0000","last_peered":"2024-09-14T10:46:24.444158+0000","last_clean":"2024-09-14T10:46:24.444158+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:46:24.444158+0000","last_undegraded":"2024-09-14T10:46:24.444158+0000","last_fullsized":"2024-09-14T10:46:24.444158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":377,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.091563+0000","last_change":"2024-09-14T10:44:13.372565+0000","last_active":"2024-09-14T10:47:22.091563+0000","last_peered":"2024-09-14T10:47:22.091563+0000","last_clean":"2024-09-14T10:47:22.091563+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:47:22.091563+0000","last_undegraded":"2024-09-14T10:47:22.091563+0000","last_fullsized":"2024-09-14T10:47:22.091563+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443179+0000","last_change":"2024-09-14T10:44:15.386780+0000","last_active":"2024-09-14T10:44:44.443179+0000","last_peered":"2024-09-14T10:44:44.443179+0000","last_clean":"2024-09-14T10:44:44.443179+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:44:44.443179+0000","last_undegraded":"2024-09-14T10:44:44.443179+0000","last_fullsized":"2024-09-14T10:44:44.443179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:51.818783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880056+0000","last_change":"2024-09-14T10:44:07.297382+0000","last_active":"2024-09-14T10:47:21.880056+0000","last_peered":"2024-09-14T10:47:21.880056+0000","last_clean":"2024-09-14T10:47:21.880056+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:47:21.880056+0000","last_undegraded":"2024-09-14T10:47:21.880056+0000","last_fullsized":"2024-09-14T10:47:21.880056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:08.033376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.580206+0000","last_change":"2024-09-14T10:44:05.318622+0000","last_active":"2024-09-14T10:44:52.580206+0000","last_peered":"2024-09-14T10:44:52.580206+0000","last_clean":"2024-09-14T10:44:52.580206+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:44:52.580206+0000","last_undegraded":"2024-09-14T10:44:52.580206+0000","last_fullsized":"2024-09-14T10:44:52.580206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:45.181544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439156+0000","last_change":"2024-09-14T10:44:09.325802+0000","last_active":"2024-09-14T10:44:44.439156+0000","last_peered":"2024-09-14T10:44:44.439156+0000","last_clean":"2024-09-14T10:44:44.439156+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:44:44.439156+0000","last_undegraded":"2024-09-14T10:44:44.439156+0000","last_fullsized":"2024-09-14T10:44:44.439156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:35.589836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444298+0000","last_change":"2024-09-14T10:44:11.356796+0000","last_active":"2024-09-14T10:46:24.444298+0000","last_peered":"2024-09-14T10:46:24.444298+0000","last_clean":"2024-09-14T10:46:24.444298+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:46:24.444298+0000","last_undegraded":"2024-09-14T10:46:24.444298+0000","last_fullsized":"2024-09-14T10:46:24.444298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:34.815043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439158+0000","last_change":"2024-09-14T10:44:13.361258+0000","last_active":"2024-09-14T10:44:44.439158+0000","last_peered":"2024-09-14T10:44:44.439158+0000","last_clean":"2024-09-14T10:44:44.439158+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:44:44.439158+0000","last_undegraded":"2024-09-14T10:44:44.439158+0000","last_fullsized":"2024-09-14T10:44:44.439158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.050143+0000","last_change":"2024-09-14T10:44:15.362513+0000","last_active":"2024-09-14T10:47:22.050143+0000","last_peered":"2024-09-14T10:47:22.050143+0000","last_clean":"2024-09-14T10:47:22.050143+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:47:22.050143+0000","last_undegraded":"2024-09-14T10:47:22.050143+0000","last_fullsized":"2024-09-14T10:47:22.050143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.899211+0000","last_change":"2024-09-14T10:44:44.460040+0000","last_active":"2024-09-14T10:47:21.899211+0000","last_peered":"2024-09-14T10:47:21.899211+0000","last_clean":"2024-09-14T10:47:21.899211+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:47:21.899211+0000","last_undegraded":"2024-09-14T10:47:21.899211+0000","last_fullsized":"2024-09-14T10:47:21.899211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:12.929749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441032+0000","last_change":"2024-09-14T10:44:05.316384+0000","last_active":"2024-09-14T10:44:44.441032+0000","last_peered":"2024-09-14T10:44:44.441032+0000","last_clean":"2024-09-14T10:44:44.441032+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:44:44.441032+0000","last_undegraded":"2024-09-14T10:44:44.441032+0000","last_fullsized":"2024-09-14T10:44:44.441032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.127894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438276+0000","last_change":"2024-09-14T10:44:09.321636+0000","last_active":"2024-09-14T10:44:44.438276+0000","last_peered":"2024-09-14T10:44:44.438276+0000","last_clean":"2024-09-14T10:44:44.438276+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:44:44.438276+0000","last_undegraded":"2024-09-14T10:44:44.438276+0000","last_fullsized":"2024-09-14T10:44:44.438276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:18.793271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.622728+0000","last_change":"2024-09-14T10:44:11.337843+0000","last_active":"2024-09-14T10:46:18.622728+0000","last_peered":"2024-09-14T10:46:18.622728+0000","last_clean":"2024-09-14T10:46:18.622728+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:46:18.622728+0000","last_undegraded":"2024-09-14T10:46:18.622728+0000","last_fullsized":"2024-09-14T10:46:18.622728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:07.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460124+0000","last_change":"2024-09-14T10:44:13.368817+0000","last_active":"2024-09-14T10:44:44.460124+0000","last_peered":"2024-09-14T10:44:44.460124+0000","last_clean":"2024-09-14T10:44:44.460124+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:44:44.460124+0000","last_undegraded":"2024-09-14T10:44:44.460124+0000","last_fullsized":"2024-09-14T10:44:44.460124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:51.609983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.281368+0000","last_change":"2024-09-14T10:44:15.388555+0000","last_active":"2024-09-14T10:46:18.281368+0000","last_peered":"2024-09-14T10:46:18.281368+0000","last_clean":"2024-09-14T10:46:18.281368+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:46:18.281368+0000","last_undegraded":"2024-09-14T10:46:18.281368+0000","last_fullsized":"2024-09-14T10:46:18.281368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:16.672301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720978+0000","last_change":"2024-09-14T10:44:07.313823+0000","last_active":"2024-09-14T10:47:21.720978+0000","last_peered":"2024-09-14T10:47:21.720978+0000","last_clean":"2024-09-14T10:47:21.720978+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:47:21.720978+0000","last_undegraded":"2024-09-14T10:47:21.720978+0000","last_fullsized":"2024-09-14T10:47:21.720978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:40.529838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453896+0000","last_change":"2024-09-14T10:44:05.324895+0000","last_active":"2024-09-14T10:44:44.453896+0000","last_peered":"2024-09-14T10:44:44.453896+0000","last_clean":"2024-09-14T10:44:44.453896+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:44:44.453896+0000","last_undegraded":"2024-09-14T10:44:44.453896+0000","last_fullsized":"2024-09-14T10:44:44.453896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:31.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440536+0000","last_change":"2024-09-14T10:44:09.325353+0000","last_active":"2024-09-14T10:44:44.440536+0000","last_peered":"2024-09-14T10:44:44.440536+0000","last_clean":"2024-09-14T10:44:44.440536+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:44:44.440536+0000","last_undegraded":"2024-09-14T10:44:44.440536+0000","last_fullsized":"2024-09-14T10:44:44.440536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:24.409253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.659927+0000","last_change":"2024-09-14T10:44:11.324938+0000","last_active":"2024-09-14T10:46:18.659927+0000","last_peered":"2024-09-14T10:46:18.659927+0000","last_clean":"2024-09-14T10:46:18.659927+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:46:18.659927+0000","last_undegraded":"2024-09-14T10:46:18.659927+0000","last_fullsized":"2024-09-14T10:46:18.659927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:38.232131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":411,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.059218+0000","last_change":"2024-09-14T10:44:13.364819+0000","last_active":"2024-09-14T10:47:22.059218+0000","last_peered":"2024-09-14T10:47:22.059218+0000","last_clean":"2024-09-14T10:47:22.059218+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:47:22.059218+0000","last_undegraded":"2024-09-14T10:47:22.059218+0000","last_fullsized":"2024-09-14T10:47:22.059218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:29.703105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:22.442035+0000","last_change":"2024-09-14T10:44:15.389692+0000","last_active":"2024-09-14T10:46:22.442035+0000","last_peered":"2024-09-14T10:46:22.442035+0000","last_clean":"2024-09-14T10:46:22.442035+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:46:22.442035+0000","last_undegraded":"2024-09-14T10:46:22.442035+0000","last_fullsized":"2024-09-14T10:46:22.442035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699712+0000","last_change":"2024-09-14T10:44:07.315452+0000","last_active":"2024-09-14T10:46:20.699712+0000","last_peered":"2024-09-14T10:46:20.699712+0000","last_clean":"2024-09-14T10:46:20.699712+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:46:20.699712+0000","last_undegraded":"2024-09-14T10:46:20.699712+0000","last_fullsized":"2024-09-14T10:46:20.699712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.769639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451555+0000","last_change":"2024-09-14T10:44:05.323413+0000","last_active":"2024-09-14T10:44:44.451555+0000","last_peered":"2024-09-14T10:44:44.451555+0000","last_clean":"2024-09-14T10:44:44.451555+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:44:44.451555+0000","last_undegraded":"2024-09-14T10:44:44.451555+0000","last_fullsized":"2024-09-14T10:44:44.451555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:47.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.083604+0000","last_change":"2024-09-14T10:44:09.321263+0000","last_active":"2024-09-14T10:46:20.083604+0000","last_peered":"2024-09-14T10:46:20.083604+0000","last_clean":"2024-09-14T10:46:20.083604+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:46:20.083604+0000","last_undegraded":"2024-09-14T10:46:20.083604+0000","last_fullsized":"2024-09-14T10:46:20.083604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:48.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455520+0000","last_change":"2024-09-14T10:44:11.365421+0000","last_active":"2024-09-14T10:44:44.455520+0000","last_peered":"2024-09-14T10:44:44.455520+0000","last_clean":"2024-09-14T10:44:44.455520+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:44:44.455520+0000","last_undegraded":"2024-09-14T10:44:44.455520+0000","last_fullsized":"2024-09-14T10:44:44.455520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:56.792327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":501,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.997414+0000","last_change":"2024-09-14T10:44:13.362574+0000","last_active":"2024-09-14T10:47:21.997414+0000","last_peered":"2024-09-14T10:47:21.997414+0000","last_clean":"2024-09-14T10:47:21.997414+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:47:21.997414+0000","last_undegraded":"2024-09-14T10:47:21.997414+0000","last_fullsized":"2024-09-14T10:47:21.997414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.234975+0000","last_change":"2024-09-14T10:44:15.376191+0000","last_active":"2024-09-14T10:46:20.234975+0000","last_peered":"2024-09-14T10:46:20.234975+0000","last_clean":"2024-09-14T10:46:20.234975+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:46:20.234975+0000","last_undegraded":"2024-09-14T10:46:20.234975+0000","last_fullsized":"2024-09-14T10:46:20.234975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:57.673158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880744+0000","last_change":"2024-09-14T10:44:07.321079+0000","last_active":"2024-09-14T10:47:21.880744+0000","last_peered":"2024-09-14T10:47:21.880744+0000","last_clean":"2024-09-14T10:47:21.880744+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:47:21.880744+0000","last_undegraded":"2024-09-14T10:47:21.880744+0000","last_fullsized":"2024-09-14T10:47:21.880744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:01.445738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441663+0000","last_change":"2024-09-14T10:44:05.327190+0000","last_active":"2024-09-14T10:44:44.441663+0000","last_peered":"2024-09-14T10:44:44.441663+0000","last_clean":"2024-09-14T10:44:44.441663+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:44:44.441663+0000","last_undegraded":"2024-09-14T10:44:44.441663+0000","last_fullsized":"2024-09-14T10:44:44.441663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:46.537438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457361+0000","last_change":"2024-09-14T10:44:09.342479+0000","last_active":"2024-09-14T10:44:44.457361+0000","last_peered":"2024-09-14T10:44:44.457361+0000","last_clean":"2024-09-14T10:44:44.457361+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:44:44.457361+0000","last_undegraded":"2024-09-14T10:44:44.457361+0000","last_fullsized":"2024-09-14T10:44:44.457361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:27.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.640584+0000","last_change":"2024-09-14T10:44:11.332997+0000","last_active":"2024-09-14T10:46:18.640584+0000","last_peered":"2024-09-14T10:46:18.640584+0000","last_clean":"2024-09-14T10:46:18.640584+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:46:18.640584+0000","last_undegraded":"2024-09-14T10:46:18.640584+0000","last_fullsized":"2024-09-14T10:46:18.640584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:53.814557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436642+0000","last_change":"2024-09-14T10:44:13.374235+0000","last_active":"2024-09-14T10:44:44.436642+0000","last_peered":"2024-09-14T10:44:44.436642+0000","last_clean":"2024-09-14T10:44:44.436642+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:44:44.436642+0000","last_undegraded":"2024-09-14T10:44:44.436642+0000","last_fullsized":"2024-09-14T10:44:44.436642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:45.457582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.953427+0000","last_change":"2024-09-14T10:44:15.378896+0000","last_active":"2024-09-14T10:47:21.953427+0000","last_peered":"2024-09-14T10:47:21.953427+0000","last_clean":"2024-09-14T10:47:21.953427+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:47:21.953427+0000","last_undegraded":"2024-09-14T10:47:21.953427+0000","last_fullsized":"2024-09-14T10:47:21.953427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:41.435534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'13","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.402163+0000","last_change":"2024-09-14T10:44:07.313348+0000","last_active":"2024-09-14T10:47:21.402163+0000","last_peered":"2024-09-14T10:47:21.402163+0000","last_clean":"2024-09-14T10:47:21.402163+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:47:21.402163+0000","last_undegraded":"2024-09-14T10:47:21.402163+0000","last_fullsized":"2024-09-14T10:47:21.402163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:03.002533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436810+0000","last_change":"2024-09-14T10:43:50.584788+0000","last_active":"2024-09-14T10:44:44.436810+0000","last_peered":"2024-09-14T10:44:44.436810+0000","last_clean":"2024-09-14T10:44:44.436810+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:44:44.436810+0000","last_undegraded":"2024-09-14T10:44:44.436810+0000","last_fullsized":"2024-09-14T10:44:44.436810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_clean_scrub_stamp":"2024-09-14T10:43:49.418142+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:43.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455044+0000","last_change":"2024-09-14T10:43:57.466810+0000","last_active":"2024-09-14T10:44:44.455044+0000","last_peered":"2024-09-14T10:44:44.455044+0000","last_clean":"2024-09-14T10:44:44.455044+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:44:44.455044+0000","last_undegraded":"2024-09-14T10:44:44.455044+0000","last_fullsized":"2024-09-14T10:44:44.455044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:33.230423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.324672+0000","last_change":"2024-09-14T10:44:05.335883+0000","last_active":"2024-09-14T10:47:21.324672+0000","last_peered":"2024-09-14T10:47:21.324672+0000","last_clean":"2024-09-14T10:47:21.324672+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:47:21.324672+0000","last_undegraded":"2024-09-14T10:47:21.324672+0000","last_fullsized":"2024-09-14T10:47:21.324672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:49.876374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.467078+0000","last_change":"2024-09-14T10:44:44.463751+0000","last_active":"2024-09-14T10:44:44.467078+0000","last_peered":"2024-09-14T10:44:44.467078+0000","last_clean":"2024-09-14T10:44:44.467078+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:44:44.467078+0000","last_undegraded":"2024-09-14T10:44:44.467078+0000","last_fullsized":"2024-09-14T10:44:44.467078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.700138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'77","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.655935+0000","last_change":"2024-09-14T10:44:11.357369+0000","last_active":"2024-09-14T10:46:18.655935+0000","last_peered":"2024-09-14T10:46:18.655935+0000","last_clean":"2024-09-14T10:46:18.655935+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:46:18.655935+0000","last_undegraded":"2024-09-14T10:46:18.655935+0000","last_fullsized":"2024-09-14T10:46:18.655935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:20.733108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443564+0000","last_change":"2024-09-14T10:44:13.372619+0000","last_active":"2024-09-14T10:44:44.443564+0000","last_peered":"2024-09-14T10:44:44.443564+0000","last_clean":"2024-09-14T10:44:44.443564+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:44:44.443564+0000","last_undegraded":"2024-09-14T10:44:44.443564+0000","last_fullsized":"2024-09-14T10:44:44.443564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.209093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.907510+0000","last_change":"2024-09-14T10:44:15.380614+0000","last_active":"2024-09-14T10:47:21.907510+0000","last_peered":"2024-09-14T10:47:21.907510+0000","last_clean":"2024-09-14T10:47:21.907510+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:47:21.907510+0000","last_undegraded":"2024-09-14T10:47:21.907510+0000","last_fullsized":"2024-09-14T10:47:21.907510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:58.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825057+0000","last_change":"2024-09-14T10:44:07.316776+0000","last_active":"2024-09-14T10:47:21.825057+0000","last_peered":"2024-09-14T10:47:21.825057+0000","last_clean":"2024-09-14T10:47:21.825057+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:47:21.825057+0000","last_undegraded":"2024-09-14T10:47:21.825057+0000","last_fullsized":"2024-09-14T10:47:21.825057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.514426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440485+0000","last_change":"2024-09-14T10:43:57.465589+0000","last_active":"2024-09-14T10:44:44.440485+0000","last_peered":"2024-09-14T10:44:44.440485+0000","last_clean":"2024-09-14T10:44:44.440485+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:44:44.440485+0000","last_undegraded":"2024-09-14T10:44:44.440485+0000","last_fullsized":"2024-09-14T10:44:44.440485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.853418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:12.439603+0000","last_change":"2024-09-14T10:44:05.313733+0000","last_active":"2024-09-14T10:46:12.439603+0000","last_peered":"2024-09-14T10:46:12.439603+0000","last_clean":"2024-09-14T10:46:12.439603+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:46:12.439603+0000","last_undegraded":"2024-09-14T10:46:12.439603+0000","last_fullsized":"2024-09-14T10:46:12.439603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:29.804432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460368+0000","last_change":"2024-09-14T10:44:09.341477+0000","last_active":"2024-09-14T10:44:44.460368+0000","last_peered":"2024-09-14T10:44:44.460368+0000","last_clean":"2024-09-14T10:44:44.460368+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:44:44.460368+0000","last_undegraded":"2024-09-14T10:44:44.460368+0000","last_fullsized":"2024-09-14T10:44:44.460368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:45.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'273","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566682+0000","last_change":"2024-09-14T10:44:11.347623+0000","last_active":"2024-09-14T10:47:19.566682+0000","last_peered":"2024-09-14T10:47:19.566682+0000","last_clean":"2024-09-14T10:47:19.566682+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:47:19.566682+0000","last_undegraded":"2024-09-14T10:47:19.566682+0000","last_fullsized":"2024-09-14T10:47:19.566682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:58.040485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454445+0000","last_change":"2024-09-14T10:44:13.368580+0000","last_active":"2024-09-14T10:44:44.454445+0000","last_peered":"2024-09-14T10:44:44.454445+0000","last_clean":"2024-09-14T10:44:44.454445+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:44:44.454445+0000","last_undegraded":"2024-09-14T10:44:44.454445+0000","last_fullsized":"2024-09-14T10:44:44.454445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:45.985218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.604538+0000","last_change":"2024-09-14T10:44:15.392131+0000","last_active":"2024-09-14T10:45:35.604538+0000","last_peered":"2024-09-14T10:45:35.604538+0000","last_clean":"2024-09-14T10:45:35.604538+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:45:35.604538+0000","last_undegraded":"2024-09-14T10:45:35.604538+0000","last_fullsized":"2024-09-14T10:45:35.604538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:37.610953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.441166+0000","last_change":"2024-09-14T10:44:07.302744+0000","last_active":"2024-09-14T10:46:17.441166+0000","last_peered":"2024-09-14T10:46:17.441166+0000","last_clean":"2024-09-14T10:46:17.441166+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:46:17.441166+0000","last_undegraded":"2024-09-14T10:46:17.441166+0000","last_fullsized":"2024-09-14T10:46:17.441166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:44.363143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434243+0000","last_change":"2024-09-14T10:43:57.622013+0000","last_active":"2024-09-14T10:44:44.434243+0000","last_peered":"2024-09-14T10:44:44.434243+0000","last_clean":"2024-09-14T10:44:44.434243+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:44:44.434243+0000","last_undegraded":"2024-09-14T10:44:44.434243+0000","last_fullsized":"2024-09-14T10:44:44.434243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438450+0000","last_change":"2024-09-14T10:44:05.314187+0000","last_active":"2024-09-14T10:44:44.438450+0000","last_peered":"2024-09-14T10:44:44.438450+0000","last_clean":"2024-09-14T10:44:44.438450+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:44:44.438450+0000","last_undegraded":"2024-09-14T10:44:44.438450+0000","last_fullsized":"2024-09-14T10:44:44.438450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.919125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438356+0000","last_change":"2024-09-14T10:44:09.316504+0000","last_active":"2024-09-14T10:44:44.438356+0000","last_peered":"2024-09-14T10:44:44.438356+0000","last_clean":"2024-09-14T10:44:44.438356+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:44:44.438356+0000","last_undegraded":"2024-09-14T10:44:44.438356+0000","last_fullsized":"2024-09-14T10:44:44.438356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.594212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566236+0000","last_change":"2024-09-14T10:44:11.340123+0000","last_active":"2024-09-14T10:47:19.566236+0000","last_peered":"2024-09-14T10:47:19.566236+0000","last_clean":"2024-09-14T10:47:19.566236+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:47:19.566236+0000","last_undegraded":"2024-09-14T10:47:19.566236+0000","last_fullsized":"2024-09-14T10:47:19.566236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:55.570468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440972+0000","last_change":"2024-09-14T10:44:13.372401+0000","last_active":"2024-09-14T10:44:44.440972+0000","last_peered":"2024-09-14T10:44:44.440972+0000","last_clean":"2024-09-14T10:44:44.440972+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:44:44.440972+0000","last_undegraded":"2024-09-14T10:44:44.440972+0000","last_fullsized":"2024-09-14T10:44:44.440972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:48.551523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451974+0000","last_change":"2024-09-14T10:44:15.379368+0000","last_active":"2024-09-14T10:44:44.451974+0000","last_peered":"2024-09-14T10:44:44.451974+0000","last_clean":"2024-09-14T10:44:44.451974+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:44:44.451974+0000","last_undegraded":"2024-09-14T10:44:44.451974+0000","last_fullsized":"2024-09-14T10:44:44.451974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:11.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.510872+0000","last_change":"2024-09-14T10:44:07.307515+0000","last_active":"2024-09-14T10:46:16.510872+0000","last_peered":"2024-09-14T10:46:16.510872+0000","last_clean":"2024-09-14T10:46:16.510872+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:46:16.510872+0000","last_undegraded":"2024-09-14T10:46:16.510872+0000","last_fullsized":"2024-09-14T10:46:16.510872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:10.397230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452886+0000","last_change":"2024-09-14T10:43:57.466709+0000","last_active":"2024-09-14T10:44:44.452886+0000","last_peered":"2024-09-14T10:44:44.452886+0000","last_clean":"2024-09-14T10:44:44.452886+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:44:44.452886+0000","last_undegraded":"2024-09-14T10:44:44.452886+0000","last_fullsized":"2024-09-14T10:44:44.452886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:59.740099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.379318+0000","last_change":"2024-09-14T10:44:05.316730+0000","last_active":"2024-09-14T10:46:20.379318+0000","last_peered":"2024-09-14T10:46:20.379318+0000","last_clean":"2024-09-14T10:46:20.379318+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:46:20.379318+0000","last_undegraded":"2024-09-14T10:46:20.379318+0000","last_fullsized":"2024-09-14T10:46:20.379318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:52.869387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444568+0000","last_change":"2024-09-14T10:44:09.322206+0000","last_active":"2024-09-14T10:44:44.444568+0000","last_peered":"2024-09-14T10:44:44.444568+0000","last_clean":"2024-09-14T10:44:44.444568+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:44:44.444568+0000","last_undegraded":"2024-09-14T10:44:44.444568+0000","last_fullsized":"2024-09-14T10:44:44.444568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:42.879923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.719618+0000","last_change":"2024-09-14T10:44:11.362466+0000","last_active":"2024-09-14T10:47:20.719618+0000","last_peered":"2024-09-14T10:47:20.719618+0000","last_clean":"2024-09-14T10:47:20.719618+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:47:20.719618+0000","last_undegraded":"2024-09-14T10:47:20.719618+0000","last_fullsized":"2024-09-14T10:47:20.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.095069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460591+0000","last_change":"2024-09-14T10:44:13.368952+0000","last_active":"2024-09-14T10:44:44.460591+0000","last_peered":"2024-09-14T10:44:44.460591+0000","last_clean":"2024-09-14T10:44:44.460591+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:44:44.460591+0000","last_undegraded":"2024-09-14T10:44:44.460591+0000","last_fullsized":"2024-09-14T10:44:44.460591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.525259+0000","last_change":"2024-09-14T10:44:15.382665+0000","last_active":"2024-09-14T10:47:21.525259+0000","last_peered":"2024-09-14T10:47:21.525259+0000","last_clean":"2024-09-14T10:47:21.525259+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:47:21.525259+0000","last_undegraded":"2024-09-14T10:47:21.525259+0000","last_fullsized":"2024-09-14T10:47:21.525259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:18.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879962+0000","last_change":"2024-09-14T10:44:07.314873+0000","last_active":"2024-09-14T10:47:21.879962+0000","last_peered":"2024-09-14T10:47:21.879962+0000","last_clean":"2024-09-14T10:47:21.879962+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:47:21.879962+0000","last_undegraded":"2024-09-14T10:47:21.879962+0000","last_fullsized":"2024-09-14T10:47:21.879962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:56.862937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.805694+0000","last_change":"2024-09-14T10:44:05.319446+0000","last_active":"2024-09-14T10:44:51.805694+0000","last_peered":"2024-09-14T10:44:51.805694+0000","last_clean":"2024-09-14T10:44:51.805694+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:44:51.805694+0000","last_undegraded":"2024-09-14T10:44:51.805694+0000","last_fullsized":"2024-09-14T10:44:51.805694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:15.462869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440965+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:44:44.440965+0000","last_peered":"2024-09-14T10:44:44.440965+0000","last_clean":"2024-09-14T10:44:44.440965+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:44:44.440965+0000","last_undegraded":"2024-09-14T10:44:44.440965+0000","last_fullsized":"2024-09-14T10:44:44.440965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.379980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:50.451391+0000","last_change":"2024-09-14T10:44:44.455451+0000","last_active":"2024-09-14T10:46:50.451391+0000","last_peered":"2024-09-14T10:46:50.451391+0000","last_clean":"2024-09-14T10:46:50.451391+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:46:50.451391+0000","last_undegraded":"2024-09-14T10:46:50.451391+0000","last_fullsized":"2024-09-14T10:46:50.451391+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:57.298667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'62","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.907486+0000","last_change":"2024-09-14T10:44:11.326152+0000","last_active":"2024-09-14T10:47:21.907486+0000","last_peered":"2024-09-14T10:47:21.907486+0000","last_clean":"2024-09-14T10:47:21.907486+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:47:21.907486+0000","last_undegraded":"2024-09-14T10:47:21.907486+0000","last_fullsized":"2024-09-14T10:47:21.907486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:41.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432731+0000","last_change":"2024-09-14T10:44:13.362954+0000","last_active":"2024-09-14T10:44:44.432731+0000","last_peered":"2024-09-14T10:44:44.432731+0000","last_clean":"2024-09-14T10:44:44.432731+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:44:44.432731+0000","last_undegraded":"2024-09-14T10:44:44.432731+0000","last_fullsized":"2024-09-14T10:44:44.432731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.191871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.551637+0000","last_change":"2024-09-14T10:44:15.380020+0000","last_active":"2024-09-14T10:46:20.551637+0000","last_peered":"2024-09-14T10:46:20.551637+0000","last_clean":"2024-09-14T10:46:20.551637+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:46:20.551637+0000","last_undegraded":"2024-09-14T10:46:20.551637+0000","last_fullsized":"2024-09-14T10:46:20.551637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:17.206749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.508788+0000","last_change":"2024-09-14T10:44:07.319078+0000","last_active":"2024-09-14T10:46:16.508788+0000","last_peered":"2024-09-14T10:46:16.508788+0000","last_clean":"2024-09-14T10:46:16.508788+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:46:16.508788+0000","last_undegraded":"2024-09-14T10:46:16.508788+0000","last_fullsized":"2024-09-14T10:46:16.508788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:20.214122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.692204+0000","last_change":"2024-09-14T10:44:05.323716+0000","last_active":"2024-09-14T10:47:21.692204+0000","last_peered":"2024-09-14T10:47:21.692204+0000","last_clean":"2024-09-14T10:47:21.692204+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:21.692204+0000","last_undegraded":"2024-09-14T10:47:21.692204+0000","last_fullsized":"2024-09-14T10:47:21.692204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:48.326362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456259+0000","last_change":"2024-09-14T10:43:57.465338+0000","last_active":"2024-09-14T10:44:44.456259+0000","last_peered":"2024-09-14T10:44:44.456259+0000","last_clean":"2024-09-14T10:44:44.456259+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:44:44.456259+0000","last_undegraded":"2024-09-14T10:44:44.456259+0000","last_fullsized":"2024-09-14T10:44:44.456259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.995453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450895+0000","last_change":"2024-09-14T10:44:09.332697+0000","last_active":"2024-09-14T10:44:44.450895+0000","last_peered":"2024-09-14T10:44:44.450895+0000","last_clean":"2024-09-14T10:44:44.450895+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:44:44.450895+0000","last_undegraded":"2024-09-14T10:44:44.450895+0000","last_fullsized":"2024-09-14T10:44:44.450895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:36.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451768+0000","last_change":"2024-09-14T10:44:11.338828+0000","last_active":"2024-09-14T10:44:44.451768+0000","last_peered":"2024-09-14T10:44:44.451768+0000","last_clean":"2024-09-14T10:44:44.451768+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:44:44.451768+0000","last_undegraded":"2024-09-14T10:44:44.451768+0000","last_fullsized":"2024-09-14T10:44:44.451768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:03.825369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.565979+0000","last_change":"2024-09-14T10:44:13.353577+0000","last_active":"2024-09-14T10:47:19.565979+0000","last_peered":"2024-09-14T10:47:19.565979+0000","last_clean":"2024-09-14T10:47:19.565979+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:47:19.565979+0000","last_undegraded":"2024-09-14T10:47:19.565979+0000","last_fullsized":"2024-09-14T10:47:19.565979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.459796+0000","last_change":"2024-09-14T10:44:15.371433+0000","last_active":"2024-09-14T10:44:44.459796+0000","last_peered":"2024-09-14T10:44:44.459796+0000","last_clean":"2024-09-14T10:44:44.459796+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:44:44.459796+0000","last_undegraded":"2024-09-14T10:44:44.459796+0000","last_fullsized":"2024-09-14T10:44:44.459796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:12.672256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.719980+0000","last_change":"2024-09-14T10:44:07.313506+0000","last_active":"2024-09-14T10:47:21.719980+0000","last_peered":"2024-09-14T10:47:21.719980+0000","last_clean":"2024-09-14T10:47:21.719980+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:47:21.719980+0000","last_undegraded":"2024-09-14T10:47:21.719980+0000","last_fullsized":"2024-09-14T10:47:21.719980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:57.847452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.461911+0000","last_change":"2024-09-14T10:44:05.318013+0000","last_active":"2024-09-14T10:44:44.461911+0000","last_peered":"2024-09-14T10:44:44.461911+0000","last_clean":"2024-09-14T10:44:44.461911+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:44:44.461911+0000","last_undegraded":"2024-09-14T10:44:44.461911+0000","last_fullsized":"2024-09-14T10:44:44.461911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:54.849665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444188+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:44:44.444188+0000","last_peered":"2024-09-14T10:44:44.444188+0000","last_clean":"2024-09-14T10:44:44.444188+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:44:44.444188+0000","last_undegraded":"2024-09-14T10:44:44.444188+0000","last_fullsized":"2024-09-14T10:44:44.444188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.947188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442798+0000","last_change":"2024-09-14T10:44:09.334472+0000","last_active":"2024-09-14T10:44:44.442798+0000","last_peered":"2024-09-14T10:44:44.442798+0000","last_clean":"2024-09-14T10:44:44.442798+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:44:44.442798+0000","last_undegraded":"2024-09-14T10:44:44.442798+0000","last_fullsized":"2024-09-14T10:44:44.442798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:18.491213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453618+0000","last_change":"2024-09-14T10:44:11.360311+0000","last_active":"2024-09-14T10:44:44.453618+0000","last_peered":"2024-09-14T10:44:44.453618+0000","last_clean":"2024-09-14T10:44:44.453618+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:44:44.453618+0000","last_undegraded":"2024-09-14T10:44:44.453618+0000","last_fullsized":"2024-09-14T10:44:44.453618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:18.907361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":419,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.052270+0000","last_change":"2024-09-14T10:44:13.349515+0000","last_active":"2024-09-14T10:47:22.052270+0000","last_peered":"2024-09-14T10:47:22.052270+0000","last_clean":"2024-09-14T10:47:22.052270+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:47:22.052270+0000","last_undegraded":"2024-09-14T10:47:22.052270+0000","last_fullsized":"2024-09-14T10:47:22.052270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.867987+0000","last_change":"2024-09-14T10:44:15.380474+0000","last_active":"2024-09-14T10:45:35.867987+0000","last_peered":"2024-09-14T10:45:35.867987+0000","last_clean":"2024-09-14T10:45:35.867987+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:45:35.867987+0000","last_undegraded":"2024-09-14T10:45:35.867987+0000","last_fullsized":"2024-09-14T10:45:35.867987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:15.535271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433094+0000","last_change":"2024-09-14T10:44:07.314957+0000","last_active":"2024-09-14T10:44:44.433094+0000","last_peered":"2024-09-14T10:44:44.433094+0000","last_clean":"2024-09-14T10:44:44.433094+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:44:44.433094+0000","last_undegraded":"2024-09-14T10:44:44.433094+0000","last_fullsized":"2024-09-14T10:44:44.433094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.570663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.440796+0000","last_change":"2024-09-14T10:44:05.322609+0000","last_active":"2024-09-14T10:46:14.440796+0000","last_peered":"2024-09-14T10:46:14.440796+0000","last_clean":"2024-09-14T10:46:14.440796+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:46:14.440796+0000","last_undegraded":"2024-09-14T10:46:14.440796+0000","last_fullsized":"2024-09-14T10:46:14.440796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:49.133099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.461469+0000","last_change":"2024-09-14T10:43:57.467362+0000","last_active":"2024-09-14T10:44:44.461469+0000","last_peered":"2024-09-14T10:44:44.461469+0000","last_clean":"2024-09-14T10:44:44.461469+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:44:44.461469+0000","last_undegraded":"2024-09-14T10:44:44.461469+0000","last_fullsized":"2024-09-14T10:44:44.461469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.939647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440109+0000","last_change":"2024-09-14T10:44:09.335319+0000","last_active":"2024-09-14T10:44:44.440109+0000","last_peered":"2024-09-14T10:44:44.440109+0000","last_clean":"2024-09-14T10:44:44.440109+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:44:44.440109+0000","last_undegraded":"2024-09-14T10:44:44.440109+0000","last_fullsized":"2024-09-14T10:44:44.440109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:44.522431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'83","reported_seq":156,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.628711+0000","last_change":"2024-09-14T10:44:11.359272+0000","last_active":"2024-09-14T10:46:18.628711+0000","last_peered":"2024-09-14T10:46:18.628711+0000","last_clean":"2024-09-14T10:46:18.628711+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:46:18.628711+0000","last_undegraded":"2024-09-14T10:46:18.628711+0000","last_fullsized":"2024-09-14T10:46:18.628711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438836+0000","last_change":"2024-09-14T10:44:13.361050+0000","last_active":"2024-09-14T10:44:44.438836+0000","last_peered":"2024-09-14T10:44:44.438836+0000","last_clean":"2024-09-14T10:44:44.438836+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:44:44.438836+0000","last_undegraded":"2024-09-14T10:44:44.438836+0000","last_fullsized":"2024-09-14T10:44:44.438836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.597367+0000","last_change":"2024-09-14T10:44:15.376175+0000","last_active":"2024-09-14T10:44:52.597367+0000","last_peered":"2024-09-14T10:44:52.597367+0000","last_clean":"2024-09-14T10:44:52.597367+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:44:52.597367+0000","last_undegraded":"2024-09-14T10:44:52.597367+0000","last_fullsized":"2024-09-14T10:44:52.597367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.409508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.990797+0000","last_change":"2024-09-14T10:44:15.381865+0000","last_active":"2024-09-14T10:47:21.990797+0000","last_peered":"2024-09-14T10:47:21.990797+0000","last_clean":"2024-09-14T10:47:21.990797+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:47:21.990797+0000","last_undegraded":"2024-09-14T10:47:21.990797+0000","last_fullsized":"2024-09-14T10:47:21.990797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:55.550930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.520688+0000","last_change":"2024-09-14T10:44:07.314638+0000","last_active":"2024-09-14T10:47:21.520688+0000","last_peered":"2024-09-14T10:47:21.520688+0000","last_clean":"2024-09-14T10:47:21.520688+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:47:21.520688+0000","last_undegraded":"2024-09-14T10:47:21.520688+0000","last_fullsized":"2024-09-14T10:47:21.520688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:49.986512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444504+0000","last_change":"2024-09-14T10:44:05.315040+0000","last_active":"2024-09-14T10:46:24.444504+0000","last_peered":"2024-09-14T10:46:24.444504+0000","last_clean":"2024-09-14T10:46:24.444504+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:46:24.444504+0000","last_undegraded":"2024-09-14T10:46:24.444504+0000","last_fullsized":"2024-09-14T10:46:24.444504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:41.172912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:02.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.645619+0000","last_change":"2024-09-14T10:44:11.356682+0000","last_active":"2024-09-14T10:46:18.645619+0000","last_peered":"2024-09-14T10:46:18.645619+0000","last_clean":"2024-09-14T10:46:18.645619+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:46:18.645619+0000","last_undegraded":"2024-09-14T10:46:18.645619+0000","last_fullsized":"2024-09-14T10:46:18.645619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:36.580622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442491+0000","last_change":"2024-09-14T10:44:13.370490+0000","last_active":"2024-09-14T10:44:44.442491+0000","last_peered":"2024-09-14T10:44:44.442491+0000","last_clean":"2024-09-14T10:44:44.442491+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:44:44.442491+0000","last_undegraded":"2024-09-14T10:44:44.442491+0000","last_fullsized":"2024-09-14T10:44:44.442491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:34.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.285933+0000","last_change":"2024-09-14T10:44:15.361905+0000","last_active":"2024-09-14T10:46:18.285933+0000","last_peered":"2024-09-14T10:46:18.285933+0000","last_clean":"2024-09-14T10:46:18.285933+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:46:18.285933+0000","last_undegraded":"2024-09-14T10:46:18.285933+0000","last_fullsized":"2024-09-14T10:46:18.285933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:48.673933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699026+0000","last_change":"2024-09-14T10:44:44.460104+0000","last_active":"2024-09-14T10:46:20.699026+0000","last_peered":"2024-09-14T10:46:20.699026+0000","last_clean":"2024-09-14T10:46:20.699026+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:46:20.699026+0000","last_undegraded":"2024-09-14T10:46:20.699026+0000","last_fullsized":"2024-09-14T10:46:20.699026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:13.899780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.708947+0000","last_change":"2024-09-14T10:44:05.320160+0000","last_active":"2024-09-14T10:44:50.708947+0000","last_peered":"2024-09-14T10:44:50.708947+0000","last_clean":"2024-09-14T10:44:50.708947+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:44:50.708947+0000","last_undegraded":"2024-09-14T10:44:50.708947+0000","last_fullsized":"2024-09-14T10:44:50.708947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:09.975430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.464537+0000","last_change":"2024-09-14T10:44:44.463214+0000","last_active":"2024-09-14T10:44:44.464537+0000","last_peered":"2024-09-14T10:44:44.464537+0000","last_clean":"2024-09-14T10:44:44.464537+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:44:44.464537+0000","last_undegraded":"2024-09-14T10:44:44.464537+0000","last_fullsized":"2024-09-14T10:44:44.464537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:34.009805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.732910+0000","last_change":"2024-09-14T10:44:11.323585+0000","last_active":"2024-09-14T10:47:20.732910+0000","last_peered":"2024-09-14T10:47:20.732910+0000","last_clean":"2024-09-14T10:47:20.732910+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:47:20.732910+0000","last_undegraded":"2024-09-14T10:47:20.732910+0000","last_fullsized":"2024-09-14T10:47:20.732910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:36.664992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434000+0000","last_change":"2024-09-14T10:44:13.371900+0000","last_active":"2024-09-14T10:44:44.434000+0000","last_peered":"2024-09-14T10:44:44.434000+0000","last_clean":"2024-09-14T10:44:44.434000+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:44:44.434000+0000","last_undegraded":"2024-09-14T10:44:44.434000+0000","last_fullsized":"2024-09-14T10:44:44.434000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:29.727463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440980+0000","last_change":"2024-09-14T10:44:15.386483+0000","last_active":"2024-09-14T10:44:44.440980+0000","last_peered":"2024-09-14T10:44:44.440980+0000","last_clean":"2024-09-14T10:44:44.440980+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:44:44.440980+0000","last_undegraded":"2024-09-14T10:44:44.440980+0000","last_fullsized":"2024-09-14T10:44:44.440980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.723831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.523634+0000","last_change":"2024-09-14T10:44:07.316643+0000","last_active":"2024-09-14T10:47:21.523634+0000","last_peered":"2024-09-14T10:47:21.523634+0000","last_clean":"2024-09-14T10:47:21.523634+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:47:21.523634+0000","last_undegraded":"2024-09-14T10:47:21.523634+0000","last_fullsized":"2024-09-14T10:47:21.523634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:51.889645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439378+0000","last_change":"2024-09-14T10:44:05.322513+0000","last_active":"2024-09-14T10:44:44.439378+0000","last_peered":"2024-09-14T10:44:44.439378+0000","last_clean":"2024-09-14T10:44:44.439378+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:44:44.439378+0000","last_undegraded":"2024-09-14T10:44:44.439378+0000","last_fullsized":"2024-09-14T10:44:44.439378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:39.441568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432334+0000","last_change":"2024-09-14T10:44:09.318542+0000","last_active":"2024-09-14T10:44:44.432334+0000","last_peered":"2024-09-14T10:44:44.432334+0000","last_clean":"2024-09-14T10:44:44.432334+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:44:44.432334+0000","last_undegraded":"2024-09-14T10:44:44.432334+0000","last_fullsized":"2024-09-14T10:44:44.432334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:29.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.823759+0000","last_change":"2024-09-14T10:44:11.336124+0000","last_active":"2024-09-14T10:47:20.823759+0000","last_peered":"2024-09-14T10:47:20.823759+0000","last_clean":"2024-09-14T10:47:20.823759+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:47:20.823759+0000","last_undegraded":"2024-09-14T10:47:20.823759+0000","last_fullsized":"2024-09-14T10:47:20.823759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:04.242694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444917+0000","last_change":"2024-09-14T10:44:13.354345+0000","last_active":"2024-09-14T10:44:44.444917+0000","last_peered":"2024-09-14T10:44:44.444917+0000","last_clean":"2024-09-14T10:44:44.444917+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:44:44.444917+0000","last_undegraded":"2024-09-14T10:44:44.444917+0000","last_fullsized":"2024-09-14T10:44:44.444917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451891+0000","last_change":"2024-09-14T10:44:15.378526+0000","last_active":"2024-09-14T10:44:44.451891+0000","last_peered":"2024-09-14T10:44:44.451891+0000","last_clean":"2024-09-14T10:44:44.451891+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:44:44.451891+0000","last_undegraded":"2024-09-14T10:44:44.451891+0000","last_fullsized":"2024-09-14T10:44:44.451891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:34.239574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872753+0000","last_change":"2024-09-14T10:44:07.313804+0000","last_active":"2024-09-14T10:45:35.872753+0000","last_peered":"2024-09-14T10:45:35.872753+0000","last_clean":"2024-09-14T10:45:35.872753+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:45:35.872753+0000","last_undegraded":"2024-09-14T10:45:35.872753+0000","last_fullsized":"2024-09-14T10:45:35.872753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:24.864032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:05.322391+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442567+0000","last_change":"2024-09-14T10:44:09.338478+0000","last_active":"2024-09-14T10:44:44.442567+0000","last_peered":"2024-09-14T10:44:44.442567+0000","last_clean":"2024-09-14T10:44:44.442567+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:44:44.442567+0000","last_undegraded":"2024-09-14T10:44:44.442567+0000","last_fullsized":"2024-09-14T10:44:44.442567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:42.543570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.626754+0000","last_change":"2024-09-14T10:44:11.321761+0000","last_active":"2024-09-14T10:46:18.626754+0000","last_peered":"2024-09-14T10:46:18.626754+0000","last_clean":"2024-09-14T10:46:18.626754+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:46:18.626754+0000","last_undegraded":"2024-09-14T10:46:18.626754+0000","last_fullsized":"2024-09-14T10:46:18.626754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.326575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434240+0000","last_change":"2024-09-14T10:44:13.356507+0000","last_active":"2024-09-14T10:44:44.434240+0000","last_peered":"2024-09-14T10:44:44.434240+0000","last_clean":"2024-09-14T10:44:44.434240+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:44:44.434240+0000","last_undegraded":"2024-09-14T10:44:44.434240+0000","last_fullsized":"2024-09-14T10:44:44.434240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.808772+0000","last_change":"2024-09-14T10:44:07.313195+0000","last_active":"2024-09-14T10:47:21.808772+0000","last_peered":"2024-09-14T10:47:21.808772+0000","last_clean":"2024-09-14T10:47:21.808772+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:47:21.808772+0000","last_undegraded":"2024-09-14T10:47:21.808772+0000","last_fullsized":"2024-09-14T10:47:21.808772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:53.410685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440632+0000","last_change":"2024-09-14T10:44:05.324942+0000","last_active":"2024-09-14T10:44:44.440632+0000","last_peered":"2024-09-14T10:44:44.440632+0000","last_clean":"2024-09-14T10:44:44.440632+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:44:44.440632+0000","last_undegraded":"2024-09-14T10:44:44.440632+0000","last_fullsized":"2024-09-14T10:44:44.440632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:09.809429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443876+0000","last_change":"2024-09-14T10:44:09.332885+0000","last_active":"2024-09-14T10:44:44.443876+0000","last_peered":"2024-09-14T10:44:44.443876+0000","last_clean":"2024-09-14T10:44:44.443876+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:44:44.443876+0000","last_undegraded":"2024-09-14T10:44:44.443876+0000","last_fullsized":"2024-09-14T10:44:44.443876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:29.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.655962+0000","last_change":"2024-09-14T10:44:11.340857+0000","last_active":"2024-09-14T10:46:18.655962+0000","last_peered":"2024-09-14T10:46:18.655962+0000","last_clean":"2024-09-14T10:46:18.655962+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:46:18.655962+0000","last_undegraded":"2024-09-14T10:46:18.655962+0000","last_fullsized":"2024-09-14T10:46:18.655962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:58.117101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436429+0000","last_change":"2024-09-14T10:44:13.356783+0000","last_active":"2024-09-14T10:44:44.436429+0000","last_peered":"2024-09-14T10:44:44.436429+0000","last_clean":"2024-09-14T10:44:44.436429+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:44:44.436429+0000","last_undegraded":"2024-09-14T10:44:44.436429+0000","last_fullsized":"2024-09-14T10:44:44.436429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:57.886038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.426338+0000","last_change":"2024-09-14T10:44:15.390085+0000","last_active":"2024-09-14T10:47:21.426338+0000","last_peered":"2024-09-14T10:47:21.426338+0000","last_clean":"2024-09-14T10:47:21.426338+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:47:21.426338+0000","last_undegraded":"2024-09-14T10:47:21.426338+0000","last_fullsized":"2024-09-14T10:47:21.426338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:09.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882763+0000","last_change":"2024-09-14T10:44:07.305111+0000","last_active":"2024-09-14T10:47:21.882763+0000","last_peered":"2024-09-14T10:47:21.882763+0000","last_clean":"2024-09-14T10:47:21.882763+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:47:21.882763+0000","last_undegraded":"2024-09-14T10:47:21.882763+0000","last_fullsized":"2024-09-14T10:47:21.882763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:28.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.443685+0000","last_change":"2024-09-14T10:44:05.316373+0000","last_active":"2024-09-14T10:46:29.443685+0000","last_peered":"2024-09-14T10:46:29.443685+0000","last_clean":"2024-09-14T10:46:29.443685+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:46:29.443685+0000","last_undegraded":"2024-09-14T10:46:29.443685+0000","last_fullsized":"2024-09-14T10:46:29.443685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:20.065314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439696+0000","last_change":"2024-09-14T10:44:09.313053+0000","last_active":"2024-09-14T10:44:44.439696+0000","last_peered":"2024-09-14T10:44:44.439696+0000","last_clean":"2024-09-14T10:44:44.439696+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:44:44.439696+0000","last_undegraded":"2024-09-14T10:44:44.439696+0000","last_fullsized":"2024-09-14T10:44:44.439696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.375123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.627786+0000","last_change":"2024-09-14T10:44:11.359808+0000","last_active":"2024-09-14T10:46:18.627786+0000","last_peered":"2024-09-14T10:46:18.627786+0000","last_clean":"2024-09-14T10:46:18.627786+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:46:18.627786+0000","last_undegraded":"2024-09-14T10:46:18.627786+0000","last_fullsized":"2024-09-14T10:46:18.627786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:51.224366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445366+0000","last_change":"2024-09-14T10:44:13.371652+0000","last_active":"2024-09-14T10:44:44.445366+0000","last_peered":"2024-09-14T10:44:44.445366+0000","last_clean":"2024-09-14T10:44:44.445366+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:44:44.445366+0000","last_undegraded":"2024-09-14T10:44:44.445366+0000","last_fullsized":"2024-09-14T10:44:44.445366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450551+0000","last_change":"2024-09-14T10:44:15.379606+0000","last_active":"2024-09-14T10:44:44.450551+0000","last_peered":"2024-09-14T10:44:44.450551+0000","last_clean":"2024-09-14T10:44:44.450551+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:44:44.450551+0000","last_undegraded":"2024-09-14T10:44:44.450551+0000","last_fullsized":"2024-09-14T10:44:44.450551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:37.639739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.298696+0000","last_change":"2024-09-14T10:44:07.317281+0000","last_active":"2024-09-14T10:44:52.298696+0000","last_peered":"2024-09-14T10:44:52.298696+0000","last_clean":"2024-09-14T10:44:52.298696+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:44:52.298696+0000","last_undegraded":"2024-09-14T10:44:52.298696+0000","last_fullsized":"2024-09-14T10:44:52.298696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:19.569186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446007+0000","last_change":"2024-09-14T10:44:05.319971+0000","last_active":"2024-09-14T10:44:44.446007+0000","last_peered":"2024-09-14T10:44:44.446007+0000","last_clean":"2024-09-14T10:44:44.446007+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:44:44.446007+0000","last_undegraded":"2024-09-14T10:44:44.446007+0000","last_fullsized":"2024-09-14T10:44:44.446007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:30.432326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438372+0000","last_change":"2024-09-14T10:44:09.316331+0000","last_active":"2024-09-14T10:44:44.438372+0000","last_peered":"2024-09-14T10:44:44.438372+0000","last_clean":"2024-09-14T10:44:44.438372+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:44:44.438372+0000","last_undegraded":"2024-09-14T10:44:44.438372+0000","last_fullsized":"2024-09-14T10:44:44.438372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.269872+0000","last_change":"2024-09-14T10:44:11.330416+0000","last_active":"2024-09-14T10:46:18.269872+0000","last_peered":"2024-09-14T10:46:18.269872+0000","last_clean":"2024-09-14T10:46:18.269872+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:46:18.269872+0000","last_undegraded":"2024-09-14T10:46:18.269872+0000","last_fullsized":"2024-09-14T10:46:18.269872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:58.265390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443419+0000","last_change":"2024-09-14T10:44:13.364526+0000","last_active":"2024-09-14T10:44:44.443419+0000","last_peered":"2024-09-14T10:44:44.443419+0000","last_clean":"2024-09-14T10:44:44.443419+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:44:44.443419+0000","last_undegraded":"2024-09-14T10:44:44.443419+0000","last_fullsized":"2024-09-14T10:44:44.443419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:46.572662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.685006+0000","last_change":"2024-09-14T10:44:15.379535+0000","last_active":"2024-09-14T10:46:20.685006+0000","last_peered":"2024-09-14T10:46:20.685006+0000","last_clean":"2024-09-14T10:46:20.685006+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:46:20.685006+0000","last_undegraded":"2024-09-14T10:46:20.685006+0000","last_fullsized":"2024-09-14T10:46:20.685006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:20.408629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.380036+0000","last_change":"2024-09-14T10:44:07.306266+0000","last_active":"2024-09-14T10:47:21.380036+0000","last_peered":"2024-09-14T10:47:21.380036+0000","last_clean":"2024-09-14T10:47:21.380036+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:47:21.380036+0000","last_undegraded":"2024-09-14T10:47:21.380036+0000","last_fullsized":"2024-09-14T10:47:21.380036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:57.380845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454069+0000","last_change":"2024-09-14T10:44:05.324788+0000","last_active":"2024-09-14T10:44:44.454069+0000","last_peered":"2024-09-14T10:44:44.454069+0000","last_clean":"2024-09-14T10:44:44.454069+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:44:44.454069+0000","last_undegraded":"2024-09-14T10:44:44.454069+0000","last_fullsized":"2024-09-14T10:44:44.454069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:56.141828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.083888+0000","last_change":"2024-09-14T10:44:09.313857+0000","last_active":"2024-09-14T10:46:20.083888+0000","last_peered":"2024-09-14T10:46:20.083888+0000","last_clean":"2024-09-14T10:46:20.083888+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:46:20.083888+0000","last_undegraded":"2024-09-14T10:46:20.083888+0000","last_fullsized":"2024-09-14T10:46:20.083888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:53.790922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'12","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.442571+0000","last_change":"2024-09-14T10:44:11.365067+0000","last_active":"2024-09-14T10:46:14.442571+0000","last_peered":"2024-09-14T10:46:14.442571+0000","last_clean":"2024-09-14T10:46:14.442571+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:46:14.442571+0000","last_undegraded":"2024-09-14T10:46:14.442571+0000","last_fullsized":"2024-09-14T10:46:14.442571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:24.755831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566159+0000","last_change":"2024-09-14T10:44:13.372845+0000","last_active":"2024-09-14T10:47:19.566159+0000","last_peered":"2024-09-14T10:47:19.566159+0000","last_clean":"2024-09-14T10:47:19.566159+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:47:19.566159+0000","last_undegraded":"2024-09-14T10:47:19.566159+0000","last_fullsized":"2024-09-14T10:47:19.566159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:44.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.813949+0000","last_change":"2024-09-14T10:44:15.388635+0000","last_active":"2024-09-14T10:47:21.813949+0000","last_peered":"2024-09-14T10:47:21.813949+0000","last_clean":"2024-09-14T10:47:21.813949+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:47:21.813949+0000","last_undegraded":"2024-09-14T10:47:21.813949+0000","last_fullsized":"2024-09-14T10:47:21.813949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:00.563368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.297384+0000","last_change":"2024-09-14T10:44:07.297715+0000","last_active":"2024-09-14T10:44:52.297384+0000","last_peered":"2024-09-14T10:44:52.297384+0000","last_clean":"2024-09-14T10:44:52.297384+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:44:52.297384+0000","last_undegraded":"2024-09-14T10:44:52.297384+0000","last_fullsized":"2024-09-14T10:44:52.297384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:13.693037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.857406+0000","last_change":"2024-09-14T10:44:05.320001+0000","last_active":"2024-09-14T10:45:35.857406+0000","last_peered":"2024-09-14T10:45:35.857406+0000","last_clean":"2024-09-14T10:45:35.857406+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:45:35.857406+0000","last_undegraded":"2024-09-14T10:45:35.857406+0000","last_fullsized":"2024-09-14T10:45:35.857406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:36.390217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.070178+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:46:20.070178+0000","last_peered":"2024-09-14T10:46:20.070178+0000","last_clean":"2024-09-14T10:46:20.070178+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:46:20.070178+0000","last_undegraded":"2024-09-14T10:46:20.070178+0000","last_fullsized":"2024-09-14T10:46:20.070178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:58.082949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.614388+0000","last_change":"2024-09-14T10:44:11.327509+0000","last_active":"2024-09-14T10:46:18.614388+0000","last_peered":"2024-09-14T10:46:18.614388+0000","last_clean":"2024-09-14T10:46:18.614388+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:46:18.614388+0000","last_undegraded":"2024-09-14T10:46:18.614388+0000","last_fullsized":"2024-09-14T10:46:18.614388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.860344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438767+0000","last_change":"2024-09-14T10:44:13.376040+0000","last_active":"2024-09-14T10:44:44.438767+0000","last_peered":"2024-09-14T10:44:44.438767+0000","last_clean":"2024-09-14T10:44:44.438767+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:44:44.438767+0000","last_undegraded":"2024-09-14T10:44:44.438767+0000","last_fullsized":"2024-09-14T10:44:44.438767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452541+0000","last_change":"2024-09-14T10:44:15.388404+0000","last_active":"2024-09-14T10:44:44.452541+0000","last_peered":"2024-09-14T10:44:44.452541+0000","last_clean":"2024-09-14T10:44:44.452541+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:44:44.452541+0000","last_undegraded":"2024-09-14T10:44:44.452541+0000","last_fullsized":"2024-09-14T10:44:44.452541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720287+0000","last_change":"2024-09-14T10:44:07.301782+0000","last_active":"2024-09-14T10:47:21.720287+0000","last_peered":"2024-09-14T10:47:21.720287+0000","last_clean":"2024-09-14T10:47:21.720287+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:47:21.720287+0000","last_undegraded":"2024-09-14T10:47:21.720287+0000","last_fullsized":"2024-09-14T10:47:21.720287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:43.671200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456552+0000","last_change":"2024-09-14T10:44:05.321255+0000","last_active":"2024-09-14T10:44:44.456552+0000","last_peered":"2024-09-14T10:44:44.456552+0000","last_clean":"2024-09-14T10:44:44.456552+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:44:44.456552+0000","last_undegraded":"2024-09-14T10:44:44.456552+0000","last_fullsized":"2024-09-14T10:44:44.456552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:08.383959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436064+0000","last_change":"2024-09-14T10:44:09.320830+0000","last_active":"2024-09-14T10:44:44.436064+0000","last_peered":"2024-09-14T10:44:44.436064+0000","last_clean":"2024-09-14T10:44:44.436064+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:44:44.436064+0000","last_undegraded":"2024-09-14T10:44:44.436064+0000","last_fullsized":"2024-09-14T10:44:44.436064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:33.277860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.618426+0000","last_change":"2024-09-14T10:44:11.325995+0000","last_active":"2024-09-14T10:46:18.618426+0000","last_peered":"2024-09-14T10:46:18.618426+0000","last_clean":"2024-09-14T10:46:18.618426+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:46:18.618426+0000","last_undegraded":"2024-09-14T10:46:18.618426+0000","last_fullsized":"2024-09-14T10:46:18.618426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:19.897508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441744+0000","last_change":"2024-09-14T10:44:13.369101+0000","last_active":"2024-09-14T10:44:44.441744+0000","last_peered":"2024-09-14T10:44:44.441744+0000","last_clean":"2024-09-14T10:44:44.441744+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:44:44.441744+0000","last_undegraded":"2024-09-14T10:44:44.441744+0000","last_fullsized":"2024-09-14T10:44:44.441744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:12.164053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457651+0000","last_change":"2024-09-14T10:44:15.386917+0000","last_active":"2024-09-14T10:44:44.457651+0000","last_peered":"2024-09-14T10:44:44.457651+0000","last_clean":"2024-09-14T10:44:44.457651+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:44:44.457651+0000","last_undegraded":"2024-09-14T10:44:44.457651+0000","last_fullsized":"2024-09-14T10:44:44.457651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:38.536486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600974+0000","last_change":"2024-09-14T10:44:44.464149+0000","last_active":"2024-09-14T10:45:35.600974+0000","last_peered":"2024-09-14T10:45:35.600974+0000","last_clean":"2024-09-14T10:45:35.600974+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:45:35.600974+0000","last_undegraded":"2024-09-14T10:45:35.600974+0000","last_fullsized":"2024-09-14T10:45:35.600974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:26.594110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.245635+0000","last_change":"2024-09-14T10:44:05.314583+0000","last_active":"2024-09-14T10:47:21.245635+0000","last_peered":"2024-09-14T10:47:21.245635+0000","last_clean":"2024-09-14T10:47:21.245635+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:21.245635+0000","last_undegraded":"2024-09-14T10:47:21.245635+0000","last_fullsized":"2024-09-14T10:47:21.245635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:24.166852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436523+0000","last_change":"2024-09-14T10:44:09.318111+0000","last_active":"2024-09-14T10:44:44.436523+0000","last_peered":"2024-09-14T10:44:44.436523+0000","last_clean":"2024-09-14T10:44:44.436523+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:44:44.436523+0000","last_undegraded":"2024-09-14T10:44:44.436523+0000","last_fullsized":"2024-09-14T10:44:44.436523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:12.821605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.647577+0000","last_change":"2024-09-14T10:44:11.356523+0000","last_active":"2024-09-14T10:46:18.647577+0000","last_peered":"2024-09-14T10:46:18.647577+0000","last_clean":"2024-09-14T10:46:18.647577+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:46:18.647577+0000","last_undegraded":"2024-09-14T10:46:18.647577+0000","last_fullsized":"2024-09-14T10:46:18.647577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:30.747229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451553+0000","last_change":"2024-09-14T10:44:13.367321+0000","last_active":"2024-09-14T10:44:44.451553+0000","last_peered":"2024-09-14T10:44:44.451553+0000","last_clean":"2024-09-14T10:44:44.451553+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:44:44.451553+0000","last_undegraded":"2024-09-14T10:44:44.451553+0000","last_fullsized":"2024-09-14T10:44:44.451553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:58.066611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.662711+0000","last_change":"2024-09-14T10:44:15.385986+0000","last_active":"2024-09-14T10:46:18.662711+0000","last_peered":"2024-09-14T10:46:18.662711+0000","last_clean":"2024-09-14T10:46:18.662711+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:46:18.662711+0000","last_undegraded":"2024-09-14T10:46:18.662711+0000","last_fullsized":"2024-09-14T10:46:18.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:58.059454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.522356+0000","last_change":"2024-09-14T10:44:07.295202+0000","last_active":"2024-09-14T10:46:16.522356+0000","last_peered":"2024-09-14T10:46:16.522356+0000","last_clean":"2024-09-14T10:46:16.522356+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:46:16.522356+0000","last_undegraded":"2024-09-14T10:46:16.522356+0000","last_fullsized":"2024-09-14T10:46:16.522356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:40.711930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451048+0000","last_change":"2024-09-14T10:44:05.323017+0000","last_active":"2024-09-14T10:44:44.451048+0000","last_peered":"2024-09-14T10:44:44.451048+0000","last_clean":"2024-09-14T10:44:44.451048+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:44:44.451048+0000","last_undegraded":"2024-09-14T10:44:44.451048+0000","last_fullsized":"2024-09-14T10:44:44.451048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:48.326362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.016574+0000","last_change":"2024-09-14T10:44:09.327924+0000","last_active":"2024-09-14T10:46:17.016574+0000","last_peered":"2024-09-14T10:46:17.016574+0000","last_clean":"2024-09-14T10:46:17.016574+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:46:17.016574+0000","last_undegraded":"2024-09-14T10:46:17.016574+0000","last_fullsized":"2024-09-14T10:46:17.016574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:38.718169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.731485+0000","last_change":"2024-09-14T10:44:11.357069+0000","last_active":"2024-09-14T10:47:20.731485+0000","last_peered":"2024-09-14T10:47:20.731485+0000","last_clean":"2024-09-14T10:47:20.731485+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:47:20.731485+0000","last_undegraded":"2024-09-14T10:47:20.731485+0000","last_fullsized":"2024-09-14T10:47:20.731485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439393+0000","last_change":"2024-09-14T10:44:13.373389+0000","last_active":"2024-09-14T10:44:44.439393+0000","last_peered":"2024-09-14T10:44:44.439393+0000","last_clean":"2024-09-14T10:44:44.439393+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:44:44.439393+0000","last_undegraded":"2024-09-14T10:44:44.439393+0000","last_fullsized":"2024-09-14T10:44:44.439393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:34.517874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.852899+0000","last_change":"2024-09-14T10:44:15.386649+0000","last_active":"2024-09-14T10:47:20.852899+0000","last_peered":"2024-09-14T10:47:20.852899+0000","last_clean":"2024-09-14T10:47:20.852899+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:47:20.852899+0000","last_undegraded":"2024-09-14T10:47:20.852899+0000","last_fullsized":"2024-09-14T10:47:20.852899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:48.236396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.826073+0000","last_change":"2024-09-14T10:44:07.319333+0000","last_active":"2024-09-14T10:47:21.826073+0000","last_peered":"2024-09-14T10:47:21.826073+0000","last_clean":"2024-09-14T10:47:21.826073+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:47:21.826073+0000","last_undegraded":"2024-09-14T10:47:21.826073+0000","last_fullsized":"2024-09-14T10:47:21.826073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:14.561201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.679774+0000","last_change":"2024-09-14T10:44:05.319396+0000","last_active":"2024-09-14T10:47:21.679774+0000","last_peered":"2024-09-14T10:47:21.679774+0000","last_clean":"2024-09-14T10:47:21.679774+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:47:21.679774+0000","last_undegraded":"2024-09-14T10:47:21.679774+0000","last_fullsized":"2024-09-14T10:47:21.679774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:14.729286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.601482+0000","last_change":"2024-09-14T10:44:07.305165+0000","last_active":"2024-09-14T10:45:35.601482+0000","last_peered":"2024-09-14T10:45:35.601482+0000","last_clean":"2024-09-14T10:45:35.601482+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:45:35.601482+0000","last_undegraded":"2024-09-14T10:45:35.601482+0000","last_fullsized":"2024-09-14T10:45:35.601482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.572269+0000","last_change":"2024-09-14T10:44:05.323992+0000","last_active":"2024-09-14T10:44:52.572269+0000","last_peered":"2024-09-14T10:44:52.572269+0000","last_clean":"2024-09-14T10:44:52.572269+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:44:52.572269+0000","last_undegraded":"2024-09-14T10:44:52.572269+0000","last_fullsized":"2024-09-14T10:44:52.572269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:52.517695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.377995+0000","last_change":"2024-09-14T10:44:07.300105+0000","last_active":"2024-09-14T10:47:21.377995+0000","last_peered":"2024-09-14T10:47:21.377995+0000","last_clean":"2024-09-14T10:47:21.377995+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:47:21.377995+0000","last_undegraded":"2024-09-14T10:47:21.377995+0000","last_fullsized":"2024-09-14T10:47:21.377995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:48.852285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452056+0000","last_change":"2024-09-14T10:44:05.327542+0000","last_active":"2024-09-14T10:44:44.452056+0000","last_peered":"2024-09-14T10:44:44.452056+0000","last_clean":"2024-09-14T10:44:44.452056+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:44:44.452056+0000","last_undegraded":"2024-09-14T10:44:44.452056+0000","last_fullsized":"2024-09-14T10:44:44.452056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:23.168081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441253+0000","last_change":"2024-09-14T10:44:07.306382+0000","last_active":"2024-09-14T10:44:44.441253+0000","last_peered":"2024-09-14T10:44:44.441253+0000","last_clean":"2024-09-14T10:44:44.441253+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:44:44.441253+0000","last_undegraded":"2024-09-14T10:44:44.441253+0000","last_fullsized":"2024-09-14T10:44:44.441253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:58.925922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.713765+0000","last_change":"2024-09-14T10:44:05.323524+0000","last_active":"2024-09-14T10:44:50.713765+0000","last_peered":"2024-09-14T10:44:50.713765+0000","last_clean":"2024-09-14T10:44:50.713765+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:44:50.713765+0000","last_undegraded":"2024-09-14T10:44:50.713765+0000","last_fullsized":"2024-09-14T10:44:50.713765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441282+0000","last_change":"2024-09-14T10:44:07.316775+0000","last_active":"2024-09-14T10:44:44.441282+0000","last_peered":"2024-09-14T10:44:44.441282+0000","last_clean":"2024-09-14T10:44:44.441282+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:44:44.441282+0000","last_undegraded":"2024-09-14T10:44:44.441282+0000","last_fullsized":"2024-09-14T10:44:44.441282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.078507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441499+0000","last_change":"2024-09-14T10:44:05.320107+0000","last_active":"2024-09-14T10:44:44.441499+0000","last_peered":"2024-09-14T10:44:44.441499+0000","last_clean":"2024-09-14T10:44:44.441499+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:44:44.441499+0000","last_undegraded":"2024-09-14T10:44:44.441499+0000","last_fullsized":"2024-09-14T10:44:44.441499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:08.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880716+0000","last_change":"2024-09-14T10:44:07.315346+0000","last_active":"2024-09-14T10:47:21.880716+0000","last_peered":"2024-09-14T10:47:21.880716+0000","last_clean":"2024-09-14T10:47:21.880716+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:47:21.880716+0000","last_undegraded":"2024-09-14T10:47:21.880716+0000","last_fullsized":"2024-09-14T10:47:21.880716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:34.364814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446125+0000","last_change":"2024-09-14T10:44:05.316250+0000","last_active":"2024-09-14T10:44:44.446125+0000","last_peered":"2024-09-14T10:44:44.446125+0000","last_clean":"2024-09-14T10:44:44.446125+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:44:44.446125+0000","last_undegraded":"2024-09-14T10:44:44.446125+0000","last_fullsized":"2024-09-14T10:44:44.446125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:41.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.873291+0000","last_change":"2024-09-14T10:44:07.302298+0000","last_active":"2024-09-14T10:45:35.873291+0000","last_peered":"2024-09-14T10:45:35.873291+0000","last_clean":"2024-09-14T10:45:35.873291+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:45:35.873291+0000","last_undegraded":"2024-09-14T10:45:35.873291+0000","last_fullsized":"2024-09-14T10:45:35.873291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:05.444889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439490+0000","last_change":"2024-09-14T10:44:05.321993+0000","last_active":"2024-09-14T10:44:44.439490+0000","last_peered":"2024-09-14T10:44:44.439490+0000","last_clean":"2024-09-14T10:44:44.439490+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:44:44.439490+0000","last_undegraded":"2024-09-14T10:44:44.439490+0000","last_fullsized":"2024-09-14T10:44:44.439490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:11.032280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.523024+0000","last_change":"2024-09-14T10:44:07.304072+0000","last_active":"2024-09-14T10:46:16.523024+0000","last_peered":"2024-09-14T10:46:16.523024+0000","last_clean":"2024-09-14T10:46:16.523024+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:46:16.523024+0000","last_undegraded":"2024-09-14T10:46:16.523024+0000","last_fullsized":"2024-09-14T10:46:16.523024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444660+0000","last_change":"2024-09-14T10:44:05.314790+0000","last_active":"2024-09-14T10:44:44.444660+0000","last_peered":"2024-09-14T10:44:44.444660+0000","last_clean":"2024-09-14T10:44:44.444660+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:44:44.444660+0000","last_undegraded":"2024-09-14T10:44:44.444660+0000","last_fullsized":"2024-09-14T10:44:44.444660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:08.523198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452649+0000","last_change":"2024-09-14T10:44:07.302967+0000","last_active":"2024-09-14T10:44:44.452649+0000","last_peered":"2024-09-14T10:44:44.452649+0000","last_clean":"2024-09-14T10:44:44.452649+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:44:44.452649+0000","last_undegraded":"2024-09-14T10:44:44.452649+0000","last_fullsized":"2024-09-14T10:44:44.452649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:58.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.707392+0000","last_change":"2024-09-14T10:44:05.326780+0000","last_active":"2024-09-14T10:44:50.707392+0000","last_peered":"2024-09-14T10:44:50.707392+0000","last_clean":"2024-09-14T10:44:50.707392+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:44:50.707392+0000","last_undegraded":"2024-09-14T10:44:50.707392+0000","last_fullsized":"2024-09-14T10:44:50.707392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:30.583609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.848468+0000","last_change":"2024-09-14T10:44:07.309384+0000","last_active":"2024-09-14T10:44:51.848468+0000","last_peered":"2024-09-14T10:44:51.848468+0000","last_clean":"2024-09-14T10:44:51.848468+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:44:51.848468+0000","last_undegraded":"2024-09-14T10:44:51.848468+0000","last_fullsized":"2024-09-14T10:44:51.848468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:20.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440181+0000","last_change":"2024-09-14T10:44:05.324016+0000","last_active":"2024-09-14T10:44:44.440181+0000","last_peered":"2024-09-14T10:44:44.440181+0000","last_clean":"2024-09-14T10:44:44.440181+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:44:44.440181+0000","last_undegraded":"2024-09-14T10:44:44.440181+0000","last_fullsized":"2024-09-14T10:44:44.440181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874270+0000","last_change":"2024-09-14T10:44:07.314041+0000","last_active":"2024-09-14T10:45:35.874270+0000","last_peered":"2024-09-14T10:45:35.874270+0000","last_clean":"2024-09-14T10:45:35.874270+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:45:35.874270+0000","last_undegraded":"2024-09-14T10:45:35.874270+0000","last_fullsized":"2024-09-14T10:45:35.874270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:27.185091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447387+0000","last_change":"2024-09-14T10:44:05.316396+0000","last_active":"2024-09-14T10:44:44.447387+0000","last_peered":"2024-09-14T10:44:44.447387+0000","last_clean":"2024-09-14T10:44:44.447387+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:44:44.447387+0000","last_undegraded":"2024-09-14T10:44:44.447387+0000","last_fullsized":"2024-09-14T10:44:44.447387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:31.844881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600757+0000","last_change":"2024-09-14T10:44:07.303238+0000","last_active":"2024-09-14T10:45:35.600757+0000","last_peered":"2024-09-14T10:45:35.600757+0000","last_clean":"2024-09-14T10:45:35.600757+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:45:35.600757+0000","last_undegraded":"2024-09-14T10:45:35.600757+0000","last_fullsized":"2024-09-14T10:45:35.600757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:49.401193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443767+0000","last_change":"2024-09-14T10:44:05.313950+0000","last_active":"2024-09-14T10:44:44.443767+0000","last_peered":"2024-09-14T10:44:44.443767+0000","last_clean":"2024-09-14T10:44:44.443767+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:44:44.443767+0000","last_undegraded":"2024-09-14T10:44:44.443767+0000","last_fullsized":"2024-09-14T10:44:44.443767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.127894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.375016+0000","last_change":"2024-09-14T10:44:07.319354+0000","last_active":"2024-09-14T10:47:21.375016+0000","last_peered":"2024-09-14T10:47:21.375016+0000","last_clean":"2024-09-14T10:47:21.375016+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:47:21.375016+0000","last_undegraded":"2024-09-14T10:47:21.375016+0000","last_fullsized":"2024-09-14T10:47:21.375016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:26.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453814+0000","last_change":"2024-09-14T10:44:05.318285+0000","last_active":"2024-09-14T10:44:44.453814+0000","last_peered":"2024-09-14T10:44:44.453814+0000","last_clean":"2024-09-14T10:44:44.453814+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:44:44.453814+0000","last_undegraded":"2024-09-14T10:44:44.453814+0000","last_fullsized":"2024-09-14T10:44:44.453814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:09.785074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.697003+0000","last_change":"2024-09-14T10:44:07.304891+0000","last_active":"2024-09-14T10:46:20.697003+0000","last_peered":"2024-09-14T10:46:20.697003+0000","last_clean":"2024-09-14T10:46:20.697003+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:46:20.697003+0000","last_undegraded":"2024-09-14T10:46:20.697003+0000","last_fullsized":"2024-09-14T10:46:20.697003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.594544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457554+0000","last_change":"2024-09-14T10:44:05.324335+0000","last_active":"2024-09-14T10:44:44.457554+0000","last_peered":"2024-09-14T10:44:44.457554+0000","last_clean":"2024-09-14T10:44:44.457554+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:44:44.457554+0000","last_undegraded":"2024-09-14T10:44:44.457554+0000","last_fullsized":"2024-09-14T10:44:44.457554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:36.457645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.521412+0000","last_change":"2024-09-14T10:44:07.309006+0000","last_active":"2024-09-14T10:47:21.521412+0000","last_peered":"2024-09-14T10:47:21.521412+0000","last_clean":"2024-09-14T10:47:21.521412+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:47:21.521412+0000","last_undegraded":"2024-09-14T10:47:21.521412+0000","last_fullsized":"2024-09-14T10:47:21.521412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:25.445644+0000","last_change":"2024-09-14T10:44:05.321869+0000","last_active":"2024-09-14T10:46:25.445644+0000","last_peered":"2024-09-14T10:46:25.445644+0000","last_clean":"2024-09-14T10:46:25.445644+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:46:25.445644+0000","last_undegraded":"2024-09-14T10:46:25.445644+0000","last_fullsized":"2024-09-14T10:46:25.445644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:52.091145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":13,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.537179+0000","last_change":"2024-09-14T10:44:07.303706+0000","last_active":"2024-09-14T10:47:21.537179+0000","last_peered":"2024-09-14T10:47:21.537179+0000","last_clean":"2024-09-14T10:47:21.537179+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:47:21.537179+0000","last_undegraded":"2024-09-14T10:47:21.537179+0000","last_fullsized":"2024-09-14T10:47:21.537179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:47.194815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460745+0000","last_change":"2024-09-14T10:44:05.318005+0000","last_active":"2024-09-14T10:44:44.460745+0000","last_peered":"2024-09-14T10:44:44.460745+0000","last_clean":"2024-09-14T10:44:44.460745+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:44:44.460745+0000","last_undegraded":"2024-09-14T10:44:44.460745+0000","last_fullsized":"2024-09-14T10:44:44.460745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:40.757947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.706195+0000","last_change":"2024-09-14T10:44:05.321634+0000","last_active":"2024-09-14T10:47:21.706195+0000","last_peered":"2024-09-14T10:47:21.706195+0000","last_clean":"2024-09-14T10:47:21.706195+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:47:21.706195+0000","last_undegraded":"2024-09-14T10:47:21.706195+0000","last_fullsized":"2024-09-14T10:47:21.706195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:01.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":29,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882780+0000","last_change":"2024-09-14T10:44:07.310127+0000","last_active":"2024-09-14T10:47:21.882780+0000","last_peered":"2024-09-14T10:47:21.882780+0000","last_clean":"2024-09-14T10:47:21.882780+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:47:21.882780+0000","last_undegraded":"2024-09-14T10:47:21.882780+0000","last_fullsized":"2024-09-14T10:47:21.882780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.606750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.713544+0000","last_change":"2024-09-14T10:44:05.325170+0000","last_active":"2024-09-14T10:44:50.713544+0000","last_peered":"2024-09-14T10:44:50.713544+0000","last_clean":"2024-09-14T10:44:50.713544+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:44:50.713544+0000","last_undegraded":"2024-09-14T10:44:50.713544+0000","last_fullsized":"2024-09-14T10:44:50.713544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:31.844881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.521493+0000","last_change":"2024-09-14T10:44:07.318886+0000","last_active":"2024-09-14T10:46:16.521493+0000","last_peered":"2024-09-14T10:46:16.521493+0000","last_clean":"2024-09-14T10:46:16.521493+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:46:16.521493+0000","last_undegraded":"2024-09-14T10:46:16.521493+0000","last_fullsized":"2024-09-14T10:46:16.521493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:08.926626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13383,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640309,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48896,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322944,"statfs":{"total":96636764160,"available":96586694656,"internally_reserved":0,"allocated":9617408,"data_stored":9346322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44220,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327620,"statfs":{"total":96636764160,"available":96591482880,"internally_reserved":0,"allocated":9089024,"data_stored":8759345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44768,"kb_used_data":9424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327072,"statfs":{"total":96636764160,"available":96590921728,"internally_reserved":0,"allocated":9650176,"data_stored":9349617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":9056256,"data_stored":8757874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:47:54.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:47:54.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.580+0000 7fa49e485640 1 Processor -- start 2024-09-14T10:47:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.580+0000 7fa49e485640 1 -- start start 2024-09-14T10:47:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa49e485640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa498071d80 0x7fa498132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa49e485640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4980724f0 con 0x7fa49812d390 2024-09-14T10:47:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa49e485640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa498099e20 con 0x7fa498071d80 2024-09-14T10:47:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa4977fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa498071d80 0x7fa498132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa497fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa49812d390 0x7fa49812d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:38954/0 (socket says 172.21.15.70:38954) 2024-09-14T10:47:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa497fff640 1 -- 172.21.15.70:0/3531782235 learned_addr learned my addr 172.21.15.70:0/3531782235 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa4977fe640 1 -- 172.21.15.70:0/3531782235 >> v1:172.21.15.70:6789/0 conn(0x7fa49812d390 legacy=0x7fa49812d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa4977fe640 1 -- 172.21.15.70:0/3531782235 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49812de80 con 0x7fa498071d80 2024-09-14T10:47:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa4977fe640 1 --2- 172.21.15.70:0/3531782235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498132390 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009770 tx=0x7fa48c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c0cf6529df0652 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa496ffd640 1 -- 172.21.15.70:0/3531782235 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c0b1070 con 0x7fa498071d80 2024-09-14T10:47:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa496ffd640 1 -- 172.21.15.70:0/3531782235 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c0ac520 con 0x7fa498071d80 2024-09-14T10:47:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.584+0000 7fa496ffd640 1 -- 172.21.15.70:0/3531782235 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c0ac820 con 0x7fa498071d80 2024-09-14T10:47:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- 172.21.15.70:0/3531782235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 msgr2=0x7fa498132390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 --2- 172.21.15.70:0/3531782235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498132390 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009770 tx=0x7fa48c01c370 comp rx=0 tx=0).stop 2024-09-14T10:47:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- 172.21.15.70:0/3531782235 shutdown_connections 2024-09-14T10:47:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 --2- 172.21.15.70:0/3531782235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498132390 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- 172.21.15.70:0/3531782235 >> 172.21.15.70:0/3531782235 conn(0x7fa49809aba0 msgr2=0x7fa4980984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- 172.21.15.70:0/3531782235 shutdown_connections 2024-09-14T10:47:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- 172.21.15.70:0/3531782235 wait complete. 2024-09-14T10:47:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 Processor -- start 2024-09-14T10:47:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- start start 2024-09-14T10:47:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498125d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa498135480 con 0x7fa498071d80 2024-09-14T10:47:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa497fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498125d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa497fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498125d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47192/0 (socket says 172.21.15.70:47192) 2024-09-14T10:47:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa497fff640 1 -- 172.21.15.70:0/3291245665 learned_addr learned my addr 172.21.15.70:0/3291245665 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa497fff640 1 -- 172.21.15.70:0/3291245665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa498127390 con 0x7fa498071d80 2024-09-14T10:47:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa497fff640 1 --2- 172.21.15.70:0/3291245665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498125d40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c480 tx=0x7fa48800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa494ff9640 1 -- 172.21.15.70:0/3291245665 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa488017070 con 0x7fa498071d80 2024-09-14T10:47:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa494ff9640 1 -- 172.21.15.70:0/3291245665 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa488005c20 con 0x7fa498071d80 2024-09-14T10:47:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa494ff9640 1 -- 172.21.15.70:0/3291245665 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4880070d0 con 0x7fa498071d80 2024-09-14T10:47:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa498129070 con 0x7fa498071d80 2024-09-14T10:47:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa498126280 con 0x7fa498071d80 2024-09-14T10:47:54.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa494ff9640 1 -- 172.21.15.70:0/3291245665 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa48801a070 con 0x7fa498071d80 2024-09-14T10:47:54.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49812a3c0 con 0x7fa498071d80 2024-09-14T10:47:54.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa494ff9640 1 --2- 172.21.15.70:0/3291245665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa48403b860 0x7fa48403dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:54.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.588+0000 7fa494ff9640 1 -- 172.21.15.70:0/3291245665 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa48804f4b0 con 0x7fa498071d80 2024-09-14T10:47:54.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.592+0000 7fa4977fe640 1 --2- 172.21.15.70:0/3291245665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa48403b860 0x7fa48403dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:54.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.592+0000 7fa4977fe640 1 --2- 172.21.15.70:0/3291245665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa48403b860 0x7fa48403dd20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0ae000 tx=0x7fa48c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:54.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.596+0000 7fa494ff9640 1 -- 172.21.15.70:0/3291245665 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fa48801ad70 con 0x7fa498071d80 2024-09-14T10:47:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.764+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa498127f90 con 0x7fa498071d80 2024-09-14T10:47:54.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.764+0000 7fa494ff9640 1 -- 172.21.15.70:0/3291245665 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+21174 (secure 0 0 0) 0x7fa48801b8d0 con 0x7fa498071d80 2024-09-14T10:47:54.761 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:47:54.761 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"fsid":"2e314bd0-9070-44fa-a8ec-a9266c5de294","created":"2024-09-14T10:43:38.317946+0000","modified":"2024-09-14T10:44:44.427113+0000","last_up_change":"2024-09-14T10:43:49.418142+0000","last_in_change":"2024-09-14T10:43:39.469314+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:43:49.381445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:43:54.136075+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T10:44:03.268052+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T10:44:05.649248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T10:44:07.601541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T10:44:09.452684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T10:44:11.371331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T10:44:13.499568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"94e00249-58b2-4247-a635-db467796e81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6801","nonce":3481052616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6803","nonce":3481052616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6807","nonce":3481052616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3481052616},{"type":"v1","addr":"172.21.15.70:6805","nonce":3481052616}]},"public_addr":"172.21.15.70:6801/3481052616","cluster_addr":"172.21.15.70:6803/3481052616","heartbeat_back_addr":"172.21.15.70:6807/3481052616","heartbeat_front_addr":"172.21.15.70:6805/3481052616","state":["exists","up"]},{"osd":1,"uuid":"26e1a964-ad73-4f8f-9ab6-0c4c442429a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6809","nonce":2339799699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6811","nonce":2339799699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6815","nonce":2339799699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2339799699},{"type":"v1","addr":"172.21.15.96:6813","nonce":2339799699}]},"public_addr":"172.21.15.96:6809/2339799699","cluster_addr":"172.21.15.96:6811/2339799699","heartbeat_back_addr":"172.21.15.96:6815/2339799699","heartbeat_front_addr":"172.21.15.96:6813/2339799699","state":["exists","up"]},{"osd":2,"uuid":"47f610b0-6d57-4262-a3a3-dc8f095700b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6817","nonce":2312202642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6819","nonce":2312202642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6823","nonce":2312202642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2312202642},{"type":"v1","addr":"172.21.15.96:6821","nonce":2312202642}]},"public_addr":"172.21.15.96:6817/2312202642","cluster_addr":"172.21.15.96:6819/2312202642","heartbeat_back_addr":"172.21.15.96:6823/2312202642","heartbeat_front_addr":"172.21.15.96:6821/2312202642","state":["exists","up"]},{"osd":3,"uuid":"0f744f58-2cfb-4f8b-81a8-0891b56da9bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6801","nonce":3683402699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6803","nonce":3683402699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6807","nonce":3683402699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3683402699},{"type":"v1","addr":"172.21.15.96:6805","nonce":3683402699}]},"public_addr":"172.21.15.96:6801/3683402699","cluster_addr":"172.21.15.96:6803/3683402699","heartbeat_back_addr":"172.21.15.96:6807/3683402699","heartbeat_front_addr":"172.21.15.96:6805/3683402699","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:45.474926+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:46.131113+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:46.635517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:43:45.852608+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":0}]},{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":2}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.3","mappings":[{"from":0,"to":2}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:47:54.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa48403b860 msgr2=0x7fa48403dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 --2- 172.21.15.70:0/3291245665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa48403b860 0x7fa48403dd20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0ae000 tx=0x7fa48c008040 comp rx=0 tx=0).stop 2024-09-14T10:47:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 msgr2=0x7fa498125d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 --2- 172.21.15.70:0/3291245665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498125d40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c480 tx=0x7fa48800c940 comp rx=0 tx=0).stop 2024-09-14T10:47:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 shutdown_connections 2024-09-14T10:47:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 --2- 172.21.15.70:0/3291245665 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa48403b860 0x7fa48403dd20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 --2- 172.21.15.70:0/3291245665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa498071d80 0x7fa498125d40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 >> 172.21.15.70:0/3291245665 conn(0x7fa49809aba0 msgr2=0x7fa49812e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 shutdown_connections 2024-09-14T10:47:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:54.768+0000 7fa49e485640 1 -- 172.21.15.70:0/3291245665 wait complete. 2024-09-14T10:47:55.779 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T10:47:55.780 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T10:47:55.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe349a4e640 1 Processor -- start 2024-09-14T10:47:55.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe349a4e640 1 -- start start 2024-09-14T10:47:55.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe349a4e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe34412be50 0x7fe34412c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe349a4e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34406ce30 con 0x7fe34412c770 2024-09-14T10:47:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe349a4e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe34406f530 con 0x7fe34412be50 2024-09-14T10:47:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe342ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe34412be50 0x7fe34412c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe3427fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe34412c770 0x7fe34406e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44554/0 (socket says 172.21.15.70:44554) 2024-09-14T10:47:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe3427fc640 1 -- 172.21.15.70:0/2986018249 learned_addr learned my addr 172.21.15.70:0/2986018249 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe341ffb640 1 -- 172.21.15.70:0/2986018249 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124956444 0 0) 0x7fe34406ce30 con 0x7fe34412c770 2024-09-14T10:47:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe341ffb640 1 -- 172.21.15.70:0/2986018249 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe32c003450 con 0x7fe34412c770 2024-09-14T10:47:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe342ffd640 1 -- 172.21.15.70:0/2986018249 >> v1:172.21.15.70:6789/0 conn(0x7fe34412c770 legacy=0x7fe34406e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe342ffd640 1 -- 172.21.15.70:0/2986018249 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe344070e90 con 0x7fe34412be50 2024-09-14T10:47:55.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe342ffd640 1 --2- 172.21.15.70:0/2986018249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34412c230 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe334009740 tx=0x7fe33401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dfd9901509eab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:55.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe341ffb640 1 -- 172.21.15.70:0/2986018249 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3340b0070 con 0x7fe34412be50 2024-09-14T10:47:55.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe341ffb640 1 -- 172.21.15.70:0/2986018249 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3340ab530 con 0x7fe34412be50 2024-09-14T10:47:55.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.928+0000 7fe341ffb640 1 -- 172.21.15.70:0/2986018249 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3340ab810 con 0x7fe34412be50 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- 172.21.15.70:0/2986018249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 msgr2=0x7fe34412c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 --2- 172.21.15.70:0/2986018249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34412c230 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe334009740 tx=0x7fe33401c370 comp rx=0 tx=0).stop 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- 172.21.15.70:0/2986018249 shutdown_connections 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 --2- 172.21.15.70:0/2986018249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34412c230 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- 172.21.15.70:0/2986018249 >> 172.21.15.70:0/2986018249 conn(0x7fe34409a970 msgr2=0x7fe34409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- 172.21.15.70:0/2986018249 shutdown_connections 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- 172.21.15.70:0/2986018249 wait complete. 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 Processor -- start 2024-09-14T10:47:55.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- start start 2024-09-14T10:47:55.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34408bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:55.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe34406f310 con 0x7fe34412be50 2024-09-14T10:47:55.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe342ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34408bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:55.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe342ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34408bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57044/0 (socket says 172.21.15.70:57044) 2024-09-14T10:47:55.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe342ffd640 1 -- 172.21.15.70:0/1775231755 learned_addr learned my addr 172.21.15.70:0/1775231755 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe342ffd640 1 -- 172.21.15.70:0/1775231755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34408d0b0 con 0x7fe34412be50 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe342ffd640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34408bff0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe33401c3b0 tx=0x7fe334019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3340b8070 con 0x7fe34412be50 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3340ac9a0 con 0x7fe34412be50 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34408e5c0 con 0x7fe34412be50 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3340b0040 con 0x7fe34412be50 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34412b080 con 0x7fe34412be50 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe34412c230 con 0x7fe34412be50 2024-09-14T10:47:55.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.932+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fe3340bb070 con 0x7fe34412be50 2024-09-14T10:47:55.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe32bfff640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe33003b8e0 0x7fe33003dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:55.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe3340e9f00 con 0x7fe34412be50 2024-09-14T10:47:55.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe32bfff640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fe330047db0 0x7fe33004a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:55.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3340ade90 con 0x7fe330047db0 2024-09-14T10:47:55.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe3340ef510 con 0x7fe34412be50 2024-09-14T10:47:55.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe3437fe640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fe330047db0 0x7fe33004a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:55.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe3427fc640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe33003b8e0 0x7fe33003dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:55.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe3437fe640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fe330047db0 0x7fe33004a250 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:55.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe3427fc640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe33003b8e0 0x7fe33003dda0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe338007fd0 tx=0x7fe338007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:55.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.936+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 <== osd.0 v2:172.21.15.70:6800/3481052616 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3340ade90 con 0x7fe330047db0 2024-09-14T10:47:55.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 --> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe344073780 con 0x7fe330047db0 2024-09-14T10:47:55.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe32bfff640 1 -- 172.21.15.70:0/1775231755 <== osd.0 v2:172.21.15.70:6800/3481052616 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe344073780 con 0x7fe330047db0 2024-09-14T10:47:55.944 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-14T10:47:55.944 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T10:47:55.944 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-14T10:47:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fe330047db0 msgr2=0x7fe33004a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fe330047db0 0x7fe33004a250 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe33003b8e0 msgr2=0x7fe33003dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe33003b8e0 0x7fe33003dda0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe338007fd0 tx=0x7fe338007900 comp rx=0 tx=0).stop 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 msgr2=0x7fe34408bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34408bff0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe33401c3b0 tx=0x7fe334019110 comp rx=0 tx=0).stop 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 shutdown_connections 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:6800/3481052616,v1:172.21.15.70:6801/3481052616] conn(0x7fe330047db0 0x7fe33004a250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe33003b8e0 0x7fe33003dda0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 --2- 172.21.15.70:0/1775231755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34412be50 0x7fe34408bff0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 >> 172.21.15.70:0/1775231755 conn(0x7fe34409a970 msgr2=0x7fe34412ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 shutdown_connections 2024-09-14T10:47:55.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:55.948+0000 7fe349a4e640 1 -- 172.21.15.70:0/1775231755 wait complete. 2024-09-14T10:47:55.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T10:47:56.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f11911a4640 1 Processor -- start 2024-09-14T10:47:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f11911a4640 1 -- start start 2024-09-14T10:47:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f11911a4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f118c132800 0x7f118c134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f11911a4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c1303a0 con 0x7f118c12f8b0 2024-09-14T10:47:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f11911a4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f118c12f4f0 con 0x7f118c132800 2024-09-14T10:47:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f1183fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f118c132800 0x7f118c134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f118ad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f118c12f8b0 0x7f118c12fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44558/0 (socket says 172.21.15.70:44558) 2024-09-14T10:47:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f118ad9d640 1 -- 172.21.15.70:0/767551810 learned_addr learned my addr 172.21.15.70:0/767551810 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f1183fff640 1 -- 172.21.15.70:0/767551810 >> v1:172.21.15.70:6789/0 conn(0x7f118c12f8b0 legacy=0x7f118c12fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f1183fff640 1 -- 172.21.15.70:0/767551810 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c070a60 con 0x7f118c132800 2024-09-14T10:47:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f1183fff640 1 --2- 172.21.15.70:0/767551810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c132800 0x7f118c134bf0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1174009770 tx=0x7f117401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f065d4239aa031 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f118a59c640 1 -- 172.21.15.70:0/767551810 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11740b0070 con 0x7f118c132800 2024-09-14T10:47:56.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f118a59c640 1 -- 172.21.15.70:0/767551810 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11740ab530 con 0x7f118c132800 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.076+0000 7f118a59c640 1 -- 172.21.15.70:0/767551810 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11740ab830 con 0x7f118c132800 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- 172.21.15.70:0/767551810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c132800 msgr2=0x7f118c134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 --2- 172.21.15.70:0/767551810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c132800 0x7f118c134bf0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1174009770 tx=0x7f117401c370 comp rx=0 tx=0).stop 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- 172.21.15.70:0/767551810 shutdown_connections 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 --2- 172.21.15.70:0/767551810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c132800 0x7f118c134bf0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- 172.21.15.70:0/767551810 >> 172.21.15.70:0/767551810 conn(0x7f118c0a2520 msgr2=0x7f118c09ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- 172.21.15.70:0/767551810 shutdown_connections 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- 172.21.15.70:0/767551810 wait complete. 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 Processor -- start 2024-09-14T10:47:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- start start 2024-09-14T10:47:56.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c12f8b0 0x7f118c12b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f118c070690 con 0x7f118c12f8b0 2024-09-14T10:47:56.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f118ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c12f8b0 0x7f118c12b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f118ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c12f8b0 0x7f118c12b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57064/0 (socket says 172.21.15.70:57064) 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f118ad9d640 1 -- 172.21.15.70:0/4135342428 learned_addr learned my addr 172.21.15.70:0/4135342428 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f118ad9d640 1 -- 172.21.15.70:0/4135342428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c071e80 con 0x7f118c12f8b0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f118ad9d640 1 --2- 172.21.15.70:0/4135342428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c12f8b0 0x7f118c12b5a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c450 tx=0x7f117c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11837fe640 1 -- 172.21.15.70:0/4135342428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117c017070 con 0x7f118c12f8b0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11837fe640 1 -- 172.21.15.70:0/4135342428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c005c20 con 0x7f118c12f8b0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118c12cac0 con 0x7f118c12f8b0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11837fe640 1 -- 172.21.15.70:0/4135342428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f117c0070d0 con 0x7f118c12f8b0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118c12bae0 con 0x7f118c12f8b0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11837fe640 1 -- 172.21.15.70:0/4135342428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f117c01a070 con 0x7f118c12f8b0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.080+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118c0711e0 con 0x7f118c12f8b0 2024-09-14T10:47:56.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.084+0000 7f11837fe640 1 --2- 172.21.15.70:0/4135342428 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f116c03b8b0 0x7f116c03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.084+0000 7f11837fe640 1 -- 172.21.15.70:0/4135342428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f117c04f430 con 0x7f118c12f8b0 2024-09-14T10:47:56.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.084+0000 7f1183fff640 1 --2- 172.21.15.70:0/4135342428 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f116c03b8b0 0x7f116c03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.084+0000 7f1183fff640 1 --2- 172.21.15.70:0/4135342428 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f116c03b8b0 0x7f116c03dd70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f11740ad000 tx=0x7f1174008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.088+0000 7f11837fe640 1 -- 172.21.15.70:0/4135342428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f117c019cd0 con 0x7f118c12f8b0 2024-09-14T10:47:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.256+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f118c12fc90 con 0x7f116c03b8b0 2024-09-14T10:47:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.256+0000 7f11837fe640 1 -- 172.21.15.70:0/4135342428 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f118c12fc90 con 0x7f116c03b8b0 2024-09-14T10:47:56.251 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f116c03b8b0 msgr2=0x7f116c03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 --2- 172.21.15.70:0/4135342428 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f116c03b8b0 0x7f116c03dd70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f11740ad000 tx=0x7f1174008040 comp rx=0 tx=0).stop 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c12f8b0 msgr2=0x7f118c12b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 --2- 172.21.15.70:0/4135342428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c12f8b0 0x7f118c12b5a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c450 tx=0x7f117c00c910 comp rx=0 tx=0).stop 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 shutdown_connections 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 --2- 172.21.15.70:0/4135342428 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f116c03b8b0 0x7f116c03dd70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 --2- 172.21.15.70:0/4135342428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f118c12f8b0 0x7f118c12b5a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 >> 172.21.15.70:0/4135342428 conn(0x7f118c0a2520 msgr2=0x7f118c06e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 shutdown_connections 2024-09-14T10:47:56.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.260+0000 7f11911a4640 1 -- 172.21.15.70:0/4135342428 wait complete. 2024-09-14T10:47:56.270 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T10:47:56.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T10:47:56.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb53d08640 1 Processor -- start 2024-09-14T10:47:56.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb53d08640 1 -- start start 2024-09-14T10:47:56.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb53d08640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feb4c06f170 0x7feb4c06f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb53d08640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb4c070510 con 0x7feb4c070b60 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb53d08640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7feb4c099dc0 con 0x7feb4c06f170 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb51aa4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feb4c06f170 0x7feb4c06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb512a3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7feb4c070b60 0x7feb4c097110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44562/0 (socket says 172.21.15.70:44562) 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb51aa4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feb4c06f170 0x7feb4c06f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57074/0 (socket says 172.21.15.70:57074) 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb512a3640 1 -- 172.21.15.70:0/1761341655 learned_addr learned my addr 172.21.15.70:0/1761341655 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb51aa4640 1 -- 172.21.15.70:0/1761341655 >> v1:172.21.15.70:6789/0 conn(0x7feb4c070b60 legacy=0x7feb4c097110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb50aa2640 1 -- 172.21.15.70:0/1761341655 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281522374 0 0) 0x7feb4c070510 con 0x7feb4c070b60 2024-09-14T10:47:56.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb51aa4640 1 -- 172.21.15.70:0/1761341655 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c099b10 con 0x7feb4c06f170 2024-09-14T10:47:56.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb51aa4640 1 --2- 172.21.15.70:0/1761341655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c06f550 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7feb48009740 tx=0x7feb4801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d440e0589212d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb50aa2640 1 -- 172.21.15.70:0/1761341655 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb480b1070 con 0x7feb4c06f170 2024-09-14T10:47:56.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb50aa2640 1 -- 172.21.15.70:0/1761341655 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb480ac570 con 0x7feb4c06f170 2024-09-14T10:47:56.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.392+0000 7feb50aa2640 1 -- 172.21.15.70:0/1761341655 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb480ac870 con 0x7feb4c06f170 2024-09-14T10:47:56.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- 172.21.15.70:0/1761341655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 msgr2=0x7feb4c06f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 --2- 172.21.15.70:0/1761341655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c06f550 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7feb48009740 tx=0x7feb4801c400 comp rx=0 tx=0).stop 2024-09-14T10:47:56.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- 172.21.15.70:0/1761341655 shutdown_connections 2024-09-14T10:47:56.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 --2- 172.21.15.70:0/1761341655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c06f550 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- 172.21.15.70:0/1761341655 >> 172.21.15.70:0/1761341655 conn(0x7feb4c09a970 msgr2=0x7feb4c09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- 172.21.15.70:0/1761341655 shutdown_connections 2024-09-14T10:47:56.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- 172.21.15.70:0/1761341655 wait complete. 2024-09-14T10:47:56.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 Processor -- start 2024-09-14T10:47:56.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- start start 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c1306b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c134ae0 con 0x7feb4c06f170 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb51aa4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c1306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb51aa4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c1306b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57090/0 (socket says 172.21.15.70:57090) 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb51aa4640 1 -- 172.21.15.70:0/2503439452 learned_addr learned my addr 172.21.15.70:0/2503439452 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb51aa4640 1 -- 172.21.15.70:0/2503439452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c074000 con 0x7feb4c06f170 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb51aa4640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c1306b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7feb4801a030 tx=0x7feb4801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb480b1050 con 0x7feb4c06f170 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb480b2040 con 0x7feb4c06f170 2024-09-14T10:47:56.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb480042a0 con 0x7feb4c06f170 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c129410 con 0x7feb4c06f170 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.396+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c06ed80 con 0x7feb4c06f170 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb4c06f550 con 0x7feb4c06f170 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7feb480bf060 con 0x7feb4c06f170 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb427fc640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feb3003b8e0 0x7feb3003dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feb480e9d00 con 0x7feb4c06f170 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb427fc640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7feb30047db0 0x7feb3004a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb480b6e50 con 0x7feb30047db0 2024-09-14T10:47:56.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7feb480ec350 con 0x7feb4c06f170 2024-09-14T10:47:56.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb512a3640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feb3003b8e0 0x7feb3003dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb522a5640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7feb30047db0 0x7feb3004a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb512a3640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feb3003b8e0 0x7feb3003dda0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7feb3c007fd0 tx=0x7feb3c0078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb522a5640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7feb30047db0 0x7feb3004a250 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.400+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 <== osd.1 v2:172.21.15.96:6808/2339799699 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb480b6e50 con 0x7feb30047db0 2024-09-14T10:47:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.412+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 --> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feb4c122ef0 con 0x7feb30047db0 2024-09-14T10:47:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb427fc640 1 -- 172.21.15.70:0/2503439452 <== osd.1 v2:172.21.15.96:6808/2339799699 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feb4c122ef0 con 0x7feb30047db0 2024-09-14T10:47:56.409 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-14T10:47:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T10:47:56.409 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-14T10:47:56.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7feb30047db0 msgr2=0x7feb3004a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7feb30047db0 0x7feb3004a250 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feb3003b8e0 msgr2=0x7feb3003dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feb3003b8e0 0x7feb3003dda0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7feb3c007fd0 tx=0x7feb3c0078e0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 msgr2=0x7feb4c1306b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c1306b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7feb4801a030 tx=0x7feb4801ac40 comp rx=0 tx=0).stop 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 shutdown_connections 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6808/2339799699,v1:172.21.15.96:6809/2339799699] conn(0x7feb30047db0 0x7feb3004a250 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7feb3003b8e0 0x7feb3003dda0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 --2- 172.21.15.70:0/2503439452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c06f170 0x7feb4c1306b0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 >> 172.21.15.70:0/2503439452 conn(0x7feb4c09a970 msgr2=0x7feb4c09b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 shutdown_connections 2024-09-14T10:47:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.416+0000 7feb53d08640 1 -- 172.21.15.70:0/2503439452 wait complete. 2024-09-14T10:47:56.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T10:47:56.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6e2f06640 1 Processor -- start 2024-09-14T10:47:56.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6e2f06640 1 -- start start 2024-09-14T10:47:56.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6e2f06640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6dc06e770 0x7fa6dc06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6e2f06640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6dc070400 con 0x7fa6dc099bc0 2024-09-14T10:47:56.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6e2f06640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa6dc0707a0 con 0x7fa6dc06e770 2024-09-14T10:47:56.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6dbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6dc06e770 0x7fa6dc06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6e0ca2640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa6dc099bc0 0x7fa6dc06e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44564/0 (socket says 172.21.15.70:44564) 2024-09-14T10:47:56.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6e0ca2640 1 -- 172.21.15.70:0/3072189812 learned_addr learned my addr 172.21.15.70:0/3072189812 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:56.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6dbfff640 1 -- 172.21.15.70:0/3072189812 >> v1:172.21.15.70:6789/0 conn(0x7fa6dc099bc0 legacy=0x7fa6dc06e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6dbfff640 1 -- 172.21.15.70:0/3072189812 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc06f0c0 con 0x7fa6dc06e770 2024-09-14T10:47:56.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.536+0000 7fa6dbfff640 1 --2- 172.21.15.70:0/3072189812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc06eb80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009d90 tx=0x7fa6cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd3f9dfac2750d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6db7fe640 1 -- 172.21.15.70:0/3072189812 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6cc0b2070 con 0x7fa6dc06e770 2024-09-14T10:47:56.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6db7fe640 1 -- 172.21.15.70:0/3072189812 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6cc0a56c0 con 0x7fa6dc06e770 2024-09-14T10:47:56.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6db7fe640 1 -- 172.21.15.70:0/3072189812 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6cc0a59c0 con 0x7fa6dc06e770 2024-09-14T10:47:56.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- 172.21.15.70:0/3072189812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 msgr2=0x7fa6dc06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 --2- 172.21.15.70:0/3072189812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc06eb80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009d90 tx=0x7fa6cc01c950 comp rx=0 tx=0).stop 2024-09-14T10:47:56.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- 172.21.15.70:0/3072189812 shutdown_connections 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 --2- 172.21.15.70:0/3072189812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc06eb80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- 172.21.15.70:0/3072189812 >> 172.21.15.70:0/3072189812 conn(0x7fa6dc09aba0 msgr2=0x7fa6dc0984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- 172.21.15.70:0/3072189812 shutdown_connections 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- 172.21.15.70:0/3072189812 wait complete. 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 Processor -- start 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- start start 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc123d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc137810 con 0x7fa6dc06e770 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e0ca2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc123d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e0ca2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc123d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57110/0 (socket says 172.21.15.70:57110) 2024-09-14T10:47:56.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e0ca2640 1 -- 172.21.15.70:0/2495556501 learned_addr learned my addr 172.21.15.70:0/2495556501 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:56.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e0ca2640 1 -- 172.21.15.70:0/2495556501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc127210 con 0x7fa6dc06e770 2024-09-14T10:47:56.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e0ca2640 1 --2- 172.21.15.70:0/2495556501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc123d60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c480 tx=0x7fa6c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6d97fa640 1 -- 172.21.15.70:0/2495556501 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c4017070 con 0x7fa6dc06e770 2024-09-14T10:47:56.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6d97fa640 1 -- 172.21.15.70:0/2495556501 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c4005c20 con 0x7fa6dc06e770 2024-09-14T10:47:56.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6d97fa640 1 -- 172.21.15.70:0/2495556501 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c4007070 con 0x7fa6dc06e770 2024-09-14T10:47:56.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc126260 con 0x7fa6dc06e770 2024-09-14T10:47:56.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc126d40 con 0x7fa6dc06e770 2024-09-14T10:47:56.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6dc06eb80 con 0x7fa6dc06e770 2024-09-14T10:47:56.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6d97fa640 1 -- 172.21.15.70:0/2495556501 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fa6c401a070 con 0x7fa6dc06e770 2024-09-14T10:47:56.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.540+0000 7fa6d97fa640 1 --2- 172.21.15.70:0/2495556501 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa6bc03b8b0 0x7fa6bc03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.544+0000 7fa6d97fa640 1 -- 172.21.15.70:0/2495556501 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa6c404f340 con 0x7fa6dc06e770 2024-09-14T10:47:56.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.544+0000 7fa6dbfff640 1 --2- 172.21.15.70:0/2495556501 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa6bc03b8b0 0x7fa6bc03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.544+0000 7fa6dbfff640 1 --2- 172.21.15.70:0/2495556501 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa6bc03b8b0 0x7fa6bc03dd70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0af000 tx=0x7fa6cc0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.548+0000 7fa6d97fa640 1 -- 172.21.15.70:0/2495556501 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fa6dc127210 con 0x7fa6dc06e770 2024-09-14T10:47:56.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.704+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa6dc050ef0 con 0x7fa6bc03b8b0 2024-09-14T10:47:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.704+0000 7fa6d97fa640 1 -- 172.21.15.70:0/2495556501 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa6dc050ef0 con 0x7fa6bc03b8b0 2024-09-14T10:47:56.700 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T10:47:56.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa6bc03b8b0 msgr2=0x7fa6bc03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 --2- 172.21.15.70:0/2495556501 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa6bc03b8b0 0x7fa6bc03dd70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0af000 tx=0x7fa6cc0a7070 comp rx=0 tx=0).stop 2024-09-14T10:47:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 msgr2=0x7fa6dc123d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 --2- 172.21.15.70:0/2495556501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc123d60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c480 tx=0x7fa6c400c940 comp rx=0 tx=0).stop 2024-09-14T10:47:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 shutdown_connections 2024-09-14T10:47:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 --2- 172.21.15.70:0/2495556501 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fa6bc03b8b0 0x7fa6bc03dd70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 --2- 172.21.15.70:0/2495556501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6dc06e770 0x7fa6dc123d60 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 >> 172.21.15.70:0/2495556501 conn(0x7fa6dc09aba0 msgr2=0x7fa6dc09bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 shutdown_connections 2024-09-14T10:47:56.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.708+0000 7fa6e2f06640 1 -- 172.21.15.70:0/2495556501 wait complete. 2024-09-14T10:47:56.718 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T10:47:56.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T10:47:56.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe80665640 1 Processor -- start 2024-09-14T10:47:56.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe80665640 1 -- start start 2024-09-14T10:47:56.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe80665640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbe7812a150 0x7fbe7812a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe80665640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe780725a0 con 0x7fbe78071d80 2024-09-14T10:47:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe80665640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fbe78099b10 con 0x7fbe7812a150 2024-09-14T10:47:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe7e401640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbe7812a150 0x7fbe7812a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe7dc00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbe78071d80 0x7fbe7806e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44568/0 (socket says 172.21.15.70:44568) 2024-09-14T10:47:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe7dc00640 1 -- 172.21.15.70:0/3078347911 learned_addr learned my addr 172.21.15.70:0/3078347911 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:56.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe7e401640 1 -- 172.21.15.70:0/3078347911 >> v1:172.21.15.70:6789/0 conn(0x7fbe78071d80 legacy=0x7fbe7806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe7e401640 1 -- 172.21.15.70:0/3078347911 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe780716a0 con 0x7fbe7812a150 2024-09-14T10:47:56.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.836+0000 7fbe7d3ff640 1 -- 172.21.15.70:0/3078347911 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116104566 0 0) 0x7fbe780725a0 con 0x7fbe78071d80 2024-09-14T10:47:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7e401640 1 --2- 172.21.15.70:0/3078347911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7812a150 0x7fbe7812a530 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009740 tx=0x7fbe7001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caba032949664549 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7d3ff640 1 -- 172.21.15.70:0/3078347911 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe700b0070 con 0x7fbe7812a150 2024-09-14T10:47:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7d3ff640 1 -- 172.21.15.70:0/3078347911 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe700ab530 con 0x7fbe7812a150 2024-09-14T10:47:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7d3ff640 1 -- 172.21.15.70:0/3078347911 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe700ab830 con 0x7fbe7812a150 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- 172.21.15.70:0/3078347911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7812a150 msgr2=0x7fbe7812a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 --2- 172.21.15.70:0/3078347911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7812a150 0x7fbe7812a530 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009740 tx=0x7fbe7001c370 comp rx=0 tx=0).stop 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- 172.21.15.70:0/3078347911 shutdown_connections 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 --2- 172.21.15.70:0/3078347911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7812a150 0x7fbe7812a530 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- 172.21.15.70:0/3078347911 >> 172.21.15.70:0/3078347911 conn(0x7fbe7809a970 msgr2=0x7fbe7809ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- 172.21.15.70:0/3078347911 shutdown_connections 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- 172.21.15.70:0/3078347911 wait complete. 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 Processor -- start 2024-09-14T10:47:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- start start 2024-09-14T10:47:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe78071d80 0x7fbe7806f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78136130 con 0x7fbe78071d80 2024-09-14T10:47:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7e401640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe78071d80 0x7fbe7806f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7e401640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe78071d80 0x7fbe7806f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57124/0 (socket says 172.21.15.70:57124) 2024-09-14T10:47:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7e401640 1 -- 172.21.15.70:0/1734960471 learned_addr learned my addr 172.21.15.70:0/1734960471 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7e401640 1 -- 172.21.15.70:0/1734960471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe78128e90 con 0x7fbe78071d80 2024-09-14T10:47:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe7e401640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe78071d80 0x7fbe7806f170 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbe700ae040 tx=0x7fbe7001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe700b0050 con 0x7fbe78071d80 2024-09-14T10:47:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe700b1040 con 0x7fbe78071d80 2024-09-14T10:47:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe78070770 con 0x7fbe78071d80 2024-09-14T10:47:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe700b58d0 con 0x7fbe78071d80 2024-09-14T10:47:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.840+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe78070e50 con 0x7fbe78071d80 2024-09-14T10:47:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe780709d0 con 0x7fbe78071d80 2024-09-14T10:47:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fbe700be030 con 0x7fbe78071d80 2024-09-14T10:47:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe6effd640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbe5c03b8b0 0x7fbe5c03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbe700bc070 con 0x7fbe78071d80 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe6effd640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe5c047e30 0x7fbe5c04a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe700ab530 con 0x7fbe5c047e30 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbe700f1050 con 0x7fbe78071d80 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe7dc00640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbe5c03b8b0 0x7fbe5c03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe7ec02640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe5c047e30 0x7fbe5c04a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe7ec02640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe5c047e30 0x7fbe5c04a2d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe7dc00640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbe5c03b8b0 0x7fbe5c03dd70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbe68007fd0 tx=0x7fbe680078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.844+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 <== osd.2 v2:172.21.15.96:6816/2312202642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe700ab530 con 0x7fbe5c047e30 2024-09-14T10:47:56.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.856+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 --> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe7808c400 con 0x7fbe5c047e30 2024-09-14T10:47:56.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe6effd640 1 -- 172.21.15.70:0/1734960471 <== osd.2 v2:172.21.15.96:6816/2312202642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbe7808c400 con 0x7fbe5c047e30 2024-09-14T10:47:56.853 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-14T10:47:56.853 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T10:47:56.853 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-14T10:47:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe5c047e30 msgr2=0x7fbe5c04a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe5c047e30 0x7fbe5c04a2d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbe5c03b8b0 msgr2=0x7fbe5c03dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbe5c03b8b0 0x7fbe5c03dd70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbe68007fd0 tx=0x7fbe680078e0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe78071d80 msgr2=0x7fbe7806f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe78071d80 0x7fbe7806f170 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbe700ae040 tx=0x7fbe7001abb0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 shutdown_connections 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6816/2312202642,v1:172.21.15.96:6817/2312202642] conn(0x7fbe5c047e30 0x7fbe5c04a2d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fbe5c03b8b0 0x7fbe5c03dd70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 --2- 172.21.15.70:0/1734960471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe78071d80 0x7fbe7806f170 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 >> 172.21.15.70:0/1734960471 conn(0x7fbe7809a970 msgr2=0x7fbe7812bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 shutdown_connections 2024-09-14T10:47:56.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.860+0000 7fbe80665640 1 -- 172.21.15.70:0/1734960471 wait complete. 2024-09-14T10:47:56.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T10:47:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f983f640 1 Processor -- start 2024-09-14T10:47:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f983f640 1 -- start start 2024-09-14T10:47:56.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f983f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f44f412bfe0 0x7f44f412c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f983f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f4099e20 con 0x7f44f4070c20 2024-09-14T10:47:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f983f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f44f40705b0 con 0x7f44f412bfe0 2024-09-14T10:47:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f2ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f44f412bfe0 0x7f44f412c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f27fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f44f4070c20 0x7f44f40970a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44584/0 (socket says 172.21.15.70:44584) 2024-09-14T10:47:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f27fc640 1 -- 172.21.15.70:0/1329225661 learned_addr learned my addr 172.21.15.70:0/1329225661 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f2ffd640 1 -- 172.21.15.70:0/1329225661 >> v1:172.21.15.70:6789/0 conn(0x7f44f4070c20 legacy=0x7f44f40970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f2ffd640 1 -- 172.21.15.70:0/1329225661 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f4071390 con 0x7f44f412bfe0 2024-09-14T10:47:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f1ffb640 1 -- 172.21.15.70:0/1329225661 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631755068 0 0) 0x7f44f4099e20 con 0x7f44f4070c20 2024-09-14T10:47:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f2ffd640 1 --2- 172.21.15.70:0/1329225661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f412bfe0 0x7f44f412c3c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009740 tx=0x7f44e401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f2e43c0d025f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f1ffb640 1 -- 172.21.15.70:0/1329225661 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44e40b0070 con 0x7f44f412bfe0 2024-09-14T10:47:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f1ffb640 1 -- 172.21.15.70:0/1329225661 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e40ab530 con 0x7f44f412bfe0 2024-09-14T10:47:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.976+0000 7f44f1ffb640 1 -- 172.21.15.70:0/1329225661 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44e40ab830 con 0x7f44f412bfe0 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- 172.21.15.70:0/1329225661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f412bfe0 msgr2=0x7f44f412c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 --2- 172.21.15.70:0/1329225661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f412bfe0 0x7f44f412c3c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009740 tx=0x7f44e401c370 comp rx=0 tx=0).stop 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- 172.21.15.70:0/1329225661 shutdown_connections 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 --2- 172.21.15.70:0/1329225661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f412bfe0 0x7f44f412c3c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- 172.21.15.70:0/1329225661 >> 172.21.15.70:0/1329225661 conn(0x7f44f409aba0 msgr2=0x7f44f40984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- 172.21.15.70:0/1329225661 shutdown_connections 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- 172.21.15.70:0/1329225661 wait complete. 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 Processor -- start 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- start start 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f4070c20 0x7f44f41287b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44f4134900 con 0x7f44f4070c20 2024-09-14T10:47:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f4070c20 0x7f44f41287b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f4070c20 0x7f44f41287b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57148/0 (socket says 172.21.15.70:57148) 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f2ffd640 1 -- 172.21.15.70:0/3255007924 learned_addr learned my addr 172.21.15.70:0/3255007924 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f2ffd640 1 -- 172.21.15.70:0/3255007924 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f4126560 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f2ffd640 1 --2- 172.21.15.70:0/3255007924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f4070c20 0x7f44f41287b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f44e4019fa0 tx=0x7f44e401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44dbfff640 1 -- 172.21.15.70:0/3255007924 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44e40b0050 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44dbfff640 1 -- 172.21.15.70:0/3255007924 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e40b1040 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f4128240 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44dbfff640 1 -- 172.21.15.70:0/3255007924 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44e40aab40 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f4128ec0 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44dbfff640 1 -- 172.21.15.70:0/3255007924 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f44e40be030 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f4126070 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44dbfff640 1 --2- 172.21.15.70:0/3255007924 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f44e003b8b0 0x7f44e003dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44dbfff640 1 -- 172.21.15.70:0/3255007924 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f44e40bc070 con 0x7f44f4070c20 2024-09-14T10:47:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.980+0000 7f44f27fc640 1 --2- 172.21.15.70:0/3255007924 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f44e003b8b0 0x7f44e003dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.984+0000 7f44f27fc640 1 --2- 172.21.15.70:0/3255007924 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f44e003b8b0 0x7f44e003dd70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f44e8007fd0 tx=0x7f44e80078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:56.984+0000 7f44dbfff640 1 -- 172.21.15.70:0/3255007924 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f44e40c5020 con 0x7f44f4070c20 2024-09-14T10:47:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.140+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f44f4050ef0 con 0x7f44e003b8b0 2024-09-14T10:47:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.140+0000 7f44dbfff640 1 -- 172.21.15.70:0/3255007924 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f44f4050ef0 con 0x7f44e003b8b0 2024-09-14T10:47:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T10:47:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f44e003b8b0 msgr2=0x7f44e003dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 --2- 172.21.15.70:0/3255007924 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f44e003b8b0 0x7f44e003dd70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f44e8007fd0 tx=0x7f44e80078e0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f4070c20 msgr2=0x7f44f41287b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 --2- 172.21.15.70:0/3255007924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f4070c20 0x7f44f41287b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f44e4019fa0 tx=0x7f44e401abb0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 shutdown_connections 2024-09-14T10:47:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 --2- 172.21.15.70:0/3255007924 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f44e003b8b0 0x7f44e003dd70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 --2- 172.21.15.70:0/3255007924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44f4070c20 0x7f44f41287b0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 >> 172.21.15.70:0/3255007924 conn(0x7f44f409aba0 msgr2=0x7f44f409b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 shutdown_connections 2024-09-14T10:47:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.144+0000 7f44f983f640 1 -- 172.21.15.70:0/3255007924 wait complete. 2024-09-14T10:47:57.152 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T10:47:57.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T10:47:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e859e640 1 Processor -- start 2024-09-14T10:47:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e859e640 1 -- start start 2024-09-14T10:47:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e859e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff9e0071d80 0x7ff9e0132570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e859e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00725a0 con 0x7ff9e012a150 2024-09-14T10:47:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e859e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e0099b10 con 0x7ff9e0071d80 2024-09-14T10:47:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e5b39640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff9e0071d80 0x7ff9e0132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e633a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff9e012a150 0x7ff9e012a530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44600/0 (socket says 172.21.15.70:44600) 2024-09-14T10:47:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e633a640 1 -- 172.21.15.70:0/1865265440 learned_addr learned my addr 172.21.15.70:0/1865265440 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e5b39640 1 -- 172.21.15.70:0/1865265440 >> v1:172.21.15.70:6789/0 conn(0x7ff9e012a150 legacy=0x7ff9e012a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e5b39640 1 -- 172.21.15.70:0/1865265440 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00716a0 con 0x7ff9e0071d80 2024-09-14T10:47:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.272+0000 7ff9e5338640 1 -- 172.21.15.70:0/1865265440 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336008535 0 0) 0x7ff9e00725a0 con 0x7ff9e012a150 2024-09-14T10:47:57.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e5b39640 1 --2- 172.21.15.70:0/1865265440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0132570 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009740 tx=0x7ff9d001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8832a26f47ff552 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e5338640 1 -- 172.21.15.70:0/1865265440 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d00b0070 con 0x7ff9e0071d80 2024-09-14T10:47:57.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e5338640 1 -- 172.21.15.70:0/1865265440 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d00ab530 con 0x7ff9e0071d80 2024-09-14T10:47:57.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e5338640 1 -- 172.21.15.70:0/1865265440 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d00ab830 con 0x7ff9e0071d80 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- 172.21.15.70:0/1865265440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 msgr2=0x7ff9e0132570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 --2- 172.21.15.70:0/1865265440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0132570 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009740 tx=0x7ff9d001c370 comp rx=0 tx=0).stop 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- 172.21.15.70:0/1865265440 shutdown_connections 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 --2- 172.21.15.70:0/1865265440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0132570 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- 172.21.15.70:0/1865265440 >> 172.21.15.70:0/1865265440 conn(0x7ff9e009a970 msgr2=0x7ff9e009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- 172.21.15.70:0/1865265440 shutdown_connections 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- 172.21.15.70:0/1865265440 wait complete. 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 Processor -- start 2024-09-14T10:47:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- start start 2024-09-14T10:47:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0124c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0135660 con 0x7ff9e0071d80 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e633a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0124c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e633a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0124c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57156/0 (socket says 172.21.15.70:57156) 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e633a640 1 -- 172.21.15.70:0/3132753181 learned_addr learned my addr 172.21.15.70:0/3132753181 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e633a640 1 -- 172.21.15.70:0/3132753181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e01269f0 con 0x7ff9e0071d80 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e633a640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0124c50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00c3d0 tx=0x7ff9dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc007410 con 0x7ff9e0071d80 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0075d0 con 0x7ff9e0071d80 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e00740c0 con 0x7ff9e0071d80 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc004960 con 0x7ff9e0071d80 2024-09-14T10:47:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.276+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e0127680 con 0x7ff9e0071d80 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9e009a310 con 0x7ff9e0071d80 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7ff9dc011070 con 0x7ff9e0071d80 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9d6ffd640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff9c403b8b0 0x7ff9c403dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff9dc04fca0 con 0x7ff9e0071d80 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9d6ffd640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7ff9c4047d80 0x7ff9c404a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9dc018e50 con 0x7ff9c4047d80 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff9dc052350 con 0x7ff9e0071d80 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9e6b3b640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7ff9c4047d80 0x7ff9c404a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9e5b39640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff9c403b8b0 0x7ff9c403dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9e6b3b640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7ff9c4047d80 0x7ff9c404a220 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9e5b39640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff9c403b8b0 0x7ff9c403dd70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00ad000 tx=0x7ff9d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.280+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 <== osd.3 v2:172.21.15.96:6800/3683402699 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9dc018e50 con 0x7ff9c4047d80 2024-09-14T10:47:57.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.292+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 --> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff9e012a150 con 0x7ff9c4047d80 2024-09-14T10:47:57.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9d6ffd640 1 -- 172.21.15.70:0/3132753181 <== osd.3 v2:172.21.15.96:6800/3683402699 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff9e012a150 con 0x7ff9c4047d80 2024-09-14T10:47:57.289 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-14T10:47:57.289 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T10:47:57.289 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-14T10:47:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7ff9c4047d80 msgr2=0x7ff9c404a220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7ff9c4047d80 0x7ff9c404a220 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff9c403b8b0 msgr2=0x7ff9c403dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff9c403b8b0 0x7ff9c403dd70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00ad000 tx=0x7ff9d0008040 comp rx=0 tx=0).stop 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 msgr2=0x7ff9e0124c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0124c50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00c3d0 tx=0x7ff9dc00c890 comp rx=0 tx=0).stop 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 shutdown_connections 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6800/3683402699,v1:172.21.15.96:6801/3683402699] conn(0x7ff9c4047d80 0x7ff9c404a220 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7ff9c403b8b0 0x7ff9c403dd70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 --2- 172.21.15.70:0/3132753181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9e0071d80 0x7ff9e0124c50 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 >> 172.21.15.70:0/3132753181 conn(0x7ff9e009a970 msgr2=0x7ff9e012b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 shutdown_connections 2024-09-14T10:47:57.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.296+0000 7ff9e859e640 1 -- 172.21.15.70:0/3132753181 wait complete. 2024-09-14T10:47:57.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T10:47:57.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb219a7c640 1 Processor -- start 2024-09-14T10:47:57.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb219a7c640 1 -- start start 2024-09-14T10:47:57.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb219a7c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb21412cad0 0x7fb214131550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb219a7c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb214099e20 con 0x7fb21412bfe0 2024-09-14T10:47:57.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb219a7c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb2140705b0 con 0x7fb21412cad0 2024-09-14T10:47:57.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb212ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb21412cad0 0x7fb214131550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb2137fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb21412bfe0 0x7fb21412c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44612/0 (socket says 172.21.15.70:44612) 2024-09-14T10:47:57.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb2137fe640 1 -- 172.21.15.70:0/2122349256 learned_addr learned my addr 172.21.15.70:0/2122349256 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:57.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb212ffd640 1 -- 172.21.15.70:0/2122349256 >> v1:172.21.15.70:6789/0 conn(0x7fb21412bfe0 legacy=0x7fb21412c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb212ffd640 1 -- 172.21.15.70:0/2122349256 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb214071390 con 0x7fb21412cad0 2024-09-14T10:47:57.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb212ffd640 1 --2- 172.21.15.70:0/2122349256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412cad0 0x7fb214131550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb208009740 tx=0x7fb20801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30babb17a3b7d093 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb2127fc640 1 -- 172.21.15.70:0/2122349256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2080b0070 con 0x7fb21412cad0 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb2127fc640 1 -- 172.21.15.70:0/2122349256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2080ab530 con 0x7fb21412cad0 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.424+0000 7fb2127fc640 1 -- 172.21.15.70:0/2122349256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2080ab830 con 0x7fb21412cad0 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- 172.21.15.70:0/2122349256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412cad0 msgr2=0x7fb214131550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 --2- 172.21.15.70:0/2122349256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412cad0 0x7fb214131550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb208009740 tx=0x7fb20801c370 comp rx=0 tx=0).stop 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- 172.21.15.70:0/2122349256 shutdown_connections 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 --2- 172.21.15.70:0/2122349256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412cad0 0x7fb214131550 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- 172.21.15.70:0/2122349256 >> 172.21.15.70:0/2122349256 conn(0x7fb21409aba0 msgr2=0x7fb2140984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:57.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- 172.21.15.70:0/2122349256 shutdown_connections 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- 172.21.15.70:0/2122349256 wait complete. 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 Processor -- start 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- start start 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412bfe0 0x7fb214125f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb214134640 con 0x7fb21412bfe0 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb2137fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412bfe0 0x7fb214125f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb2137fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412bfe0 0x7fb214125f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57164/0 (socket says 172.21.15.70:57164) 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb2137fe640 1 -- 172.21.15.70:0/4031596117 learned_addr learned my addr 172.21.15.70:0/4031596117 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:57.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb2137fe640 1 -- 172.21.15.70:0/4031596117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb214127880 con 0x7fb21412bfe0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb2137fe640 1 --2- 172.21.15.70:0/4031596117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412bfe0 0x7fb214125f80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c450 tx=0x7fb20400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb1fbfff640 1 -- 172.21.15.70:0/4031596117 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb204017070 con 0x7fb21412bfe0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb1fbfff640 1 -- 172.21.15.70:0/4031596117 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb204005c20 con 0x7fb21412bfe0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb214128130 con 0x7fb21412bfe0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb1fbfff640 1 -- 172.21.15.70:0/4031596117 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2040070d0 con 0x7fb21412bfe0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb214128b80 con 0x7fb21412bfe0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb1fbfff640 1 -- 172.21.15.70:0/4031596117 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fb20401a070 con 0x7fb21412bfe0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21412c3c0 con 0x7fb21412bfe0 2024-09-14T10:47:57.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb1fbfff640 1 --2- 172.21.15.70:0/4031596117 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb20003b8b0 0x7fb20003dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb1fbfff640 1 -- 172.21.15.70:0/4031596117 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb20404f3b0 con 0x7fb21412bfe0 2024-09-14T10:47:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.428+0000 7fb212ffd640 1 --2- 172.21.15.70:0/4031596117 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb20003b8b0 0x7fb20003dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.432+0000 7fb212ffd640 1 --2- 172.21.15.70:0/4031596117 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb20003b8b0 0x7fb20003dd70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb2080ad000 tx=0x7fb2080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.432+0000 7fb1fbfff640 1 -- 172.21.15.70:0/4031596117 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fb204019cd0 con 0x7fb21412bfe0 2024-09-14T10:47:57.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-14T10:47:57.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.600+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb214129240 con 0x7fb20003b8b0 2024-09-14T10:47:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb1fbfff640 1 -- 172.21.15.70:0/4031596117 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb214129240 con 0x7fb20003b8b0 2024-09-14T10:47:57.598 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb20003b8b0 msgr2=0x7fb20003dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 --2- 172.21.15.70:0/4031596117 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb20003b8b0 0x7fb20003dd70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb2080ad000 tx=0x7fb2080a6000 comp rx=0 tx=0).stop 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412bfe0 msgr2=0x7fb214125f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 --2- 172.21.15.70:0/4031596117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412bfe0 0x7fb214125f80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c450 tx=0x7fb20400c910 comp rx=0 tx=0).stop 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 shutdown_connections 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 --2- 172.21.15.70:0/4031596117 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fb20003b8b0 0x7fb20003dd70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 --2- 172.21.15.70:0/4031596117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb21412bfe0 0x7fb214125f80 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 >> 172.21.15.70:0/4031596117 conn(0x7fb21409aba0 msgr2=0x7fb21406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 shutdown_connections 2024-09-14T10:47:57.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.604+0000 7fb219a7c640 1 -- 172.21.15.70:0/4031596117 wait complete. 2024-09-14T10:47:57.617 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:47:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.724+0000 7f3ee8159640 1 Processor -- start 2024-09-14T10:47:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.724+0000 7f3ee8159640 1 -- start start 2024-09-14T10:47:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3ee0132660 0x7f3ee0134a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee0070700 con 0x7f3ee012f840 2024-09-14T10:47:57.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f3ee006fec0 con 0x7f3ee0132660 2024-09-14T10:47:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee56f4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3ee0132660 0x7f3ee0134a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee5ef5640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3ee012f840 0x7f3ee012fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:44622/0 (socket says 172.21.15.70:44622) 2024-09-14T10:47:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee5ef5640 1 -- 172.21.15.70:0/2868070281 learned_addr learned my addr 172.21.15.70:0/2868070281 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:47:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee56f4640 1 -- 172.21.15.70:0/2868070281 >> v1:172.21.15.70:6789/0 conn(0x7f3ee012f840 legacy=0x7f3ee012fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee56f4640 1 -- 172.21.15.70:0/2868070281 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee012f5b0 con 0x7f3ee0132660 2024-09-14T10:47:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee56f4640 1 --2- 172.21.15.70:0/2868070281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee0132660 0x7f3ee0134a50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009770 tx=0x7f3edc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8989eb175620f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee4ef3640 1 -- 172.21.15.70:0/2868070281 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc0b1070 con 0x7f3ee0132660 2024-09-14T10:47:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee4ef3640 1 -- 172.21.15.70:0/2868070281 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc0ac570 con 0x7f3ee0132660 2024-09-14T10:47:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee4ef3640 1 -- 172.21.15.70:0/2868070281 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc0ac870 con 0x7f3ee0132660 2024-09-14T10:47:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 -- 172.21.15.70:0/2868070281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee0132660 msgr2=0x7f3ee0134a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 --2- 172.21.15.70:0/2868070281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee0132660 0x7f3ee0134a50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009770 tx=0x7f3edc01c400 comp rx=0 tx=0).stop 2024-09-14T10:47:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 -- 172.21.15.70:0/2868070281 shutdown_connections 2024-09-14T10:47:57.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 --2- 172.21.15.70:0/2868070281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee0132660 0x7f3ee0134a50 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 -- 172.21.15.70:0/2868070281 >> 172.21.15.70:0/2868070281 conn(0x7f3ee009ffd0 msgr2=0x7f3ee00a03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 -- 172.21.15.70:0/2868070281 shutdown_connections 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.728+0000 7f3ee8159640 1 -- 172.21.15.70:0/2868070281 wait complete. 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee8159640 1 Processor -- start 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee8159640 1 -- start start 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee8159640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee012f840 0x7f3ee012bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee8159640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee01379c0 con 0x7f3ee012f840 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee5ef5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee012f840 0x7f3ee012bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee5ef5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee012f840 0x7f3ee012bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57176/0 (socket says 172.21.15.70:57176) 2024-09-14T10:47:57.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee5ef5640 1 -- 172.21.15.70:0/3095266843 learned_addr learned my addr 172.21.15.70:0/3095266843 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee5ef5640 1 -- 172.21.15.70:0/3095266843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee012c950 con 0x7f3ee012f840 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee5ef5640 1 --2- 172.21.15.70:0/3095266843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee012f840 0x7f3ee012bb00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c450 tx=0x7f3ed000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ed67fc640 1 -- 172.21.15.70:0/3095266843 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0017070 con 0x7f3ee012f840 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ed67fc640 1 -- 172.21.15.70:0/3095266843 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0005c20 con 0x7f3ee012f840 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee01298b0 con 0x7f3ee012f840 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ed67fc640 1 -- 172.21.15.70:0/3095266843 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed00070d0 con 0x7f3ee012f840 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee012cbd0 con 0x7f3ee012f840 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee0129330 con 0x7f3ee012f840 2024-09-14T10:47:57.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ed67fc640 1 -- 172.21.15.70:0/3095266843 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f3ed001a070 con 0x7f3ee012f840 2024-09-14T10:47:57.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ed67fc640 1 --2- 172.21.15.70:0/3095266843 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ec403b8b0 0x7f3ec403dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:47:57.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ed67fc640 1 -- 172.21.15.70:0/3095266843 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3ed004f3b0 con 0x7f3ee012f840 2024-09-14T10:47:57.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee56f4640 1 --2- 172.21.15.70:0/3095266843 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ec403b8b0 0x7f3ec403dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:47:57.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.732+0000 7f3ee56f4640 1 --2- 172.21.15.70:0/3095266843 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ec403b8b0 0x7f3ec403dd70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009770 tx=0x7f3edc0a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:47:57.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.736+0000 7f3ed67fc640 1 -- 172.21.15.70:0/3095266843 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f3ed0019cd0 con 0x7f3ee012f840 2024-09-14T10:47:57.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.892+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ee012fc20 con 0x7f3ec403b8b0 2024-09-14T10:47:57.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.920+0000 7f3ed67fc640 1 -- 172.21.15.70:0/3095266843 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665953 (secure 0 0 0) 0x7f3ee012fc20 con 0x7f3ec403b8b0 2024-09-14T10:47:57.922 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:47:57.928 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:47:57.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ec403b8b0 msgr2=0x7f3ec403dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 --2- 172.21.15.70:0/3095266843 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ec403b8b0 0x7f3ec403dd70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009770 tx=0x7f3edc0a6070 comp rx=0 tx=0).stop 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee012f840 msgr2=0x7f3ee012bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 --2- 172.21.15.70:0/3095266843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee012f840 0x7f3ee012bb00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c450 tx=0x7f3ed000c910 comp rx=0 tx=0).stop 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 shutdown_connections 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 --2- 172.21.15.70:0/3095266843 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f3ec403b8b0 0x7f3ec403dd70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 --2- 172.21.15.70:0/3095266843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ee012f840 0x7f3ee012bb00 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 >> 172.21.15.70:0/3095266843 conn(0x7f3ee009ffd0 msgr2=0x7f3ee012e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 shutdown_connections 2024-09-14T10:47:57.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:47:57.928+0000 7f3ee8159640 1 -- 172.21.15.70:0/3095266843 wait complete. 2024-09-14T10:47:57.939 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-14T10:47:57.466933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5157,"num_read_kb":4699,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4565,"ondisk_log_size":4565,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148456,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338904,"statfs":{"total":386547056640,"available":386395037696,"internally_reserved":0,"allocated":2981888,"data_stored":1786956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25811501,"num_objects":-7,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007180"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439387+0000","last_change":"2024-09-14T10:44:05.314727+0000","last_active":"2024-09-14T10:44:44.439387+0000","last_peered":"2024-09-14T10:44:44.439387+0000","last_clean":"2024-09-14T10:44:44.439387+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:44:44.439387+0000","last_undegraded":"2024-09-14T10:44:44.439387+0000","last_fullsized":"2024-09-14T10:44:44.439387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:33.017320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720305+0000","last_change":"2024-09-14T10:44:07.304568+0000","last_active":"2024-09-14T10:47:21.720305+0000","last_peered":"2024-09-14T10:47:21.720305+0000","last_clean":"2024-09-14T10:47:21.720305+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:47:21.720305+0000","last_undegraded":"2024-09-14T10:47:21.720305+0000","last_fullsized":"2024-09-14T10:47:21.720305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:11.798345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.674373+0000","last_change":"2024-09-14T10:44:05.320383+0000","last_active":"2024-09-14T10:47:21.674373+0000","last_peered":"2024-09-14T10:47:21.674373+0000","last_clean":"2024-09-14T10:47:21.674373+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:47:21.674373+0000","last_undegraded":"2024-09-14T10:47:21.674373+0000","last_fullsized":"2024-09-14T10:47:21.674373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:57.992699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720464+0000","last_change":"2024-09-14T10:44:07.311706+0000","last_active":"2024-09-14T10:47:21.720464+0000","last_peered":"2024-09-14T10:47:21.720464+0000","last_clean":"2024-09-14T10:47:21.720464+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:47:21.720464+0000","last_undegraded":"2024-09-14T10:47:21.720464+0000","last_fullsized":"2024-09-14T10:47:21.720464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:27.522929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.458276+0000","last_change":"2024-09-14T10:44:05.321748+0000","last_active":"2024-09-14T10:44:44.458276+0000","last_peered":"2024-09-14T10:44:44.458276+0000","last_clean":"2024-09-14T10:44:44.458276+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:44:44.458276+0000","last_undegraded":"2024-09-14T10:44:44.458276+0000","last_fullsized":"2024-09-14T10:44:44.458276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.177217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879810+0000","last_change":"2024-09-14T10:44:07.311756+0000","last_active":"2024-09-14T10:47:21.879810+0000","last_peered":"2024-09-14T10:47:21.879810+0000","last_clean":"2024-09-14T10:47:21.879810+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:47:21.879810+0000","last_undegraded":"2024-09-14T10:47:21.879810+0000","last_fullsized":"2024-09-14T10:47:21.879810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.711375+0000","last_change":"2024-09-14T10:44:05.316542+0000","last_active":"2024-09-14T10:44:50.711375+0000","last_peered":"2024-09-14T10:44:50.711375+0000","last_clean":"2024-09-14T10:44:50.711375+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:44:50.711375+0000","last_undegraded":"2024-09-14T10:44:50.711375+0000","last_fullsized":"2024-09-14T10:44:50.711375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:35.707595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600024+0000","last_change":"2024-09-14T10:44:07.312388+0000","last_active":"2024-09-14T10:45:35.600024+0000","last_peered":"2024-09-14T10:45:35.600024+0000","last_clean":"2024-09-14T10:45:35.600024+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:45:35.600024+0000","last_undegraded":"2024-09-14T10:45:35.600024+0000","last_fullsized":"2024-09-14T10:45:35.600024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:31.070464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454651+0000","last_change":"2024-09-14T10:44:05.329861+0000","last_active":"2024-09-14T10:44:44.454651+0000","last_peered":"2024-09-14T10:44:44.454651+0000","last_clean":"2024-09-14T10:44:44.454651+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:44:44.454651+0000","last_undegraded":"2024-09-14T10:44:44.454651+0000","last_fullsized":"2024-09-14T10:44:44.454651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:01.827439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.677760+0000","last_change":"2024-09-14T10:44:07.303712+0000","last_active":"2024-09-14T10:46:20.677760+0000","last_peered":"2024-09-14T10:46:20.677760+0000","last_clean":"2024-09-14T10:46:20.677760+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:46:20.677760+0000","last_undegraded":"2024-09-14T10:46:20.677760+0000","last_fullsized":"2024-09-14T10:46:20.677760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433524+0000","last_change":"2024-09-14T10:44:05.317002+0000","last_active":"2024-09-14T10:44:44.433524+0000","last_peered":"2024-09-14T10:44:44.433524+0000","last_clean":"2024-09-14T10:44:44.433524+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:44:44.433524+0000","last_undegraded":"2024-09-14T10:44:44.433524+0000","last_fullsized":"2024-09-14T10:44:44.433524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:24.606365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.373297+0000","last_change":"2024-09-14T10:44:44.462329+0000","last_active":"2024-09-14T10:47:21.373297+0000","last_peered":"2024-09-14T10:47:21.373297+0000","last_clean":"2024-09-14T10:47:21.373297+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:47:21.373297+0000","last_undegraded":"2024-09-14T10:47:21.373297+0000","last_fullsized":"2024-09-14T10:47:21.373297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:05.537374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.449407+0000","last_change":"2024-09-14T10:44:05.319096+0000","last_active":"2024-09-14T10:44:44.449407+0000","last_peered":"2024-09-14T10:44:44.449407+0000","last_clean":"2024-09-14T10:44:44.449407+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:44:44.449407+0000","last_undegraded":"2024-09-14T10:44:44.449407+0000","last_fullsized":"2024-09-14T10:44:44.449407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:07.843074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879838+0000","last_change":"2024-09-14T10:44:07.301357+0000","last_active":"2024-09-14T10:47:21.879838+0000","last_peered":"2024-09-14T10:47:21.879838+0000","last_clean":"2024-09-14T10:47:21.879838+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:47:21.879838+0000","last_undegraded":"2024-09-14T10:47:21.879838+0000","last_fullsized":"2024-09-14T10:47:21.879838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:49.933862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.869625+0000","last_change":"2024-09-14T10:44:05.315243+0000","last_active":"2024-09-14T10:47:21.869625+0000","last_peered":"2024-09-14T10:47:21.869625+0000","last_clean":"2024-09-14T10:47:21.869625+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:47:21.869625+0000","last_undegraded":"2024-09-14T10:47:21.869625+0000","last_fullsized":"2024-09-14T10:47:21.869625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:04.517080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.986354+0000","last_change":"2024-09-14T10:44:07.315054+0000","last_active":"2024-09-14T10:47:21.986354+0000","last_peered":"2024-09-14T10:47:21.986354+0000","last_clean":"2024-09-14T10:47:21.986354+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:47:21.986354+0000","last_undegraded":"2024-09-14T10:47:21.986354+0000","last_fullsized":"2024-09-14T10:47:21.986354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:46.799488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872805+0000","last_change":"2024-09-14T10:44:07.313852+0000","last_active":"2024-09-14T10:45:35.872805+0000","last_peered":"2024-09-14T10:45:35.872805+0000","last_clean":"2024-09-14T10:45:35.872805+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:45:35.872805+0000","last_undegraded":"2024-09-14T10:45:35.872805+0000","last_fullsized":"2024-09-14T10:45:35.872805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:54.012187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450856+0000","last_change":"2024-09-14T10:44:05.322752+0000","last_active":"2024-09-14T10:44:44.450856+0000","last_peered":"2024-09-14T10:44:44.450856+0000","last_clean":"2024-09-14T10:44:44.450856+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:44:44.450856+0000","last_undegraded":"2024-09-14T10:44:44.450856+0000","last_fullsized":"2024-09-14T10:44:44.450856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:08.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720065+0000","last_change":"2024-09-14T10:44:07.303444+0000","last_active":"2024-09-14T10:47:21.720065+0000","last_peered":"2024-09-14T10:47:21.720065+0000","last_clean":"2024-09-14T10:47:21.720065+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:47:21.720065+0000","last_undegraded":"2024-09-14T10:47:21.720065+0000","last_fullsized":"2024-09-14T10:47:21.720065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:42.771218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440693+0000","last_change":"2024-09-14T10:44:05.314433+0000","last_active":"2024-09-14T10:44:44.440693+0000","last_peered":"2024-09-14T10:44:44.440693+0000","last_clean":"2024-09-14T10:44:44.440693+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:44:44.440693+0000","last_undegraded":"2024-09-14T10:44:44.440693+0000","last_fullsized":"2024-09-14T10:44:44.440693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:30.161133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880404+0000","last_change":"2024-09-14T10:44:07.302716+0000","last_active":"2024-09-14T10:47:21.880404+0000","last_peered":"2024-09-14T10:47:21.880404+0000","last_clean":"2024-09-14T10:47:21.880404+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:47:21.880404+0000","last_undegraded":"2024-09-14T10:47:21.880404+0000","last_fullsized":"2024-09-14T10:47:21.880404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:36.213106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446820+0000","last_change":"2024-09-14T10:44:05.320439+0000","last_active":"2024-09-14T10:44:44.446820+0000","last_peered":"2024-09-14T10:44:44.446820+0000","last_clean":"2024-09-14T10:44:44.446820+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:44:44.446820+0000","last_undegraded":"2024-09-14T10:44:44.446820+0000","last_fullsized":"2024-09-14T10:44:44.446820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:30.093065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874276+0000","last_change":"2024-09-14T10:44:07.314159+0000","last_active":"2024-09-14T10:45:35.874276+0000","last_peered":"2024-09-14T10:45:35.874276+0000","last_clean":"2024-09-14T10:45:35.874276+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:45:35.874276+0000","last_undegraded":"2024-09-14T10:45:35.874276+0000","last_fullsized":"2024-09-14T10:45:35.874276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443974+0000","last_change":"2024-09-14T10:44:05.320368+0000","last_active":"2024-09-14T10:44:44.443974+0000","last_peered":"2024-09-14T10:44:44.443974+0000","last_clean":"2024-09-14T10:44:44.443974+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:44:44.443974+0000","last_undegraded":"2024-09-14T10:44:44.443974+0000","last_fullsized":"2024-09-14T10:44:44.443974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879927+0000","last_change":"2024-09-14T10:44:07.313819+0000","last_active":"2024-09-14T10:47:21.879927+0000","last_peered":"2024-09-14T10:47:21.879927+0000","last_clean":"2024-09-14T10:47:21.879927+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:47:21.879927+0000","last_undegraded":"2024-09-14T10:47:21.879927+0000","last_fullsized":"2024-09-14T10:47:21.879927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.226631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444169+0000","last_change":"2024-09-14T10:44:05.324714+0000","last_active":"2024-09-14T10:44:44.444169+0000","last_peered":"2024-09-14T10:44:44.444169+0000","last_clean":"2024-09-14T10:44:44.444169+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:44:44.444169+0000","last_undegraded":"2024-09-14T10:44:44.444169+0000","last_fullsized":"2024-09-14T10:44:44.444169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:41.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825511+0000","last_change":"2024-09-14T10:44:07.303481+0000","last_active":"2024-09-14T10:47:21.825511+0000","last_peered":"2024-09-14T10:47:21.825511+0000","last_clean":"2024-09-14T10:47:21.825511+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:47:21.825511+0000","last_undegraded":"2024-09-14T10:47:21.825511+0000","last_fullsized":"2024-09-14T10:47:21.825511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.685013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452678+0000","last_change":"2024-09-14T10:44:05.312131+0000","last_active":"2024-09-14T10:44:44.452678+0000","last_peered":"2024-09-14T10:44:44.452678+0000","last_clean":"2024-09-14T10:44:44.452678+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:44:44.452678+0000","last_undegraded":"2024-09-14T10:44:44.452678+0000","last_fullsized":"2024-09-14T10:44:44.452678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:20.004027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891282+0000","last_change":"2024-09-14T10:44:15.384222+0000","last_active":"2024-09-14T10:47:21.891282+0000","last_peered":"2024-09-14T10:47:21.891282+0000","last_clean":"2024-09-14T10:47:21.891282+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:47:21.891282+0000","last_undegraded":"2024-09-14T10:47:21.891282+0000","last_fullsized":"2024-09-14T10:47:21.891282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:52.493514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825066+0000","last_change":"2024-09-14T10:44:07.300223+0000","last_active":"2024-09-14T10:47:21.825066+0000","last_peered":"2024-09-14T10:47:21.825066+0000","last_clean":"2024-09-14T10:47:21.825066+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:47:21.825066+0000","last_undegraded":"2024-09-14T10:47:21.825066+0000","last_fullsized":"2024-09-14T10:47:21.825066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:41.299865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453614+0000","last_change":"2024-09-14T10:44:05.327015+0000","last_active":"2024-09-14T10:44:44.453614+0000","last_peered":"2024-09-14T10:44:44.453614+0000","last_clean":"2024-09-14T10:44:44.453614+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:44:44.453614+0000","last_undegraded":"2024-09-14T10:44:44.453614+0000","last_fullsized":"2024-09-14T10:44:44.453614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:24.855054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456793+0000","last_change":"2024-09-14T10:44:09.339751+0000","last_active":"2024-09-14T10:44:44.456793+0000","last_peered":"2024-09-14T10:44:44.456793+0000","last_clean":"2024-09-14T10:44:44.456793+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:44:44.456793+0000","last_undegraded":"2024-09-14T10:44:44.456793+0000","last_fullsized":"2024-09-14T10:44:44.456793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:31.250869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.068511+0000","last_change":"2024-09-14T10:44:11.366230+0000","last_active":"2024-09-14T10:47:53.068511+0000","last_peered":"2024-09-14T10:47:53.068511+0000","last_clean":"2024-09-14T10:47:53.068511+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:47:53.068511+0000","last_undegraded":"2024-09-14T10:47:53.068511+0000","last_fullsized":"2024-09-14T10:47:53.068511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446129+0000","last_change":"2024-09-14T10:44:13.370430+0000","last_active":"2024-09-14T10:44:44.446129+0000","last_peered":"2024-09-14T10:44:44.446129+0000","last_clean":"2024-09-14T10:44:44.446129+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:44:44.446129+0000","last_undegraded":"2024-09-14T10:44:44.446129+0000","last_fullsized":"2024-09-14T10:44:44.446129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.607941+0000","last_change":"2024-09-14T10:44:15.377551+0000","last_active":"2024-09-14T10:45:35.607941+0000","last_peered":"2024-09-14T10:45:35.607941+0000","last_clean":"2024-09-14T10:45:35.607941+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:45:35.607941+0000","last_undegraded":"2024-09-14T10:45:35.607941+0000","last_fullsized":"2024-09-14T10:45:35.607941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:02.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.739203+0000","last_change":"2024-09-14T10:44:07.309285+0000","last_active":"2024-09-14T10:47:21.739203+0000","last_peered":"2024-09-14T10:47:21.739203+0000","last_clean":"2024-09-14T10:47:21.739203+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:47:21.739203+0000","last_undegraded":"2024-09-14T10:47:21.739203+0000","last_fullsized":"2024-09-14T10:47:21.739203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433126+0000","last_change":"2024-09-14T10:44:05.323067+0000","last_active":"2024-09-14T10:44:44.433126+0000","last_peered":"2024-09-14T10:44:44.433126+0000","last_clean":"2024-09-14T10:44:44.433126+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:44:44.433126+0000","last_undegraded":"2024-09-14T10:44:44.433126+0000","last_fullsized":"2024-09-14T10:44:44.433126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:16.558078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440248+0000","last_change":"2024-09-14T10:44:09.318715+0000","last_active":"2024-09-14T10:44:44.440248+0000","last_peered":"2024-09-14T10:44:44.440248+0000","last_clean":"2024-09-14T10:44:44.440248+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:44:44.440248+0000","last_undegraded":"2024-09-14T10:44:44.440248+0000","last_fullsized":"2024-09-14T10:44:44.440248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:56.922877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444934+0000","last_change":"2024-09-14T10:44:11.327271+0000","last_active":"2024-09-14T10:44:44.444934+0000","last_peered":"2024-09-14T10:44:44.444934+0000","last_clean":"2024-09-14T10:44:44.444934+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:44:44.444934+0000","last_undegraded":"2024-09-14T10:44:44.444934+0000","last_fullsized":"2024-09-14T10:44:44.444934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.449635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444347+0000","last_change":"2024-09-14T10:44:13.360104+0000","last_active":"2024-09-14T10:44:44.444347+0000","last_peered":"2024-09-14T10:44:44.444347+0000","last_clean":"2024-09-14T10:44:44.444347+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:44:44.444347+0000","last_undegraded":"2024-09-14T10:44:44.444347+0000","last_fullsized":"2024-09-14T10:44:44.444347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438541+0000","last_change":"2024-09-14T10:44:15.385641+0000","last_active":"2024-09-14T10:44:44.438541+0000","last_peered":"2024-09-14T10:44:44.438541+0000","last_clean":"2024-09-14T10:44:44.438541+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:44:44.438541+0000","last_undegraded":"2024-09-14T10:44:44.438541+0000","last_fullsized":"2024-09-14T10:44:44.438541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.602221+0000","last_change":"2024-09-14T10:44:07.312266+0000","last_active":"2024-09-14T10:44:52.602221+0000","last_peered":"2024-09-14T10:44:52.602221+0000","last_clean":"2024-09-14T10:44:52.602221+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:44:52.602221+0000","last_undegraded":"2024-09-14T10:44:52.602221+0000","last_fullsized":"2024-09-14T10:44:52.602221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:05.421337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443044+0000","last_change":"2024-09-14T10:44:05.321201+0000","last_active":"2024-09-14T10:44:44.443044+0000","last_peered":"2024-09-14T10:44:44.443044+0000","last_clean":"2024-09-14T10:44:44.443044+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:44:44.443044+0000","last_undegraded":"2024-09-14T10:44:44.443044+0000","last_fullsized":"2024-09-14T10:44:44.443044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:05.963673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447321+0000","last_change":"2024-09-14T10:44:09.326103+0000","last_active":"2024-09-14T10:44:44.447321+0000","last_peered":"2024-09-14T10:44:44.447321+0000","last_clean":"2024-09-14T10:44:44.447321+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:44:44.447321+0000","last_undegraded":"2024-09-14T10:44:44.447321+0000","last_fullsized":"2024-09-14T10:44:44.447321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.437130+0000","last_change":"2024-09-14T10:44:11.355262+0000","last_active":"2024-09-14T10:44:44.437130+0000","last_peered":"2024-09-14T10:44:44.437130+0000","last_clean":"2024-09-14T10:44:44.437130+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:44:44.437130+0000","last_undegraded":"2024-09-14T10:44:44.437130+0000","last_fullsized":"2024-09-14T10:44:44.437130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:55.694768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.880932+0000","last_change":"2024-09-14T10:44:13.370887+0000","last_active":"2024-09-14T10:47:52.880932+0000","last_peered":"2024-09-14T10:47:52.880932+0000","last_clean":"2024-09-14T10:47:52.880932+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:47:52.880932+0000","last_undegraded":"2024-09-14T10:47:52.880932+0000","last_fullsized":"2024-09-14T10:47:52.880932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433906+0000","last_change":"2024-09-14T10:44:15.393155+0000","last_active":"2024-09-14T10:44:44.433906+0000","last_peered":"2024-09-14T10:44:44.433906+0000","last_clean":"2024-09-14T10:44:44.433906+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:44:44.433906+0000","last_undegraded":"2024-09-14T10:44:44.433906+0000","last_fullsized":"2024-09-14T10:44:44.433906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:01.351429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:53.304550+0000","last_change":"2024-09-14T10:44:07.310193+0000","last_active":"2024-09-14T10:44:53.304550+0000","last_peered":"2024-09-14T10:44:53.304550+0000","last_clean":"2024-09-14T10:44:53.304550+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:44:53.304550+0000","last_undegraded":"2024-09-14T10:44:53.304550+0000","last_fullsized":"2024-09-14T10:44:53.304550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:15.726650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.564329+0000","last_change":"2024-09-14T10:44:05.315829+0000","last_active":"2024-09-14T10:44:52.564329+0000","last_peered":"2024-09-14T10:44:52.564329+0000","last_clean":"2024-09-14T10:44:52.564329+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:44:52.564329+0000","last_undegraded":"2024-09-14T10:44:52.564329+0000","last_fullsized":"2024-09-14T10:44:52.564329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:08.412821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455297+0000","last_change":"2024-09-14T10:44:09.341355+0000","last_active":"2024-09-14T10:44:44.455297+0000","last_peered":"2024-09-14T10:44:44.455297+0000","last_clean":"2024-09-14T10:44:44.455297+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:44:44.455297+0000","last_undegraded":"2024-09-14T10:44:44.455297+0000","last_fullsized":"2024-09-14T10:44:44.455297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:06.338264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.034915+0000","last_change":"2024-09-14T10:44:11.349869+0000","last_active":"2024-09-14T10:47:53.034915+0000","last_peered":"2024-09-14T10:47:53.034915+0000","last_clean":"2024-09-14T10:47:53.034915+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:47:53.034915+0000","last_undegraded":"2024-09-14T10:47:53.034915+0000","last_fullsized":"2024-09-14T10:47:53.034915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.892718+0000","last_change":"2024-09-14T10:44:13.359625+0000","last_active":"2024-09-14T10:47:52.892718+0000","last_peered":"2024-09-14T10:47:52.892718+0000","last_clean":"2024-09-14T10:47:52.892718+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:47:52.892718+0000","last_undegraded":"2024-09-14T10:47:52.892718+0000","last_fullsized":"2024-09-14T10:47:52.892718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.828035+0000","last_change":"2024-09-14T10:44:07.313431+0000","last_active":"2024-09-14T10:47:21.828035+0000","last_peered":"2024-09-14T10:47:21.828035+0000","last_clean":"2024-09-14T10:47:21.828035+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:47:21.828035+0000","last_undegraded":"2024-09-14T10:47:21.828035+0000","last_fullsized":"2024-09-14T10:47:21.828035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:28.832046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438420+0000","last_change":"2024-09-14T10:44:05.319480+0000","last_active":"2024-09-14T10:44:44.438420+0000","last_peered":"2024-09-14T10:44:44.438420+0000","last_clean":"2024-09-14T10:44:44.438420+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:44:44.438420+0000","last_undegraded":"2024-09-14T10:44:44.438420+0000","last_fullsized":"2024-09-14T10:44:44.438420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:30.352842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447310+0000","last_change":"2024-09-14T10:44:09.321893+0000","last_active":"2024-09-14T10:44:44.447310+0000","last_peered":"2024-09-14T10:44:44.447310+0000","last_clean":"2024-09-14T10:44:44.447310+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:44:44.447310+0000","last_undegraded":"2024-09-14T10:44:44.447310+0000","last_fullsized":"2024-09-14T10:44:44.447310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:04.728659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'43","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.093942+0000","last_change":"2024-09-14T10:44:11.342017+0000","last_active":"2024-09-14T10:47:53.093942+0000","last_peered":"2024-09-14T10:47:53.093942+0000","last_clean":"2024-09-14T10:47:53.093942+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:47:53.093942+0000","last_undegraded":"2024-09-14T10:47:53.093942+0000","last_fullsized":"2024-09-14T10:47:53.093942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:22.056805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441567+0000","last_change":"2024-09-14T10:44:13.359612+0000","last_active":"2024-09-14T10:44:44.441567+0000","last_peered":"2024-09-14T10:44:44.441567+0000","last_clean":"2024-09-14T10:44:44.441567+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:44:44.441567+0000","last_undegraded":"2024-09-14T10:44:44.441567+0000","last_fullsized":"2024-09-14T10:44:44.441567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:40.424615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.610998+0000","last_change":"2024-09-14T10:44:15.384957+0000","last_active":"2024-09-14T10:45:35.610998+0000","last_peered":"2024-09-14T10:45:35.610998+0000","last_clean":"2024-09-14T10:45:35.610998+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:45:35.610998+0000","last_undegraded":"2024-09-14T10:45:35.610998+0000","last_fullsized":"2024-09-14T10:45:35.610998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.508508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.822961+0000","last_change":"2024-09-14T10:44:07.297475+0000","last_active":"2024-09-14T10:47:21.822961+0000","last_peered":"2024-09-14T10:47:21.822961+0000","last_clean":"2024-09-14T10:47:21.822961+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:47:21.822961+0000","last_undegraded":"2024-09-14T10:47:21.822961+0000","last_fullsized":"2024-09-14T10:47:21.822961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:38.470916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.697456+0000","last_change":"2024-09-14T10:44:05.322339+0000","last_active":"2024-09-14T10:47:21.697456+0000","last_peered":"2024-09-14T10:47:21.697456+0000","last_clean":"2024-09-14T10:47:21.697456+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:21.697456+0000","last_undegraded":"2024-09-14T10:47:21.697456+0000","last_fullsized":"2024-09-14T10:47:21.697456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:19.073960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439715+0000","last_change":"2024-09-14T10:44:09.315832+0000","last_active":"2024-09-14T10:44:44.439715+0000","last_peered":"2024-09-14T10:44:44.439715+0000","last_clean":"2024-09-14T10:44:44.439715+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:44:44.439715+0000","last_undegraded":"2024-09-14T10:44:44.439715+0000","last_fullsized":"2024-09-14T10:44:44.439715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:23.486222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.974322+0000","last_change":"2024-09-14T10:44:11.361862+0000","last_active":"2024-09-14T10:47:52.974322+0000","last_peered":"2024-09-14T10:47:52.974322+0000","last_clean":"2024-09-14T10:47:52.974322+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:47:52.974322+0000","last_undegraded":"2024-09-14T10:47:52.974322+0000","last_fullsized":"2024-09-14T10:47:52.974322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:38.109362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441326+0000","last_change":"2024-09-14T10:44:13.371521+0000","last_active":"2024-09-14T10:44:44.441326+0000","last_peered":"2024-09-14T10:44:44.441326+0000","last_clean":"2024-09-14T10:44:44.441326+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:44:44.441326+0000","last_undegraded":"2024-09-14T10:44:44.441326+0000","last_fullsized":"2024-09-14T10:44:44.441326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:22.520305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:29.960732+0000","last_change":"2024-09-14T10:44:15.387133+0000","last_active":"2024-09-14T10:45:29.960732+0000","last_peered":"2024-09-14T10:45:29.960732+0000","last_clean":"2024-09-14T10:45:29.960732+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:45:29.960732+0000","last_undegraded":"2024-09-14T10:45:29.960732+0000","last_fullsized":"2024-09-14T10:45:29.960732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.599443+0000","last_change":"2024-09-14T10:44:07.313496+0000","last_active":"2024-09-14T10:45:35.599443+0000","last_peered":"2024-09-14T10:45:35.599443+0000","last_clean":"2024-09-14T10:45:35.599443+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:45:35.599443+0000","last_undegraded":"2024-09-14T10:45:35.599443+0000","last_fullsized":"2024-09-14T10:45:35.599443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:25.073228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.109332+0000","last_change":"2024-09-14T10:44:05.333550+0000","last_active":"2024-09-14T10:47:21.109332+0000","last_peered":"2024-09-14T10:47:21.109332+0000","last_clean":"2024-09-14T10:47:21.109332+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:47:21.109332+0000","last_undegraded":"2024-09-14T10:47:21.109332+0000","last_fullsized":"2024-09-14T10:47:21.109332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.200851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440400+0000","last_change":"2024-09-14T10:44:09.327528+0000","last_active":"2024-09-14T10:44:44.440400+0000","last_peered":"2024-09-14T10:44:44.440400+0000","last_clean":"2024-09-14T10:44:44.440400+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:44:44.440400+0000","last_undegraded":"2024-09-14T10:44:44.440400+0000","last_fullsized":"2024-09-14T10:44:44.440400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:16.948139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'41","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.107576+0000","last_change":"2024-09-14T10:44:11.356327+0000","last_active":"2024-09-14T10:47:53.107576+0000","last_peered":"2024-09-14T10:47:53.107576+0000","last_clean":"2024-09-14T10:47:53.107576+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:47:53.107576+0000","last_undegraded":"2024-09-14T10:47:53.107576+0000","last_fullsized":"2024-09-14T10:47:53.107576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":380,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.894970+0000","last_change":"2024-09-14T10:44:13.372565+0000","last_active":"2024-09-14T10:47:52.894970+0000","last_peered":"2024-09-14T10:47:52.894970+0000","last_clean":"2024-09-14T10:47:52.894970+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:47:52.894970+0000","last_undegraded":"2024-09-14T10:47:52.894970+0000","last_fullsized":"2024-09-14T10:47:52.894970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443179+0000","last_change":"2024-09-14T10:44:15.386780+0000","last_active":"2024-09-14T10:44:44.443179+0000","last_peered":"2024-09-14T10:44:44.443179+0000","last_clean":"2024-09-14T10:44:44.443179+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:44:44.443179+0000","last_undegraded":"2024-09-14T10:44:44.443179+0000","last_fullsized":"2024-09-14T10:44:44.443179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:51.818783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880056+0000","last_change":"2024-09-14T10:44:07.297382+0000","last_active":"2024-09-14T10:47:21.880056+0000","last_peered":"2024-09-14T10:47:21.880056+0000","last_clean":"2024-09-14T10:47:21.880056+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:47:21.880056+0000","last_undegraded":"2024-09-14T10:47:21.880056+0000","last_fullsized":"2024-09-14T10:47:21.880056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:08.033376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.580206+0000","last_change":"2024-09-14T10:44:05.318622+0000","last_active":"2024-09-14T10:44:52.580206+0000","last_peered":"2024-09-14T10:44:52.580206+0000","last_clean":"2024-09-14T10:44:52.580206+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:44:52.580206+0000","last_undegraded":"2024-09-14T10:44:52.580206+0000","last_fullsized":"2024-09-14T10:44:52.580206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:45.181544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439156+0000","last_change":"2024-09-14T10:44:09.325802+0000","last_active":"2024-09-14T10:44:44.439156+0000","last_peered":"2024-09-14T10:44:44.439156+0000","last_clean":"2024-09-14T10:44:44.439156+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:44:44.439156+0000","last_undegraded":"2024-09-14T10:44:44.439156+0000","last_fullsized":"2024-09-14T10:44:44.439156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:35.589836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'61","reported_seq":126,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.120517+0000","last_change":"2024-09-14T10:44:11.356796+0000","last_active":"2024-09-14T10:47:53.120517+0000","last_peered":"2024-09-14T10:47:53.120517+0000","last_clean":"2024-09-14T10:47:53.120517+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:47:53.120517+0000","last_undegraded":"2024-09-14T10:47:53.120517+0000","last_fullsized":"2024-09-14T10:47:53.120517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:34.815043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439158+0000","last_change":"2024-09-14T10:44:13.361258+0000","last_active":"2024-09-14T10:44:44.439158+0000","last_peered":"2024-09-14T10:44:44.439158+0000","last_clean":"2024-09-14T10:44:44.439158+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:44:44.439158+0000","last_undegraded":"2024-09-14T10:44:44.439158+0000","last_fullsized":"2024-09-14T10:44:44.439158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.050143+0000","last_change":"2024-09-14T10:44:15.362513+0000","last_active":"2024-09-14T10:47:22.050143+0000","last_peered":"2024-09-14T10:47:22.050143+0000","last_clean":"2024-09-14T10:47:22.050143+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:47:22.050143+0000","last_undegraded":"2024-09-14T10:47:22.050143+0000","last_fullsized":"2024-09-14T10:47:22.050143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'9","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.899211+0000","last_change":"2024-09-14T10:44:44.460040+0000","last_active":"2024-09-14T10:47:21.899211+0000","last_peered":"2024-09-14T10:47:21.899211+0000","last_clean":"2024-09-14T10:47:21.899211+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:47:21.899211+0000","last_undegraded":"2024-09-14T10:47:21.899211+0000","last_fullsized":"2024-09-14T10:47:21.899211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:12.929749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441032+0000","last_change":"2024-09-14T10:44:05.316384+0000","last_active":"2024-09-14T10:44:44.441032+0000","last_peered":"2024-09-14T10:44:44.441032+0000","last_clean":"2024-09-14T10:44:44.441032+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:44:44.441032+0000","last_undegraded":"2024-09-14T10:44:44.441032+0000","last_fullsized":"2024-09-14T10:44:44.441032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.127894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438276+0000","last_change":"2024-09-14T10:44:09.321636+0000","last_active":"2024-09-14T10:44:44.438276+0000","last_peered":"2024-09-14T10:44:44.438276+0000","last_clean":"2024-09-14T10:44:44.438276+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:44:44.438276+0000","last_undegraded":"2024-09-14T10:44:44.438276+0000","last_fullsized":"2024-09-14T10:44:44.438276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:18.793271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.995447+0000","last_change":"2024-09-14T10:44:11.337843+0000","last_active":"2024-09-14T10:47:52.995447+0000","last_peered":"2024-09-14T10:47:52.995447+0000","last_clean":"2024-09-14T10:47:52.995447+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:47:52.995447+0000","last_undegraded":"2024-09-14T10:47:52.995447+0000","last_fullsized":"2024-09-14T10:47:52.995447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:07.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460124+0000","last_change":"2024-09-14T10:44:13.368817+0000","last_active":"2024-09-14T10:44:44.460124+0000","last_peered":"2024-09-14T10:44:44.460124+0000","last_clean":"2024-09-14T10:44:44.460124+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:44:44.460124+0000","last_undegraded":"2024-09-14T10:44:44.460124+0000","last_fullsized":"2024-09-14T10:44:44.460124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:51.609983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.281368+0000","last_change":"2024-09-14T10:44:15.388555+0000","last_active":"2024-09-14T10:46:18.281368+0000","last_peered":"2024-09-14T10:46:18.281368+0000","last_clean":"2024-09-14T10:46:18.281368+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:46:18.281368+0000","last_undegraded":"2024-09-14T10:46:18.281368+0000","last_fullsized":"2024-09-14T10:46:18.281368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:16.672301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720978+0000","last_change":"2024-09-14T10:44:07.313823+0000","last_active":"2024-09-14T10:47:21.720978+0000","last_peered":"2024-09-14T10:47:21.720978+0000","last_clean":"2024-09-14T10:47:21.720978+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:47:21.720978+0000","last_undegraded":"2024-09-14T10:47:21.720978+0000","last_fullsized":"2024-09-14T10:47:21.720978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:40.529838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453896+0000","last_change":"2024-09-14T10:44:05.324895+0000","last_active":"2024-09-14T10:44:44.453896+0000","last_peered":"2024-09-14T10:44:44.453896+0000","last_clean":"2024-09-14T10:44:44.453896+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:44:44.453896+0000","last_undegraded":"2024-09-14T10:44:44.453896+0000","last_fullsized":"2024-09-14T10:44:44.453896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:31.302720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440536+0000","last_change":"2024-09-14T10:44:09.325353+0000","last_active":"2024-09-14T10:44:44.440536+0000","last_peered":"2024-09-14T10:44:44.440536+0000","last_clean":"2024-09-14T10:44:44.440536+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:44:44.440536+0000","last_undegraded":"2024-09-14T10:44:44.440536+0000","last_fullsized":"2024-09-14T10:44:44.440536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:24.409253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.171546+0000","last_change":"2024-09-14T10:44:11.324938+0000","last_active":"2024-09-14T10:47:53.171546+0000","last_peered":"2024-09-14T10:47:53.171546+0000","last_clean":"2024-09-14T10:47:53.171546+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:47:53.171546+0000","last_undegraded":"2024-09-14T10:47:53.171546+0000","last_fullsized":"2024-09-14T10:47:53.171546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:38.232131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.881845+0000","last_change":"2024-09-14T10:44:13.364819+0000","last_active":"2024-09-14T10:47:52.881845+0000","last_peered":"2024-09-14T10:47:52.881845+0000","last_clean":"2024-09-14T10:47:52.881845+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:47:52.881845+0000","last_undegraded":"2024-09-14T10:47:52.881845+0000","last_fullsized":"2024-09-14T10:47:52.881845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:29.703105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:22.442035+0000","last_change":"2024-09-14T10:44:15.389692+0000","last_active":"2024-09-14T10:46:22.442035+0000","last_peered":"2024-09-14T10:46:22.442035+0000","last_clean":"2024-09-14T10:46:22.442035+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:46:22.442035+0000","last_undegraded":"2024-09-14T10:46:22.442035+0000","last_fullsized":"2024-09-14T10:46:22.442035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699712+0000","last_change":"2024-09-14T10:44:07.315452+0000","last_active":"2024-09-14T10:46:20.699712+0000","last_peered":"2024-09-14T10:46:20.699712+0000","last_clean":"2024-09-14T10:46:20.699712+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:46:20.699712+0000","last_undegraded":"2024-09-14T10:46:20.699712+0000","last_fullsized":"2024-09-14T10:46:20.699712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.769639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451555+0000","last_change":"2024-09-14T10:44:05.323413+0000","last_active":"2024-09-14T10:44:44.451555+0000","last_peered":"2024-09-14T10:44:44.451555+0000","last_clean":"2024-09-14T10:44:44.451555+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:44:44.451555+0000","last_undegraded":"2024-09-14T10:44:44.451555+0000","last_fullsized":"2024-09-14T10:44:44.451555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:47.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.854315+0000","last_change":"2024-09-14T10:44:09.321263+0000","last_active":"2024-09-14T10:47:52.854315+0000","last_peered":"2024-09-14T10:47:52.854315+0000","last_clean":"2024-09-14T10:47:52.854315+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:47:52.854315+0000","last_undegraded":"2024-09-14T10:47:52.854315+0000","last_fullsized":"2024-09-14T10:47:52.854315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:48.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455520+0000","last_change":"2024-09-14T10:44:11.365421+0000","last_active":"2024-09-14T10:44:44.455520+0000","last_peered":"2024-09-14T10:44:44.455520+0000","last_clean":"2024-09-14T10:44:44.455520+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:44:44.455520+0000","last_undegraded":"2024-09-14T10:44:44.455520+0000","last_fullsized":"2024-09-14T10:44:44.455520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:56.792327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":504,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.884680+0000","last_change":"2024-09-14T10:44:13.362574+0000","last_active":"2024-09-14T10:47:52.884680+0000","last_peered":"2024-09-14T10:47:52.884680+0000","last_clean":"2024-09-14T10:47:52.884680+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:47:52.884680+0000","last_undegraded":"2024-09-14T10:47:52.884680+0000","last_fullsized":"2024-09-14T10:47:52.884680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.234975+0000","last_change":"2024-09-14T10:44:15.376191+0000","last_active":"2024-09-14T10:46:20.234975+0000","last_peered":"2024-09-14T10:46:20.234975+0000","last_clean":"2024-09-14T10:46:20.234975+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:46:20.234975+0000","last_undegraded":"2024-09-14T10:46:20.234975+0000","last_fullsized":"2024-09-14T10:46:20.234975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:57.673158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880744+0000","last_change":"2024-09-14T10:44:07.321079+0000","last_active":"2024-09-14T10:47:21.880744+0000","last_peered":"2024-09-14T10:47:21.880744+0000","last_clean":"2024-09-14T10:47:21.880744+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:47:21.880744+0000","last_undegraded":"2024-09-14T10:47:21.880744+0000","last_fullsized":"2024-09-14T10:47:21.880744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:01.445738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441663+0000","last_change":"2024-09-14T10:44:05.327190+0000","last_active":"2024-09-14T10:44:44.441663+0000","last_peered":"2024-09-14T10:44:44.441663+0000","last_clean":"2024-09-14T10:44:44.441663+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:44:44.441663+0000","last_undegraded":"2024-09-14T10:44:44.441663+0000","last_fullsized":"2024-09-14T10:44:44.441663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:46.537438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457361+0000","last_change":"2024-09-14T10:44:09.342479+0000","last_active":"2024-09-14T10:44:44.457361+0000","last_peered":"2024-09-14T10:44:44.457361+0000","last_clean":"2024-09-14T10:44:44.457361+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:44:44.457361+0000","last_undegraded":"2024-09-14T10:44:44.457361+0000","last_fullsized":"2024-09-14T10:44:44.457361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:27.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'41","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.074359+0000","last_change":"2024-09-14T10:44:11.332997+0000","last_active":"2024-09-14T10:47:53.074359+0000","last_peered":"2024-09-14T10:47:53.074359+0000","last_clean":"2024-09-14T10:47:53.074359+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:47:53.074359+0000","last_undegraded":"2024-09-14T10:47:53.074359+0000","last_fullsized":"2024-09-14T10:47:53.074359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:53.814557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436642+0000","last_change":"2024-09-14T10:44:13.374235+0000","last_active":"2024-09-14T10:44:44.436642+0000","last_peered":"2024-09-14T10:44:44.436642+0000","last_clean":"2024-09-14T10:44:44.436642+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:44:44.436642+0000","last_undegraded":"2024-09-14T10:44:44.436642+0000","last_fullsized":"2024-09-14T10:44:44.436642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:45.457582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.953427+0000","last_change":"2024-09-14T10:44:15.378896+0000","last_active":"2024-09-14T10:47:21.953427+0000","last_peered":"2024-09-14T10:47:21.953427+0000","last_clean":"2024-09-14T10:47:21.953427+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:47:21.953427+0000","last_undegraded":"2024-09-14T10:47:21.953427+0000","last_fullsized":"2024-09-14T10:47:21.953427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:41.435534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'13","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.402163+0000","last_change":"2024-09-14T10:44:07.313348+0000","last_active":"2024-09-14T10:47:21.402163+0000","last_peered":"2024-09-14T10:47:21.402163+0000","last_clean":"2024-09-14T10:47:21.402163+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:47:21.402163+0000","last_undegraded":"2024-09-14T10:47:21.402163+0000","last_fullsized":"2024-09-14T10:47:21.402163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:03.002533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:54.436156+0000","last_change":"2024-09-14T10:43:50.584788+0000","last_active":"2024-09-14T10:45:54.436156+0000","last_peered":"2024-09-14T10:45:54.436156+0000","last_clean":"2024-09-14T10:45:54.436156+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:45:54.436156+0000","last_undegraded":"2024-09-14T10:45:54.436156+0000","last_fullsized":"2024-09-14T10:45:54.436156+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:49.418142+0000","last_clean_scrub_stamp":"2024-09-14T10:43:49.418142+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:43.928260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455044+0000","last_change":"2024-09-14T10:43:57.466810+0000","last_active":"2024-09-14T10:44:44.455044+0000","last_peered":"2024-09-14T10:44:44.455044+0000","last_clean":"2024-09-14T10:44:44.455044+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:44:44.455044+0000","last_undegraded":"2024-09-14T10:44:44.455044+0000","last_fullsized":"2024-09-14T10:44:44.455044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:33.230423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.324672+0000","last_change":"2024-09-14T10:44:05.335883+0000","last_active":"2024-09-14T10:47:21.324672+0000","last_peered":"2024-09-14T10:47:21.324672+0000","last_clean":"2024-09-14T10:47:21.324672+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:47:21.324672+0000","last_undegraded":"2024-09-14T10:47:21.324672+0000","last_fullsized":"2024-09-14T10:47:21.324672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:49.876374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.467078+0000","last_change":"2024-09-14T10:44:44.463751+0000","last_active":"2024-09-14T10:44:44.467078+0000","last_peered":"2024-09-14T10:44:44.467078+0000","last_clean":"2024-09-14T10:44:44.467078+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:44:44.467078+0000","last_undegraded":"2024-09-14T10:44:44.467078+0000","last_fullsized":"2024-09-14T10:44:44.467078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.700138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'86","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.153812+0000","last_change":"2024-09-14T10:44:11.357369+0000","last_active":"2024-09-14T10:47:53.153812+0000","last_peered":"2024-09-14T10:47:53.153812+0000","last_clean":"2024-09-14T10:47:53.153812+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:47:53.153812+0000","last_undegraded":"2024-09-14T10:47:53.153812+0000","last_fullsized":"2024-09-14T10:47:53.153812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:20.733108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443564+0000","last_change":"2024-09-14T10:44:13.372619+0000","last_active":"2024-09-14T10:44:44.443564+0000","last_peered":"2024-09-14T10:44:44.443564+0000","last_clean":"2024-09-14T10:44:44.443564+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:44:44.443564+0000","last_undegraded":"2024-09-14T10:44:44.443564+0000","last_fullsized":"2024-09-14T10:44:44.443564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.209093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.907510+0000","last_change":"2024-09-14T10:44:15.380614+0000","last_active":"2024-09-14T10:47:21.907510+0000","last_peered":"2024-09-14T10:47:21.907510+0000","last_clean":"2024-09-14T10:47:21.907510+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:47:21.907510+0000","last_undegraded":"2024-09-14T10:47:21.907510+0000","last_fullsized":"2024-09-14T10:47:21.907510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:58.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825057+0000","last_change":"2024-09-14T10:44:07.316776+0000","last_active":"2024-09-14T10:47:21.825057+0000","last_peered":"2024-09-14T10:47:21.825057+0000","last_clean":"2024-09-14T10:47:21.825057+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:47:21.825057+0000","last_undegraded":"2024-09-14T10:47:21.825057+0000","last_fullsized":"2024-09-14T10:47:21.825057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.514426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440485+0000","last_change":"2024-09-14T10:43:57.465589+0000","last_active":"2024-09-14T10:44:44.440485+0000","last_peered":"2024-09-14T10:44:44.440485+0000","last_clean":"2024-09-14T10:44:44.440485+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:44:44.440485+0000","last_undegraded":"2024-09-14T10:44:44.440485+0000","last_fullsized":"2024-09-14T10:44:44.440485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.853418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.190894+0000","last_change":"2024-09-14T10:44:05.313733+0000","last_active":"2024-09-14T10:47:21.190894+0000","last_peered":"2024-09-14T10:47:21.190894+0000","last_clean":"2024-09-14T10:47:21.190894+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:47:21.190894+0000","last_undegraded":"2024-09-14T10:47:21.190894+0000","last_fullsized":"2024-09-14T10:47:21.190894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:29.804432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460368+0000","last_change":"2024-09-14T10:44:09.341477+0000","last_active":"2024-09-14T10:44:44.460368+0000","last_peered":"2024-09-14T10:44:44.460368+0000","last_clean":"2024-09-14T10:44:44.460368+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:44:44.460368+0000","last_undegraded":"2024-09-14T10:44:44.460368+0000","last_fullsized":"2024-09-14T10:44:44.460368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:45.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'284","reported_seq":502,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.082629+0000","last_change":"2024-09-14T10:44:11.347623+0000","last_active":"2024-09-14T10:47:53.082629+0000","last_peered":"2024-09-14T10:47:53.082629+0000","last_clean":"2024-09-14T10:47:53.082629+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:47:53.082629+0000","last_undegraded":"2024-09-14T10:47:53.082629+0000","last_fullsized":"2024-09-14T10:47:53.082629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:58.040485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454445+0000","last_change":"2024-09-14T10:44:13.368580+0000","last_active":"2024-09-14T10:44:44.454445+0000","last_peered":"2024-09-14T10:44:44.454445+0000","last_clean":"2024-09-14T10:44:44.454445+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:44:44.454445+0000","last_undegraded":"2024-09-14T10:44:44.454445+0000","last_fullsized":"2024-09-14T10:44:44.454445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:45.985218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.604538+0000","last_change":"2024-09-14T10:44:15.392131+0000","last_active":"2024-09-14T10:45:35.604538+0000","last_peered":"2024-09-14T10:45:35.604538+0000","last_clean":"2024-09-14T10:45:35.604538+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:45:35.604538+0000","last_undegraded":"2024-09-14T10:45:35.604538+0000","last_fullsized":"2024-09-14T10:45:35.604538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:37.610953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.441166+0000","last_change":"2024-09-14T10:44:07.302744+0000","last_active":"2024-09-14T10:46:17.441166+0000","last_peered":"2024-09-14T10:46:17.441166+0000","last_clean":"2024-09-14T10:46:17.441166+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:46:17.441166+0000","last_undegraded":"2024-09-14T10:46:17.441166+0000","last_fullsized":"2024-09-14T10:46:17.441166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:44.363143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434243+0000","last_change":"2024-09-14T10:43:57.622013+0000","last_active":"2024-09-14T10:44:44.434243+0000","last_peered":"2024-09-14T10:44:44.434243+0000","last_clean":"2024-09-14T10:44:44.434243+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:44:44.434243+0000","last_undegraded":"2024-09-14T10:44:44.434243+0000","last_fullsized":"2024-09-14T10:44:44.434243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438450+0000","last_change":"2024-09-14T10:44:05.314187+0000","last_active":"2024-09-14T10:44:44.438450+0000","last_peered":"2024-09-14T10:44:44.438450+0000","last_clean":"2024-09-14T10:44:44.438450+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:44:44.438450+0000","last_undegraded":"2024-09-14T10:44:44.438450+0000","last_fullsized":"2024-09-14T10:44:44.438450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:38.919125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438356+0000","last_change":"2024-09-14T10:44:09.316504+0000","last_active":"2024-09-14T10:44:44.438356+0000","last_peered":"2024-09-14T10:44:44.438356+0000","last_clean":"2024-09-14T10:44:44.438356+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:44:44.438356+0000","last_undegraded":"2024-09-14T10:44:44.438356+0000","last_fullsized":"2024-09-14T10:44:44.438356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.594212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566236+0000","last_change":"2024-09-14T10:44:11.340123+0000","last_active":"2024-09-14T10:47:19.566236+0000","last_peered":"2024-09-14T10:47:19.566236+0000","last_clean":"2024-09-14T10:47:19.566236+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:47:19.566236+0000","last_undegraded":"2024-09-14T10:47:19.566236+0000","last_fullsized":"2024-09-14T10:47:19.566236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:55.570468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440972+0000","last_change":"2024-09-14T10:44:13.372401+0000","last_active":"2024-09-14T10:44:44.440972+0000","last_peered":"2024-09-14T10:44:44.440972+0000","last_clean":"2024-09-14T10:44:44.440972+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:44:44.440972+0000","last_undegraded":"2024-09-14T10:44:44.440972+0000","last_fullsized":"2024-09-14T10:44:44.440972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:48.551523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451974+0000","last_change":"2024-09-14T10:44:15.379368+0000","last_active":"2024-09-14T10:44:44.451974+0000","last_peered":"2024-09-14T10:44:44.451974+0000","last_clean":"2024-09-14T10:44:44.451974+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:44:44.451974+0000","last_undegraded":"2024-09-14T10:44:44.451974+0000","last_fullsized":"2024-09-14T10:44:44.451974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:11.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.510872+0000","last_change":"2024-09-14T10:44:07.307515+0000","last_active":"2024-09-14T10:46:16.510872+0000","last_peered":"2024-09-14T10:46:16.510872+0000","last_clean":"2024-09-14T10:46:16.510872+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:46:16.510872+0000","last_undegraded":"2024-09-14T10:46:16.510872+0000","last_fullsized":"2024-09-14T10:46:16.510872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:10.397230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452886+0000","last_change":"2024-09-14T10:43:57.466709+0000","last_active":"2024-09-14T10:44:44.452886+0000","last_peered":"2024-09-14T10:44:44.452886+0000","last_clean":"2024-09-14T10:44:44.452886+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:44:44.452886+0000","last_undegraded":"2024-09-14T10:44:44.452886+0000","last_fullsized":"2024-09-14T10:44:44.452886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:59.740099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.379318+0000","last_change":"2024-09-14T10:44:05.316730+0000","last_active":"2024-09-14T10:46:20.379318+0000","last_peered":"2024-09-14T10:46:20.379318+0000","last_clean":"2024-09-14T10:46:20.379318+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:46:20.379318+0000","last_undegraded":"2024-09-14T10:46:20.379318+0000","last_fullsized":"2024-09-14T10:46:20.379318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:52.869387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444568+0000","last_change":"2024-09-14T10:44:09.322206+0000","last_active":"2024-09-14T10:44:44.444568+0000","last_peered":"2024-09-14T10:44:44.444568+0000","last_clean":"2024-09-14T10:44:44.444568+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:44:44.444568+0000","last_undegraded":"2024-09-14T10:44:44.444568+0000","last_fullsized":"2024-09-14T10:44:44.444568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:42.879923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.719618+0000","last_change":"2024-09-14T10:44:11.362466+0000","last_active":"2024-09-14T10:47:20.719618+0000","last_peered":"2024-09-14T10:47:20.719618+0000","last_clean":"2024-09-14T10:47:20.719618+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:47:20.719618+0000","last_undegraded":"2024-09-14T10:47:20.719618+0000","last_fullsized":"2024-09-14T10:47:20.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.095069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460591+0000","last_change":"2024-09-14T10:44:13.368952+0000","last_active":"2024-09-14T10:44:44.460591+0000","last_peered":"2024-09-14T10:44:44.460591+0000","last_clean":"2024-09-14T10:44:44.460591+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:44:44.460591+0000","last_undegraded":"2024-09-14T10:44:44.460591+0000","last_fullsized":"2024-09-14T10:44:44.460591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.525259+0000","last_change":"2024-09-14T10:44:15.382665+0000","last_active":"2024-09-14T10:47:21.525259+0000","last_peered":"2024-09-14T10:47:21.525259+0000","last_clean":"2024-09-14T10:47:21.525259+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:47:21.525259+0000","last_undegraded":"2024-09-14T10:47:21.525259+0000","last_fullsized":"2024-09-14T10:47:21.525259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:18.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879962+0000","last_change":"2024-09-14T10:44:07.314873+0000","last_active":"2024-09-14T10:47:21.879962+0000","last_peered":"2024-09-14T10:47:21.879962+0000","last_clean":"2024-09-14T10:47:21.879962+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:47:21.879962+0000","last_undegraded":"2024-09-14T10:47:21.879962+0000","last_fullsized":"2024-09-14T10:47:21.879962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:56.862937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.805694+0000","last_change":"2024-09-14T10:44:05.319446+0000","last_active":"2024-09-14T10:44:51.805694+0000","last_peered":"2024-09-14T10:44:51.805694+0000","last_clean":"2024-09-14T10:44:51.805694+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:44:51.805694+0000","last_undegraded":"2024-09-14T10:44:51.805694+0000","last_fullsized":"2024-09-14T10:44:51.805694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:15.462869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440965+0000","last_change":"2024-09-14T10:43:57.471405+0000","last_active":"2024-09-14T10:44:44.440965+0000","last_peered":"2024-09-14T10:44:44.440965+0000","last_clean":"2024-09-14T10:44:44.440965+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:44:44.440965+0000","last_undegraded":"2024-09-14T10:44:44.440965+0000","last_fullsized":"2024-09-14T10:44:44.440965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.379980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.086419+0000","last_change":"2024-09-14T10:44:44.455451+0000","last_active":"2024-09-14T10:47:22.086419+0000","last_peered":"2024-09-14T10:47:22.086419+0000","last_clean":"2024-09-14T10:47:22.086419+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:47:22.086419+0000","last_undegraded":"2024-09-14T10:47:22.086419+0000","last_fullsized":"2024-09-14T10:47:22.086419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:57.298667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'68","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.166989+0000","last_change":"2024-09-14T10:44:11.326152+0000","last_active":"2024-09-14T10:47:53.166989+0000","last_peered":"2024-09-14T10:47:53.166989+0000","last_clean":"2024-09-14T10:47:53.166989+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:47:53.166989+0000","last_undegraded":"2024-09-14T10:47:53.166989+0000","last_fullsized":"2024-09-14T10:47:53.166989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:41.985865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432731+0000","last_change":"2024-09-14T10:44:13.362954+0000","last_active":"2024-09-14T10:44:44.432731+0000","last_peered":"2024-09-14T10:44:44.432731+0000","last_clean":"2024-09-14T10:44:44.432731+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:44:44.432731+0000","last_undegraded":"2024-09-14T10:44:44.432731+0000","last_fullsized":"2024-09-14T10:44:44.432731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.191871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.551637+0000","last_change":"2024-09-14T10:44:15.380020+0000","last_active":"2024-09-14T10:46:20.551637+0000","last_peered":"2024-09-14T10:46:20.551637+0000","last_clean":"2024-09-14T10:46:20.551637+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:46:20.551637+0000","last_undegraded":"2024-09-14T10:46:20.551637+0000","last_fullsized":"2024-09-14T10:46:20.551637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:17.206749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.508788+0000","last_change":"2024-09-14T10:44:07.319078+0000","last_active":"2024-09-14T10:46:16.508788+0000","last_peered":"2024-09-14T10:46:16.508788+0000","last_clean":"2024-09-14T10:46:16.508788+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:46:16.508788+0000","last_undegraded":"2024-09-14T10:46:16.508788+0000","last_fullsized":"2024-09-14T10:46:16.508788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:20.214122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.692204+0000","last_change":"2024-09-14T10:44:05.323716+0000","last_active":"2024-09-14T10:47:21.692204+0000","last_peered":"2024-09-14T10:47:21.692204+0000","last_clean":"2024-09-14T10:47:21.692204+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:21.692204+0000","last_undegraded":"2024-09-14T10:47:21.692204+0000","last_fullsized":"2024-09-14T10:47:21.692204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:48.326362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456259+0000","last_change":"2024-09-14T10:43:57.465338+0000","last_active":"2024-09-14T10:44:44.456259+0000","last_peered":"2024-09-14T10:44:44.456259+0000","last_clean":"2024-09-14T10:44:44.456259+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:44:44.456259+0000","last_undegraded":"2024-09-14T10:44:44.456259+0000","last_fullsized":"2024-09-14T10:44:44.456259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.995453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450895+0000","last_change":"2024-09-14T10:44:09.332697+0000","last_active":"2024-09-14T10:44:44.450895+0000","last_peered":"2024-09-14T10:44:44.450895+0000","last_clean":"2024-09-14T10:44:44.450895+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:44:44.450895+0000","last_undegraded":"2024-09-14T10:44:44.450895+0000","last_fullsized":"2024-09-14T10:44:44.450895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:36.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451768+0000","last_change":"2024-09-14T10:44:11.338828+0000","last_active":"2024-09-14T10:44:44.451768+0000","last_peered":"2024-09-14T10:44:44.451768+0000","last_clean":"2024-09-14T10:44:44.451768+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:44:44.451768+0000","last_undegraded":"2024-09-14T10:44:44.451768+0000","last_fullsized":"2024-09-14T10:44:44.451768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:03.825369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":351,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.878601+0000","last_change":"2024-09-14T10:44:13.353577+0000","last_active":"2024-09-14T10:47:52.878601+0000","last_peered":"2024-09-14T10:47:52.878601+0000","last_clean":"2024-09-14T10:47:52.878601+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:47:52.878601+0000","last_undegraded":"2024-09-14T10:47:52.878601+0000","last_fullsized":"2024-09-14T10:47:52.878601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.459796+0000","last_change":"2024-09-14T10:44:15.371433+0000","last_active":"2024-09-14T10:44:44.459796+0000","last_peered":"2024-09-14T10:44:44.459796+0000","last_clean":"2024-09-14T10:44:44.459796+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:44:44.459796+0000","last_undegraded":"2024-09-14T10:44:44.459796+0000","last_fullsized":"2024-09-14T10:44:44.459796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:12.672256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.719980+0000","last_change":"2024-09-14T10:44:07.313506+0000","last_active":"2024-09-14T10:47:21.719980+0000","last_peered":"2024-09-14T10:47:21.719980+0000","last_clean":"2024-09-14T10:47:21.719980+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:47:21.719980+0000","last_undegraded":"2024-09-14T10:47:21.719980+0000","last_fullsized":"2024-09-14T10:47:21.719980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:57.847452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.461911+0000","last_change":"2024-09-14T10:44:05.318013+0000","last_active":"2024-09-14T10:44:44.461911+0000","last_peered":"2024-09-14T10:44:44.461911+0000","last_clean":"2024-09-14T10:44:44.461911+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:44:44.461911+0000","last_undegraded":"2024-09-14T10:44:44.461911+0000","last_fullsized":"2024-09-14T10:44:44.461911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:54.849665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:56.524057+0000","last_change":"2024-09-14T10:47:56.524057+0000","last_active":"2024-09-14T10:47:56.524057+0000","last_peered":"2024-09-14T10:47:56.524057+0000","last_clean":"2024-09-14T10:47:56.524057+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:47:56.524057+0000","last_undegraded":"2024-09-14T10:47:56.524057+0000","last_fullsized":"2024-09-14T10:47:56.524057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_clean_scrub_stamp":"2024-09-14T10:47:56.523860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:01.837471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442798+0000","last_change":"2024-09-14T10:44:09.334472+0000","last_active":"2024-09-14T10:44:44.442798+0000","last_peered":"2024-09-14T10:44:44.442798+0000","last_clean":"2024-09-14T10:44:44.442798+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:44:44.442798+0000","last_undegraded":"2024-09-14T10:44:44.442798+0000","last_fullsized":"2024-09-14T10:44:44.442798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:18.491213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453618+0000","last_change":"2024-09-14T10:44:11.360311+0000","last_active":"2024-09-14T10:44:44.453618+0000","last_peered":"2024-09-14T10:44:44.453618+0000","last_clean":"2024-09-14T10:44:44.453618+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:44:44.453618+0000","last_undegraded":"2024-09-14T10:44:44.453618+0000","last_fullsized":"2024-09-14T10:44:44.453618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:18.907361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":422,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.890503+0000","last_change":"2024-09-14T10:44:13.349515+0000","last_active":"2024-09-14T10:47:52.890503+0000","last_peered":"2024-09-14T10:47:52.890503+0000","last_clean":"2024-09-14T10:47:52.890503+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:47:52.890503+0000","last_undegraded":"2024-09-14T10:47:52.890503+0000","last_fullsized":"2024-09-14T10:47:52.890503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.867987+0000","last_change":"2024-09-14T10:44:15.380474+0000","last_active":"2024-09-14T10:45:35.867987+0000","last_peered":"2024-09-14T10:45:35.867987+0000","last_clean":"2024-09-14T10:45:35.867987+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:45:35.867987+0000","last_undegraded":"2024-09-14T10:45:35.867987+0000","last_fullsized":"2024-09-14T10:45:35.867987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:15.535271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433094+0000","last_change":"2024-09-14T10:44:07.314957+0000","last_active":"2024-09-14T10:44:44.433094+0000","last_peered":"2024-09-14T10:44:44.433094+0000","last_clean":"2024-09-14T10:44:44.433094+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:44:44.433094+0000","last_undegraded":"2024-09-14T10:44:44.433094+0000","last_fullsized":"2024-09-14T10:44:44.433094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:53.570663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.160701+0000","last_change":"2024-09-14T10:44:05.322609+0000","last_active":"2024-09-14T10:47:21.160701+0000","last_peered":"2024-09-14T10:47:21.160701+0000","last_clean":"2024-09-14T10:47:21.160701+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:47:21.160701+0000","last_undegraded":"2024-09-14T10:47:21.160701+0000","last_fullsized":"2024-09-14T10:47:21.160701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:49.133099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.461469+0000","last_change":"2024-09-14T10:43:57.467362+0000","last_active":"2024-09-14T10:44:44.461469+0000","last_peered":"2024-09-14T10:44:44.461469+0000","last_clean":"2024-09-14T10:44:44.461469+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:44:44.461469+0000","last_undegraded":"2024-09-14T10:44:44.461469+0000","last_fullsized":"2024-09-14T10:44:44.461469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:43:54.435773+0000","last_clean_scrub_stamp":"2024-09-14T10:43:54.435773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.939647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440109+0000","last_change":"2024-09-14T10:44:09.335319+0000","last_active":"2024-09-14T10:44:44.440109+0000","last_peered":"2024-09-14T10:44:44.440109+0000","last_clean":"2024-09-14T10:44:44.440109+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:44:44.440109+0000","last_undegraded":"2024-09-14T10:44:44.440109+0000","last_fullsized":"2024-09-14T10:44:44.440109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:44.522431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'92","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.062841+0000","last_change":"2024-09-14T10:44:11.359272+0000","last_active":"2024-09-14T10:47:53.062841+0000","last_peered":"2024-09-14T10:47:53.062841+0000","last_clean":"2024-09-14T10:47:53.062841+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:47:53.062841+0000","last_undegraded":"2024-09-14T10:47:53.062841+0000","last_fullsized":"2024-09-14T10:47:53.062841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438836+0000","last_change":"2024-09-14T10:44:13.361050+0000","last_active":"2024-09-14T10:44:44.438836+0000","last_peered":"2024-09-14T10:44:44.438836+0000","last_clean":"2024-09-14T10:44:44.438836+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:44:44.438836+0000","last_undegraded":"2024-09-14T10:44:44.438836+0000","last_fullsized":"2024-09-14T10:44:44.438836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.597367+0000","last_change":"2024-09-14T10:44:15.376175+0000","last_active":"2024-09-14T10:44:52.597367+0000","last_peered":"2024-09-14T10:44:52.597367+0000","last_clean":"2024-09-14T10:44:52.597367+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:44:52.597367+0000","last_undegraded":"2024-09-14T10:44:52.597367+0000","last_fullsized":"2024-09-14T10:44:52.597367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.409508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.990797+0000","last_change":"2024-09-14T10:44:15.381865+0000","last_active":"2024-09-14T10:47:21.990797+0000","last_peered":"2024-09-14T10:47:21.990797+0000","last_clean":"2024-09-14T10:47:21.990797+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:47:21.990797+0000","last_undegraded":"2024-09-14T10:47:21.990797+0000","last_fullsized":"2024-09-14T10:47:21.990797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:55.550930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.520688+0000","last_change":"2024-09-14T10:44:07.314638+0000","last_active":"2024-09-14T10:47:21.520688+0000","last_peered":"2024-09-14T10:47:21.520688+0000","last_clean":"2024-09-14T10:47:21.520688+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:47:21.520688+0000","last_undegraded":"2024-09-14T10:47:21.520688+0000","last_fullsized":"2024-09-14T10:47:21.520688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:49.986512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.135398+0000","last_change":"2024-09-14T10:44:05.315040+0000","last_active":"2024-09-14T10:47:21.135398+0000","last_peered":"2024-09-14T10:47:21.135398+0000","last_clean":"2024-09-14T10:47:21.135398+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:47:21.135398+0000","last_undegraded":"2024-09-14T10:47:21.135398+0000","last_fullsized":"2024-09-14T10:47:21.135398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:41.172912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:02.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.100532+0000","last_change":"2024-09-14T10:44:11.356682+0000","last_active":"2024-09-14T10:47:53.100532+0000","last_peered":"2024-09-14T10:47:53.100532+0000","last_clean":"2024-09-14T10:47:53.100532+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:47:53.100532+0000","last_undegraded":"2024-09-14T10:47:53.100532+0000","last_fullsized":"2024-09-14T10:47:53.100532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:36.580622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442491+0000","last_change":"2024-09-14T10:44:13.370490+0000","last_active":"2024-09-14T10:44:44.442491+0000","last_peered":"2024-09-14T10:44:44.442491+0000","last_clean":"2024-09-14T10:44:44.442491+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:44:44.442491+0000","last_undegraded":"2024-09-14T10:44:44.442491+0000","last_fullsized":"2024-09-14T10:44:44.442491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:34.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.285933+0000","last_change":"2024-09-14T10:44:15.361905+0000","last_active":"2024-09-14T10:46:18.285933+0000","last_peered":"2024-09-14T10:46:18.285933+0000","last_clean":"2024-09-14T10:46:18.285933+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:46:18.285933+0000","last_undegraded":"2024-09-14T10:46:18.285933+0000","last_fullsized":"2024-09-14T10:46:18.285933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:48.673933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699026+0000","last_change":"2024-09-14T10:44:44.460104+0000","last_active":"2024-09-14T10:46:20.699026+0000","last_peered":"2024-09-14T10:46:20.699026+0000","last_clean":"2024-09-14T10:46:20.699026+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:46:20.699026+0000","last_undegraded":"2024-09-14T10:46:20.699026+0000","last_fullsized":"2024-09-14T10:46:20.699026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:13.899780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.708947+0000","last_change":"2024-09-14T10:44:05.320160+0000","last_active":"2024-09-14T10:44:50.708947+0000","last_peered":"2024-09-14T10:44:50.708947+0000","last_clean":"2024-09-14T10:44:50.708947+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:44:50.708947+0000","last_undegraded":"2024-09-14T10:44:50.708947+0000","last_fullsized":"2024-09-14T10:44:50.708947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:09.975430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.464537+0000","last_change":"2024-09-14T10:44:44.463214+0000","last_active":"2024-09-14T10:44:44.464537+0000","last_peered":"2024-09-14T10:44:44.464537+0000","last_clean":"2024-09-14T10:44:44.464537+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:44:44.464537+0000","last_undegraded":"2024-09-14T10:44:44.464537+0000","last_fullsized":"2024-09-14T10:44:44.464537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:34.009805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.732910+0000","last_change":"2024-09-14T10:44:11.323585+0000","last_active":"2024-09-14T10:47:20.732910+0000","last_peered":"2024-09-14T10:47:20.732910+0000","last_clean":"2024-09-14T10:47:20.732910+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:47:20.732910+0000","last_undegraded":"2024-09-14T10:47:20.732910+0000","last_fullsized":"2024-09-14T10:47:20.732910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:36.664992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434000+0000","last_change":"2024-09-14T10:44:13.371900+0000","last_active":"2024-09-14T10:44:44.434000+0000","last_peered":"2024-09-14T10:44:44.434000+0000","last_clean":"2024-09-14T10:44:44.434000+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:44:44.434000+0000","last_undegraded":"2024-09-14T10:44:44.434000+0000","last_fullsized":"2024-09-14T10:44:44.434000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:29.727463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440980+0000","last_change":"2024-09-14T10:44:15.386483+0000","last_active":"2024-09-14T10:44:44.440980+0000","last_peered":"2024-09-14T10:44:44.440980+0000","last_clean":"2024-09-14T10:44:44.440980+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:44:44.440980+0000","last_undegraded":"2024-09-14T10:44:44.440980+0000","last_fullsized":"2024-09-14T10:44:44.440980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.723831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.523634+0000","last_change":"2024-09-14T10:44:07.316643+0000","last_active":"2024-09-14T10:47:21.523634+0000","last_peered":"2024-09-14T10:47:21.523634+0000","last_clean":"2024-09-14T10:47:21.523634+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:47:21.523634+0000","last_undegraded":"2024-09-14T10:47:21.523634+0000","last_fullsized":"2024-09-14T10:47:21.523634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:51.889645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439378+0000","last_change":"2024-09-14T10:44:05.322513+0000","last_active":"2024-09-14T10:44:44.439378+0000","last_peered":"2024-09-14T10:44:44.439378+0000","last_clean":"2024-09-14T10:44:44.439378+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:44:44.439378+0000","last_undegraded":"2024-09-14T10:44:44.439378+0000","last_fullsized":"2024-09-14T10:44:44.439378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:39.441568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432334+0000","last_change":"2024-09-14T10:44:09.318542+0000","last_active":"2024-09-14T10:44:44.432334+0000","last_peered":"2024-09-14T10:44:44.432334+0000","last_clean":"2024-09-14T10:44:44.432334+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:44:44.432334+0000","last_undegraded":"2024-09-14T10:44:44.432334+0000","last_fullsized":"2024-09-14T10:44:44.432334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:29.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.032529+0000","last_change":"2024-09-14T10:44:11.336124+0000","last_active":"2024-09-14T10:47:53.032529+0000","last_peered":"2024-09-14T10:47:53.032529+0000","last_clean":"2024-09-14T10:47:53.032529+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:47:53.032529+0000","last_undegraded":"2024-09-14T10:47:53.032529+0000","last_fullsized":"2024-09-14T10:47:53.032529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:04.242694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444917+0000","last_change":"2024-09-14T10:44:13.354345+0000","last_active":"2024-09-14T10:44:44.444917+0000","last_peered":"2024-09-14T10:44:44.444917+0000","last_clean":"2024-09-14T10:44:44.444917+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:44:44.444917+0000","last_undegraded":"2024-09-14T10:44:44.444917+0000","last_fullsized":"2024-09-14T10:44:44.444917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451891+0000","last_change":"2024-09-14T10:44:15.378526+0000","last_active":"2024-09-14T10:44:44.451891+0000","last_peered":"2024-09-14T10:44:44.451891+0000","last_clean":"2024-09-14T10:44:44.451891+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:44:44.451891+0000","last_undegraded":"2024-09-14T10:44:44.451891+0000","last_fullsized":"2024-09-14T10:44:44.451891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:34.239574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872753+0000","last_change":"2024-09-14T10:44:07.313804+0000","last_active":"2024-09-14T10:45:35.872753+0000","last_peered":"2024-09-14T10:45:35.872753+0000","last_clean":"2024-09-14T10:45:35.872753+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:45:35.872753+0000","last_undegraded":"2024-09-14T10:45:35.872753+0000","last_fullsized":"2024-09-14T10:45:35.872753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:24.864032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:05.322391+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442567+0000","last_change":"2024-09-14T10:44:09.338478+0000","last_active":"2024-09-14T10:44:44.442567+0000","last_peered":"2024-09-14T10:44:44.442567+0000","last_clean":"2024-09-14T10:44:44.442567+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:44:44.442567+0000","last_undegraded":"2024-09-14T10:44:44.442567+0000","last_fullsized":"2024-09-14T10:44:44.442567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:42.543570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.010478+0000","last_change":"2024-09-14T10:44:11.321761+0000","last_active":"2024-09-14T10:47:53.010478+0000","last_peered":"2024-09-14T10:47:53.010478+0000","last_clean":"2024-09-14T10:47:53.010478+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:47:53.010478+0000","last_undegraded":"2024-09-14T10:47:53.010478+0000","last_fullsized":"2024-09-14T10:47:53.010478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.326575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434240+0000","last_change":"2024-09-14T10:44:13.356507+0000","last_active":"2024-09-14T10:44:44.434240+0000","last_peered":"2024-09-14T10:44:44.434240+0000","last_clean":"2024-09-14T10:44:44.434240+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:44:44.434240+0000","last_undegraded":"2024-09-14T10:44:44.434240+0000","last_fullsized":"2024-09-14T10:44:44.434240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.808772+0000","last_change":"2024-09-14T10:44:07.313195+0000","last_active":"2024-09-14T10:47:21.808772+0000","last_peered":"2024-09-14T10:47:21.808772+0000","last_clean":"2024-09-14T10:47:21.808772+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:47:21.808772+0000","last_undegraded":"2024-09-14T10:47:21.808772+0000","last_fullsized":"2024-09-14T10:47:21.808772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:53.410685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440632+0000","last_change":"2024-09-14T10:44:05.324942+0000","last_active":"2024-09-14T10:44:44.440632+0000","last_peered":"2024-09-14T10:44:44.440632+0000","last_clean":"2024-09-14T10:44:44.440632+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:44:44.440632+0000","last_undegraded":"2024-09-14T10:44:44.440632+0000","last_fullsized":"2024-09-14T10:44:44.440632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:09.809429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443876+0000","last_change":"2024-09-14T10:44:09.332885+0000","last_active":"2024-09-14T10:44:44.443876+0000","last_peered":"2024-09-14T10:44:44.443876+0000","last_clean":"2024-09-14T10:44:44.443876+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:44:44.443876+0000","last_undegraded":"2024-09-14T10:44:44.443876+0000","last_fullsized":"2024-09-14T10:44:44.443876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:29.989539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.149219+0000","last_change":"2024-09-14T10:44:11.340857+0000","last_active":"2024-09-14T10:47:53.149219+0000","last_peered":"2024-09-14T10:47:53.149219+0000","last_clean":"2024-09-14T10:47:53.149219+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:47:53.149219+0000","last_undegraded":"2024-09-14T10:47:53.149219+0000","last_fullsized":"2024-09-14T10:47:53.149219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:58.117101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436429+0000","last_change":"2024-09-14T10:44:13.356783+0000","last_active":"2024-09-14T10:44:44.436429+0000","last_peered":"2024-09-14T10:44:44.436429+0000","last_clean":"2024-09-14T10:44:44.436429+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:44:44.436429+0000","last_undegraded":"2024-09-14T10:44:44.436429+0000","last_fullsized":"2024-09-14T10:44:44.436429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:57.886038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.426338+0000","last_change":"2024-09-14T10:44:15.390085+0000","last_active":"2024-09-14T10:47:21.426338+0000","last_peered":"2024-09-14T10:47:21.426338+0000","last_clean":"2024-09-14T10:47:21.426338+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:47:21.426338+0000","last_undegraded":"2024-09-14T10:47:21.426338+0000","last_fullsized":"2024-09-14T10:47:21.426338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:09.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882763+0000","last_change":"2024-09-14T10:44:07.305111+0000","last_active":"2024-09-14T10:47:21.882763+0000","last_peered":"2024-09-14T10:47:21.882763+0000","last_clean":"2024-09-14T10:47:21.882763+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:47:21.882763+0000","last_undegraded":"2024-09-14T10:47:21.882763+0000","last_fullsized":"2024-09-14T10:47:21.882763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:28.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.079244+0000","last_change":"2024-09-14T10:44:05.316373+0000","last_active":"2024-09-14T10:47:21.079244+0000","last_peered":"2024-09-14T10:47:21.079244+0000","last_clean":"2024-09-14T10:47:21.079244+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:47:21.079244+0000","last_undegraded":"2024-09-14T10:47:21.079244+0000","last_fullsized":"2024-09-14T10:47:21.079244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:20.065314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439696+0000","last_change":"2024-09-14T10:44:09.313053+0000","last_active":"2024-09-14T10:44:44.439696+0000","last_peered":"2024-09-14T10:44:44.439696+0000","last_clean":"2024-09-14T10:44:44.439696+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:44:44.439696+0000","last_undegraded":"2024-09-14T10:44:44.439696+0000","last_fullsized":"2024-09-14T10:44:44.439696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.375123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.016361+0000","last_change":"2024-09-14T10:44:11.359808+0000","last_active":"2024-09-14T10:47:53.016361+0000","last_peered":"2024-09-14T10:47:53.016361+0000","last_clean":"2024-09-14T10:47:53.016361+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:47:53.016361+0000","last_undegraded":"2024-09-14T10:47:53.016361+0000","last_fullsized":"2024-09-14T10:47:53.016361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:51.224366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445366+0000","last_change":"2024-09-14T10:44:13.371652+0000","last_active":"2024-09-14T10:44:44.445366+0000","last_peered":"2024-09-14T10:44:44.445366+0000","last_clean":"2024-09-14T10:44:44.445366+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:44:44.445366+0000","last_undegraded":"2024-09-14T10:44:44.445366+0000","last_fullsized":"2024-09-14T10:44:44.445366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450551+0000","last_change":"2024-09-14T10:44:15.379606+0000","last_active":"2024-09-14T10:44:44.450551+0000","last_peered":"2024-09-14T10:44:44.450551+0000","last_clean":"2024-09-14T10:44:44.450551+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:44:44.450551+0000","last_undegraded":"2024-09-14T10:44:44.450551+0000","last_fullsized":"2024-09-14T10:44:44.450551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:37.639739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.298696+0000","last_change":"2024-09-14T10:44:07.317281+0000","last_active":"2024-09-14T10:44:52.298696+0000","last_peered":"2024-09-14T10:44:52.298696+0000","last_clean":"2024-09-14T10:44:52.298696+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:44:52.298696+0000","last_undegraded":"2024-09-14T10:44:52.298696+0000","last_fullsized":"2024-09-14T10:44:52.298696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:19.569186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446007+0000","last_change":"2024-09-14T10:44:05.319971+0000","last_active":"2024-09-14T10:44:44.446007+0000","last_peered":"2024-09-14T10:44:44.446007+0000","last_clean":"2024-09-14T10:44:44.446007+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:44:44.446007+0000","last_undegraded":"2024-09-14T10:44:44.446007+0000","last_fullsized":"2024-09-14T10:44:44.446007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:30.432326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438372+0000","last_change":"2024-09-14T10:44:09.316331+0000","last_active":"2024-09-14T10:44:44.438372+0000","last_peered":"2024-09-14T10:44:44.438372+0000","last_clean":"2024-09-14T10:44:44.438372+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:44:44.438372+0000","last_undegraded":"2024-09-14T10:44:44.438372+0000","last_fullsized":"2024-09-14T10:44:44.438372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.133563+0000","last_change":"2024-09-14T10:44:11.330416+0000","last_active":"2024-09-14T10:47:53.133563+0000","last_peered":"2024-09-14T10:47:53.133563+0000","last_clean":"2024-09-14T10:47:53.133563+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:47:53.133563+0000","last_undegraded":"2024-09-14T10:47:53.133563+0000","last_fullsized":"2024-09-14T10:47:53.133563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:58.265390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443419+0000","last_change":"2024-09-14T10:44:13.364526+0000","last_active":"2024-09-14T10:44:44.443419+0000","last_peered":"2024-09-14T10:44:44.443419+0000","last_clean":"2024-09-14T10:44:44.443419+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:44:44.443419+0000","last_undegraded":"2024-09-14T10:44:44.443419+0000","last_fullsized":"2024-09-14T10:44:44.443419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:46.572662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.685006+0000","last_change":"2024-09-14T10:44:15.379535+0000","last_active":"2024-09-14T10:46:20.685006+0000","last_peered":"2024-09-14T10:46:20.685006+0000","last_clean":"2024-09-14T10:46:20.685006+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:46:20.685006+0000","last_undegraded":"2024-09-14T10:46:20.685006+0000","last_fullsized":"2024-09-14T10:46:20.685006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:20.408629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.380036+0000","last_change":"2024-09-14T10:44:07.306266+0000","last_active":"2024-09-14T10:47:21.380036+0000","last_peered":"2024-09-14T10:47:21.380036+0000","last_clean":"2024-09-14T10:47:21.380036+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:47:21.380036+0000","last_undegraded":"2024-09-14T10:47:21.380036+0000","last_fullsized":"2024-09-14T10:47:21.380036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:57.380845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454069+0000","last_change":"2024-09-14T10:44:05.324788+0000","last_active":"2024-09-14T10:44:44.454069+0000","last_peered":"2024-09-14T10:44:44.454069+0000","last_clean":"2024-09-14T10:44:44.454069+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:44:44.454069+0000","last_undegraded":"2024-09-14T10:44:44.454069+0000","last_fullsized":"2024-09-14T10:44:44.454069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:56.141828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"25'1","reported_seq":221,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.841801+0000","last_change":"2024-09-14T10:44:09.313857+0000","last_active":"2024-09-14T10:47:52.841801+0000","last_peered":"2024-09-14T10:47:52.841801+0000","last_clean":"2024-09-14T10:47:52.841801+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:47:52.841801+0000","last_undegraded":"2024-09-14T10:47:52.841801+0000","last_fullsized":"2024-09-14T10:47:52.841801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:53.790922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'12","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.442571+0000","last_change":"2024-09-14T10:44:11.365067+0000","last_active":"2024-09-14T10:46:14.442571+0000","last_peered":"2024-09-14T10:46:14.442571+0000","last_clean":"2024-09-14T10:46:14.442571+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:46:14.442571+0000","last_undegraded":"2024-09-14T10:46:14.442571+0000","last_fullsized":"2024-09-14T10:46:14.442571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:24.755831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":371,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.875309+0000","last_change":"2024-09-14T10:44:13.372845+0000","last_active":"2024-09-14T10:47:52.875309+0000","last_peered":"2024-09-14T10:47:52.875309+0000","last_clean":"2024-09-14T10:47:52.875309+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:47:52.875309+0000","last_undegraded":"2024-09-14T10:47:52.875309+0000","last_fullsized":"2024-09-14T10:47:52.875309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:44.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.813949+0000","last_change":"2024-09-14T10:44:15.388635+0000","last_active":"2024-09-14T10:47:21.813949+0000","last_peered":"2024-09-14T10:47:21.813949+0000","last_clean":"2024-09-14T10:47:21.813949+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:47:21.813949+0000","last_undegraded":"2024-09-14T10:47:21.813949+0000","last_fullsized":"2024-09-14T10:47:21.813949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:00.563368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.297384+0000","last_change":"2024-09-14T10:44:07.297715+0000","last_active":"2024-09-14T10:44:52.297384+0000","last_peered":"2024-09-14T10:44:52.297384+0000","last_clean":"2024-09-14T10:44:52.297384+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:44:52.297384+0000","last_undegraded":"2024-09-14T10:44:52.297384+0000","last_fullsized":"2024-09-14T10:44:52.297384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:13.693037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.857406+0000","last_change":"2024-09-14T10:44:05.320001+0000","last_active":"2024-09-14T10:45:35.857406+0000","last_peered":"2024-09-14T10:45:35.857406+0000","last_clean":"2024-09-14T10:45:35.857406+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:45:35.857406+0000","last_undegraded":"2024-09-14T10:45:35.857406+0000","last_fullsized":"2024-09-14T10:45:35.857406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:36.390217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'4","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.841020+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:47:52.841020+0000","last_peered":"2024-09-14T10:47:52.841020+0000","last_clean":"2024-09-14T10:47:52.841020+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:47:52.841020+0000","last_undegraded":"2024-09-14T10:47:52.841020+0000","last_fullsized":"2024-09-14T10:47:52.841020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:58.082949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.178369+0000","last_change":"2024-09-14T10:44:11.327509+0000","last_active":"2024-09-14T10:47:53.178369+0000","last_peered":"2024-09-14T10:47:53.178369+0000","last_clean":"2024-09-14T10:47:53.178369+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:47:53.178369+0000","last_undegraded":"2024-09-14T10:47:53.178369+0000","last_fullsized":"2024-09-14T10:47:53.178369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.860344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438767+0000","last_change":"2024-09-14T10:44:13.376040+0000","last_active":"2024-09-14T10:44:44.438767+0000","last_peered":"2024-09-14T10:44:44.438767+0000","last_clean":"2024-09-14T10:44:44.438767+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:44:44.438767+0000","last_undegraded":"2024-09-14T10:44:44.438767+0000","last_fullsized":"2024-09-14T10:44:44.438767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452541+0000","last_change":"2024-09-14T10:44:15.388404+0000","last_active":"2024-09-14T10:44:44.452541+0000","last_peered":"2024-09-14T10:44:44.452541+0000","last_clean":"2024-09-14T10:44:44.452541+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:44:44.452541+0000","last_undegraded":"2024-09-14T10:44:44.452541+0000","last_fullsized":"2024-09-14T10:44:44.452541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720287+0000","last_change":"2024-09-14T10:44:07.301782+0000","last_active":"2024-09-14T10:47:21.720287+0000","last_peered":"2024-09-14T10:47:21.720287+0000","last_clean":"2024-09-14T10:47:21.720287+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:47:21.720287+0000","last_undegraded":"2024-09-14T10:47:21.720287+0000","last_fullsized":"2024-09-14T10:47:21.720287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:43.671200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456552+0000","last_change":"2024-09-14T10:44:05.321255+0000","last_active":"2024-09-14T10:44:44.456552+0000","last_peered":"2024-09-14T10:44:44.456552+0000","last_clean":"2024-09-14T10:44:44.456552+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:44:44.456552+0000","last_undegraded":"2024-09-14T10:44:44.456552+0000","last_fullsized":"2024-09-14T10:44:44.456552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:08.383959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436064+0000","last_change":"2024-09-14T10:44:09.320830+0000","last_active":"2024-09-14T10:44:44.436064+0000","last_peered":"2024-09-14T10:44:44.436064+0000","last_clean":"2024-09-14T10:44:44.436064+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:44:44.436064+0000","last_undegraded":"2024-09-14T10:44:44.436064+0000","last_fullsized":"2024-09-14T10:44:44.436064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:33.277860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.191050+0000","last_change":"2024-09-14T10:44:11.325995+0000","last_active":"2024-09-14T10:47:53.191050+0000","last_peered":"2024-09-14T10:47:53.191050+0000","last_clean":"2024-09-14T10:47:53.191050+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:47:53.191050+0000","last_undegraded":"2024-09-14T10:47:53.191050+0000","last_fullsized":"2024-09-14T10:47:53.191050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:19.897508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441744+0000","last_change":"2024-09-14T10:44:13.369101+0000","last_active":"2024-09-14T10:44:44.441744+0000","last_peered":"2024-09-14T10:44:44.441744+0000","last_clean":"2024-09-14T10:44:44.441744+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:44:44.441744+0000","last_undegraded":"2024-09-14T10:44:44.441744+0000","last_fullsized":"2024-09-14T10:44:44.441744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:12.164053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457651+0000","last_change":"2024-09-14T10:44:15.386917+0000","last_active":"2024-09-14T10:44:44.457651+0000","last_peered":"2024-09-14T10:44:44.457651+0000","last_clean":"2024-09-14T10:44:44.457651+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:44:44.457651+0000","last_undegraded":"2024-09-14T10:44:44.457651+0000","last_fullsized":"2024-09-14T10:44:44.457651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:38.536486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600974+0000","last_change":"2024-09-14T10:44:44.464149+0000","last_active":"2024-09-14T10:45:35.600974+0000","last_peered":"2024-09-14T10:45:35.600974+0000","last_clean":"2024-09-14T10:45:35.600974+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:45:35.600974+0000","last_undegraded":"2024-09-14T10:45:35.600974+0000","last_fullsized":"2024-09-14T10:45:35.600974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:26.594110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.245635+0000","last_change":"2024-09-14T10:44:05.314583+0000","last_active":"2024-09-14T10:47:21.245635+0000","last_peered":"2024-09-14T10:47:21.245635+0000","last_clean":"2024-09-14T10:47:21.245635+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:21.245635+0000","last_undegraded":"2024-09-14T10:47:21.245635+0000","last_fullsized":"2024-09-14T10:47:21.245635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:24.166852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436523+0000","last_change":"2024-09-14T10:44:09.318111+0000","last_active":"2024-09-14T10:44:44.436523+0000","last_peered":"2024-09-14T10:44:44.436523+0000","last_clean":"2024-09-14T10:44:44.436523+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:44:44.436523+0000","last_undegraded":"2024-09-14T10:44:44.436523+0000","last_fullsized":"2024-09-14T10:44:44.436523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:12.821605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.114087+0000","last_change":"2024-09-14T10:44:11.356523+0000","last_active":"2024-09-14T10:47:53.114087+0000","last_peered":"2024-09-14T10:47:53.114087+0000","last_clean":"2024-09-14T10:47:53.114087+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:47:53.114087+0000","last_undegraded":"2024-09-14T10:47:53.114087+0000","last_fullsized":"2024-09-14T10:47:53.114087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:30.747229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451553+0000","last_change":"2024-09-14T10:44:13.367321+0000","last_active":"2024-09-14T10:44:44.451553+0000","last_peered":"2024-09-14T10:44:44.451553+0000","last_clean":"2024-09-14T10:44:44.451553+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:44:44.451553+0000","last_undegraded":"2024-09-14T10:44:44.451553+0000","last_fullsized":"2024-09-14T10:44:44.451553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:58.066611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.662711+0000","last_change":"2024-09-14T10:44:15.385986+0000","last_active":"2024-09-14T10:46:18.662711+0000","last_peered":"2024-09-14T10:46:18.662711+0000","last_clean":"2024-09-14T10:46:18.662711+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:46:18.662711+0000","last_undegraded":"2024-09-14T10:46:18.662711+0000","last_fullsized":"2024-09-14T10:46:18.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:58.059454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.522356+0000","last_change":"2024-09-14T10:44:07.295202+0000","last_active":"2024-09-14T10:46:16.522356+0000","last_peered":"2024-09-14T10:46:16.522356+0000","last_clean":"2024-09-14T10:46:16.522356+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:46:16.522356+0000","last_undegraded":"2024-09-14T10:46:16.522356+0000","last_fullsized":"2024-09-14T10:46:16.522356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:40.711930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451048+0000","last_change":"2024-09-14T10:44:05.323017+0000","last_active":"2024-09-14T10:44:44.451048+0000","last_peered":"2024-09-14T10:44:44.451048+0000","last_clean":"2024-09-14T10:44:44.451048+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:44:44.451048+0000","last_undegraded":"2024-09-14T10:44:44.451048+0000","last_fullsized":"2024-09-14T10:44:44.451048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:48.326362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.016574+0000","last_change":"2024-09-14T10:44:09.327924+0000","last_active":"2024-09-14T10:46:17.016574+0000","last_peered":"2024-09-14T10:46:17.016574+0000","last_clean":"2024-09-14T10:46:17.016574+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:46:17.016574+0000","last_undegraded":"2024-09-14T10:46:17.016574+0000","last_fullsized":"2024-09-14T10:46:17.016574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:38.718169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.137521+0000","last_change":"2024-09-14T10:44:11.357069+0000","last_active":"2024-09-14T10:47:53.137521+0000","last_peered":"2024-09-14T10:47:53.137521+0000","last_clean":"2024-09-14T10:47:53.137521+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:47:53.137521+0000","last_undegraded":"2024-09-14T10:47:53.137521+0000","last_fullsized":"2024-09-14T10:47:53.137521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439393+0000","last_change":"2024-09-14T10:44:13.373389+0000","last_active":"2024-09-14T10:44:44.439393+0000","last_peered":"2024-09-14T10:44:44.439393+0000","last_clean":"2024-09-14T10:44:44.439393+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:44:44.439393+0000","last_undegraded":"2024-09-14T10:44:44.439393+0000","last_fullsized":"2024-09-14T10:44:44.439393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:34.517874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.852899+0000","last_change":"2024-09-14T10:44:15.386649+0000","last_active":"2024-09-14T10:47:20.852899+0000","last_peered":"2024-09-14T10:47:20.852899+0000","last_clean":"2024-09-14T10:47:20.852899+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:47:20.852899+0000","last_undegraded":"2024-09-14T10:47:20.852899+0000","last_fullsized":"2024-09-14T10:47:20.852899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:48.236396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.826073+0000","last_change":"2024-09-14T10:44:07.319333+0000","last_active":"2024-09-14T10:47:21.826073+0000","last_peered":"2024-09-14T10:47:21.826073+0000","last_clean":"2024-09-14T10:47:21.826073+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:47:21.826073+0000","last_undegraded":"2024-09-14T10:47:21.826073+0000","last_fullsized":"2024-09-14T10:47:21.826073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:14.561201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.679774+0000","last_change":"2024-09-14T10:44:05.319396+0000","last_active":"2024-09-14T10:47:21.679774+0000","last_peered":"2024-09-14T10:47:21.679774+0000","last_clean":"2024-09-14T10:47:21.679774+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:47:21.679774+0000","last_undegraded":"2024-09-14T10:47:21.679774+0000","last_fullsized":"2024-09-14T10:47:21.679774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:14.729286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.601482+0000","last_change":"2024-09-14T10:44:07.305165+0000","last_active":"2024-09-14T10:45:35.601482+0000","last_peered":"2024-09-14T10:45:35.601482+0000","last_clean":"2024-09-14T10:45:35.601482+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:45:35.601482+0000","last_undegraded":"2024-09-14T10:45:35.601482+0000","last_fullsized":"2024-09-14T10:45:35.601482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.572269+0000","last_change":"2024-09-14T10:44:05.323992+0000","last_active":"2024-09-14T10:44:52.572269+0000","last_peered":"2024-09-14T10:44:52.572269+0000","last_clean":"2024-09-14T10:44:52.572269+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:44:52.572269+0000","last_undegraded":"2024-09-14T10:44:52.572269+0000","last_fullsized":"2024-09-14T10:44:52.572269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:52.517695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.377995+0000","last_change":"2024-09-14T10:44:07.300105+0000","last_active":"2024-09-14T10:47:21.377995+0000","last_peered":"2024-09-14T10:47:21.377995+0000","last_clean":"2024-09-14T10:47:21.377995+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:47:21.377995+0000","last_undegraded":"2024-09-14T10:47:21.377995+0000","last_fullsized":"2024-09-14T10:47:21.377995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:48.852285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452056+0000","last_change":"2024-09-14T10:44:05.327542+0000","last_active":"2024-09-14T10:44:44.452056+0000","last_peered":"2024-09-14T10:44:44.452056+0000","last_clean":"2024-09-14T10:44:44.452056+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:44:44.452056+0000","last_undegraded":"2024-09-14T10:44:44.452056+0000","last_fullsized":"2024-09-14T10:44:44.452056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:23.168081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441253+0000","last_change":"2024-09-14T10:44:07.306382+0000","last_active":"2024-09-14T10:44:44.441253+0000","last_peered":"2024-09-14T10:44:44.441253+0000","last_clean":"2024-09-14T10:44:44.441253+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:44:44.441253+0000","last_undegraded":"2024-09-14T10:44:44.441253+0000","last_fullsized":"2024-09-14T10:44:44.441253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:58.925922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.713765+0000","last_change":"2024-09-14T10:44:05.323524+0000","last_active":"2024-09-14T10:44:50.713765+0000","last_peered":"2024-09-14T10:44:50.713765+0000","last_clean":"2024-09-14T10:44:50.713765+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:44:50.713765+0000","last_undegraded":"2024-09-14T10:44:50.713765+0000","last_fullsized":"2024-09-14T10:44:50.713765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441282+0000","last_change":"2024-09-14T10:44:07.316775+0000","last_active":"2024-09-14T10:44:44.441282+0000","last_peered":"2024-09-14T10:44:44.441282+0000","last_clean":"2024-09-14T10:44:44.441282+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:44:44.441282+0000","last_undegraded":"2024-09-14T10:44:44.441282+0000","last_fullsized":"2024-09-14T10:44:44.441282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.078507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441499+0000","last_change":"2024-09-14T10:44:05.320107+0000","last_active":"2024-09-14T10:44:44.441499+0000","last_peered":"2024-09-14T10:44:44.441499+0000","last_clean":"2024-09-14T10:44:44.441499+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:44:44.441499+0000","last_undegraded":"2024-09-14T10:44:44.441499+0000","last_fullsized":"2024-09-14T10:44:44.441499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:08.181522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880716+0000","last_change":"2024-09-14T10:44:07.315346+0000","last_active":"2024-09-14T10:47:21.880716+0000","last_peered":"2024-09-14T10:47:21.880716+0000","last_clean":"2024-09-14T10:47:21.880716+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:47:21.880716+0000","last_undegraded":"2024-09-14T10:47:21.880716+0000","last_fullsized":"2024-09-14T10:47:21.880716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:34.364814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446125+0000","last_change":"2024-09-14T10:44:05.316250+0000","last_active":"2024-09-14T10:44:44.446125+0000","last_peered":"2024-09-14T10:44:44.446125+0000","last_clean":"2024-09-14T10:44:44.446125+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:44:44.446125+0000","last_undegraded":"2024-09-14T10:44:44.446125+0000","last_fullsized":"2024-09-14T10:44:44.446125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:41.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.873291+0000","last_change":"2024-09-14T10:44:07.302298+0000","last_active":"2024-09-14T10:45:35.873291+0000","last_peered":"2024-09-14T10:45:35.873291+0000","last_clean":"2024-09-14T10:45:35.873291+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:45:35.873291+0000","last_undegraded":"2024-09-14T10:45:35.873291+0000","last_fullsized":"2024-09-14T10:45:35.873291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:05.444889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439490+0000","last_change":"2024-09-14T10:44:05.321993+0000","last_active":"2024-09-14T10:44:44.439490+0000","last_peered":"2024-09-14T10:44:44.439490+0000","last_clean":"2024-09-14T10:44:44.439490+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:44:44.439490+0000","last_undegraded":"2024-09-14T10:44:44.439490+0000","last_fullsized":"2024-09-14T10:44:44.439490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:11.032280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.523024+0000","last_change":"2024-09-14T10:44:07.304072+0000","last_active":"2024-09-14T10:46:16.523024+0000","last_peered":"2024-09-14T10:46:16.523024+0000","last_clean":"2024-09-14T10:46:16.523024+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:46:16.523024+0000","last_undegraded":"2024-09-14T10:46:16.523024+0000","last_fullsized":"2024-09-14T10:46:16.523024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444660+0000","last_change":"2024-09-14T10:44:05.314790+0000","last_active":"2024-09-14T10:44:44.444660+0000","last_peered":"2024-09-14T10:44:44.444660+0000","last_clean":"2024-09-14T10:44:44.444660+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:44:44.444660+0000","last_undegraded":"2024-09-14T10:44:44.444660+0000","last_fullsized":"2024-09-14T10:44:44.444660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:08.523198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452649+0000","last_change":"2024-09-14T10:44:07.302967+0000","last_active":"2024-09-14T10:44:44.452649+0000","last_peered":"2024-09-14T10:44:44.452649+0000","last_clean":"2024-09-14T10:44:44.452649+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:44:44.452649+0000","last_undegraded":"2024-09-14T10:44:44.452649+0000","last_fullsized":"2024-09-14T10:44:44.452649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:58.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.707392+0000","last_change":"2024-09-14T10:44:05.326780+0000","last_active":"2024-09-14T10:44:50.707392+0000","last_peered":"2024-09-14T10:44:50.707392+0000","last_clean":"2024-09-14T10:44:50.707392+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:44:50.707392+0000","last_undegraded":"2024-09-14T10:44:50.707392+0000","last_fullsized":"2024-09-14T10:44:50.707392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:30.583609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.848468+0000","last_change":"2024-09-14T10:44:07.309384+0000","last_active":"2024-09-14T10:44:51.848468+0000","last_peered":"2024-09-14T10:44:51.848468+0000","last_clean":"2024-09-14T10:44:51.848468+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:44:51.848468+0000","last_undegraded":"2024-09-14T10:44:51.848468+0000","last_fullsized":"2024-09-14T10:44:51.848468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:20.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440181+0000","last_change":"2024-09-14T10:44:05.324016+0000","last_active":"2024-09-14T10:44:44.440181+0000","last_peered":"2024-09-14T10:44:44.440181+0000","last_clean":"2024-09-14T10:44:44.440181+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:44:44.440181+0000","last_undegraded":"2024-09-14T10:44:44.440181+0000","last_fullsized":"2024-09-14T10:44:44.440181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:28.063427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874270+0000","last_change":"2024-09-14T10:44:07.314041+0000","last_active":"2024-09-14T10:45:35.874270+0000","last_peered":"2024-09-14T10:45:35.874270+0000","last_clean":"2024-09-14T10:45:35.874270+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:45:35.874270+0000","last_undegraded":"2024-09-14T10:45:35.874270+0000","last_fullsized":"2024-09-14T10:45:35.874270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:27.185091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447387+0000","last_change":"2024-09-14T10:44:05.316396+0000","last_active":"2024-09-14T10:44:44.447387+0000","last_peered":"2024-09-14T10:44:44.447387+0000","last_clean":"2024-09-14T10:44:44.447387+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:44:44.447387+0000","last_undegraded":"2024-09-14T10:44:44.447387+0000","last_fullsized":"2024-09-14T10:44:44.447387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:31.844881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600757+0000","last_change":"2024-09-14T10:44:07.303238+0000","last_active":"2024-09-14T10:45:35.600757+0000","last_peered":"2024-09-14T10:45:35.600757+0000","last_clean":"2024-09-14T10:45:35.600757+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:45:35.600757+0000","last_undegraded":"2024-09-14T10:45:35.600757+0000","last_fullsized":"2024-09-14T10:45:35.600757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:49.401193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443767+0000","last_change":"2024-09-14T10:44:05.313950+0000","last_active":"2024-09-14T10:44:44.443767+0000","last_peered":"2024-09-14T10:44:44.443767+0000","last_clean":"2024-09-14T10:44:44.443767+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:44:44.443767+0000","last_undegraded":"2024-09-14T10:44:44.443767+0000","last_fullsized":"2024-09-14T10:44:44.443767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:12.127894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.375016+0000","last_change":"2024-09-14T10:44:07.319354+0000","last_active":"2024-09-14T10:47:21.375016+0000","last_peered":"2024-09-14T10:47:21.375016+0000","last_clean":"2024-09-14T10:47:21.375016+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:47:21.375016+0000","last_undegraded":"2024-09-14T10:47:21.375016+0000","last_fullsized":"2024-09-14T10:47:21.375016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:26.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453814+0000","last_change":"2024-09-14T10:44:05.318285+0000","last_active":"2024-09-14T10:44:44.453814+0000","last_peered":"2024-09-14T10:44:44.453814+0000","last_clean":"2024-09-14T10:44:44.453814+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:44:44.453814+0000","last_undegraded":"2024-09-14T10:44:44.453814+0000","last_fullsized":"2024-09-14T10:44:44.453814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:09.785074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.697003+0000","last_change":"2024-09-14T10:44:07.304891+0000","last_active":"2024-09-14T10:46:20.697003+0000","last_peered":"2024-09-14T10:46:20.697003+0000","last_clean":"2024-09-14T10:46:20.697003+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:46:20.697003+0000","last_undegraded":"2024-09-14T10:46:20.697003+0000","last_fullsized":"2024-09-14T10:46:20.697003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.594544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457554+0000","last_change":"2024-09-14T10:44:05.324335+0000","last_active":"2024-09-14T10:44:44.457554+0000","last_peered":"2024-09-14T10:44:44.457554+0000","last_clean":"2024-09-14T10:44:44.457554+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:44:44.457554+0000","last_undegraded":"2024-09-14T10:44:44.457554+0000","last_fullsized":"2024-09-14T10:44:44.457554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:36.457645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.521412+0000","last_change":"2024-09-14T10:44:07.309006+0000","last_active":"2024-09-14T10:47:21.521412+0000","last_peered":"2024-09-14T10:47:21.521412+0000","last_clean":"2024-09-14T10:47:21.521412+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:47:21.521412+0000","last_undegraded":"2024-09-14T10:47:21.521412+0000","last_fullsized":"2024-09-14T10:47:21.521412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'5","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.211900+0000","last_change":"2024-09-14T10:44:05.321869+0000","last_active":"2024-09-14T10:47:21.211900+0000","last_peered":"2024-09-14T10:47:21.211900+0000","last_clean":"2024-09-14T10:47:21.211900+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:47:21.211900+0000","last_undegraded":"2024-09-14T10:47:21.211900+0000","last_fullsized":"2024-09-14T10:47:21.211900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:52.091145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.537179+0000","last_change":"2024-09-14T10:44:07.303706+0000","last_active":"2024-09-14T10:47:21.537179+0000","last_peered":"2024-09-14T10:47:21.537179+0000","last_clean":"2024-09-14T10:47:21.537179+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:47:21.537179+0000","last_undegraded":"2024-09-14T10:47:21.537179+0000","last_fullsized":"2024-09-14T10:47:21.537179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:47.194815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460745+0000","last_change":"2024-09-14T10:44:05.318005+0000","last_active":"2024-09-14T10:44:44.460745+0000","last_peered":"2024-09-14T10:44:44.460745+0000","last_clean":"2024-09-14T10:44:44.460745+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:44:44.460745+0000","last_undegraded":"2024-09-14T10:44:44.460745+0000","last_fullsized":"2024-09-14T10:44:44.460745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:40.757947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.713111+0000","last_change":"2024-09-14T10:44:05.321634+0000","last_active":"2024-09-14T10:47:21.713111+0000","last_peered":"2024-09-14T10:47:21.713111+0000","last_clean":"2024-09-14T10:47:21.713111+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:47:21.713111+0000","last_undegraded":"2024-09-14T10:47:21.713111+0000","last_fullsized":"2024-09-14T10:47:21.713111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:01.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882780+0000","last_change":"2024-09-14T10:44:07.310127+0000","last_active":"2024-09-14T10:47:21.882780+0000","last_peered":"2024-09-14T10:47:21.882780+0000","last_clean":"2024-09-14T10:47:21.882780+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:47:21.882780+0000","last_undegraded":"2024-09-14T10:47:21.882780+0000","last_fullsized":"2024-09-14T10:47:21.882780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.606750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.713544+0000","last_change":"2024-09-14T10:44:05.325170+0000","last_active":"2024-09-14T10:44:50.713544+0000","last_peered":"2024-09-14T10:44:50.713544+0000","last_clean":"2024-09-14T10:44:50.713544+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:44:50.713544+0000","last_undegraded":"2024-09-14T10:44:50.713544+0000","last_fullsized":"2024-09-14T10:44:50.713544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:31.844881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.521493+0000","last_change":"2024-09-14T10:44:07.318886+0000","last_active":"2024-09-14T10:46:16.521493+0000","last_peered":"2024-09-14T10:46:16.521493+0000","last_clean":"2024-09-14T10:46:16.521493+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:46:16.521493+0000","last_undegraded":"2024-09-14T10:46:16.521493+0000","last_fullsized":"2024-09-14T10:46:16.521493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:08.926626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640310,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":740626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673012,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":479232,"data_stored":151940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36364,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335476,"statfs":{"total":96636764160,"available":96599527424,"internally_reserved":0,"allocated":1040384,"data_stored":742212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":152178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:47:57.952 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.952 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.952 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.952 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.952 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.952 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.952 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.953 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.954 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.955 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.956 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.957 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.958 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.959 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.960 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.961 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.962 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.963 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.963 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T10:43:49.418142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=43, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.963 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T10:43:54.435773+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=43, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.963 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.963 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.963 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.963 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.964 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.964 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.964 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T10:43:54.435773+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=43, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.964 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.964 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.964 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.964 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.964 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T10:43:54.435773+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=43, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T10:43:54.435773+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=43, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.965 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T10:43:54.435773+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=43, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.966 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T10:43:54.435773+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=43, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.967 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T10:43:54.435773+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=43, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.968 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.969 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.970 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.970 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.970 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.970 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.970 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.970 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.971 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.971 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.971 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.971 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.971 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.971 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.971 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.971 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.972 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.972 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.972 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.972 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.972 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.972 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.972 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.973 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.973 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.973 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.973 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.973 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.973 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.974 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.975 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.975 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.975 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.975 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.975 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.975 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.975 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.975 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.976 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.976 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.976 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.976 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.976 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.976 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.976 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.977 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.977 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.977 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.977 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.977 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.977 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.977 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.978 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.978 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.978 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.978 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.978 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.978 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.978 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.978 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.979 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.980 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.980 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.980 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.980 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.980 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.980 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.980 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.980 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.981 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.981 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.981 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.981 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.981 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.981 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.981 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.981 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.982 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.982 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.982 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.982 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.982 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.982 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.982 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.982 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.983 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.983 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:47:57.983 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:48:17.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:48:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.120+0000 7f93a924d640 1 Processor -- start 2024-09-14T10:48:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.120+0000 7f93a924d640 1 -- start start 2024-09-14T10:48:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.120+0000 7f93a924d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f93a412bfe0 0x7f93a412c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.120+0000 7f93a924d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a4099e20 con 0x7f93a4070c20 2024-09-14T10:48:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.124+0000 7f93a924d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f93a40705b0 con 0x7f93a412bfe0 2024-09-14T10:48:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.124+0000 7f939bfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f93a4070c20 0x7f93a40970a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48902/0 (socket says 172.21.15.70:48902) 2024-09-14T10:48:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.124+0000 7f939bfff640 1 -- 172.21.15.70:0/2065307525 learned_addr learned my addr 172.21.15.70:0/2065307525 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:48:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.124+0000 7f93a2d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f93a412bfe0 0x7f93a412c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.124+0000 7f93a259c640 1 -- 172.21.15.70:0/2065307525 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2030813290 0 0) 0x7f93a4099e20 con 0x7f93a4070c20 2024-09-14T10:48:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.124+0000 7f93a259c640 1 -- 172.21.15.70:0/2065307525 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9390003530 con 0x7f93a4070c20 2024-09-14T10:48:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.124+0000 7f93a2d9d640 1 -- 172.21.15.70:0/2065307525 >> v1:172.21.15.70:6789/0 conn(0x7f93a4070c20 legacy=0x7f93a40970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.124+0000 7f93a2d9d640 1 -- 172.21.15.70:0/2065307525 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a4071390 con 0x7f93a412bfe0 2024-09-14T10:48:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a2d9d640 1 --2- 172.21.15.70:0/2065307525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a412bfe0 0x7f93a412c3c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f938c009740 tx=0x7f938c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbeaeb1028348448 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a259c640 1 -- 172.21.15.70:0/2065307525 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f938c0b0070 con 0x7f93a412bfe0 2024-09-14T10:48:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a259c640 1 -- 172.21.15.70:0/2065307525 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0ab530 con 0x7f93a412bfe0 2024-09-14T10:48:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a259c640 1 -- 172.21.15.70:0/2065307525 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f938c0ab830 con 0x7f93a412bfe0 2024-09-14T10:48:18.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 -- 172.21.15.70:0/2065307525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a412bfe0 msgr2=0x7f93a412c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:18.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 --2- 172.21.15.70:0/2065307525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a412bfe0 0x7f93a412c3c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f938c009740 tx=0x7f938c01c370 comp rx=0 tx=0).stop 2024-09-14T10:48:18.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 -- 172.21.15.70:0/2065307525 shutdown_connections 2024-09-14T10:48:18.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 --2- 172.21.15.70:0/2065307525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a412bfe0 0x7f93a412c3c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:18.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 -- 172.21.15.70:0/2065307525 >> 172.21.15.70:0/2065307525 conn(0x7f93a409aba0 msgr2=0x7f93a40984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:48:18.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 -- 172.21.15.70:0/2065307525 shutdown_connections 2024-09-14T10:48:18.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 -- 172.21.15.70:0/2065307525 wait complete. 2024-09-14T10:48:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 Processor -- start 2024-09-14T10:48:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 -- start start 2024-09-14T10:48:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a4070c20 0x7f93a412fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a924d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4134900 con 0x7f93a4070c20 2024-09-14T10:48:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a4070c20 0x7f93a412fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a4070c20 0x7f93a412fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55652/0 (socket says 172.21.15.70:55652) 2024-09-14T10:48:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.128+0000 7f93a2d9d640 1 -- 172.21.15.70:0/2750877448 learned_addr learned my addr 172.21.15.70:0/2750877448 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:48:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f93a2d9d640 1 -- 172.21.15.70:0/2750877448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a41310b0 con 0x7f93a4070c20 2024-09-14T10:48:18.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f93a2d9d640 1 --2- 172.21.15.70:0/2750877448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a4070c20 0x7f93a412fa70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f938c0ae040 tx=0x7f938c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:18.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f939b7fe640 1 -- 172.21.15.70:0/2750877448 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f938c0b8020 con 0x7f93a4070c20 2024-09-14T10:48:18.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f939b7fe640 1 -- 172.21.15.70:0/2750877448 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0aa6d0 con 0x7f93a4070c20 2024-09-14T10:48:18.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f939b7fe640 1 -- 172.21.15.70:0/2750877448 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f938c0b0040 con 0x7f93a4070c20 2024-09-14T10:48:18.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a4074070 con 0x7f93a4070c20 2024-09-14T10:48:18.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a412ffb0 con 0x7f93a4070c20 2024-09-14T10:48:18.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a408c930 con 0x7f93a4070c20 2024-09-14T10:48:18.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f939b7fe640 1 -- 172.21.15.70:0/2750877448 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f938c0bb020 con 0x7f93a4070c20 2024-09-14T10:48:18.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f939b7fe640 1 --2- 172.21.15.70:0/2750877448 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f938403b8b0 0x7f938403dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:18.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f939b7fe640 1 -- 172.21.15.70:0/2750877448 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f938c0a4e00 con 0x7f93a4070c20 2024-09-14T10:48:18.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f939bfff640 1 --2- 172.21.15.70:0/2750877448 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f938403b8b0 0x7f938403dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:18.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.132+0000 7f939bfff640 1 --2- 172.21.15.70:0/2750877448 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f938403b8b0 0x7f938403dd70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9394007fd0 tx=0x7f9394007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.220+0000 7f939b7fe640 1 -- 172.21.15.70:0/2750877448 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f938c0c2030 con 0x7f93a4070c20 2024-09-14T10:48:18.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.388+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93a4130b50 con 0x7f938403b8b0 2024-09-14T10:48:18.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.416+0000 7f939b7fe640 1 -- 172.21.15.70:0/2750877448 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665450 (secure 0 0 0) 0x7f93a4130b50 con 0x7f938403b8b0 2024-09-14T10:48:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:48:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:48:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f938403b8b0 msgr2=0x7f938403dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 --2- 172.21.15.70:0/2750877448 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f938403b8b0 0x7f938403dd70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9394007fd0 tx=0x7f9394007900 comp rx=0 tx=0).stop 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a4070c20 msgr2=0x7f93a412fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 --2- 172.21.15.70:0/2750877448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a4070c20 0x7f93a412fa70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f938c0ae040 tx=0x7f938c019110 comp rx=0 tx=0).stop 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 shutdown_connections 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 --2- 172.21.15.70:0/2750877448 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f938403b8b0 0x7f938403dd70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 --2- 172.21.15.70:0/2750877448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93a4070c20 0x7f93a412fa70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 >> 172.21.15.70:0/2750877448 conn(0x7f93a409aba0 msgr2=0x7f93a409b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 shutdown_connections 2024-09-14T10:48:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:18.428+0000 7f93a924d640 1 -- 172.21.15.70:0/2750877448 wait complete. 2024-09-14T10:48:18.442 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-14T10:48:17.479164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5157,"num_read_kb":4699,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4571,"ondisk_log_size":4571,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148448,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338912,"statfs":{"total":386547056640,"available":386395045888,"internally_reserved":0,"allocated":2981888,"data_stored":1786956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007575"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.798951+0000","last_change":"2024-09-14T10:48:10.798810+0000","last_active":"2024-09-14T10:48:10.798951+0000","last_peered":"2024-09-14T10:48:10.798951+0000","last_clean":"2024-09-14T10:48:10.798951+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:48:10.798951+0000","last_undegraded":"2024-09-14T10:48:10.798951+0000","last_fullsized":"2024-09-14T10:48:10.798951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.798632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:20.160081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720305+0000","last_change":"2024-09-14T10:44:07.304568+0000","last_active":"2024-09-14T10:47:21.720305+0000","last_peered":"2024-09-14T10:47:21.720305+0000","last_clean":"2024-09-14T10:47:21.720305+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:47:21.720305+0000","last_undegraded":"2024-09-14T10:47:21.720305+0000","last_fullsized":"2024-09-14T10:47:21.720305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:11.798345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.492325+0000","last_change":"2024-09-14T10:48:10.492066+0000","last_active":"2024-09-14T10:48:10.492325+0000","last_peered":"2024-09-14T10:48:10.492325+0000","last_clean":"2024-09-14T10:48:10.492325+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:48:10.492325+0000","last_undegraded":"2024-09-14T10:48:10.492325+0000","last_fullsized":"2024-09-14T10:48:10.492325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.491821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:30.410764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720464+0000","last_change":"2024-09-14T10:44:07.311706+0000","last_active":"2024-09-14T10:47:21.720464+0000","last_peered":"2024-09-14T10:47:21.720464+0000","last_clean":"2024-09-14T10:47:21.720464+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:47:21.720464+0000","last_undegraded":"2024-09-14T10:47:21.720464+0000","last_fullsized":"2024-09-14T10:47:21.720464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:27.522929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:09.441289+0000","last_change":"2024-09-14T10:44:05.321748+0000","last_active":"2024-09-14T10:46:09.441289+0000","last_peered":"2024-09-14T10:46:09.441289+0000","last_clean":"2024-09-14T10:46:09.441289+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:46:09.441289+0000","last_undegraded":"2024-09-14T10:46:09.441289+0000","last_fullsized":"2024-09-14T10:46:09.441289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879810+0000","last_change":"2024-09-14T10:44:07.311756+0000","last_active":"2024-09-14T10:47:21.879810+0000","last_peered":"2024-09-14T10:47:21.879810+0000","last_clean":"2024-09-14T10:47:21.879810+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:47:21.879810+0000","last_undegraded":"2024-09-14T10:47:21.879810+0000","last_fullsized":"2024-09-14T10:47:21.879810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.801154+0000","last_change":"2024-09-14T10:48:13.801154+0000","last_active":"2024-09-14T10:48:13.801154+0000","last_peered":"2024-09-14T10:48:13.801154+0000","last_clean":"2024-09-14T10:48:13.801154+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:48:13.801154+0000","last_undegraded":"2024-09-14T10:48:13.801154+0000","last_fullsized":"2024-09-14T10:48:13.801154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.800954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:10.498468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600024+0000","last_change":"2024-09-14T10:44:07.312388+0000","last_active":"2024-09-14T10:45:35.600024+0000","last_peered":"2024-09-14T10:45:35.600024+0000","last_clean":"2024-09-14T10:45:35.600024+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:45:35.600024+0000","last_undegraded":"2024-09-14T10:45:35.600024+0000","last_fullsized":"2024-09-14T10:45:35.600024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:31.070464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454651+0000","last_change":"2024-09-14T10:44:05.329861+0000","last_active":"2024-09-14T10:44:44.454651+0000","last_peered":"2024-09-14T10:44:44.454651+0000","last_clean":"2024-09-14T10:44:44.454651+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:44:44.454651+0000","last_undegraded":"2024-09-14T10:44:44.454651+0000","last_fullsized":"2024-09-14T10:44:44.454651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:01.827439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.697129+0000","last_change":"2024-09-14T10:44:07.303712+0000","last_active":"2024-09-14T10:46:20.697129+0000","last_peered":"2024-09-14T10:46:20.697129+0000","last_clean":"2024-09-14T10:46:20.697129+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:46:20.697129+0000","last_undegraded":"2024-09-14T10:46:20.697129+0000","last_fullsized":"2024-09-14T10:46:20.697129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.752350+0000","last_change":"2024-09-14T10:48:09.752350+0000","last_active":"2024-09-14T10:48:09.752350+0000","last_peered":"2024-09-14T10:48:09.752350+0000","last_clean":"2024-09-14T10:48:09.752350+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:48:09.752350+0000","last_undegraded":"2024-09-14T10:48:09.752350+0000","last_fullsized":"2024-09-14T10:48:09.752350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.752173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:57.545208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.373297+0000","last_change":"2024-09-14T10:44:44.462329+0000","last_active":"2024-09-14T10:47:21.373297+0000","last_peered":"2024-09-14T10:47:21.373297+0000","last_clean":"2024-09-14T10:47:21.373297+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:47:21.373297+0000","last_undegraded":"2024-09-14T10:47:21.373297+0000","last_fullsized":"2024-09-14T10:47:21.373297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:05.537374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.449407+0000","last_change":"2024-09-14T10:44:05.319096+0000","last_active":"2024-09-14T10:44:44.449407+0000","last_peered":"2024-09-14T10:44:44.449407+0000","last_clean":"2024-09-14T10:44:44.449407+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:44:44.449407+0000","last_undegraded":"2024-09-14T10:44:44.449407+0000","last_fullsized":"2024-09-14T10:44:44.449407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:07.843074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879838+0000","last_change":"2024-09-14T10:44:07.301357+0000","last_active":"2024-09-14T10:47:21.879838+0000","last_peered":"2024-09-14T10:47:21.879838+0000","last_clean":"2024-09-14T10:47:21.879838+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:47:21.879838+0000","last_undegraded":"2024-09-14T10:47:21.879838+0000","last_fullsized":"2024-09-14T10:47:21.879838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:49.933862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.503799+0000","last_change":"2024-09-14T10:48:09.503799+0000","last_active":"2024-09-14T10:48:09.503799+0000","last_peered":"2024-09-14T10:48:09.503799+0000","last_clean":"2024-09-14T10:48:09.503799+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:48:09.503799+0000","last_undegraded":"2024-09-14T10:48:09.503799+0000","last_fullsized":"2024-09-14T10:48:09.503799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.503614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:43.187650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.986354+0000","last_change":"2024-09-14T10:44:07.315054+0000","last_active":"2024-09-14T10:47:21.986354+0000","last_peered":"2024-09-14T10:47:21.986354+0000","last_clean":"2024-09-14T10:47:21.986354+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:47:21.986354+0000","last_undegraded":"2024-09-14T10:47:21.986354+0000","last_fullsized":"2024-09-14T10:47:21.986354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:46.799488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872805+0000","last_change":"2024-09-14T10:44:07.313852+0000","last_active":"2024-09-14T10:45:35.872805+0000","last_peered":"2024-09-14T10:45:35.872805+0000","last_clean":"2024-09-14T10:45:35.872805+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:45:35.872805+0000","last_undegraded":"2024-09-14T10:45:35.872805+0000","last_fullsized":"2024-09-14T10:45:35.872805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:54.012187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.434015+0000","last_change":"2024-09-14T10:48:10.434015+0000","last_active":"2024-09-14T10:48:10.434015+0000","last_peered":"2024-09-14T10:48:10.434015+0000","last_clean":"2024-09-14T10:48:10.434015+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:48:10.434015+0000","last_undegraded":"2024-09-14T10:48:10.434015+0000","last_fullsized":"2024-09-14T10:48:10.434015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.433796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:25.542559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720065+0000","last_change":"2024-09-14T10:44:07.303444+0000","last_active":"2024-09-14T10:47:21.720065+0000","last_peered":"2024-09-14T10:47:21.720065+0000","last_clean":"2024-09-14T10:47:21.720065+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:47:21.720065+0000","last_undegraded":"2024-09-14T10:47:21.720065+0000","last_fullsized":"2024-09-14T10:47:21.720065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:42.771218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.731550+0000","last_change":"2024-09-14T10:48:08.731550+0000","last_active":"2024-09-14T10:48:08.731550+0000","last_peered":"2024-09-14T10:48:08.731550+0000","last_clean":"2024-09-14T10:48:08.731550+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:48:08.731550+0000","last_undegraded":"2024-09-14T10:48:08.731550+0000","last_fullsized":"2024-09-14T10:48:08.731550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.731374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:25.870502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880404+0000","last_change":"2024-09-14T10:44:07.302716+0000","last_active":"2024-09-14T10:47:21.880404+0000","last_peered":"2024-09-14T10:47:21.880404+0000","last_clean":"2024-09-14T10:47:21.880404+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:47:21.880404+0000","last_undegraded":"2024-09-14T10:47:21.880404+0000","last_fullsized":"2024-09-14T10:47:21.880404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:36.213106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.413034+0000","last_change":"2024-09-14T10:48:09.413034+0000","last_active":"2024-09-14T10:48:09.413034+0000","last_peered":"2024-09-14T10:48:09.413034+0000","last_clean":"2024-09-14T10:48:09.413034+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:48:09.413034+0000","last_undegraded":"2024-09-14T10:48:09.413034+0000","last_fullsized":"2024-09-14T10:48:09.413034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.412833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:35.318942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874276+0000","last_change":"2024-09-14T10:44:07.314159+0000","last_active":"2024-09-14T10:45:35.874276+0000","last_peered":"2024-09-14T10:45:35.874276+0000","last_clean":"2024-09-14T10:45:35.874276+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:45:35.874276+0000","last_undegraded":"2024-09-14T10:45:35.874276+0000","last_fullsized":"2024-09-14T10:45:35.874276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.345264+0000","last_change":"2024-09-14T10:48:07.345264+0000","last_active":"2024-09-14T10:48:07.345264+0000","last_peered":"2024-09-14T10:48:07.345264+0000","last_clean":"2024-09-14T10:48:07.345264+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:48:07.345264+0000","last_undegraded":"2024-09-14T10:48:07.345264+0000","last_fullsized":"2024-09-14T10:48:07.345264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.345074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.041740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879927+0000","last_change":"2024-09-14T10:44:07.313819+0000","last_active":"2024-09-14T10:47:21.879927+0000","last_peered":"2024-09-14T10:47:21.879927+0000","last_clean":"2024-09-14T10:47:21.879927+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:47:21.879927+0000","last_undegraded":"2024-09-14T10:47:21.879927+0000","last_fullsized":"2024-09-14T10:47:21.879927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:15.226631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.537992+0000","last_change":"2024-09-14T10:48:11.537992+0000","last_active":"2024-09-14T10:48:11.537992+0000","last_peered":"2024-09-14T10:48:11.537992+0000","last_clean":"2024-09-14T10:48:11.537992+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:48:11.537992+0000","last_undegraded":"2024-09-14T10:48:11.537992+0000","last_fullsized":"2024-09-14T10:48:11.537992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.537799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:49.788688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825511+0000","last_change":"2024-09-14T10:44:07.303481+0000","last_active":"2024-09-14T10:47:21.825511+0000","last_peered":"2024-09-14T10:47:21.825511+0000","last_clean":"2024-09-14T10:47:21.825511+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:47:21.825511+0000","last_undegraded":"2024-09-14T10:47:21.825511+0000","last_fullsized":"2024-09-14T10:47:21.825511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.685013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452678+0000","last_change":"2024-09-14T10:44:05.312131+0000","last_active":"2024-09-14T10:44:44.452678+0000","last_peered":"2024-09-14T10:44:44.452678+0000","last_clean":"2024-09-14T10:44:44.452678+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:44:44.452678+0000","last_undegraded":"2024-09-14T10:44:44.452678+0000","last_fullsized":"2024-09-14T10:44:44.452678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:20.004027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891282+0000","last_change":"2024-09-14T10:44:15.384222+0000","last_active":"2024-09-14T10:47:21.891282+0000","last_peered":"2024-09-14T10:47:21.891282+0000","last_clean":"2024-09-14T10:47:21.891282+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:47:21.891282+0000","last_undegraded":"2024-09-14T10:47:21.891282+0000","last_fullsized":"2024-09-14T10:47:21.891282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:52.493514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825066+0000","last_change":"2024-09-14T10:44:07.300223+0000","last_active":"2024-09-14T10:47:21.825066+0000","last_peered":"2024-09-14T10:47:21.825066+0000","last_clean":"2024-09-14T10:47:21.825066+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:47:21.825066+0000","last_undegraded":"2024-09-14T10:47:21.825066+0000","last_fullsized":"2024-09-14T10:47:21.825066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:41.299865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.016248+0000","last_change":"2024-09-14T10:48:11.016248+0000","last_active":"2024-09-14T10:48:11.016248+0000","last_peered":"2024-09-14T10:48:11.016248+0000","last_clean":"2024-09-14T10:48:11.016248+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:48:11.016248+0000","last_undegraded":"2024-09-14T10:48:11.016248+0000","last_fullsized":"2024-09-14T10:48:11.016248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.016029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.143146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456793+0000","last_change":"2024-09-14T10:44:09.339751+0000","last_active":"2024-09-14T10:44:44.456793+0000","last_peered":"2024-09-14T10:44:44.456793+0000","last_clean":"2024-09-14T10:44:44.456793+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:44:44.456793+0000","last_undegraded":"2024-09-14T10:44:44.456793+0000","last_fullsized":"2024-09-14T10:44:44.456793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:31.250869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.068511+0000","last_change":"2024-09-14T10:44:11.366230+0000","last_active":"2024-09-14T10:47:53.068511+0000","last_peered":"2024-09-14T10:47:53.068511+0000","last_clean":"2024-09-14T10:47:53.068511+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:47:53.068511+0000","last_undegraded":"2024-09-14T10:47:53.068511+0000","last_fullsized":"2024-09-14T10:47:53.068511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446129+0000","last_change":"2024-09-14T10:44:13.370430+0000","last_active":"2024-09-14T10:44:44.446129+0000","last_peered":"2024-09-14T10:44:44.446129+0000","last_clean":"2024-09-14T10:44:44.446129+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:44:44.446129+0000","last_undegraded":"2024-09-14T10:44:44.446129+0000","last_fullsized":"2024-09-14T10:44:44.446129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.607941+0000","last_change":"2024-09-14T10:44:15.377551+0000","last_active":"2024-09-14T10:45:35.607941+0000","last_peered":"2024-09-14T10:45:35.607941+0000","last_clean":"2024-09-14T10:45:35.607941+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:45:35.607941+0000","last_undegraded":"2024-09-14T10:45:35.607941+0000","last_fullsized":"2024-09-14T10:45:35.607941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:02.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.739203+0000","last_change":"2024-09-14T10:44:07.309285+0000","last_active":"2024-09-14T10:47:21.739203+0000","last_peered":"2024-09-14T10:47:21.739203+0000","last_clean":"2024-09-14T10:47:21.739203+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:47:21.739203+0000","last_undegraded":"2024-09-14T10:47:21.739203+0000","last_fullsized":"2024-09-14T10:47:21.739203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:49.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.605793+0000","last_change":"2024-09-14T10:48:01.605793+0000","last_active":"2024-09-14T10:48:01.605793+0000","last_peered":"2024-09-14T10:48:01.605793+0000","last_clean":"2024-09-14T10:48:01.605793+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:48:01.605793+0000","last_undegraded":"2024-09-14T10:48:01.605793+0000","last_fullsized":"2024-09-14T10:48:01.605793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.605543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:33.748359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440248+0000","last_change":"2024-09-14T10:44:09.318715+0000","last_active":"2024-09-14T10:44:44.440248+0000","last_peered":"2024-09-14T10:44:44.440248+0000","last_clean":"2024-09-14T10:44:44.440248+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:44:44.440248+0000","last_undegraded":"2024-09-14T10:44:44.440248+0000","last_fullsized":"2024-09-14T10:44:44.440248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:56.922877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444934+0000","last_change":"2024-09-14T10:44:11.327271+0000","last_active":"2024-09-14T10:44:44.444934+0000","last_peered":"2024-09-14T10:44:44.444934+0000","last_clean":"2024-09-14T10:44:44.444934+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:44:44.444934+0000","last_undegraded":"2024-09-14T10:44:44.444934+0000","last_fullsized":"2024-09-14T10:44:44.444934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.449635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444347+0000","last_change":"2024-09-14T10:44:13.360104+0000","last_active":"2024-09-14T10:44:44.444347+0000","last_peered":"2024-09-14T10:44:44.444347+0000","last_clean":"2024-09-14T10:44:44.444347+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:44:44.444347+0000","last_undegraded":"2024-09-14T10:44:44.444347+0000","last_fullsized":"2024-09-14T10:44:44.444347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438541+0000","last_change":"2024-09-14T10:44:15.385641+0000","last_active":"2024-09-14T10:44:44.438541+0000","last_peered":"2024-09-14T10:44:44.438541+0000","last_clean":"2024-09-14T10:44:44.438541+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:44:44.438541+0000","last_undegraded":"2024-09-14T10:44:44.438541+0000","last_fullsized":"2024-09-14T10:44:44.438541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.602221+0000","last_change":"2024-09-14T10:44:07.312266+0000","last_active":"2024-09-14T10:44:52.602221+0000","last_peered":"2024-09-14T10:44:52.602221+0000","last_clean":"2024-09-14T10:44:52.602221+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:44:52.602221+0000","last_undegraded":"2024-09-14T10:44:52.602221+0000","last_fullsized":"2024-09-14T10:44:52.602221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:05.421337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.984385+0000","last_change":"2024-09-14T10:48:09.984385+0000","last_active":"2024-09-14T10:48:09.984385+0000","last_peered":"2024-09-14T10:48:09.984385+0000","last_clean":"2024-09-14T10:48:09.984385+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:48:09.984385+0000","last_undegraded":"2024-09-14T10:48:09.984385+0000","last_fullsized":"2024-09-14T10:48:09.984385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.984177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:13.140019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447321+0000","last_change":"2024-09-14T10:44:09.326103+0000","last_active":"2024-09-14T10:44:44.447321+0000","last_peered":"2024-09-14T10:44:44.447321+0000","last_clean":"2024-09-14T10:44:44.447321+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:44:44.447321+0000","last_undegraded":"2024-09-14T10:44:44.447321+0000","last_fullsized":"2024-09-14T10:44:44.447321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.304599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.437130+0000","last_change":"2024-09-14T10:44:11.355262+0000","last_active":"2024-09-14T10:44:44.437130+0000","last_peered":"2024-09-14T10:44:44.437130+0000","last_clean":"2024-09-14T10:44:44.437130+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:44:44.437130+0000","last_undegraded":"2024-09-14T10:44:44.437130+0000","last_fullsized":"2024-09-14T10:44:44.437130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:55.694768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.880932+0000","last_change":"2024-09-14T10:44:13.370887+0000","last_active":"2024-09-14T10:47:52.880932+0000","last_peered":"2024-09-14T10:47:52.880932+0000","last_clean":"2024-09-14T10:47:52.880932+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:47:52.880932+0000","last_undegraded":"2024-09-14T10:47:52.880932+0000","last_fullsized":"2024-09-14T10:47:52.880932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433906+0000","last_change":"2024-09-14T10:44:15.393155+0000","last_active":"2024-09-14T10:44:44.433906+0000","last_peered":"2024-09-14T10:44:44.433906+0000","last_clean":"2024-09-14T10:44:44.433906+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:44:44.433906+0000","last_undegraded":"2024-09-14T10:44:44.433906+0000","last_fullsized":"2024-09-14T10:44:44.433906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:01.351429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.635473+0000","last_change":"2024-09-14T10:48:15.635473+0000","last_active":"2024-09-14T10:48:15.635473+0000","last_peered":"2024-09-14T10:48:15.635473+0000","last_clean":"2024-09-14T10:48:15.635473+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:48:15.635473+0000","last_undegraded":"2024-09-14T10:48:15.635473+0000","last_fullsized":"2024-09-14T10:48:15.635473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.635292+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:37.356846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.255546+0000","last_change":"2024-09-14T10:47:59.255546+0000","last_active":"2024-09-14T10:47:59.255546+0000","last_peered":"2024-09-14T10:47:59.255546+0000","last_clean":"2024-09-14T10:47:59.255546+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:47:59.255546+0000","last_undegraded":"2024-09-14T10:47:59.255546+0000","last_fullsized":"2024-09-14T10:47:59.255546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.255367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.490294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455297+0000","last_change":"2024-09-14T10:44:09.341355+0000","last_active":"2024-09-14T10:44:44.455297+0000","last_peered":"2024-09-14T10:44:44.455297+0000","last_clean":"2024-09-14T10:44:44.455297+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:44:44.455297+0000","last_undegraded":"2024-09-14T10:44:44.455297+0000","last_fullsized":"2024-09-14T10:44:44.455297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:06.338264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.034915+0000","last_change":"2024-09-14T10:44:11.349869+0000","last_active":"2024-09-14T10:47:53.034915+0000","last_peered":"2024-09-14T10:47:53.034915+0000","last_clean":"2024-09-14T10:47:53.034915+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:47:53.034915+0000","last_undegraded":"2024-09-14T10:47:53.034915+0000","last_fullsized":"2024-09-14T10:47:53.034915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.892718+0000","last_change":"2024-09-14T10:44:13.359625+0000","last_active":"2024-09-14T10:47:52.892718+0000","last_peered":"2024-09-14T10:47:52.892718+0000","last_clean":"2024-09-14T10:47:52.892718+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:47:52.892718+0000","last_undegraded":"2024-09-14T10:47:52.892718+0000","last_fullsized":"2024-09-14T10:47:52.892718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.828035+0000","last_change":"2024-09-14T10:44:07.313431+0000","last_active":"2024-09-14T10:47:21.828035+0000","last_peered":"2024-09-14T10:47:21.828035+0000","last_clean":"2024-09-14T10:47:21.828035+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:47:21.828035+0000","last_undegraded":"2024-09-14T10:47:21.828035+0000","last_fullsized":"2024-09-14T10:47:21.828035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:28.832046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.552213+0000","last_change":"2024-09-14T10:48:03.552213+0000","last_active":"2024-09-14T10:48:03.552213+0000","last_peered":"2024-09-14T10:48:03.552213+0000","last_clean":"2024-09-14T10:48:03.552213+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:48:03.552213+0000","last_undegraded":"2024-09-14T10:48:03.552213+0000","last_fullsized":"2024-09-14T10:48:03.552213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.551983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.648129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.447310+0000","last_change":"2024-09-14T10:44:09.321893+0000","last_active":"2024-09-14T10:44:44.447310+0000","last_peered":"2024-09-14T10:44:44.447310+0000","last_clean":"2024-09-14T10:44:44.447310+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:44:44.447310+0000","last_undegraded":"2024-09-14T10:44:44.447310+0000","last_fullsized":"2024-09-14T10:44:44.447310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:04.728659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'43","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.093942+0000","last_change":"2024-09-14T10:44:11.342017+0000","last_active":"2024-09-14T10:47:53.093942+0000","last_peered":"2024-09-14T10:47:53.093942+0000","last_clean":"2024-09-14T10:47:53.093942+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:47:53.093942+0000","last_undegraded":"2024-09-14T10:47:53.093942+0000","last_fullsized":"2024-09-14T10:47:53.093942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:22.056805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441567+0000","last_change":"2024-09-14T10:44:13.359612+0000","last_active":"2024-09-14T10:44:44.441567+0000","last_peered":"2024-09-14T10:44:44.441567+0000","last_clean":"2024-09-14T10:44:44.441567+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:44:44.441567+0000","last_undegraded":"2024-09-14T10:44:44.441567+0000","last_fullsized":"2024-09-14T10:44:44.441567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:40.424615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.610998+0000","last_change":"2024-09-14T10:44:15.384957+0000","last_active":"2024-09-14T10:45:35.610998+0000","last_peered":"2024-09-14T10:45:35.610998+0000","last_clean":"2024-09-14T10:45:35.610998+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:45:35.610998+0000","last_undegraded":"2024-09-14T10:45:35.610998+0000","last_fullsized":"2024-09-14T10:45:35.610998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.508508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'11","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.822961+0000","last_change":"2024-09-14T10:44:07.297475+0000","last_active":"2024-09-14T10:47:21.822961+0000","last_peered":"2024-09-14T10:47:21.822961+0000","last_clean":"2024-09-14T10:47:21.822961+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:47:21.822961+0000","last_undegraded":"2024-09-14T10:47:21.822961+0000","last_fullsized":"2024-09-14T10:47:21.822961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:38.470916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.618709+0000","last_change":"2024-09-14T10:47:59.618709+0000","last_active":"2024-09-14T10:47:59.618709+0000","last_peered":"2024-09-14T10:47:59.618709+0000","last_clean":"2024-09-14T10:47:59.618709+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:59.618709+0000","last_undegraded":"2024-09-14T10:47:59.618709+0000","last_fullsized":"2024-09-14T10:47:59.618709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.618492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:36.397328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439715+0000","last_change":"2024-09-14T10:44:09.315832+0000","last_active":"2024-09-14T10:44:44.439715+0000","last_peered":"2024-09-14T10:44:44.439715+0000","last_clean":"2024-09-14T10:44:44.439715+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:44:44.439715+0000","last_undegraded":"2024-09-14T10:44:44.439715+0000","last_fullsized":"2024-09-14T10:44:44.439715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:23.486222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.974322+0000","last_change":"2024-09-14T10:44:11.361862+0000","last_active":"2024-09-14T10:47:52.974322+0000","last_peered":"2024-09-14T10:47:52.974322+0000","last_clean":"2024-09-14T10:47:52.974322+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:47:52.974322+0000","last_undegraded":"2024-09-14T10:47:52.974322+0000","last_fullsized":"2024-09-14T10:47:52.974322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:38.109362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441326+0000","last_change":"2024-09-14T10:44:13.371521+0000","last_active":"2024-09-14T10:44:44.441326+0000","last_peered":"2024-09-14T10:44:44.441326+0000","last_clean":"2024-09-14T10:44:44.441326+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:44:44.441326+0000","last_undegraded":"2024-09-14T10:44:44.441326+0000","last_fullsized":"2024-09-14T10:44:44.441326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:22.520305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:29.960732+0000","last_change":"2024-09-14T10:44:15.387133+0000","last_active":"2024-09-14T10:45:29.960732+0000","last_peered":"2024-09-14T10:45:29.960732+0000","last_clean":"2024-09-14T10:45:29.960732+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:45:29.960732+0000","last_undegraded":"2024-09-14T10:45:29.960732+0000","last_fullsized":"2024-09-14T10:45:29.960732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.831150+0000","last_change":"2024-09-14T10:48:12.831150+0000","last_active":"2024-09-14T10:48:12.831150+0000","last_peered":"2024-09-14T10:48:12.831150+0000","last_clean":"2024-09-14T10:48:12.831150+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:48:12.831150+0000","last_undegraded":"2024-09-14T10:48:12.831150+0000","last_fullsized":"2024-09-14T10:48:12.831150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.830946+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:42.495812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.990298+0000","last_change":"2024-09-14T10:48:08.990298+0000","last_active":"2024-09-14T10:48:08.990298+0000","last_peered":"2024-09-14T10:48:08.990298+0000","last_clean":"2024-09-14T10:48:08.990298+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:48:08.990298+0000","last_undegraded":"2024-09-14T10:48:08.990298+0000","last_fullsized":"2024-09-14T10:48:08.990298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.990075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:54.174799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440400+0000","last_change":"2024-09-14T10:44:09.327528+0000","last_active":"2024-09-14T10:44:44.440400+0000","last_peered":"2024-09-14T10:44:44.440400+0000","last_clean":"2024-09-14T10:44:44.440400+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:44:44.440400+0000","last_undegraded":"2024-09-14T10:44:44.440400+0000","last_fullsized":"2024-09-14T10:44:44.440400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:16.948139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'41","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.107576+0000","last_change":"2024-09-14T10:44:11.356327+0000","last_active":"2024-09-14T10:47:53.107576+0000","last_peered":"2024-09-14T10:47:53.107576+0000","last_clean":"2024-09-14T10:47:53.107576+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:47:53.107576+0000","last_undegraded":"2024-09-14T10:47:53.107576+0000","last_fullsized":"2024-09-14T10:47:53.107576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:55.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":380,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.894970+0000","last_change":"2024-09-14T10:44:13.372565+0000","last_active":"2024-09-14T10:47:52.894970+0000","last_peered":"2024-09-14T10:47:52.894970+0000","last_clean":"2024-09-14T10:47:52.894970+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:47:52.894970+0000","last_undegraded":"2024-09-14T10:47:52.894970+0000","last_fullsized":"2024-09-14T10:47:52.894970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443179+0000","last_change":"2024-09-14T10:44:15.386780+0000","last_active":"2024-09-14T10:44:44.443179+0000","last_peered":"2024-09-14T10:44:44.443179+0000","last_clean":"2024-09-14T10:44:44.443179+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:44:44.443179+0000","last_undegraded":"2024-09-14T10:44:44.443179+0000","last_fullsized":"2024-09-14T10:44:44.443179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:51.818783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.781725+0000","last_change":"2024-09-14T10:48:14.781725+0000","last_active":"2024-09-14T10:48:14.781725+0000","last_peered":"2024-09-14T10:48:14.781725+0000","last_clean":"2024-09-14T10:48:14.781725+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:48:14.781725+0000","last_undegraded":"2024-09-14T10:48:14.781725+0000","last_fullsized":"2024-09-14T10:48:14.781725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.781515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:43.801565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.031832+0000","last_change":"2024-09-14T10:48:08.031832+0000","last_active":"2024-09-14T10:48:08.031832+0000","last_peered":"2024-09-14T10:48:08.031832+0000","last_clean":"2024-09-14T10:48:08.031832+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:48:08.031832+0000","last_undegraded":"2024-09-14T10:48:08.031832+0000","last_fullsized":"2024-09-14T10:48:08.031832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.031656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:31.479586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439156+0000","last_change":"2024-09-14T10:44:09.325802+0000","last_active":"2024-09-14T10:44:44.439156+0000","last_peered":"2024-09-14T10:44:44.439156+0000","last_clean":"2024-09-14T10:44:44.439156+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:44:44.439156+0000","last_undegraded":"2024-09-14T10:44:44.439156+0000","last_fullsized":"2024-09-14T10:44:44.439156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:35.589836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'61","reported_seq":126,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.120517+0000","last_change":"2024-09-14T10:44:11.356796+0000","last_active":"2024-09-14T10:47:53.120517+0000","last_peered":"2024-09-14T10:47:53.120517+0000","last_clean":"2024-09-14T10:47:53.120517+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:47:53.120517+0000","last_undegraded":"2024-09-14T10:47:53.120517+0000","last_fullsized":"2024-09-14T10:47:53.120517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:34.815043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439158+0000","last_change":"2024-09-14T10:44:13.361258+0000","last_active":"2024-09-14T10:44:44.439158+0000","last_peered":"2024-09-14T10:44:44.439158+0000","last_clean":"2024-09-14T10:44:44.439158+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:44:44.439158+0000","last_undegraded":"2024-09-14T10:44:44.439158+0000","last_fullsized":"2024-09-14T10:44:44.439158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:15.973997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.050143+0000","last_change":"2024-09-14T10:44:15.362513+0000","last_active":"2024-09-14T10:47:22.050143+0000","last_peered":"2024-09-14T10:47:22.050143+0000","last_clean":"2024-09-14T10:47:22.050143+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:47:22.050143+0000","last_undegraded":"2024-09-14T10:47:22.050143+0000","last_fullsized":"2024-09-14T10:47:22.050143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.897617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.499703+0000","last_change":"2024-09-14T10:48:13.499703+0000","last_active":"2024-09-14T10:48:13.499703+0000","last_peered":"2024-09-14T10:48:13.499703+0000","last_clean":"2024-09-14T10:48:13.499703+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:48:13.499703+0000","last_undegraded":"2024-09-14T10:48:13.499703+0000","last_fullsized":"2024-09-14T10:48:13.499703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.499518+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:35.604108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.460875+0000","last_change":"2024-09-14T10:48:02.460875+0000","last_active":"2024-09-14T10:48:02.460875+0000","last_peered":"2024-09-14T10:48:02.460875+0000","last_clean":"2024-09-14T10:48:02.460875+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:48:02.460875+0000","last_undegraded":"2024-09-14T10:48:02.460875+0000","last_fullsized":"2024-09-14T10:48:02.460875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.460647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:07.647413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438276+0000","last_change":"2024-09-14T10:44:09.321636+0000","last_active":"2024-09-14T10:44:44.438276+0000","last_peered":"2024-09-14T10:44:44.438276+0000","last_clean":"2024-09-14T10:44:44.438276+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:44:44.438276+0000","last_undegraded":"2024-09-14T10:44:44.438276+0000","last_fullsized":"2024-09-14T10:44:44.438276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:18.793271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.995447+0000","last_change":"2024-09-14T10:44:11.337843+0000","last_active":"2024-09-14T10:47:52.995447+0000","last_peered":"2024-09-14T10:47:52.995447+0000","last_clean":"2024-09-14T10:47:52.995447+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:47:52.995447+0000","last_undegraded":"2024-09-14T10:47:52.995447+0000","last_fullsized":"2024-09-14T10:47:52.995447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:07.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460124+0000","last_change":"2024-09-14T10:44:13.368817+0000","last_active":"2024-09-14T10:44:44.460124+0000","last_peered":"2024-09-14T10:44:44.460124+0000","last_clean":"2024-09-14T10:44:44.460124+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:44:44.460124+0000","last_undegraded":"2024-09-14T10:44:44.460124+0000","last_fullsized":"2024-09-14T10:44:44.460124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:51.609983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.995889+0000","last_change":"2024-09-14T10:44:15.388555+0000","last_active":"2024-09-14T10:47:21.995889+0000","last_peered":"2024-09-14T10:47:21.995889+0000","last_clean":"2024-09-14T10:47:21.995889+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:47:21.995889+0000","last_undegraded":"2024-09-14T10:47:21.995889+0000","last_fullsized":"2024-09-14T10:47:21.995889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720978+0000","last_change":"2024-09-14T10:44:07.313823+0000","last_active":"2024-09-14T10:47:21.720978+0000","last_peered":"2024-09-14T10:47:21.720978+0000","last_clean":"2024-09-14T10:47:21.720978+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:47:21.720978+0000","last_undegraded":"2024-09-14T10:47:21.720978+0000","last_fullsized":"2024-09-14T10:47:21.720978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:40.529838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.078927+0000","last_change":"2024-09-14T10:48:07.078927+0000","last_active":"2024-09-14T10:48:07.078927+0000","last_peered":"2024-09-14T10:48:07.078927+0000","last_clean":"2024-09-14T10:48:07.078927+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:48:07.078927+0000","last_undegraded":"2024-09-14T10:48:07.078927+0000","last_fullsized":"2024-09-14T10:48:07.078927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.078726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.976365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440536+0000","last_change":"2024-09-14T10:44:09.325353+0000","last_active":"2024-09-14T10:44:44.440536+0000","last_peered":"2024-09-14T10:44:44.440536+0000","last_clean":"2024-09-14T10:44:44.440536+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:44:44.440536+0000","last_undegraded":"2024-09-14T10:44:44.440536+0000","last_fullsized":"2024-09-14T10:44:44.440536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:24.409253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.171546+0000","last_change":"2024-09-14T10:44:11.324938+0000","last_active":"2024-09-14T10:47:53.171546+0000","last_peered":"2024-09-14T10:47:53.171546+0000","last_clean":"2024-09-14T10:47:53.171546+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:47:53.171546+0000","last_undegraded":"2024-09-14T10:47:53.171546+0000","last_fullsized":"2024-09-14T10:47:53.171546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:38.232131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.881845+0000","last_change":"2024-09-14T10:44:13.364819+0000","last_active":"2024-09-14T10:47:52.881845+0000","last_peered":"2024-09-14T10:47:52.881845+0000","last_clean":"2024-09-14T10:47:52.881845+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:47:52.881845+0000","last_undegraded":"2024-09-14T10:47:52.881845+0000","last_fullsized":"2024-09-14T10:47:52.881845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:29.703105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:22.442035+0000","last_change":"2024-09-14T10:44:15.389692+0000","last_active":"2024-09-14T10:46:22.442035+0000","last_peered":"2024-09-14T10:46:22.442035+0000","last_clean":"2024-09-14T10:46:22.442035+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:46:22.442035+0000","last_undegraded":"2024-09-14T10:46:22.442035+0000","last_fullsized":"2024-09-14T10:46:22.442035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:45.978470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699712+0000","last_change":"2024-09-14T10:44:07.315452+0000","last_active":"2024-09-14T10:46:20.699712+0000","last_peered":"2024-09-14T10:46:20.699712+0000","last_clean":"2024-09-14T10:46:20.699712+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:46:20.699712+0000","last_undegraded":"2024-09-14T10:46:20.699712+0000","last_fullsized":"2024-09-14T10:46:20.699712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.769639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.033536+0000","last_change":"2024-09-14T10:48:05.033536+0000","last_active":"2024-09-14T10:48:05.033536+0000","last_peered":"2024-09-14T10:48:05.033536+0000","last_clean":"2024-09-14T10:48:05.033536+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:48:05.033536+0000","last_undegraded":"2024-09-14T10:48:05.033536+0000","last_fullsized":"2024-09-14T10:48:05.033536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.033307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:22.683683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.854315+0000","last_change":"2024-09-14T10:44:09.321263+0000","last_active":"2024-09-14T10:47:52.854315+0000","last_peered":"2024-09-14T10:47:52.854315+0000","last_clean":"2024-09-14T10:47:52.854315+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:47:52.854315+0000","last_undegraded":"2024-09-14T10:47:52.854315+0000","last_fullsized":"2024-09-14T10:47:52.854315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:48.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455520+0000","last_change":"2024-09-14T10:44:11.365421+0000","last_active":"2024-09-14T10:44:44.455520+0000","last_peered":"2024-09-14T10:44:44.455520+0000","last_clean":"2024-09-14T10:44:44.455520+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:44:44.455520+0000","last_undegraded":"2024-09-14T10:44:44.455520+0000","last_fullsized":"2024-09-14T10:44:44.455520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:56.792327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":504,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.884680+0000","last_change":"2024-09-14T10:44:13.362574+0000","last_active":"2024-09-14T10:47:52.884680+0000","last_peered":"2024-09-14T10:47:52.884680+0000","last_clean":"2024-09-14T10:47:52.884680+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:47:52.884680+0000","last_undegraded":"2024-09-14T10:47:52.884680+0000","last_fullsized":"2024-09-14T10:47:52.884680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.234975+0000","last_change":"2024-09-14T10:44:15.376191+0000","last_active":"2024-09-14T10:46:20.234975+0000","last_peered":"2024-09-14T10:46:20.234975+0000","last_clean":"2024-09-14T10:46:20.234975+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:46:20.234975+0000","last_undegraded":"2024-09-14T10:46:20.234975+0000","last_fullsized":"2024-09-14T10:46:20.234975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:57.673158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880744+0000","last_change":"2024-09-14T10:44:07.321079+0000","last_active":"2024-09-14T10:47:21.880744+0000","last_peered":"2024-09-14T10:47:21.880744+0000","last_clean":"2024-09-14T10:47:21.880744+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:47:21.880744+0000","last_undegraded":"2024-09-14T10:47:21.880744+0000","last_fullsized":"2024-09-14T10:47:21.880744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:01.445738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.058107+0000","last_change":"2024-09-14T10:48:02.058107+0000","last_active":"2024-09-14T10:48:02.058107+0000","last_peered":"2024-09-14T10:48:02.058107+0000","last_clean":"2024-09-14T10:48:02.058107+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:48:02.058107+0000","last_undegraded":"2024-09-14T10:48:02.058107+0000","last_fullsized":"2024-09-14T10:48:02.058107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.057931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:29.184273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457361+0000","last_change":"2024-09-14T10:44:09.342479+0000","last_active":"2024-09-14T10:44:44.457361+0000","last_peered":"2024-09-14T10:44:44.457361+0000","last_clean":"2024-09-14T10:44:44.457361+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:44:44.457361+0000","last_undegraded":"2024-09-14T10:44:44.457361+0000","last_fullsized":"2024-09-14T10:44:44.457361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:27.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'41","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.074359+0000","last_change":"2024-09-14T10:44:11.332997+0000","last_active":"2024-09-14T10:47:53.074359+0000","last_peered":"2024-09-14T10:47:53.074359+0000","last_clean":"2024-09-14T10:47:53.074359+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:47:53.074359+0000","last_undegraded":"2024-09-14T10:47:53.074359+0000","last_fullsized":"2024-09-14T10:47:53.074359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:53.814557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436642+0000","last_change":"2024-09-14T10:44:13.374235+0000","last_active":"2024-09-14T10:44:44.436642+0000","last_peered":"2024-09-14T10:44:44.436642+0000","last_clean":"2024-09-14T10:44:44.436642+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:44:44.436642+0000","last_undegraded":"2024-09-14T10:44:44.436642+0000","last_fullsized":"2024-09-14T10:44:44.436642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:45.457582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.953427+0000","last_change":"2024-09-14T10:44:15.378896+0000","last_active":"2024-09-14T10:47:21.953427+0000","last_peered":"2024-09-14T10:47:21.953427+0000","last_clean":"2024-09-14T10:47:21.953427+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:47:21.953427+0000","last_undegraded":"2024-09-14T10:47:21.953427+0000","last_fullsized":"2024-09-14T10:47:21.953427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:41.435534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'13","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.402163+0000","last_change":"2024-09-14T10:44:07.313348+0000","last_active":"2024-09-14T10:47:21.402163+0000","last_peered":"2024-09-14T10:47:21.402163+0000","last_clean":"2024-09-14T10:47:21.402163+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:47:21.402163+0000","last_undegraded":"2024-09-14T10:47:21.402163+0000","last_fullsized":"2024-09-14T10:47:21.402163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:03.002533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.245843+0000","last_change":"2024-09-14T10:47:57.245843+0000","last_active":"2024-09-14T10:47:57.245843+0000","last_peered":"2024-09-14T10:47:57.245843+0000","last_clean":"2024-09-14T10:47:57.245843+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:47:57.245843+0000","last_undegraded":"2024-09-14T10:47:57.245843+0000","last_fullsized":"2024-09-14T10:47:57.245843+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.245648+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:34.787201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.098357+0000","last_change":"2024-09-14T10:48:00.098121+0000","last_active":"2024-09-14T10:48:00.098357+0000","last_peered":"2024-09-14T10:48:00.098357+0000","last_clean":"2024-09-14T10:48:00.098357+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:48:00.098357+0000","last_undegraded":"2024-09-14T10:48:00.098357+0000","last_fullsized":"2024-09-14T10:48:00.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.097899+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:08.489566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.044417+0000","last_change":"2024-09-14T10:48:03.044221+0000","last_active":"2024-09-14T10:48:03.044417+0000","last_peered":"2024-09-14T10:48:03.044417+0000","last_clean":"2024-09-14T10:48:03.044417+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:48:03.044417+0000","last_undegraded":"2024-09-14T10:48:03.044417+0000","last_fullsized":"2024-09-14T10:48:03.044417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.044031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.988834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.467078+0000","last_change":"2024-09-14T10:44:44.463751+0000","last_active":"2024-09-14T10:44:44.467078+0000","last_peered":"2024-09-14T10:44:44.467078+0000","last_clean":"2024-09-14T10:44:44.467078+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:44:44.467078+0000","last_undegraded":"2024-09-14T10:44:44.467078+0000","last_fullsized":"2024-09-14T10:44:44.467078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.700138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'86","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.153812+0000","last_change":"2024-09-14T10:44:11.357369+0000","last_active":"2024-09-14T10:47:53.153812+0000","last_peered":"2024-09-14T10:47:53.153812+0000","last_clean":"2024-09-14T10:47:53.153812+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:47:53.153812+0000","last_undegraded":"2024-09-14T10:47:53.153812+0000","last_fullsized":"2024-09-14T10:47:53.153812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:20.733108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.443564+0000","last_change":"2024-09-14T10:44:13.372619+0000","last_active":"2024-09-14T10:44:44.443564+0000","last_peered":"2024-09-14T10:44:44.443564+0000","last_clean":"2024-09-14T10:44:44.443564+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:44:44.443564+0000","last_undegraded":"2024-09-14T10:44:44.443564+0000","last_fullsized":"2024-09-14T10:44:44.443564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:00.209093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.907510+0000","last_change":"2024-09-14T10:44:15.380614+0000","last_active":"2024-09-14T10:47:21.907510+0000","last_peered":"2024-09-14T10:47:21.907510+0000","last_clean":"2024-09-14T10:47:21.907510+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:47:21.907510+0000","last_undegraded":"2024-09-14T10:47:21.907510+0000","last_fullsized":"2024-09-14T10:47:21.907510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:58.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825057+0000","last_change":"2024-09-14T10:44:07.316776+0000","last_active":"2024-09-14T10:47:21.825057+0000","last_peered":"2024-09-14T10:47:21.825057+0000","last_clean":"2024-09-14T10:47:21.825057+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:47:21.825057+0000","last_undegraded":"2024-09-14T10:47:21.825057+0000","last_fullsized":"2024-09-14T10:47:21.825057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:48.514426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.110721+0000","last_change":"2024-09-14T10:47:59.110585+0000","last_active":"2024-09-14T10:47:59.110721+0000","last_peered":"2024-09-14T10:47:59.110721+0000","last_clean":"2024-09-14T10:47:59.110721+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:47:59.110721+0000","last_undegraded":"2024-09-14T10:47:59.110721+0000","last_fullsized":"2024-09-14T10:47:59.110721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.110378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.838325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.456447+0000","last_change":"2024-09-14T10:48:00.456288+0000","last_active":"2024-09-14T10:48:00.456447+0000","last_peered":"2024-09-14T10:48:00.456447+0000","last_clean":"2024-09-14T10:48:00.456447+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:48:00.456447+0000","last_undegraded":"2024-09-14T10:48:00.456447+0000","last_fullsized":"2024-09-14T10:48:00.456447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.456099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:16.850631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460368+0000","last_change":"2024-09-14T10:44:09.341477+0000","last_active":"2024-09-14T10:44:44.460368+0000","last_peered":"2024-09-14T10:44:44.460368+0000","last_clean":"2024-09-14T10:44:44.460368+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:44:44.460368+0000","last_undegraded":"2024-09-14T10:44:44.460368+0000","last_fullsized":"2024-09-14T10:44:44.460368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:45.465045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'284","reported_seq":502,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.082629+0000","last_change":"2024-09-14T10:44:11.347623+0000","last_active":"2024-09-14T10:47:53.082629+0000","last_peered":"2024-09-14T10:47:53.082629+0000","last_clean":"2024-09-14T10:47:53.082629+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:47:53.082629+0000","last_undegraded":"2024-09-14T10:47:53.082629+0000","last_fullsized":"2024-09-14T10:47:53.082629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:58.040485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.454445+0000","last_change":"2024-09-14T10:44:13.368580+0000","last_active":"2024-09-14T10:44:44.454445+0000","last_peered":"2024-09-14T10:44:44.454445+0000","last_clean":"2024-09-14T10:44:44.454445+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:44:44.454445+0000","last_undegraded":"2024-09-14T10:44:44.454445+0000","last_fullsized":"2024-09-14T10:44:44.454445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:45.985218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.604538+0000","last_change":"2024-09-14T10:44:15.392131+0000","last_active":"2024-09-14T10:45:35.604538+0000","last_peered":"2024-09-14T10:45:35.604538+0000","last_clean":"2024-09-14T10:45:35.604538+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:45:35.604538+0000","last_undegraded":"2024-09-14T10:45:35.604538+0000","last_fullsized":"2024-09-14T10:45:35.604538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:37.610953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.567549+0000","last_change":"2024-09-14T10:48:12.567549+0000","last_active":"2024-09-14T10:48:12.567549+0000","last_peered":"2024-09-14T10:48:12.567549+0000","last_clean":"2024-09-14T10:48:12.567549+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:48:12.567549+0000","last_undegraded":"2024-09-14T10:48:12.567549+0000","last_fullsized":"2024-09-14T10:48:12.567549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.567361+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:57.983269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.581742+0000","last_change":"2024-09-14T10:47:58.581615+0000","last_active":"2024-09-14T10:47:58.581742+0000","last_peered":"2024-09-14T10:47:58.581742+0000","last_clean":"2024-09-14T10:47:58.581742+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:47:58.581742+0000","last_undegraded":"2024-09-14T10:47:58.581742+0000","last_fullsized":"2024-09-14T10:47:58.581742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.581432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:45.392307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.414030+0000","last_change":"2024-09-14T10:48:01.413761+0000","last_active":"2024-09-14T10:48:01.414030+0000","last_peered":"2024-09-14T10:48:01.414030+0000","last_clean":"2024-09-14T10:48:01.414030+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:48:01.414030+0000","last_undegraded":"2024-09-14T10:48:01.414030+0000","last_fullsized":"2024-09-14T10:48:01.414030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.413492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.502183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438356+0000","last_change":"2024-09-14T10:44:09.316504+0000","last_active":"2024-09-14T10:44:44.438356+0000","last_peered":"2024-09-14T10:44:44.438356+0000","last_clean":"2024-09-14T10:44:44.438356+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:44:44.438356+0000","last_undegraded":"2024-09-14T10:44:44.438356+0000","last_fullsized":"2024-09-14T10:44:44.438356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.594212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'17","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:19.566236+0000","last_change":"2024-09-14T10:44:11.340123+0000","last_active":"2024-09-14T10:47:19.566236+0000","last_peered":"2024-09-14T10:47:19.566236+0000","last_clean":"2024-09-14T10:47:19.566236+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:47:19.566236+0000","last_undegraded":"2024-09-14T10:47:19.566236+0000","last_fullsized":"2024-09-14T10:47:19.566236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:55.570468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440972+0000","last_change":"2024-09-14T10:44:13.372401+0000","last_active":"2024-09-14T10:44:44.440972+0000","last_peered":"2024-09-14T10:44:44.440972+0000","last_clean":"2024-09-14T10:44:44.440972+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:44:44.440972+0000","last_undegraded":"2024-09-14T10:44:44.440972+0000","last_fullsized":"2024-09-14T10:44:44.440972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:48.551523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451974+0000","last_change":"2024-09-14T10:44:15.379368+0000","last_active":"2024-09-14T10:44:44.451974+0000","last_peered":"2024-09-14T10:44:44.451974+0000","last_clean":"2024-09-14T10:44:44.451974+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:44:44.451974+0000","last_undegraded":"2024-09-14T10:44:44.451974+0000","last_fullsized":"2024-09-14T10:44:44.451974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:11.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.613733+0000","last_change":"2024-09-14T10:48:13.613570+0000","last_active":"2024-09-14T10:48:13.613733+0000","last_peered":"2024-09-14T10:48:13.613733+0000","last_clean":"2024-09-14T10:48:13.613733+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:48:13.613733+0000","last_undegraded":"2024-09-14T10:48:13.613733+0000","last_fullsized":"2024-09-14T10:48:13.613733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.613391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:50.163937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.149492+0000","last_change":"2024-09-14T10:47:58.149312+0000","last_active":"2024-09-14T10:47:58.149492+0000","last_peered":"2024-09-14T10:47:58.149492+0000","last_clean":"2024-09-14T10:47:58.149492+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:47:58.149492+0000","last_undegraded":"2024-09-14T10:47:58.149492+0000","last_fullsized":"2024-09-14T10:47:58.149492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.149127+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:37.977768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.572653+0000","last_change":"2024-09-14T10:48:00.572497+0000","last_active":"2024-09-14T10:48:00.572653+0000","last_peered":"2024-09-14T10:48:00.572653+0000","last_clean":"2024-09-14T10:48:00.572653+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:48:00.572653+0000","last_undegraded":"2024-09-14T10:48:00.572653+0000","last_fullsized":"2024-09-14T10:48:00.572653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.572309+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:24.566081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444568+0000","last_change":"2024-09-14T10:44:09.322206+0000","last_active":"2024-09-14T10:44:44.444568+0000","last_peered":"2024-09-14T10:44:44.444568+0000","last_clean":"2024-09-14T10:44:44.444568+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:44:44.444568+0000","last_undegraded":"2024-09-14T10:44:44.444568+0000","last_fullsized":"2024-09-14T10:44:44.444568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:42.879923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.719618+0000","last_change":"2024-09-14T10:44:11.362466+0000","last_active":"2024-09-14T10:47:20.719618+0000","last_peered":"2024-09-14T10:47:20.719618+0000","last_clean":"2024-09-14T10:47:20.719618+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:47:20.719618+0000","last_undegraded":"2024-09-14T10:47:20.719618+0000","last_fullsized":"2024-09-14T10:47:20.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:33.095069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460591+0000","last_change":"2024-09-14T10:44:13.368952+0000","last_active":"2024-09-14T10:44:44.460591+0000","last_peered":"2024-09-14T10:44:44.460591+0000","last_clean":"2024-09-14T10:44:44.460591+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:44:44.460591+0000","last_undegraded":"2024-09-14T10:44:44.460591+0000","last_fullsized":"2024-09-14T10:44:44.460591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.525259+0000","last_change":"2024-09-14T10:44:15.382665+0000","last_active":"2024-09-14T10:47:21.525259+0000","last_peered":"2024-09-14T10:47:21.525259+0000","last_clean":"2024-09-14T10:47:21.525259+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:47:21.525259+0000","last_undegraded":"2024-09-14T10:47:21.525259+0000","last_fullsized":"2024-09-14T10:47:21.525259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:18.617151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.468705+0000","last_change":"2024-09-14T10:48:11.468705+0000","last_active":"2024-09-14T10:48:11.468705+0000","last_peered":"2024-09-14T10:48:11.468705+0000","last_clean":"2024-09-14T10:48:11.468705+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:48:11.468705+0000","last_undegraded":"2024-09-14T10:48:11.468705+0000","last_fullsized":"2024-09-14T10:48:11.468705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.468533+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:45.152569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.623568+0000","last_change":"2024-09-14T10:47:57.623416+0000","last_active":"2024-09-14T10:47:57.623568+0000","last_peered":"2024-09-14T10:47:57.623568+0000","last_clean":"2024-09-14T10:47:57.623568+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:47:57.623568+0000","last_undegraded":"2024-09-14T10:47:57.623568+0000","last_fullsized":"2024-09-14T10:47:57.623568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.623229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:32.565978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.487932+0000","last_change":"2024-09-14T10:47:57.487828+0000","last_active":"2024-09-14T10:47:57.487932+0000","last_peered":"2024-09-14T10:47:57.487932+0000","last_clean":"2024-09-14T10:47:57.487932+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:47:57.487932+0000","last_undegraded":"2024-09-14T10:47:57.487932+0000","last_fullsized":"2024-09-14T10:47:57.487932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.487712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:43.722639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.086419+0000","last_change":"2024-09-14T10:44:44.455451+0000","last_active":"2024-09-14T10:47:22.086419+0000","last_peered":"2024-09-14T10:47:22.086419+0000","last_clean":"2024-09-14T10:47:22.086419+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:47:22.086419+0000","last_undegraded":"2024-09-14T10:47:22.086419+0000","last_fullsized":"2024-09-14T10:47:22.086419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:57.298667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'68","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.170008+0000","last_change":"2024-09-14T10:44:11.326152+0000","last_active":"2024-09-14T10:47:53.170008+0000","last_peered":"2024-09-14T10:47:53.170008+0000","last_clean":"2024-09-14T10:47:53.170008+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:47:53.170008+0000","last_undegraded":"2024-09-14T10:47:53.170008+0000","last_fullsized":"2024-09-14T10:47:53.170008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432731+0000","last_change":"2024-09-14T10:44:13.362954+0000","last_active":"2024-09-14T10:44:44.432731+0000","last_peered":"2024-09-14T10:44:44.432731+0000","last_clean":"2024-09-14T10:44:44.432731+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:44:44.432731+0000","last_undegraded":"2024-09-14T10:44:44.432731+0000","last_fullsized":"2024-09-14T10:44:44.432731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.191871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.551637+0000","last_change":"2024-09-14T10:44:15.380020+0000","last_active":"2024-09-14T10:46:20.551637+0000","last_peered":"2024-09-14T10:46:20.551637+0000","last_clean":"2024-09-14T10:46:20.551637+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:46:20.551637+0000","last_undegraded":"2024-09-14T10:46:20.551637+0000","last_fullsized":"2024-09-14T10:46:20.551637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:17.206749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.481545+0000","last_change":"2024-09-14T10:48:12.481545+0000","last_active":"2024-09-14T10:48:12.481545+0000","last_peered":"2024-09-14T10:48:12.481545+0000","last_clean":"2024-09-14T10:48:12.481545+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:48:12.481545+0000","last_undegraded":"2024-09-14T10:48:12.481545+0000","last_fullsized":"2024-09-14T10:48:12.481545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.481368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.388398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.477560+0000","last_change":"2024-09-14T10:47:58.477358+0000","last_active":"2024-09-14T10:47:58.477560+0000","last_peered":"2024-09-14T10:47:58.477560+0000","last_clean":"2024-09-14T10:47:58.477560+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:58.477560+0000","last_undegraded":"2024-09-14T10:47:58.477560+0000","last_fullsized":"2024-09-14T10:47:58.477560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.477145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.383210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.998360+0000","last_change":"2024-09-14T10:48:03.998223+0000","last_active":"2024-09-14T10:48:03.998360+0000","last_peered":"2024-09-14T10:48:03.998360+0000","last_clean":"2024-09-14T10:48:03.998360+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:48:03.998360+0000","last_undegraded":"2024-09-14T10:48:03.998360+0000","last_fullsized":"2024-09-14T10:48:03.998360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.998046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.536432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450895+0000","last_change":"2024-09-14T10:44:09.332697+0000","last_active":"2024-09-14T10:44:44.450895+0000","last_peered":"2024-09-14T10:44:44.450895+0000","last_clean":"2024-09-14T10:44:44.450895+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:44:44.450895+0000","last_undegraded":"2024-09-14T10:44:44.450895+0000","last_fullsized":"2024-09-14T10:44:44.450895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:36.395523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451768+0000","last_change":"2024-09-14T10:44:11.338828+0000","last_active":"2024-09-14T10:44:44.451768+0000","last_peered":"2024-09-14T10:44:44.451768+0000","last_clean":"2024-09-14T10:44:44.451768+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:44:44.451768+0000","last_undegraded":"2024-09-14T10:44:44.451768+0000","last_fullsized":"2024-09-14T10:44:44.451768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:03.825369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.199526+0000","last_change":"2024-09-14T10:44:13.353577+0000","last_active":"2024-09-14T10:47:53.199526+0000","last_peered":"2024-09-14T10:47:53.199526+0000","last_clean":"2024-09-14T10:47:53.199526+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:47:53.199526+0000","last_undegraded":"2024-09-14T10:47:53.199526+0000","last_fullsized":"2024-09-14T10:47:53.199526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.459796+0000","last_change":"2024-09-14T10:44:15.371433+0000","last_active":"2024-09-14T10:44:44.459796+0000","last_peered":"2024-09-14T10:44:44.459796+0000","last_clean":"2024-09-14T10:44:44.459796+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:44:44.459796+0000","last_undegraded":"2024-09-14T10:44:44.459796+0000","last_fullsized":"2024-09-14T10:44:44.459796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:12.672256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.739156+0000","last_change":"2024-09-14T10:44:07.313506+0000","last_active":"2024-09-14T10:47:21.739156+0000","last_peered":"2024-09-14T10:47:21.739156+0000","last_clean":"2024-09-14T10:47:21.739156+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:47:21.739156+0000","last_undegraded":"2024-09-14T10:47:21.739156+0000","last_fullsized":"2024-09-14T10:47:21.739156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.041282+0000","last_change":"2024-09-14T10:48:06.041282+0000","last_active":"2024-09-14T10:48:06.041282+0000","last_peered":"2024-09-14T10:48:06.041282+0000","last_clean":"2024-09-14T10:48:06.041282+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:48:06.041282+0000","last_undegraded":"2024-09-14T10:48:06.041282+0000","last_fullsized":"2024-09-14T10:48:06.041282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.041120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:55.979958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:56.524180+0000","last_change":"2024-09-14T10:47:56.524057+0000","last_active":"2024-09-14T10:47:56.524180+0000","last_peered":"2024-09-14T10:47:56.524180+0000","last_clean":"2024-09-14T10:47:56.524180+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:47:56.524180+0000","last_undegraded":"2024-09-14T10:47:56.524180+0000","last_fullsized":"2024-09-14T10:47:56.524180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_clean_scrub_stamp":"2024-09-14T10:47:56.523860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:01.837471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442798+0000","last_change":"2024-09-14T10:44:09.334472+0000","last_active":"2024-09-14T10:44:44.442798+0000","last_peered":"2024-09-14T10:44:44.442798+0000","last_clean":"2024-09-14T10:44:44.442798+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:44:44.442798+0000","last_undegraded":"2024-09-14T10:44:44.442798+0000","last_fullsized":"2024-09-14T10:44:44.442798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:18.491213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453618+0000","last_change":"2024-09-14T10:44:11.360311+0000","last_active":"2024-09-14T10:44:44.453618+0000","last_peered":"2024-09-14T10:44:44.453618+0000","last_clean":"2024-09-14T10:44:44.453618+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:44:44.453618+0000","last_undegraded":"2024-09-14T10:44:44.453618+0000","last_fullsized":"2024-09-14T10:44:44.453618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:18.907361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":422,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.890503+0000","last_change":"2024-09-14T10:44:13.349515+0000","last_active":"2024-09-14T10:47:52.890503+0000","last_peered":"2024-09-14T10:47:52.890503+0000","last_clean":"2024-09-14T10:47:52.890503+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:47:52.890503+0000","last_undegraded":"2024-09-14T10:47:52.890503+0000","last_fullsized":"2024-09-14T10:47:52.890503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.867987+0000","last_change":"2024-09-14T10:44:15.380474+0000","last_active":"2024-09-14T10:45:35.867987+0000","last_peered":"2024-09-14T10:45:35.867987+0000","last_clean":"2024-09-14T10:45:35.867987+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:45:35.867987+0000","last_undegraded":"2024-09-14T10:45:35.867987+0000","last_fullsized":"2024-09-14T10:45:35.867987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:15.535271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.839361+0000","last_change":"2024-09-14T10:48:11.839361+0000","last_active":"2024-09-14T10:48:11.839361+0000","last_peered":"2024-09-14T10:48:11.839361+0000","last_clean":"2024-09-14T10:48:11.839361+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:48:11.839361+0000","last_undegraded":"2024-09-14T10:48:11.839361+0000","last_fullsized":"2024-09-14T10:48:11.839361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.839181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:55.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.217454+0000","last_change":"2024-09-14T10:47:58.217454+0000","last_active":"2024-09-14T10:47:58.217454+0000","last_peered":"2024-09-14T10:47:58.217454+0000","last_clean":"2024-09-14T10:47:58.217454+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:47:58.217454+0000","last_undegraded":"2024-09-14T10:47:58.217454+0000","last_fullsized":"2024-09-14T10:47:58.217454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.217266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:03.530877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.067081+0000","last_change":"2024-09-14T10:48:01.067081+0000","last_active":"2024-09-14T10:48:01.067081+0000","last_peered":"2024-09-14T10:48:01.067081+0000","last_clean":"2024-09-14T10:48:01.067081+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:48:01.067081+0000","last_undegraded":"2024-09-14T10:48:01.067081+0000","last_fullsized":"2024-09-14T10:48:01.067081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.066905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:15.602397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:09.440990+0000","last_change":"2024-09-14T10:44:09.335319+0000","last_active":"2024-09-14T10:46:09.440990+0000","last_peered":"2024-09-14T10:46:09.440990+0000","last_clean":"2024-09-14T10:46:09.440990+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:46:09.440990+0000","last_undegraded":"2024-09-14T10:46:09.440990+0000","last_fullsized":"2024-09-14T10:46:09.440990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'92","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.062841+0000","last_change":"2024-09-14T10:44:11.359272+0000","last_active":"2024-09-14T10:47:53.062841+0000","last_peered":"2024-09-14T10:47:53.062841+0000","last_clean":"2024-09-14T10:47:53.062841+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:47:53.062841+0000","last_undegraded":"2024-09-14T10:47:53.062841+0000","last_fullsized":"2024-09-14T10:47:53.062841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:29.672456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438836+0000","last_change":"2024-09-14T10:44:13.361050+0000","last_active":"2024-09-14T10:44:44.438836+0000","last_peered":"2024-09-14T10:44:44.438836+0000","last_clean":"2024-09-14T10:44:44.438836+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:44:44.438836+0000","last_undegraded":"2024-09-14T10:44:44.438836+0000","last_fullsized":"2024-09-14T10:44:44.438836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.597367+0000","last_change":"2024-09-14T10:44:15.376175+0000","last_active":"2024-09-14T10:44:52.597367+0000","last_peered":"2024-09-14T10:44:52.597367+0000","last_clean":"2024-09-14T10:44:52.597367+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:44:52.597367+0000","last_undegraded":"2024-09-14T10:44:52.597367+0000","last_fullsized":"2024-09-14T10:44:52.597367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.409508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.990797+0000","last_change":"2024-09-14T10:44:15.381865+0000","last_active":"2024-09-14T10:47:21.990797+0000","last_peered":"2024-09-14T10:47:21.990797+0000","last_clean":"2024-09-14T10:47:21.990797+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:47:21.990797+0000","last_undegraded":"2024-09-14T10:47:21.990797+0000","last_fullsized":"2024-09-14T10:47:21.990797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:55.550930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.520688+0000","last_change":"2024-09-14T10:44:07.314638+0000","last_active":"2024-09-14T10:47:21.520688+0000","last_peered":"2024-09-14T10:47:21.520688+0000","last_clean":"2024-09-14T10:47:21.520688+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:47:21.520688+0000","last_undegraded":"2024-09-14T10:47:21.520688+0000","last_fullsized":"2024-09-14T10:47:21.520688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:49.986512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.979725+0000","last_change":"2024-09-14T10:48:11.979725+0000","last_active":"2024-09-14T10:48:11.979725+0000","last_peered":"2024-09-14T10:48:11.979725+0000","last_clean":"2024-09-14T10:48:11.979725+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:48:11.979725+0000","last_undegraded":"2024-09-14T10:48:11.979725+0000","last_fullsized":"2024-09-14T10:48:11.979725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.979551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:25.927244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:02.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.100532+0000","last_change":"2024-09-14T10:44:11.356682+0000","last_active":"2024-09-14T10:47:53.100532+0000","last_peered":"2024-09-14T10:47:53.100532+0000","last_clean":"2024-09-14T10:47:53.100532+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:47:53.100532+0000","last_undegraded":"2024-09-14T10:47:53.100532+0000","last_fullsized":"2024-09-14T10:47:53.100532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:36.580622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442491+0000","last_change":"2024-09-14T10:44:13.370490+0000","last_active":"2024-09-14T10:44:44.442491+0000","last_peered":"2024-09-14T10:44:44.442491+0000","last_clean":"2024-09-14T10:44:44.442491+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:44:44.442491+0000","last_undegraded":"2024-09-14T10:44:44.442491+0000","last_fullsized":"2024-09-14T10:44:44.442491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:34.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.287971+0000","last_change":"2024-09-14T10:44:15.361905+0000","last_active":"2024-09-14T10:46:18.287971+0000","last_peered":"2024-09-14T10:46:18.287971+0000","last_clean":"2024-09-14T10:46:18.287971+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:46:18.287971+0000","last_undegraded":"2024-09-14T10:46:18.287971+0000","last_fullsized":"2024-09-14T10:46:18.287971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.699026+0000","last_change":"2024-09-14T10:44:44.460104+0000","last_active":"2024-09-14T10:46:20.699026+0000","last_peered":"2024-09-14T10:46:20.699026+0000","last_clean":"2024-09-14T10:46:20.699026+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:46:20.699026+0000","last_undegraded":"2024-09-14T10:46:20.699026+0000","last_fullsized":"2024-09-14T10:46:20.699026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:13.899780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.594367+0000","last_change":"2024-09-14T10:48:02.594367+0000","last_active":"2024-09-14T10:48:02.594367+0000","last_peered":"2024-09-14T10:48:02.594367+0000","last_clean":"2024-09-14T10:48:02.594367+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:48:02.594367+0000","last_undegraded":"2024-09-14T10:48:02.594367+0000","last_fullsized":"2024-09-14T10:48:02.594367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.594183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.132926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.464537+0000","last_change":"2024-09-14T10:44:44.463214+0000","last_active":"2024-09-14T10:44:44.464537+0000","last_peered":"2024-09-14T10:44:44.464537+0000","last_clean":"2024-09-14T10:44:44.464537+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:44:44.464537+0000","last_undegraded":"2024-09-14T10:44:44.464537+0000","last_fullsized":"2024-09-14T10:44:44.464537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:34.009805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.732910+0000","last_change":"2024-09-14T10:44:11.323585+0000","last_active":"2024-09-14T10:47:20.732910+0000","last_peered":"2024-09-14T10:47:20.732910+0000","last_clean":"2024-09-14T10:47:20.732910+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:47:20.732910+0000","last_undegraded":"2024-09-14T10:47:20.732910+0000","last_fullsized":"2024-09-14T10:47:20.732910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:36.664992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434000+0000","last_change":"2024-09-14T10:44:13.371900+0000","last_active":"2024-09-14T10:44:44.434000+0000","last_peered":"2024-09-14T10:44:44.434000+0000","last_clean":"2024-09-14T10:44:44.434000+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:44:44.434000+0000","last_undegraded":"2024-09-14T10:44:44.434000+0000","last_fullsized":"2024-09-14T10:44:44.434000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:29.727463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440980+0000","last_change":"2024-09-14T10:44:15.386483+0000","last_active":"2024-09-14T10:44:44.440980+0000","last_peered":"2024-09-14T10:44:44.440980+0000","last_clean":"2024-09-14T10:44:44.440980+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:44:44.440980+0000","last_undegraded":"2024-09-14T10:44:44.440980+0000","last_fullsized":"2024-09-14T10:44:44.440980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.723831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.626010+0000","last_change":"2024-09-14T10:48:14.626010+0000","last_active":"2024-09-14T10:48:14.626010+0000","last_peered":"2024-09-14T10:48:14.626010+0000","last_clean":"2024-09-14T10:48:14.626010+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:48:14.626010+0000","last_undegraded":"2024-09-14T10:48:14.626010+0000","last_fullsized":"2024-09-14T10:48:14.626010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.625832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:18.247497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.596063+0000","last_change":"2024-09-14T10:48:04.596063+0000","last_active":"2024-09-14T10:48:04.596063+0000","last_peered":"2024-09-14T10:48:04.596063+0000","last_clean":"2024-09-14T10:48:04.596063+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:48:04.596063+0000","last_undegraded":"2024-09-14T10:48:04.596063+0000","last_fullsized":"2024-09-14T10:48:04.596063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.595874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:58.777417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.432334+0000","last_change":"2024-09-14T10:44:09.318542+0000","last_active":"2024-09-14T10:44:44.432334+0000","last_peered":"2024-09-14T10:44:44.432334+0000","last_clean":"2024-09-14T10:44:44.432334+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:44:44.432334+0000","last_undegraded":"2024-09-14T10:44:44.432334+0000","last_fullsized":"2024-09-14T10:44:44.432334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:29.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.032529+0000","last_change":"2024-09-14T10:44:11.336124+0000","last_active":"2024-09-14T10:47:53.032529+0000","last_peered":"2024-09-14T10:47:53.032529+0000","last_clean":"2024-09-14T10:47:53.032529+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:47:53.032529+0000","last_undegraded":"2024-09-14T10:47:53.032529+0000","last_fullsized":"2024-09-14T10:47:53.032529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:04.242694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444917+0000","last_change":"2024-09-14T10:44:13.354345+0000","last_active":"2024-09-14T10:44:44.444917+0000","last_peered":"2024-09-14T10:44:44.444917+0000","last_clean":"2024-09-14T10:44:44.444917+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:44:44.444917+0000","last_undegraded":"2024-09-14T10:44:44.444917+0000","last_fullsized":"2024-09-14T10:44:44.444917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451891+0000","last_change":"2024-09-14T10:44:15.378526+0000","last_active":"2024-09-14T10:44:44.451891+0000","last_peered":"2024-09-14T10:44:44.451891+0000","last_clean":"2024-09-14T10:44:44.451891+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:44:44.451891+0000","last_undegraded":"2024-09-14T10:44:44.451891+0000","last_fullsized":"2024-09-14T10:44:44.451891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:34.239574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872753+0000","last_change":"2024-09-14T10:44:07.313804+0000","last_active":"2024-09-14T10:45:35.872753+0000","last_peered":"2024-09-14T10:45:35.872753+0000","last_clean":"2024-09-14T10:45:35.872753+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:45:35.872753+0000","last_undegraded":"2024-09-14T10:45:35.872753+0000","last_fullsized":"2024-09-14T10:45:35.872753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:24.864032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.280211+0000","last_change":"2024-09-14T10:48:00.280211+0000","last_active":"2024-09-14T10:48:00.280211+0000","last_peered":"2024-09-14T10:48:00.280211+0000","last_clean":"2024-09-14T10:48:00.280211+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:48:00.280211+0000","last_undegraded":"2024-09-14T10:48:00.280211+0000","last_fullsized":"2024-09-14T10:48:00.280211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.280016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:02.623876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442567+0000","last_change":"2024-09-14T10:44:09.338478+0000","last_active":"2024-09-14T10:44:44.442567+0000","last_peered":"2024-09-14T10:44:44.442567+0000","last_clean":"2024-09-14T10:44:44.442567+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:44:44.442567+0000","last_undegraded":"2024-09-14T10:44:44.442567+0000","last_fullsized":"2024-09-14T10:44:44.442567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:42.543570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.010478+0000","last_change":"2024-09-14T10:44:11.321761+0000","last_active":"2024-09-14T10:47:53.010478+0000","last_peered":"2024-09-14T10:47:53.010478+0000","last_clean":"2024-09-14T10:47:53.010478+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:47:53.010478+0000","last_undegraded":"2024-09-14T10:47:53.010478+0000","last_fullsized":"2024-09-14T10:47:53.010478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.326575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434240+0000","last_change":"2024-09-14T10:44:13.356507+0000","last_active":"2024-09-14T10:44:44.434240+0000","last_peered":"2024-09-14T10:44:44.434240+0000","last_clean":"2024-09-14T10:44:44.434240+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:44:44.434240+0000","last_undegraded":"2024-09-14T10:44:44.434240+0000","last_fullsized":"2024-09-14T10:44:44.434240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.808772+0000","last_change":"2024-09-14T10:44:07.313195+0000","last_active":"2024-09-14T10:47:21.808772+0000","last_peered":"2024-09-14T10:47:21.808772+0000","last_clean":"2024-09-14T10:47:21.808772+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:47:21.808772+0000","last_undegraded":"2024-09-14T10:47:21.808772+0000","last_fullsized":"2024-09-14T10:47:21.808772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:53.410685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.008639+0000","last_change":"2024-09-14T10:48:13.008639+0000","last_active":"2024-09-14T10:48:13.008639+0000","last_peered":"2024-09-14T10:48:13.008639+0000","last_clean":"2024-09-14T10:48:13.008639+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:48:13.008639+0000","last_undegraded":"2024-09-14T10:48:13.008639+0000","last_fullsized":"2024-09-14T10:48:13.008639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.008350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:31.362974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:12.439841+0000","last_change":"2024-09-14T10:44:09.332885+0000","last_active":"2024-09-14T10:46:12.439841+0000","last_peered":"2024-09-14T10:46:12.439841+0000","last_clean":"2024-09-14T10:46:12.439841+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:46:12.439841+0000","last_undegraded":"2024-09-14T10:46:12.439841+0000","last_fullsized":"2024-09-14T10:46:12.439841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.149219+0000","last_change":"2024-09-14T10:44:11.340857+0000","last_active":"2024-09-14T10:47:53.149219+0000","last_peered":"2024-09-14T10:47:53.149219+0000","last_clean":"2024-09-14T10:47:53.149219+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:47:53.149219+0000","last_undegraded":"2024-09-14T10:47:53.149219+0000","last_fullsized":"2024-09-14T10:47:53.149219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:58.117101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436429+0000","last_change":"2024-09-14T10:44:13.356783+0000","last_active":"2024-09-14T10:44:44.436429+0000","last_peered":"2024-09-14T10:44:44.436429+0000","last_clean":"2024-09-14T10:44:44.436429+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:44:44.436429+0000","last_undegraded":"2024-09-14T10:44:44.436429+0000","last_fullsized":"2024-09-14T10:44:44.436429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:57.886038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.426338+0000","last_change":"2024-09-14T10:44:15.390085+0000","last_active":"2024-09-14T10:47:21.426338+0000","last_peered":"2024-09-14T10:47:21.426338+0000","last_clean":"2024-09-14T10:47:21.426338+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:47:21.426338+0000","last_undegraded":"2024-09-14T10:47:21.426338+0000","last_fullsized":"2024-09-14T10:47:21.426338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:09.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.903174+0000","last_change":"2024-09-14T10:44:07.305111+0000","last_active":"2024-09-14T10:47:21.903174+0000","last_peered":"2024-09-14T10:47:21.903174+0000","last_clean":"2024-09-14T10:47:21.903174+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:47:21.903174+0000","last_undegraded":"2024-09-14T10:47:21.903174+0000","last_fullsized":"2024-09-14T10:47:21.903174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.271045+0000","last_change":"2024-09-14T10:48:01.271045+0000","last_active":"2024-09-14T10:48:01.271045+0000","last_peered":"2024-09-14T10:48:01.271045+0000","last_clean":"2024-09-14T10:48:01.271045+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:48:01.271045+0000","last_undegraded":"2024-09-14T10:48:01.271045+0000","last_fullsized":"2024-09-14T10:48:01.271045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.270861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:42.910644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439696+0000","last_change":"2024-09-14T10:44:09.313053+0000","last_active":"2024-09-14T10:44:44.439696+0000","last_peered":"2024-09-14T10:44:44.439696+0000","last_clean":"2024-09-14T10:44:44.439696+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:44:44.439696+0000","last_undegraded":"2024-09-14T10:44:44.439696+0000","last_fullsized":"2024-09-14T10:44:44.439696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.375123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.016361+0000","last_change":"2024-09-14T10:44:11.359808+0000","last_active":"2024-09-14T10:47:53.016361+0000","last_peered":"2024-09-14T10:47:53.016361+0000","last_clean":"2024-09-14T10:47:53.016361+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:47:53.016361+0000","last_undegraded":"2024-09-14T10:47:53.016361+0000","last_fullsized":"2024-09-14T10:47:53.016361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:51.224366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445366+0000","last_change":"2024-09-14T10:44:13.371652+0000","last_active":"2024-09-14T10:44:44.445366+0000","last_peered":"2024-09-14T10:44:44.445366+0000","last_clean":"2024-09-14T10:44:44.445366+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:44:44.445366+0000","last_undegraded":"2024-09-14T10:44:44.445366+0000","last_fullsized":"2024-09-14T10:44:44.445366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450551+0000","last_change":"2024-09-14T10:44:15.379606+0000","last_active":"2024-09-14T10:44:44.450551+0000","last_peered":"2024-09-14T10:44:44.450551+0000","last_clean":"2024-09-14T10:44:44.450551+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:44:44.450551+0000","last_undegraded":"2024-09-14T10:44:44.450551+0000","last_fullsized":"2024-09-14T10:44:44.450551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:37.639739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.298696+0000","last_change":"2024-09-14T10:44:07.317281+0000","last_active":"2024-09-14T10:44:52.298696+0000","last_peered":"2024-09-14T10:44:52.298696+0000","last_clean":"2024-09-14T10:44:52.298696+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:44:52.298696+0000","last_undegraded":"2024-09-14T10:44:52.298696+0000","last_fullsized":"2024-09-14T10:44:52.298696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:19.569186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.292893+0000","last_change":"2024-09-14T10:48:02.292893+0000","last_active":"2024-09-14T10:48:02.292893+0000","last_peered":"2024-09-14T10:48:02.292893+0000","last_clean":"2024-09-14T10:48:02.292893+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:48:02.292893+0000","last_undegraded":"2024-09-14T10:48:02.292893+0000","last_fullsized":"2024-09-14T10:48:02.292893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.292668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:18.687200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438372+0000","last_change":"2024-09-14T10:44:09.316331+0000","last_active":"2024-09-14T10:44:44.438372+0000","last_peered":"2024-09-14T10:44:44.438372+0000","last_clean":"2024-09-14T10:44:44.438372+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:44:44.438372+0000","last_undegraded":"2024-09-14T10:44:44.438372+0000","last_fullsized":"2024-09-14T10:44:44.438372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:38.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.133563+0000","last_change":"2024-09-14T10:44:11.330416+0000","last_active":"2024-09-14T10:47:53.133563+0000","last_peered":"2024-09-14T10:47:53.133563+0000","last_clean":"2024-09-14T10:47:53.133563+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:47:53.133563+0000","last_undegraded":"2024-09-14T10:47:53.133563+0000","last_fullsized":"2024-09-14T10:47:53.133563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:58.265390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:12.439821+0000","last_change":"2024-09-14T10:44:13.364526+0000","last_active":"2024-09-14T10:46:12.439821+0000","last_peered":"2024-09-14T10:46:12.439821+0000","last_clean":"2024-09-14T10:46:12.439821+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:46:12.439821+0000","last_undegraded":"2024-09-14T10:46:12.439821+0000","last_fullsized":"2024-09-14T10:46:12.439821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.685006+0000","last_change":"2024-09-14T10:44:15.379535+0000","last_active":"2024-09-14T10:46:20.685006+0000","last_peered":"2024-09-14T10:46:20.685006+0000","last_clean":"2024-09-14T10:46:20.685006+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:46:20.685006+0000","last_undegraded":"2024-09-14T10:46:20.685006+0000","last_fullsized":"2024-09-14T10:46:20.685006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:20.408629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.588402+0000","last_change":"2024-09-14T10:48:16.588402+0000","last_active":"2024-09-14T10:48:16.588402+0000","last_peered":"2024-09-14T10:48:16.588402+0000","last_clean":"2024-09-14T10:48:16.588402+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:48:16.588402+0000","last_undegraded":"2024-09-14T10:48:16.588402+0000","last_fullsized":"2024-09-14T10:48:16.588402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.588185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:49.661160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.969100+0000","last_change":"2024-09-14T10:48:13.969100+0000","last_active":"2024-09-14T10:48:13.969100+0000","last_peered":"2024-09-14T10:48:13.969100+0000","last_clean":"2024-09-14T10:48:13.969100+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:48:13.969100+0000","last_undegraded":"2024-09-14T10:48:13.969100+0000","last_fullsized":"2024-09-14T10:48:13.969100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.968917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:56.650501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"25'1","reported_seq":221,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.841801+0000","last_change":"2024-09-14T10:44:09.313857+0000","last_active":"2024-09-14T10:47:52.841801+0000","last_peered":"2024-09-14T10:47:52.841801+0000","last_clean":"2024-09-14T10:47:52.841801+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:47:52.841801+0000","last_undegraded":"2024-09-14T10:47:52.841801+0000","last_fullsized":"2024-09-14T10:47:52.841801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:53.790922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.526716+0000","last_change":"2024-09-14T10:44:11.365067+0000","last_active":"2024-09-14T10:46:16.526716+0000","last_peered":"2024-09-14T10:46:16.526716+0000","last_clean":"2024-09-14T10:46:16.526716+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:46:16.526716+0000","last_undegraded":"2024-09-14T10:46:16.526716+0000","last_fullsized":"2024-09-14T10:46:16.526716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":371,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.875309+0000","last_change":"2024-09-14T10:44:13.372845+0000","last_active":"2024-09-14T10:47:52.875309+0000","last_peered":"2024-09-14T10:47:52.875309+0000","last_clean":"2024-09-14T10:47:52.875309+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:47:52.875309+0000","last_undegraded":"2024-09-14T10:47:52.875309+0000","last_fullsized":"2024-09-14T10:47:52.875309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:44.405525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.813949+0000","last_change":"2024-09-14T10:44:15.388635+0000","last_active":"2024-09-14T10:47:21.813949+0000","last_peered":"2024-09-14T10:47:21.813949+0000","last_clean":"2024-09-14T10:47:21.813949+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:47:21.813949+0000","last_undegraded":"2024-09-14T10:47:21.813949+0000","last_fullsized":"2024-09-14T10:47:21.813949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:00.563368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.297384+0000","last_change":"2024-09-14T10:44:07.297715+0000","last_active":"2024-09-14T10:44:52.297384+0000","last_peered":"2024-09-14T10:44:52.297384+0000","last_clean":"2024-09-14T10:44:52.297384+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:44:52.297384+0000","last_undegraded":"2024-09-14T10:44:52.297384+0000","last_fullsized":"2024-09-14T10:44:52.297384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:13.693037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.279857+0000","last_change":"2024-09-14T10:48:03.279857+0000","last_active":"2024-09-14T10:48:03.279857+0000","last_peered":"2024-09-14T10:48:03.279857+0000","last_clean":"2024-09-14T10:48:03.279857+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:48:03.279857+0000","last_undegraded":"2024-09-14T10:48:03.279857+0000","last_fullsized":"2024-09-14T10:48:03.279857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.279672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:11.368363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'4","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.841020+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:47:52.841020+0000","last_peered":"2024-09-14T10:47:52.841020+0000","last_clean":"2024-09-14T10:47:52.841020+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:47:52.841020+0000","last_undegraded":"2024-09-14T10:47:52.841020+0000","last_fullsized":"2024-09-14T10:47:52.841020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:58.082949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.178369+0000","last_change":"2024-09-14T10:44:11.327509+0000","last_active":"2024-09-14T10:47:53.178369+0000","last_peered":"2024-09-14T10:47:53.178369+0000","last_clean":"2024-09-14T10:47:53.178369+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:47:53.178369+0000","last_undegraded":"2024-09-14T10:47:53.178369+0000","last_fullsized":"2024-09-14T10:47:53.178369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.860344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438767+0000","last_change":"2024-09-14T10:44:13.376040+0000","last_active":"2024-09-14T10:44:44.438767+0000","last_peered":"2024-09-14T10:44:44.438767+0000","last_clean":"2024-09-14T10:44:44.438767+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:44:44.438767+0000","last_undegraded":"2024-09-14T10:44:44.438767+0000","last_fullsized":"2024-09-14T10:44:44.438767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452541+0000","last_change":"2024-09-14T10:44:15.388404+0000","last_active":"2024-09-14T10:44:44.452541+0000","last_peered":"2024-09-14T10:44:44.452541+0000","last_clean":"2024-09-14T10:44:44.452541+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:44:44.452541+0000","last_undegraded":"2024-09-14T10:44:44.452541+0000","last_fullsized":"2024-09-14T10:44:44.452541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720287+0000","last_change":"2024-09-14T10:44:07.301782+0000","last_active":"2024-09-14T10:47:21.720287+0000","last_peered":"2024-09-14T10:47:21.720287+0000","last_clean":"2024-09-14T10:47:21.720287+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:47:21.720287+0000","last_undegraded":"2024-09-14T10:47:21.720287+0000","last_fullsized":"2024-09-14T10:47:21.720287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:43.671200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456552+0000","last_change":"2024-09-14T10:44:05.321255+0000","last_active":"2024-09-14T10:44:44.456552+0000","last_peered":"2024-09-14T10:44:44.456552+0000","last_clean":"2024-09-14T10:44:44.456552+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:44:44.456552+0000","last_undegraded":"2024-09-14T10:44:44.456552+0000","last_fullsized":"2024-09-14T10:44:44.456552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:08.383959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436064+0000","last_change":"2024-09-14T10:44:09.320830+0000","last_active":"2024-09-14T10:44:44.436064+0000","last_peered":"2024-09-14T10:44:44.436064+0000","last_clean":"2024-09-14T10:44:44.436064+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:44:44.436064+0000","last_undegraded":"2024-09-14T10:44:44.436064+0000","last_fullsized":"2024-09-14T10:44:44.436064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:33.277860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.191050+0000","last_change":"2024-09-14T10:44:11.325995+0000","last_active":"2024-09-14T10:47:53.191050+0000","last_peered":"2024-09-14T10:47:53.191050+0000","last_clean":"2024-09-14T10:47:53.191050+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:47:53.191050+0000","last_undegraded":"2024-09-14T10:47:53.191050+0000","last_fullsized":"2024-09-14T10:47:53.191050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:19.897508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441744+0000","last_change":"2024-09-14T10:44:13.369101+0000","last_active":"2024-09-14T10:44:44.441744+0000","last_peered":"2024-09-14T10:44:44.441744+0000","last_clean":"2024-09-14T10:44:44.441744+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:44:44.441744+0000","last_undegraded":"2024-09-14T10:44:44.441744+0000","last_fullsized":"2024-09-14T10:44:44.441744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:12.164053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457651+0000","last_change":"2024-09-14T10:44:15.386917+0000","last_active":"2024-09-14T10:44:44.457651+0000","last_peered":"2024-09-14T10:44:44.457651+0000","last_clean":"2024-09-14T10:44:44.457651+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:44:44.457651+0000","last_undegraded":"2024-09-14T10:44:44.457651+0000","last_fullsized":"2024-09-14T10:44:44.457651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:38.536486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600974+0000","last_change":"2024-09-14T10:44:44.464149+0000","last_active":"2024-09-14T10:45:35.600974+0000","last_peered":"2024-09-14T10:45:35.600974+0000","last_clean":"2024-09-14T10:45:35.600974+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:45:35.600974+0000","last_undegraded":"2024-09-14T10:45:35.600974+0000","last_fullsized":"2024-09-14T10:45:35.600974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:26.594110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.470373+0000","last_change":"2024-09-14T10:47:59.470192+0000","last_active":"2024-09-14T10:47:59.470373+0000","last_peered":"2024-09-14T10:47:59.470373+0000","last_clean":"2024-09-14T10:47:59.470373+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:59.470373+0000","last_undegraded":"2024-09-14T10:47:59.470373+0000","last_fullsized":"2024-09-14T10:47:59.470373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.470009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:41.109792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436523+0000","last_change":"2024-09-14T10:44:09.318111+0000","last_active":"2024-09-14T10:44:44.436523+0000","last_peered":"2024-09-14T10:44:44.436523+0000","last_clean":"2024-09-14T10:44:44.436523+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:44:44.436523+0000","last_undegraded":"2024-09-14T10:44:44.436523+0000","last_fullsized":"2024-09-14T10:44:44.436523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:12.821605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.114087+0000","last_change":"2024-09-14T10:44:11.356523+0000","last_active":"2024-09-14T10:47:53.114087+0000","last_peered":"2024-09-14T10:47:53.114087+0000","last_clean":"2024-09-14T10:47:53.114087+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:47:53.114087+0000","last_undegraded":"2024-09-14T10:47:53.114087+0000","last_fullsized":"2024-09-14T10:47:53.114087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:30.747229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451553+0000","last_change":"2024-09-14T10:44:13.367321+0000","last_active":"2024-09-14T10:44:44.451553+0000","last_peered":"2024-09-14T10:44:44.451553+0000","last_clean":"2024-09-14T10:44:44.451553+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:44:44.451553+0000","last_undegraded":"2024-09-14T10:44:44.451553+0000","last_fullsized":"2024-09-14T10:44:44.451553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:58.066611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.662711+0000","last_change":"2024-09-14T10:44:15.385986+0000","last_active":"2024-09-14T10:46:18.662711+0000","last_peered":"2024-09-14T10:46:18.662711+0000","last_clean":"2024-09-14T10:46:18.662711+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:46:18.662711+0000","last_undegraded":"2024-09-14T10:46:18.662711+0000","last_fullsized":"2024-09-14T10:46:18.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:58.059454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.522356+0000","last_change":"2024-09-14T10:44:07.295202+0000","last_active":"2024-09-14T10:46:16.522356+0000","last_peered":"2024-09-14T10:46:16.522356+0000","last_clean":"2024-09-14T10:46:16.522356+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:46:16.522356+0000","last_undegraded":"2024-09-14T10:46:16.522356+0000","last_fullsized":"2024-09-14T10:46:16.522356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:40.711930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.315403+0000","last_change":"2024-09-14T10:48:04.315262+0000","last_active":"2024-09-14T10:48:04.315403+0000","last_peered":"2024-09-14T10:48:04.315403+0000","last_clean":"2024-09-14T10:48:04.315403+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:48:04.315403+0000","last_undegraded":"2024-09-14T10:48:04.315403+0000","last_fullsized":"2024-09-14T10:48:04.315403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.315084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:09.501850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.016574+0000","last_change":"2024-09-14T10:44:09.327924+0000","last_active":"2024-09-14T10:46:17.016574+0000","last_peered":"2024-09-14T10:46:17.016574+0000","last_clean":"2024-09-14T10:46:17.016574+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:46:17.016574+0000","last_undegraded":"2024-09-14T10:46:17.016574+0000","last_fullsized":"2024-09-14T10:46:17.016574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:38.718169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.137521+0000","last_change":"2024-09-14T10:44:11.357069+0000","last_active":"2024-09-14T10:47:53.137521+0000","last_peered":"2024-09-14T10:47:53.137521+0000","last_clean":"2024-09-14T10:47:53.137521+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:47:53.137521+0000","last_undegraded":"2024-09-14T10:47:53.137521+0000","last_fullsized":"2024-09-14T10:47:53.137521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439393+0000","last_change":"2024-09-14T10:44:13.373389+0000","last_active":"2024-09-14T10:44:44.439393+0000","last_peered":"2024-09-14T10:44:44.439393+0000","last_clean":"2024-09-14T10:44:44.439393+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:44:44.439393+0000","last_undegraded":"2024-09-14T10:44:44.439393+0000","last_fullsized":"2024-09-14T10:44:44.439393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:34.517874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.852899+0000","last_change":"2024-09-14T10:44:15.386649+0000","last_active":"2024-09-14T10:47:20.852899+0000","last_peered":"2024-09-14T10:47:20.852899+0000","last_clean":"2024-09-14T10:47:20.852899+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:47:20.852899+0000","last_undegraded":"2024-09-14T10:47:20.852899+0000","last_fullsized":"2024-09-14T10:47:20.852899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:48.236396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'9","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.826073+0000","last_change":"2024-09-14T10:44:07.319333+0000","last_active":"2024-09-14T10:47:21.826073+0000","last_peered":"2024-09-14T10:47:21.826073+0000","last_clean":"2024-09-14T10:47:21.826073+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:47:21.826073+0000","last_undegraded":"2024-09-14T10:47:21.826073+0000","last_fullsized":"2024-09-14T10:47:21.826073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:14.561201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.685193+0000","last_change":"2024-09-14T10:48:06.684936+0000","last_active":"2024-09-14T10:48:06.685193+0000","last_peered":"2024-09-14T10:48:06.685193+0000","last_clean":"2024-09-14T10:48:06.685193+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:48:06.685193+0000","last_undegraded":"2024-09-14T10:48:06.685193+0000","last_fullsized":"2024-09-14T10:48:06.685193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.684579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:30.618905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.601482+0000","last_change":"2024-09-14T10:44:07.305165+0000","last_active":"2024-09-14T10:45:35.601482+0000","last_peered":"2024-09-14T10:45:35.601482+0000","last_clean":"2024-09-14T10:45:35.601482+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:45:35.601482+0000","last_undegraded":"2024-09-14T10:45:35.601482+0000","last_fullsized":"2024-09-14T10:45:35.601482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:48.550710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.500388+0000","last_change":"2024-09-14T10:48:03.500209+0000","last_active":"2024-09-14T10:48:03.500388+0000","last_peered":"2024-09-14T10:48:03.500388+0000","last_clean":"2024-09-14T10:48:03.500388+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:48:03.500388+0000","last_undegraded":"2024-09-14T10:48:03.500388+0000","last_fullsized":"2024-09-14T10:48:03.500388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.500037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:09.580224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.377995+0000","last_change":"2024-09-14T10:44:07.300105+0000","last_active":"2024-09-14T10:47:21.377995+0000","last_peered":"2024-09-14T10:47:21.377995+0000","last_clean":"2024-09-14T10:47:21.377995+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:47:21.377995+0000","last_undegraded":"2024-09-14T10:47:21.377995+0000","last_fullsized":"2024-09-14T10:47:21.377995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:48.852285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:09.441139+0000","last_change":"2024-09-14T10:44:05.327542+0000","last_active":"2024-09-14T10:46:09.441139+0000","last_peered":"2024-09-14T10:46:09.441139+0000","last_clean":"2024-09-14T10:46:09.441139+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:46:09.441139+0000","last_undegraded":"2024-09-14T10:46:09.441139+0000","last_fullsized":"2024-09-14T10:46:09.441139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441253+0000","last_change":"2024-09-14T10:44:07.306382+0000","last_active":"2024-09-14T10:44:44.441253+0000","last_peered":"2024-09-14T10:44:44.441253+0000","last_clean":"2024-09-14T10:44:44.441253+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:44:44.441253+0000","last_undegraded":"2024-09-14T10:44:44.441253+0000","last_fullsized":"2024-09-14T10:44:44.441253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:58.925922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.437129+0000","last_change":"2024-09-14T10:48:06.436938+0000","last_active":"2024-09-14T10:48:06.437129+0000","last_peered":"2024-09-14T10:48:06.437129+0000","last_clean":"2024-09-14T10:48:06.437129+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:48:06.437129+0000","last_undegraded":"2024-09-14T10:48:06.437129+0000","last_fullsized":"2024-09-14T10:48:06.437129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.436743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:28.064799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:12.439691+0000","last_change":"2024-09-14T10:44:07.316775+0000","last_active":"2024-09-14T10:46:12.439691+0000","last_peered":"2024-09-14T10:46:12.439691+0000","last_clean":"2024-09-14T10:46:12.439691+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:46:12.439691+0000","last_undegraded":"2024-09-14T10:46:12.439691+0000","last_fullsized":"2024-09-14T10:46:12.439691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.477245+0000","last_change":"2024-09-14T10:48:07.477245+0000","last_active":"2024-09-14T10:48:07.477245+0000","last_peered":"2024-09-14T10:48:07.477245+0000","last_clean":"2024-09-14T10:48:07.477245+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:48:07.477245+0000","last_undegraded":"2024-09-14T10:48:07.477245+0000","last_fullsized":"2024-09-14T10:48:07.477245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.477054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.880716+0000","last_change":"2024-09-14T10:44:07.315346+0000","last_active":"2024-09-14T10:47:21.880716+0000","last_peered":"2024-09-14T10:47:21.880716+0000","last_clean":"2024-09-14T10:47:21.880716+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:47:21.880716+0000","last_undegraded":"2024-09-14T10:47:21.880716+0000","last_fullsized":"2024-09-14T10:47:21.880716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:34.364814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.343952+0000","last_change":"2024-09-14T10:48:05.343952+0000","last_active":"2024-09-14T10:48:05.343952+0000","last_peered":"2024-09-14T10:48:05.343952+0000","last_clean":"2024-09-14T10:48:05.343952+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:48:05.343952+0000","last_undegraded":"2024-09-14T10:48:05.343952+0000","last_fullsized":"2024-09-14T10:48:05.343952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.343728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:11.423916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:12.439637+0000","last_change":"2024-09-14T10:44:07.302298+0000","last_active":"2024-09-14T10:46:12.439637+0000","last_peered":"2024-09-14T10:46:12.439637+0000","last_clean":"2024-09-14T10:46:12.439637+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:46:12.439637+0000","last_undegraded":"2024-09-14T10:46:12.439637+0000","last_fullsized":"2024-09-14T10:46:12.439637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.636531+0000","last_change":"2024-09-14T10:48:05.636531+0000","last_active":"2024-09-14T10:48:05.636531+0000","last_peered":"2024-09-14T10:48:05.636531+0000","last_clean":"2024-09-14T10:48:05.636531+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:48:05.636531+0000","last_undegraded":"2024-09-14T10:48:05.636531+0000","last_fullsized":"2024-09-14T10:48:05.636531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.636345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:39.594590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.523024+0000","last_change":"2024-09-14T10:44:07.304072+0000","last_active":"2024-09-14T10:46:16.523024+0000","last_peered":"2024-09-14T10:46:16.523024+0000","last_clean":"2024-09-14T10:46:16.523024+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:46:16.523024+0000","last_undegraded":"2024-09-14T10:46:16.523024+0000","last_fullsized":"2024-09-14T10:46:16.523024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:27.825426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.492991+0000","last_change":"2024-09-14T10:48:04.492991+0000","last_active":"2024-09-14T10:48:04.492991+0000","last_peered":"2024-09-14T10:48:04.492991+0000","last_clean":"2024-09-14T10:48:04.492991+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:48:04.492991+0000","last_undegraded":"2024-09-14T10:48:04.492991+0000","last_fullsized":"2024-09-14T10:48:04.492991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.492802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:02.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452649+0000","last_change":"2024-09-14T10:44:07.302967+0000","last_active":"2024-09-14T10:44:44.452649+0000","last_peered":"2024-09-14T10:44:44.452649+0000","last_clean":"2024-09-14T10:44:44.452649+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:44:44.452649+0000","last_undegraded":"2024-09-14T10:44:44.452649+0000","last_fullsized":"2024-09-14T10:44:44.452649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:58.163763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:50.707392+0000","last_change":"2024-09-14T10:44:05.326780+0000","last_active":"2024-09-14T10:44:50.707392+0000","last_peered":"2024-09-14T10:44:50.707392+0000","last_clean":"2024-09-14T10:44:50.707392+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:44:50.707392+0000","last_undegraded":"2024-09-14T10:44:50.707392+0000","last_fullsized":"2024-09-14T10:44:50.707392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:30.583609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.848468+0000","last_change":"2024-09-14T10:44:07.309384+0000","last_active":"2024-09-14T10:44:51.848468+0000","last_peered":"2024-09-14T10:44:51.848468+0000","last_clean":"2024-09-14T10:44:51.848468+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:44:51.848468+0000","last_undegraded":"2024-09-14T10:44:51.848468+0000","last_fullsized":"2024-09-14T10:44:51.848468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:20.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.451486+0000","last_change":"2024-09-14T10:48:05.451486+0000","last_active":"2024-09-14T10:48:05.451486+0000","last_peered":"2024-09-14T10:48:05.451486+0000","last_clean":"2024-09-14T10:48:05.451486+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:48:05.451486+0000","last_undegraded":"2024-09-14T10:48:05.451486+0000","last_fullsized":"2024-09-14T10:48:05.451486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.451302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:31.147968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.874270+0000","last_change":"2024-09-14T10:44:07.314041+0000","last_active":"2024-09-14T10:45:35.874270+0000","last_peered":"2024-09-14T10:45:35.874270+0000","last_clean":"2024-09-14T10:45:35.874270+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:45:35.874270+0000","last_undegraded":"2024-09-14T10:45:35.874270+0000","last_fullsized":"2024-09-14T10:45:35.874270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:27.185091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.364214+0000","last_change":"2024-09-14T10:48:08.364214+0000","last_active":"2024-09-14T10:48:08.364214+0000","last_peered":"2024-09-14T10:48:08.364214+0000","last_clean":"2024-09-14T10:48:08.364214+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:48:08.364214+0000","last_undegraded":"2024-09-14T10:48:08.364214+0000","last_fullsized":"2024-09-14T10:48:08.364214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.364025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:29.992081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600757+0000","last_change":"2024-09-14T10:44:07.303238+0000","last_active":"2024-09-14T10:45:35.600757+0000","last_peered":"2024-09-14T10:45:35.600757+0000","last_clean":"2024-09-14T10:45:35.600757+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:45:35.600757+0000","last_undegraded":"2024-09-14T10:45:35.600757+0000","last_fullsized":"2024-09-14T10:45:35.600757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:49.401193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.363263+0000","last_change":"2024-09-14T10:48:06.363263+0000","last_active":"2024-09-14T10:48:06.363263+0000","last_peered":"2024-09-14T10:48:06.363263+0000","last_clean":"2024-09-14T10:48:06.363263+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:48:06.363263+0000","last_undegraded":"2024-09-14T10:48:06.363263+0000","last_fullsized":"2024-09-14T10:48:06.363263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.363044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:10.900801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.375016+0000","last_change":"2024-09-14T10:44:07.319354+0000","last_active":"2024-09-14T10:47:21.375016+0000","last_peered":"2024-09-14T10:47:21.375016+0000","last_clean":"2024-09-14T10:47:21.375016+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:47:21.375016+0000","last_undegraded":"2024-09-14T10:47:21.375016+0000","last_fullsized":"2024-09-14T10:47:21.375016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:26.868325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.453814+0000","last_change":"2024-09-14T10:44:05.318285+0000","last_active":"2024-09-14T10:44:44.453814+0000","last_peered":"2024-09-14T10:44:44.453814+0000","last_clean":"2024-09-14T10:44:44.453814+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:44:44.453814+0000","last_undegraded":"2024-09-14T10:44:44.453814+0000","last_fullsized":"2024-09-14T10:44:44.453814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:09.785074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.697003+0000","last_change":"2024-09-14T10:44:07.304891+0000","last_active":"2024-09-14T10:46:20.697003+0000","last_peered":"2024-09-14T10:46:20.697003+0000","last_clean":"2024-09-14T10:46:20.697003+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:46:20.697003+0000","last_undegraded":"2024-09-14T10:46:20.697003+0000","last_fullsized":"2024-09-14T10:46:20.697003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:28.594544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457554+0000","last_change":"2024-09-14T10:44:05.324335+0000","last_active":"2024-09-14T10:44:44.457554+0000","last_peered":"2024-09-14T10:44:44.457554+0000","last_clean":"2024-09-14T10:44:44.457554+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:44:44.457554+0000","last_undegraded":"2024-09-14T10:44:44.457554+0000","last_fullsized":"2024-09-14T10:44:44.457554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:36.457645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.521412+0000","last_change":"2024-09-14T10:44:07.309006+0000","last_active":"2024-09-14T10:47:21.521412+0000","last_peered":"2024-09-14T10:47:21.521412+0000","last_clean":"2024-09-14T10:47:21.521412+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:47:21.521412+0000","last_undegraded":"2024-09-14T10:47:21.521412+0000","last_fullsized":"2024-09-14T10:47:21.521412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.692142+0000","last_change":"2024-09-14T10:48:07.692142+0000","last_active":"2024-09-14T10:48:07.692142+0000","last_peered":"2024-09-14T10:48:07.692142+0000","last_clean":"2024-09-14T10:48:07.692142+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:48:07.692142+0000","last_undegraded":"2024-09-14T10:48:07.692142+0000","last_fullsized":"2024-09-14T10:48:07.692142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.691953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:20.730540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.537179+0000","last_change":"2024-09-14T10:44:07.303706+0000","last_active":"2024-09-14T10:47:21.537179+0000","last_peered":"2024-09-14T10:47:21.537179+0000","last_clean":"2024-09-14T10:47:21.537179+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:47:21.537179+0000","last_undegraded":"2024-09-14T10:47:21.537179+0000","last_fullsized":"2024-09-14T10:47:21.537179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:47.194815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460745+0000","last_change":"2024-09-14T10:44:05.318005+0000","last_active":"2024-09-14T10:44:44.460745+0000","last_peered":"2024-09-14T10:44:44.460745+0000","last_clean":"2024-09-14T10:44:44.460745+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:44:44.460745+0000","last_undegraded":"2024-09-14T10:44:44.460745+0000","last_fullsized":"2024-09-14T10:44:44.460745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:40.757947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.713111+0000","last_change":"2024-09-14T10:44:05.321634+0000","last_active":"2024-09-14T10:47:21.713111+0000","last_peered":"2024-09-14T10:47:21.713111+0000","last_clean":"2024-09-14T10:47:21.713111+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:47:21.713111+0000","last_undegraded":"2024-09-14T10:47:21.713111+0000","last_fullsized":"2024-09-14T10:47:21.713111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:04.258152+0000","last_clean_scrub_stamp":"2024-09-14T10:44:04.258152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:01.426481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.882780+0000","last_change":"2024-09-14T10:44:07.310127+0000","last_active":"2024-09-14T10:47:21.882780+0000","last_peered":"2024-09-14T10:47:21.882780+0000","last_clean":"2024-09-14T10:47:21.882780+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:47:21.882780+0000","last_undegraded":"2024-09-14T10:47:21.882780+0000","last_fullsized":"2024-09-14T10:47:21.882780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.606750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.454843+0000","last_change":"2024-09-14T10:48:08.454843+0000","last_active":"2024-09-14T10:48:08.454843+0000","last_peered":"2024-09-14T10:48:08.454843+0000","last_clean":"2024-09-14T10:48:08.454843+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:48:08.454843+0000","last_undegraded":"2024-09-14T10:48:08.454843+0000","last_fullsized":"2024-09-14T10:48:08.454843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.454661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:34.179499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.521493+0000","last_change":"2024-09-14T10:44:07.318886+0000","last_active":"2024-09-14T10:46:16.521493+0000","last_peered":"2024-09-14T10:46:16.521493+0000","last_clean":"2024-09-14T10:46:16.521493+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:46:16.521493+0000","last_undegraded":"2024-09-14T10:46:16.521493+0000","last_fullsized":"2024-09-14T10:46:16.521493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:08.926626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":475,"ondisk_log_size":475,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640314,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":740626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673016,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1040384,"data_stored":742212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":152178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:48:18.453 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.453 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.453 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.453 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.453 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.453 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.454 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.454 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.454 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.454 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.454 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.454 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.454 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.455 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.455 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.455 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.455 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.455 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.455 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.455 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.456 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.456 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.456 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.456 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.456 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.456 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.456 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.456 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.457 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.457 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.457 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.457 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.457 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.457 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.458 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.458 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.458 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.458 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.458 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.458 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.458 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.458 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.459 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.459 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.459 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.459 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.460 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.460 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.460 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.460 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.460 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.461 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.461 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.461 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.461 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.461 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.461 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.462 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.462 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.462 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.462 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.462 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.462 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.462 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.463 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.463 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.463 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.463 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.463 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.464 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.464 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.464 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.464 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.464 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.464 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.465 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.465 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.465 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.465 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.466 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.466 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.466 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.466 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.466 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.467 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.467 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.467 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.467 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.467 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.467 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.468 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.468 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.468 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.468 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.468 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.468 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.468 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.468 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.469 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.470 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.470 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.470 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.470 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.470 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.470 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.470 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.470 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.471 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.471 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.471 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.471 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.471 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.471 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.471 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.471 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.472 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.472 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.472 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.472 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.472 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.472 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.472 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.472 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.473 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.473 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.473 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.473 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.473 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.473 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.473 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.473 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.474 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.474 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.474 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.474 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.474 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.474 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.474 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.475 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.475 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.475 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.475 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.475 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.475 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.475 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.476 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.476 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.476 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.476 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.476 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.476 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.476 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.477 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.477 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.477 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.477 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.477 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.477 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.477 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.477 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.478 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.478 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.478 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.478 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.478 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.478 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.479 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.479 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.479 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.479 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.479 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.479 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.480 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.481 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:44:04.258152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.481 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.481 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:18.481 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:48:38.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:48:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.616+0000 7f37874c9640 1 Processor -- start 2024-09-14T10:48:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.616+0000 7f37874c9640 1 -- start start 2024-09-14T10:48:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.616+0000 7f37874c9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3780132800 0x7f3780134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.616+0000 7f37874c9640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37801303a0 con 0x7f378012f8b0 2024-09-14T10:48:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.616+0000 7f37874c9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f378012f4f0 con 0x7f3780132800 2024-09-14T10:48:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.616+0000 7f3784a64640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3780132800 0x7f3780134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.616+0000 7f3784a64640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3780132800 0x7f3780134bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36488/0 (socket says 172.21.15.70:36488) 2024-09-14T10:48:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.616+0000 7f3784a64640 1 -- 172.21.15.70:0/3158999078 learned_addr learned my addr 172.21.15.70:0/3158999078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:48:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f3784a64640 1 -- 172.21.15.70:0/3158999078 >> v1:172.21.15.70:6789/0 conn(0x7f378012f8b0 legacy=0x7f378012fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f3784a64640 1 -- 172.21.15.70:0/3158999078 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3780070a60 con 0x7f3780132800 2024-09-14T10:48:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f3784a64640 1 --2- 172.21.15.70:0/3158999078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3780132800 0x7f3780134bf0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3770009820 tx=0x7f377001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f3e5bbb1105803 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f3777fff640 1 -- 172.21.15.70:0/3158999078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37700b0070 con 0x7f3780132800 2024-09-14T10:48:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f3777fff640 1 -- 172.21.15.70:0/3158999078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37700ab530 con 0x7f3780132800 2024-09-14T10:48:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f3777fff640 1 -- 172.21.15.70:0/3158999078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37700ab830 con 0x7f3780132800 2024-09-14T10:48:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f37874c9640 1 -- 172.21.15.70:0/3158999078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3780132800 msgr2=0x7f3780134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f37874c9640 1 --2- 172.21.15.70:0/3158999078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3780132800 0x7f3780134bf0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3770009820 tx=0x7f377001c410 comp rx=0 tx=0).stop 2024-09-14T10:48:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f37874c9640 1 -- 172.21.15.70:0/3158999078 shutdown_connections 2024-09-14T10:48:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f37874c9640 1 --2- 172.21.15.70:0/3158999078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3780132800 0x7f3780134bf0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f37874c9640 1 -- 172.21.15.70:0/3158999078 >> 172.21.15.70:0/3158999078 conn(0x7f37800a2520 msgr2=0x7f378009ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:48:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f37874c9640 1 -- 172.21.15.70:0/3158999078 shutdown_connections 2024-09-14T10:48:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.620+0000 7f37874c9640 1 -- 172.21.15.70:0/3158999078 wait complete. 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f37874c9640 1 Processor -- start 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f37874c9640 1 -- start start 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f37874c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f378012f8b0 0x7f378012b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f37874c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3780070690 con 0x7f378012f8b0 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3785265640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f378012f8b0 0x7f378012b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3785265640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f378012f8b0 0x7f378012b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36496/0 (socket says 172.21.15.70:36496) 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3785265640 1 -- 172.21.15.70:0/376556885 learned_addr learned my addr 172.21.15.70:0/376556885 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3785265640 1 -- 172.21.15.70:0/376556885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3780071e80 con 0x7f378012f8b0 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3785265640 1 --2- 172.21.15.70:0/376556885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f378012f8b0 0x7f378012b5a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c430 tx=0x7f377c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3775ffb640 1 -- 172.21.15.70:0/376556885 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f377c017070 con 0x7f378012f8b0 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3775ffb640 1 -- 172.21.15.70:0/376556885 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c005200 con 0x7f378012f8b0 2024-09-14T10:48:38.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378012cac0 con 0x7f378012f8b0 2024-09-14T10:48:38.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3775ffb640 1 -- 172.21.15.70:0/376556885 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f377c003600 con 0x7f378012f8b0 2024-09-14T10:48:38.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378012bae0 con 0x7f378012f8b0 2024-09-14T10:48:38.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3775ffb640 1 -- 172.21.15.70:0/376556885 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f377c01a070 con 0x7f378012f8b0 2024-09-14T10:48:38.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378012fc90 con 0x7f378012f8b0 2024-09-14T10:48:38.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3775ffb640 1 --2- 172.21.15.70:0/376556885 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f376403b8b0 0x7f376403dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:38.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3775ffb640 1 -- 172.21.15.70:0/376556885 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f377c04f4b0 con 0x7f378012f8b0 2024-09-14T10:48:38.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.624+0000 7f3784a64640 1 --2- 172.21.15.70:0/376556885 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f376403b8b0 0x7f376403dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:38.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.628+0000 7f3784a64640 1 --2- 172.21.15.70:0/376556885 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f376403b8b0 0x7f376403dd70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f37700ad000 tx=0x7f3770008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:38.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.628+0000 7f3775ffb640 1 -- 172.21.15.70:0/376556885 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f377c0102e0 con 0x7f378012f8b0 2024-09-14T10:48:38.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.796+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3780071630 con 0x7f376403b8b0 2024-09-14T10:48:38.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.828+0000 7f3775ffb640 1 -- 172.21.15.70:0/376556885 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664681 (secure 0 0 0) 0x7f3780071630 con 0x7f376403b8b0 2024-09-14T10:48:38.824 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:48:38.833 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:48:38.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f376403b8b0 msgr2=0x7f376403dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:38.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 --2- 172.21.15.70:0/376556885 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f376403b8b0 0x7f376403dd70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f37700ad000 tx=0x7f3770008040 comp rx=0 tx=0).stop 2024-09-14T10:48:38.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f378012f8b0 msgr2=0x7f378012b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:38.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 --2- 172.21.15.70:0/376556885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f378012f8b0 0x7f378012b5a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c430 tx=0x7f377c00c8f0 comp rx=0 tx=0).stop 2024-09-14T10:48:38.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 shutdown_connections 2024-09-14T10:48:38.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 --2- 172.21.15.70:0/376556885 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f376403b8b0 0x7f376403dd70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:38.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 --2- 172.21.15.70:0/376556885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f378012f8b0 0x7f378012b5a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:38.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 >> 172.21.15.70:0/376556885 conn(0x7f37800a2520 msgr2=0x7f378006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:48:38.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 shutdown_connections 2024-09-14T10:48:38.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:38.836+0000 7f37874c9640 1 -- 172.21.15.70:0/376556885 wait complete. 2024-09-14T10:48:38.850 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-14T10:48:37.490708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5157,"num_read_kb":4699,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4638,"ondisk_log_size":4638,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148448,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338912,"statfs":{"total":386547056640,"available":386395045888,"internally_reserved":0,"allocated":2981888,"data_stored":1786956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007492"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.798951+0000","last_change":"2024-09-14T10:48:10.798810+0000","last_active":"2024-09-14T10:48:10.798951+0000","last_peered":"2024-09-14T10:48:10.798951+0000","last_clean":"2024-09-14T10:48:10.798951+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:48:10.798951+0000","last_undegraded":"2024-09-14T10:48:10.798951+0000","last_fullsized":"2024-09-14T10:48:10.798951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.798632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:20.160081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.490121+0000","last_change":"2024-09-14T10:48:29.490121+0000","last_active":"2024-09-14T10:48:29.490121+0000","last_peered":"2024-09-14T10:48:29.490121+0000","last_clean":"2024-09-14T10:48:29.490121+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:48:29.490121+0000","last_undegraded":"2024-09-14T10:48:29.490121+0000","last_fullsized":"2024-09-14T10:48:29.490121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:29.489905+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:29.489905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.489905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:03.916811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.492325+0000","last_change":"2024-09-14T10:48:10.492066+0000","last_active":"2024-09-14T10:48:10.492325+0000","last_peered":"2024-09-14T10:48:10.492325+0000","last_clean":"2024-09-14T10:48:10.492325+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:48:10.492325+0000","last_undegraded":"2024-09-14T10:48:10.492325+0000","last_fullsized":"2024-09-14T10:48:10.492325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.491821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:30.410764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.720464+0000","last_change":"2024-09-14T10:44:07.311706+0000","last_active":"2024-09-14T10:47:21.720464+0000","last_peered":"2024-09-14T10:47:21.720464+0000","last_clean":"2024-09-14T10:47:21.720464+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:47:21.720464+0000","last_undegraded":"2024-09-14T10:47:21.720464+0000","last_fullsized":"2024-09-14T10:47:21.720464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:27.522929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.891397+0000","last_change":"2024-09-14T10:48:25.891397+0000","last_active":"2024-09-14T10:48:25.891397+0000","last_peered":"2024-09-14T10:48:25.891397+0000","last_clean":"2024-09-14T10:48:25.891397+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:48:25.891397+0000","last_undegraded":"2024-09-14T10:48:25.891397+0000","last_fullsized":"2024-09-14T10:48:25.891397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:25.891164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:25.891164+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.891164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:32.955966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.879810+0000","last_change":"2024-09-14T10:44:07.311756+0000","last_active":"2024-09-14T10:47:21.879810+0000","last_peered":"2024-09-14T10:47:21.879810+0000","last_clean":"2024-09-14T10:47:21.879810+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:47:21.879810+0000","last_undegraded":"2024-09-14T10:47:21.879810+0000","last_fullsized":"2024-09-14T10:47:21.879810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.801154+0000","last_change":"2024-09-14T10:48:13.801154+0000","last_active":"2024-09-14T10:48:13.801154+0000","last_peered":"2024-09-14T10:48:13.801154+0000","last_clean":"2024-09-14T10:48:13.801154+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:48:13.801154+0000","last_undegraded":"2024-09-14T10:48:13.801154+0000","last_fullsized":"2024-09-14T10:48:13.801154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.800954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:10.498468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.600024+0000","last_change":"2024-09-14T10:44:07.312388+0000","last_active":"2024-09-14T10:45:35.600024+0000","last_peered":"2024-09-14T10:45:35.600024+0000","last_clean":"2024-09-14T10:45:35.600024+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:45:35.600024+0000","last_undegraded":"2024-09-14T10:45:35.600024+0000","last_fullsized":"2024-09-14T10:45:35.600024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:31.070464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.884659+0000","last_change":"2024-09-14T10:48:21.884659+0000","last_active":"2024-09-14T10:48:21.884659+0000","last_peered":"2024-09-14T10:48:21.884659+0000","last_clean":"2024-09-14T10:48:21.884659+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:48:21.884659+0000","last_undegraded":"2024-09-14T10:48:21.884659+0000","last_fullsized":"2024-09-14T10:48:21.884659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:21.884467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:21.884467+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.884467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:25.811308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.474754+0000","last_change":"2024-09-14T10:48:30.474754+0000","last_active":"2024-09-14T10:48:30.474754+0000","last_peered":"2024-09-14T10:48:30.474754+0000","last_clean":"2024-09-14T10:48:30.474754+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:48:30.474754+0000","last_undegraded":"2024-09-14T10:48:30.474754+0000","last_fullsized":"2024-09-14T10:48:30.474754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:30.474471+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:30.474471+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.474471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:13.709808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.752350+0000","last_change":"2024-09-14T10:48:09.752350+0000","last_active":"2024-09-14T10:48:09.752350+0000","last_peered":"2024-09-14T10:48:09.752350+0000","last_clean":"2024-09-14T10:48:09.752350+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:48:09.752350+0000","last_undegraded":"2024-09-14T10:48:09.752350+0000","last_fullsized":"2024-09-14T10:48:09.752350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.752173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:57.545208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.713985+0000","last_change":"2024-09-14T10:48:22.713985+0000","last_active":"2024-09-14T10:48:22.713985+0000","last_peered":"2024-09-14T10:48:22.713985+0000","last_clean":"2024-09-14T10:48:22.713985+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:48:22.713985+0000","last_undegraded":"2024-09-14T10:48:22.713985+0000","last_fullsized":"2024-09-14T10:48:22.713985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:22.713714+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:22.713714+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.713714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:32.805970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.887921+0000","last_change":"2024-09-14T10:48:22.887921+0000","last_active":"2024-09-14T10:48:22.887921+0000","last_peered":"2024-09-14T10:48:22.887921+0000","last_clean":"2024-09-14T10:48:22.887921+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:48:22.887921+0000","last_undegraded":"2024-09-14T10:48:22.887921+0000","last_fullsized":"2024-09-14T10:48:22.887921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:22.887731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:22.887731+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.887731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.608934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.690389+0000","last_change":"2024-09-14T10:48:23.690389+0000","last_active":"2024-09-14T10:48:23.690389+0000","last_peered":"2024-09-14T10:48:23.690389+0000","last_clean":"2024-09-14T10:48:23.690389+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:48:23.690389+0000","last_undegraded":"2024-09-14T10:48:23.690389+0000","last_fullsized":"2024-09-14T10:48:23.690389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:23.690127+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:23.690127+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.690127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:31.933431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.503799+0000","last_change":"2024-09-14T10:48:09.503799+0000","last_active":"2024-09-14T10:48:09.503799+0000","last_peered":"2024-09-14T10:48:09.503799+0000","last_clean":"2024-09-14T10:48:09.503799+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:48:09.503799+0000","last_undegraded":"2024-09-14T10:48:09.503799+0000","last_fullsized":"2024-09-14T10:48:09.503799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.503614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:43.187650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.653888+0000","last_change":"2024-09-14T10:48:24.653888+0000","last_active":"2024-09-14T10:48:24.653888+0000","last_peered":"2024-09-14T10:48:24.653888+0000","last_clean":"2024-09-14T10:48:24.653888+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:48:24.653888+0000","last_undegraded":"2024-09-14T10:48:24.653888+0000","last_fullsized":"2024-09-14T10:48:24.653888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:24.653671+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:24.653671+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.653671+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:36.631176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.872805+0000","last_change":"2024-09-14T10:44:07.313852+0000","last_active":"2024-09-14T10:45:35.872805+0000","last_peered":"2024-09-14T10:45:35.872805+0000","last_clean":"2024-09-14T10:45:35.872805+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:45:35.872805+0000","last_undegraded":"2024-09-14T10:45:35.872805+0000","last_fullsized":"2024-09-14T10:45:35.872805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:54.012187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.434015+0000","last_change":"2024-09-14T10:48:10.434015+0000","last_active":"2024-09-14T10:48:10.434015+0000","last_peered":"2024-09-14T10:48:10.434015+0000","last_clean":"2024-09-14T10:48:10.434015+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:48:10.434015+0000","last_undegraded":"2024-09-14T10:48:10.434015+0000","last_fullsized":"2024-09-14T10:48:10.434015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.433796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:25.542559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.442195+0000","last_change":"2024-09-14T10:48:25.442195+0000","last_active":"2024-09-14T10:48:25.442195+0000","last_peered":"2024-09-14T10:48:25.442195+0000","last_clean":"2024-09-14T10:48:25.442195+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:48:25.442195+0000","last_undegraded":"2024-09-14T10:48:25.442195+0000","last_fullsized":"2024-09-14T10:48:25.442195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:25.442006+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:25.442006+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.442006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:27.650647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.731550+0000","last_change":"2024-09-14T10:48:08.731550+0000","last_active":"2024-09-14T10:48:08.731550+0000","last_peered":"2024-09-14T10:48:08.731550+0000","last_clean":"2024-09-14T10:48:08.731550+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:48:08.731550+0000","last_undegraded":"2024-09-14T10:48:08.731550+0000","last_fullsized":"2024-09-14T10:48:08.731550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.731374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:25.870502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.521815+0000","last_change":"2024-09-14T10:48:28.521815+0000","last_active":"2024-09-14T10:48:28.521815+0000","last_peered":"2024-09-14T10:48:28.521815+0000","last_clean":"2024-09-14T10:48:28.521815+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:48:28.521815+0000","last_undegraded":"2024-09-14T10:48:28.521815+0000","last_fullsized":"2024-09-14T10:48:28.521815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:28.521636+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:28.521636+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.521636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:47.105831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.413034+0000","last_change":"2024-09-14T10:48:09.413034+0000","last_active":"2024-09-14T10:48:09.413034+0000","last_peered":"2024-09-14T10:48:09.413034+0000","last_clean":"2024-09-14T10:48:09.413034+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:48:09.413034+0000","last_undegraded":"2024-09-14T10:48:09.413034+0000","last_fullsized":"2024-09-14T10:48:09.413034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.412833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:35.318942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.597380+0000","last_change":"2024-09-14T10:48:28.597380+0000","last_active":"2024-09-14T10:48:28.597380+0000","last_peered":"2024-09-14T10:48:28.597380+0000","last_clean":"2024-09-14T10:48:28.597380+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:48:28.597380+0000","last_undegraded":"2024-09-14T10:48:28.597380+0000","last_fullsized":"2024-09-14T10:48:28.597380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:28.597180+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:28.597180+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.597180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:04.719964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.345264+0000","last_change":"2024-09-14T10:48:07.345264+0000","last_active":"2024-09-14T10:48:07.345264+0000","last_peered":"2024-09-14T10:48:07.345264+0000","last_clean":"2024-09-14T10:48:07.345264+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:48:07.345264+0000","last_undegraded":"2024-09-14T10:48:07.345264+0000","last_fullsized":"2024-09-14T10:48:07.345264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.345074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.041740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.761411+0000","last_change":"2024-09-14T10:48:21.761411+0000","last_active":"2024-09-14T10:48:21.761411+0000","last_peered":"2024-09-14T10:48:21.761411+0000","last_clean":"2024-09-14T10:48:21.761411+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:48:21.761411+0000","last_undegraded":"2024-09-14T10:48:21.761411+0000","last_fullsized":"2024-09-14T10:48:21.761411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:21.761222+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:21.761222+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.761222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:14.714371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.537992+0000","last_change":"2024-09-14T10:48:11.537992+0000","last_active":"2024-09-14T10:48:11.537992+0000","last_peered":"2024-09-14T10:48:11.537992+0000","last_clean":"2024-09-14T10:48:11.537992+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:48:11.537992+0000","last_undegraded":"2024-09-14T10:48:11.537992+0000","last_fullsized":"2024-09-14T10:48:11.537992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.537799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:49.788688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.458972+0000","last_change":"2024-09-14T10:48:26.458972+0000","last_active":"2024-09-14T10:48:26.458972+0000","last_peered":"2024-09-14T10:48:26.458972+0000","last_clean":"2024-09-14T10:48:26.458972+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:48:26.458972+0000","last_undegraded":"2024-09-14T10:48:26.458972+0000","last_fullsized":"2024-09-14T10:48:26.458972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:26.458789+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:26.458789+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.458789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:37.373380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.835752+0000","last_change":"2024-09-14T10:48:20.835752+0000","last_active":"2024-09-14T10:48:20.835752+0000","last_peered":"2024-09-14T10:48:20.835752+0000","last_clean":"2024-09-14T10:48:20.835752+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:48:20.835752+0000","last_undegraded":"2024-09-14T10:48:20.835752+0000","last_fullsized":"2024-09-14T10:48:20.835752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:20.835574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:20.835574+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.835574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:37.288457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891282+0000","last_change":"2024-09-14T10:44:15.384222+0000","last_active":"2024-09-14T10:47:21.891282+0000","last_peered":"2024-09-14T10:47:21.891282+0000","last_clean":"2024-09-14T10:47:21.891282+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:47:21.891282+0000","last_undegraded":"2024-09-14T10:47:21.891282+0000","last_fullsized":"2024-09-14T10:47:21.891282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:52.493514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.868270+0000","last_change":"2024-09-14T10:48:31.868270+0000","last_active":"2024-09-14T10:48:31.868270+0000","last_peered":"2024-09-14T10:48:31.868270+0000","last_clean":"2024-09-14T10:48:31.868270+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:48:31.868270+0000","last_undegraded":"2024-09-14T10:48:31.868270+0000","last_fullsized":"2024-09-14T10:48:31.868270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:31.868080+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:31.868080+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.868080+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:24.962231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.016248+0000","last_change":"2024-09-14T10:48:11.016248+0000","last_active":"2024-09-14T10:48:11.016248+0000","last_peered":"2024-09-14T10:48:11.016248+0000","last_clean":"2024-09-14T10:48:11.016248+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:48:11.016248+0000","last_undegraded":"2024-09-14T10:48:11.016248+0000","last_fullsized":"2024-09-14T10:48:11.016248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.016029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.143146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.456793+0000","last_change":"2024-09-14T10:44:09.339751+0000","last_active":"2024-09-14T10:44:44.456793+0000","last_peered":"2024-09-14T10:44:44.456793+0000","last_clean":"2024-09-14T10:44:44.456793+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:44:44.456793+0000","last_undegraded":"2024-09-14T10:44:44.456793+0000","last_fullsized":"2024-09-14T10:44:44.456793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:31.250869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.068511+0000","last_change":"2024-09-14T10:44:11.366230+0000","last_active":"2024-09-14T10:47:53.068511+0000","last_peered":"2024-09-14T10:47:53.068511+0000","last_clean":"2024-09-14T10:47:53.068511+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:47:53.068511+0000","last_undegraded":"2024-09-14T10:47:53.068511+0000","last_fullsized":"2024-09-14T10:47:53.068511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.446129+0000","last_change":"2024-09-14T10:44:13.370430+0000","last_active":"2024-09-14T10:44:44.446129+0000","last_peered":"2024-09-14T10:44:44.446129+0000","last_clean":"2024-09-14T10:44:44.446129+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:44:44.446129+0000","last_undegraded":"2024-09-14T10:44:44.446129+0000","last_fullsized":"2024-09-14T10:44:44.446129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.607941+0000","last_change":"2024-09-14T10:44:15.377551+0000","last_active":"2024-09-14T10:45:35.607941+0000","last_peered":"2024-09-14T10:45:35.607941+0000","last_clean":"2024-09-14T10:45:35.607941+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:45:35.607941+0000","last_undegraded":"2024-09-14T10:45:35.607941+0000","last_fullsized":"2024-09-14T10:45:35.607941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:02.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.826539+0000","last_change":"2024-09-14T10:48:32.826539+0000","last_active":"2024-09-14T10:48:32.826539+0000","last_peered":"2024-09-14T10:48:32.826539+0000","last_clean":"2024-09-14T10:48:32.826539+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:48:32.826539+0000","last_undegraded":"2024-09-14T10:48:32.826539+0000","last_fullsized":"2024-09-14T10:48:32.826539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-14T10:48:32.826333+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-14T10:48:32.826333+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.826333+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:05.422320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.605793+0000","last_change":"2024-09-14T10:48:01.605793+0000","last_active":"2024-09-14T10:48:01.605793+0000","last_peered":"2024-09-14T10:48:01.605793+0000","last_clean":"2024-09-14T10:48:01.605793+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:48:01.605793+0000","last_undegraded":"2024-09-14T10:48:01.605793+0000","last_fullsized":"2024-09-14T10:48:01.605793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.605543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:33.748359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.619763+0000","last_change":"2024-09-14T10:48:33.619763+0000","last_active":"2024-09-14T10:48:33.619763+0000","last_peered":"2024-09-14T10:48:33.619763+0000","last_clean":"2024-09-14T10:48:33.619763+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:48:33.619763+0000","last_undegraded":"2024-09-14T10:48:33.619763+0000","last_fullsized":"2024-09-14T10:48:33.619763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:33.619581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:33.619581+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.619581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.570850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444934+0000","last_change":"2024-09-14T10:44:11.327271+0000","last_active":"2024-09-14T10:44:44.444934+0000","last_peered":"2024-09-14T10:44:44.444934+0000","last_clean":"2024-09-14T10:44:44.444934+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:44:44.444934+0000","last_undegraded":"2024-09-14T10:44:44.444934+0000","last_fullsized":"2024-09-14T10:44:44.444934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:09.449635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444347+0000","last_change":"2024-09-14T10:44:13.360104+0000","last_active":"2024-09-14T10:44:44.444347+0000","last_peered":"2024-09-14T10:44:44.444347+0000","last_clean":"2024-09-14T10:44:44.444347+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:44:44.444347+0000","last_undegraded":"2024-09-14T10:44:44.444347+0000","last_fullsized":"2024-09-14T10:44:44.444347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.636795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438541+0000","last_change":"2024-09-14T10:44:15.385641+0000","last_active":"2024-09-14T10:44:44.438541+0000","last_peered":"2024-09-14T10:44:44.438541+0000","last_clean":"2024-09-14T10:44:44.438541+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:44:44.438541+0000","last_undegraded":"2024-09-14T10:44:44.438541+0000","last_fullsized":"2024-09-14T10:44:44.438541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.801688+0000","last_change":"2024-09-14T10:48:33.801688+0000","last_active":"2024-09-14T10:48:33.801688+0000","last_peered":"2024-09-14T10:48:33.801688+0000","last_clean":"2024-09-14T10:48:33.801688+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:48:33.801688+0000","last_undegraded":"2024-09-14T10:48:33.801688+0000","last_fullsized":"2024-09-14T10:48:33.801688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-14T10:48:33.801495+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-14T10:48:33.801495+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.801495+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:25.809741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.984385+0000","last_change":"2024-09-14T10:48:09.984385+0000","last_active":"2024-09-14T10:48:09.984385+0000","last_peered":"2024-09-14T10:48:09.984385+0000","last_clean":"2024-09-14T10:48:09.984385+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:48:09.984385+0000","last_undegraded":"2024-09-14T10:48:09.984385+0000","last_fullsized":"2024-09-14T10:48:09.984385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.984177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:13.140019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.606320+0000","last_change":"2024-09-14T10:48:27.606320+0000","last_active":"2024-09-14T10:48:27.606320+0000","last_peered":"2024-09-14T10:48:27.606320+0000","last_clean":"2024-09-14T10:48:27.606320+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:48:27.606320+0000","last_undegraded":"2024-09-14T10:48:27.606320+0000","last_fullsized":"2024-09-14T10:48:27.606320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:27.606121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:27.606121+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.606121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.007371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.437130+0000","last_change":"2024-09-14T10:44:11.355262+0000","last_active":"2024-09-14T10:44:44.437130+0000","last_peered":"2024-09-14T10:44:44.437130+0000","last_clean":"2024-09-14T10:44:44.437130+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:44:44.437130+0000","last_undegraded":"2024-09-14T10:44:44.437130+0000","last_fullsized":"2024-09-14T10:44:44.437130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:55.694768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.880932+0000","last_change":"2024-09-14T10:44:13.370887+0000","last_active":"2024-09-14T10:47:52.880932+0000","last_peered":"2024-09-14T10:47:52.880932+0000","last_clean":"2024-09-14T10:47:52.880932+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:47:52.880932+0000","last_undegraded":"2024-09-14T10:47:52.880932+0000","last_fullsized":"2024-09-14T10:47:52.880932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.433906+0000","last_change":"2024-09-14T10:44:15.393155+0000","last_active":"2024-09-14T10:44:44.433906+0000","last_peered":"2024-09-14T10:44:44.433906+0000","last_clean":"2024-09-14T10:44:44.433906+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:44:44.433906+0000","last_undegraded":"2024-09-14T10:44:44.433906+0000","last_fullsized":"2024-09-14T10:44:44.433906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:01.351429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.635473+0000","last_change":"2024-09-14T10:48:15.635473+0000","last_active":"2024-09-14T10:48:15.635473+0000","last_peered":"2024-09-14T10:48:15.635473+0000","last_clean":"2024-09-14T10:48:15.635473+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:48:15.635473+0000","last_undegraded":"2024-09-14T10:48:15.635473+0000","last_fullsized":"2024-09-14T10:48:15.635473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.635292+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:37.356846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.255546+0000","last_change":"2024-09-14T10:47:59.255546+0000","last_active":"2024-09-14T10:47:59.255546+0000","last_peered":"2024-09-14T10:47:59.255546+0000","last_clean":"2024-09-14T10:47:59.255546+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:47:59.255546+0000","last_undegraded":"2024-09-14T10:47:59.255546+0000","last_fullsized":"2024-09-14T10:47:59.255546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.255367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.490294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455297+0000","last_change":"2024-09-14T10:44:09.341355+0000","last_active":"2024-09-14T10:44:44.455297+0000","last_peered":"2024-09-14T10:44:44.455297+0000","last_clean":"2024-09-14T10:44:44.455297+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:44:44.455297+0000","last_undegraded":"2024-09-14T10:44:44.455297+0000","last_fullsized":"2024-09-14T10:44:44.455297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:06.338264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.034915+0000","last_change":"2024-09-14T10:44:11.349869+0000","last_active":"2024-09-14T10:47:53.034915+0000","last_peered":"2024-09-14T10:47:53.034915+0000","last_clean":"2024-09-14T10:47:53.034915+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:47:53.034915+0000","last_undegraded":"2024-09-14T10:47:53.034915+0000","last_fullsized":"2024-09-14T10:47:53.034915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.892718+0000","last_change":"2024-09-14T10:44:13.359625+0000","last_active":"2024-09-14T10:47:52.892718+0000","last_peered":"2024-09-14T10:47:52.892718+0000","last_clean":"2024-09-14T10:47:52.892718+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:47:52.892718+0000","last_undegraded":"2024-09-14T10:47:52.892718+0000","last_fullsized":"2024-09-14T10:47:52.892718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:47.749074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.881054+0000","last_change":"2024-09-14T10:48:27.880910+0000","last_active":"2024-09-14T10:48:27.881054+0000","last_peered":"2024-09-14T10:48:27.881054+0000","last_clean":"2024-09-14T10:48:27.881054+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:48:27.881054+0000","last_undegraded":"2024-09-14T10:48:27.881054+0000","last_fullsized":"2024-09-14T10:48:27.881054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:27.880708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:27.880708+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.880708+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:31.359099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.552491+0000","last_change":"2024-09-14T10:48:03.552213+0000","last_active":"2024-09-14T10:48:03.552491+0000","last_peered":"2024-09-14T10:48:03.552491+0000","last_clean":"2024-09-14T10:48:03.552491+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:48:03.552491+0000","last_undegraded":"2024-09-14T10:48:03.552491+0000","last_fullsized":"2024-09-14T10:48:03.552491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.551983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.648129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.489804+0000","last_change":"2024-09-14T10:48:32.489804+0000","last_active":"2024-09-14T10:48:32.489804+0000","last_peered":"2024-09-14T10:48:32.489804+0000","last_clean":"2024-09-14T10:48:32.489804+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:48:32.489804+0000","last_undegraded":"2024-09-14T10:48:32.489804+0000","last_fullsized":"2024-09-14T10:48:32.489804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:32.489524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:32.489524+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.489524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:13.102091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.485022+0000","last_change":"2024-09-14T10:48:34.485022+0000","last_active":"2024-09-14T10:48:34.485022+0000","last_peered":"2024-09-14T10:48:34.485022+0000","last_clean":"2024-09-14T10:48:34.485022+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:48:34.485022+0000","last_undegraded":"2024-09-14T10:48:34.485022+0000","last_fullsized":"2024-09-14T10:48:34.485022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-14T10:48:34.484782+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-14T10:48:34.484782+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.484782+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:29.171627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441567+0000","last_change":"2024-09-14T10:44:13.359612+0000","last_active":"2024-09-14T10:44:44.441567+0000","last_peered":"2024-09-14T10:44:44.441567+0000","last_clean":"2024-09-14T10:44:44.441567+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:44:44.441567+0000","last_undegraded":"2024-09-14T10:44:44.441567+0000","last_fullsized":"2024-09-14T10:44:44.441567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:40.424615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.444208+0000","last_change":"2024-09-14T10:44:15.384957+0000","last_active":"2024-09-14T10:46:20.444208+0000","last_peered":"2024-09-14T10:46:20.444208+0000","last_clean":"2024-09-14T10:46:20.444208+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:46:20.444208+0000","last_undegraded":"2024-09-14T10:46:20.444208+0000","last_fullsized":"2024-09-14T10:46:20.444208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.497753+0000","last_change":"2024-09-14T10:48:14.497618+0000","last_active":"2024-09-14T10:48:14.497753+0000","last_peered":"2024-09-14T10:48:14.497753+0000","last_clean":"2024-09-14T10:48:14.497753+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:48:14.497753+0000","last_undegraded":"2024-09-14T10:48:14.497753+0000","last_fullsized":"2024-09-14T10:48:14.497753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:14.497416+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:14.497416+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.497416+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:54.322425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.618993+0000","last_change":"2024-09-14T10:47:59.618709+0000","last_active":"2024-09-14T10:47:59.618993+0000","last_peered":"2024-09-14T10:47:59.618993+0000","last_clean":"2024-09-14T10:47:59.618993+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:59.618993+0000","last_undegraded":"2024-09-14T10:47:59.618993+0000","last_fullsized":"2024-09-14T10:47:59.618993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.618492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:36.397328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.600141+0000","last_change":"2024-09-14T10:48:26.599902+0000","last_active":"2024-09-14T10:48:26.600141+0000","last_peered":"2024-09-14T10:48:26.600141+0000","last_clean":"2024-09-14T10:48:26.600141+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:48:26.600141+0000","last_undegraded":"2024-09-14T10:48:26.600141+0000","last_fullsized":"2024-09-14T10:48:26.600141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:26.599635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:26.599635+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.599635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:39.190465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.974322+0000","last_change":"2024-09-14T10:44:11.361862+0000","last_active":"2024-09-14T10:47:52.974322+0000","last_peered":"2024-09-14T10:47:52.974322+0000","last_clean":"2024-09-14T10:47:52.974322+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:47:52.974322+0000","last_undegraded":"2024-09-14T10:47:52.974322+0000","last_fullsized":"2024-09-14T10:47:52.974322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:38.109362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:22.442134+0000","last_change":"2024-09-14T10:44:13.371521+0000","last_active":"2024-09-14T10:46:22.442134+0000","last_peered":"2024-09-14T10:46:22.442134+0000","last_clean":"2024-09-14T10:46:22.442134+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:46:22.442134+0000","last_undegraded":"2024-09-14T10:46:22.442134+0000","last_fullsized":"2024-09-14T10:46:22.442134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.441560+0000","last_change":"2024-09-14T10:44:15.387133+0000","last_active":"2024-09-14T10:46:19.441560+0000","last_peered":"2024-09-14T10:46:19.441560+0000","last_clean":"2024-09-14T10:46:19.441560+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:46:19.441560+0000","last_undegraded":"2024-09-14T10:46:19.441560+0000","last_fullsized":"2024-09-14T10:46:19.441560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.831292+0000","last_change":"2024-09-14T10:48:12.831150+0000","last_active":"2024-09-14T10:48:12.831292+0000","last_peered":"2024-09-14T10:48:12.831292+0000","last_clean":"2024-09-14T10:48:12.831292+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:48:12.831292+0000","last_undegraded":"2024-09-14T10:48:12.831292+0000","last_fullsized":"2024-09-14T10:48:12.831292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.830946+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:42.495812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.990560+0000","last_change":"2024-09-14T10:48:08.990298+0000","last_active":"2024-09-14T10:48:08.990560+0000","last_peered":"2024-09-14T10:48:08.990560+0000","last_clean":"2024-09-14T10:48:08.990560+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:48:08.990560+0000","last_undegraded":"2024-09-14T10:48:08.990560+0000","last_fullsized":"2024-09-14T10:48:08.990560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.990075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:54.174799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.571660+0000","last_change":"2024-09-14T10:48:25.571660+0000","last_active":"2024-09-14T10:48:25.571660+0000","last_peered":"2024-09-14T10:48:25.571660+0000","last_clean":"2024-09-14T10:48:25.571660+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:48:25.571660+0000","last_undegraded":"2024-09-14T10:48:25.571660+0000","last_fullsized":"2024-09-14T10:48:25.571660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:25.571436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:25.571436+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.571436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:36.486026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'41","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.109551+0000","last_change":"2024-09-14T10:44:11.356327+0000","last_active":"2024-09-14T10:47:53.109551+0000","last_peered":"2024-09-14T10:47:53.109551+0000","last_clean":"2024-09-14T10:47:53.109551+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:47:53.109551+0000","last_undegraded":"2024-09-14T10:47:53.109551+0000","last_fullsized":"2024-09-14T10:47:53.109551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.218892+0000","last_change":"2024-09-14T10:44:13.372565+0000","last_active":"2024-09-14T10:47:53.218892+0000","last_peered":"2024-09-14T10:47:53.218892+0000","last_clean":"2024-09-14T10:47:53.218892+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:47:53.218892+0000","last_undegraded":"2024-09-14T10:47:53.218892+0000","last_fullsized":"2024-09-14T10:47:53.218892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:27.443375+0000","last_change":"2024-09-14T10:44:15.386780+0000","last_active":"2024-09-14T10:46:27.443375+0000","last_peered":"2024-09-14T10:46:27.443375+0000","last_clean":"2024-09-14T10:46:27.443375+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:46:27.443375+0000","last_undegraded":"2024-09-14T10:46:27.443375+0000","last_fullsized":"2024-09-14T10:46:27.443375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.781725+0000","last_change":"2024-09-14T10:48:14.781725+0000","last_active":"2024-09-14T10:48:14.781725+0000","last_peered":"2024-09-14T10:48:14.781725+0000","last_clean":"2024-09-14T10:48:14.781725+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:48:14.781725+0000","last_undegraded":"2024-09-14T10:48:14.781725+0000","last_fullsized":"2024-09-14T10:48:14.781725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.781515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:43.801565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.031970+0000","last_change":"2024-09-14T10:48:08.031832+0000","last_active":"2024-09-14T10:48:08.031970+0000","last_peered":"2024-09-14T10:48:08.031970+0000","last_clean":"2024-09-14T10:48:08.031970+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:48:08.031970+0000","last_undegraded":"2024-09-14T10:48:08.031970+0000","last_fullsized":"2024-09-14T10:48:08.031970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.031656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:31.479586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.600776+0000","last_change":"2024-09-14T10:48:24.600606+0000","last_active":"2024-09-14T10:48:24.600776+0000","last_peered":"2024-09-14T10:48:24.600776+0000","last_clean":"2024-09-14T10:48:24.600776+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:48:24.600776+0000","last_undegraded":"2024-09-14T10:48:24.600776+0000","last_fullsized":"2024-09-14T10:48:24.600776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:24.600403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:24.600403+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.600403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:26.809043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'61","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.122706+0000","last_change":"2024-09-14T10:44:11.356796+0000","last_active":"2024-09-14T10:47:53.122706+0000","last_peered":"2024-09-14T10:47:53.122706+0000","last_clean":"2024-09-14T10:47:53.122706+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:47:53.122706+0000","last_undegraded":"2024-09-14T10:47:53.122706+0000","last_fullsized":"2024-09-14T10:47:53.122706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:22.441975+0000","last_change":"2024-09-14T10:44:13.361258+0000","last_active":"2024-09-14T10:46:22.441975+0000","last_peered":"2024-09-14T10:46:22.441975+0000","last_clean":"2024-09-14T10:46:22.441975+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:46:22.441975+0000","last_undegraded":"2024-09-14T10:46:22.441975+0000","last_fullsized":"2024-09-14T10:46:22.441975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.060805+0000","last_change":"2024-09-14T10:44:15.362513+0000","last_active":"2024-09-14T10:47:22.060805+0000","last_peered":"2024-09-14T10:47:22.060805+0000","last_clean":"2024-09-14T10:47:22.060805+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:47:22.060805+0000","last_undegraded":"2024-09-14T10:47:22.060805+0000","last_fullsized":"2024-09-14T10:47:22.060805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.499703+0000","last_change":"2024-09-14T10:48:13.499703+0000","last_active":"2024-09-14T10:48:13.499703+0000","last_peered":"2024-09-14T10:48:13.499703+0000","last_clean":"2024-09-14T10:48:13.499703+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:48:13.499703+0000","last_undegraded":"2024-09-14T10:48:13.499703+0000","last_fullsized":"2024-09-14T10:48:13.499703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.499518+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:35.604108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.461131+0000","last_change":"2024-09-14T10:48:02.460875+0000","last_active":"2024-09-14T10:48:02.461131+0000","last_peered":"2024-09-14T10:48:02.461131+0000","last_clean":"2024-09-14T10:48:02.461131+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:48:02.461131+0000","last_undegraded":"2024-09-14T10:48:02.461131+0000","last_fullsized":"2024-09-14T10:48:02.461131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.460647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:07.647413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.607156+0000","last_change":"2024-09-14T10:48:27.607156+0000","last_active":"2024-09-14T10:48:27.607156+0000","last_peered":"2024-09-14T10:48:27.607156+0000","last_clean":"2024-09-14T10:48:27.607156+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:48:27.607156+0000","last_undegraded":"2024-09-14T10:48:27.607156+0000","last_fullsized":"2024-09-14T10:48:27.607156+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:27.606970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:27.606970+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.606970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:41.101194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.995447+0000","last_change":"2024-09-14T10:44:11.337843+0000","last_active":"2024-09-14T10:47:52.995447+0000","last_peered":"2024-09-14T10:47:52.995447+0000","last_clean":"2024-09-14T10:47:52.995447+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:47:52.995447+0000","last_undegraded":"2024-09-14T10:47:52.995447+0000","last_fullsized":"2024-09-14T10:47:52.995447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:07.030831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.460124+0000","last_change":"2024-09-14T10:44:13.368817+0000","last_active":"2024-09-14T10:44:44.460124+0000","last_peered":"2024-09-14T10:44:44.460124+0000","last_clean":"2024-09-14T10:44:44.460124+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:44:44.460124+0000","last_undegraded":"2024-09-14T10:44:44.460124+0000","last_fullsized":"2024-09-14T10:44:44.460124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:51.609983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.995889+0000","last_change":"2024-09-14T10:44:15.388555+0000","last_active":"2024-09-14T10:47:21.995889+0000","last_peered":"2024-09-14T10:47:21.995889+0000","last_clean":"2024-09-14T10:47:21.995889+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:47:21.995889+0000","last_undegraded":"2024-09-14T10:47:21.995889+0000","last_fullsized":"2024-09-14T10:47:21.995889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.862407+0000","last_change":"2024-09-14T10:48:29.862407+0000","last_active":"2024-09-14T10:48:29.862407+0000","last_peered":"2024-09-14T10:48:29.862407+0000","last_clean":"2024-09-14T10:48:29.862407+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:48:29.862407+0000","last_undegraded":"2024-09-14T10:48:29.862407+0000","last_fullsized":"2024-09-14T10:48:29.862407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:29.862217+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:29.862217+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.862217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:24.391104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.079073+0000","last_change":"2024-09-14T10:48:07.078927+0000","last_active":"2024-09-14T10:48:07.079073+0000","last_peered":"2024-09-14T10:48:07.079073+0000","last_clean":"2024-09-14T10:48:07.079073+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:48:07.079073+0000","last_undegraded":"2024-09-14T10:48:07.079073+0000","last_fullsized":"2024-09-14T10:48:07.079073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.078726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.976365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.657101+0000","last_change":"2024-09-14T10:48:30.657101+0000","last_active":"2024-09-14T10:48:30.657101+0000","last_peered":"2024-09-14T10:48:30.657101+0000","last_clean":"2024-09-14T10:48:30.657101+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:48:30.657101+0000","last_undegraded":"2024-09-14T10:48:30.657101+0000","last_fullsized":"2024-09-14T10:48:30.657101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:30.656887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:30.656887+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.656887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:28.780823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.472601+0000","last_change":"2024-09-14T10:48:35.472601+0000","last_active":"2024-09-14T10:48:35.472601+0000","last_peered":"2024-09-14T10:48:35.472601+0000","last_clean":"2024-09-14T10:48:35.472601+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:48:35.472601+0000","last_undegraded":"2024-09-14T10:48:35.472601+0000","last_fullsized":"2024-09-14T10:48:35.472601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:48:35.472394+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:48:35.472394+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.472394+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.251475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.881845+0000","last_change":"2024-09-14T10:44:13.364819+0000","last_active":"2024-09-14T10:47:52.881845+0000","last_peered":"2024-09-14T10:47:52.881845+0000","last_clean":"2024-09-14T10:47:52.881845+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:47:52.881845+0000","last_undegraded":"2024-09-14T10:47:52.881845+0000","last_fullsized":"2024-09-14T10:47:52.881845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:29.703105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.003711+0000","last_change":"2024-09-14T10:44:15.389692+0000","last_active":"2024-09-14T10:47:22.003711+0000","last_peered":"2024-09-14T10:47:22.003711+0000","last_clean":"2024-09-14T10:47:22.003711+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:47:22.003711+0000","last_undegraded":"2024-09-14T10:47:22.003711+0000","last_fullsized":"2024-09-14T10:47:22.003711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.779894+0000","last_change":"2024-09-14T10:48:15.779894+0000","last_active":"2024-09-14T10:48:15.779894+0000","last_peered":"2024-09-14T10:48:15.779894+0000","last_clean":"2024-09-14T10:48:15.779894+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:48:15.779894+0000","last_undegraded":"2024-09-14T10:48:15.779894+0000","last_fullsized":"2024-09-14T10:48:15.779894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.779722+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.779722+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.779722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:54.382214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.033800+0000","last_change":"2024-09-14T10:48:05.033536+0000","last_active":"2024-09-14T10:48:05.033800+0000","last_peered":"2024-09-14T10:48:05.033800+0000","last_clean":"2024-09-14T10:48:05.033800+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:48:05.033800+0000","last_undegraded":"2024-09-14T10:48:05.033800+0000","last_fullsized":"2024-09-14T10:48:05.033800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.033307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:22.683683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.532122+0000","last_change":"2024-09-14T10:48:33.532122+0000","last_active":"2024-09-14T10:48:33.532122+0000","last_peered":"2024-09-14T10:48:33.532122+0000","last_clean":"2024-09-14T10:48:33.532122+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:48:33.532122+0000","last_undegraded":"2024-09-14T10:48:33.532122+0000","last_fullsized":"2024-09-14T10:48:33.532122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:33.531807+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:33.531807+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.531807+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:30.728116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.455520+0000","last_change":"2024-09-14T10:44:11.365421+0000","last_active":"2024-09-14T10:44:44.455520+0000","last_peered":"2024-09-14T10:44:44.455520+0000","last_clean":"2024-09-14T10:44:44.455520+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:44:44.455520+0000","last_undegraded":"2024-09-14T10:44:44.455520+0000","last_fullsized":"2024-09-14T10:44:44.455520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:56.792327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":504,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.884680+0000","last_change":"2024-09-14T10:44:13.362574+0000","last_active":"2024-09-14T10:47:52.884680+0000","last_peered":"2024-09-14T10:47:52.884680+0000","last_clean":"2024-09-14T10:47:52.884680+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:47:52.884680+0000","last_undegraded":"2024-09-14T10:47:52.884680+0000","last_fullsized":"2024-09-14T10:47:52.884680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:17.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.444134+0000","last_change":"2024-09-14T10:44:15.376191+0000","last_active":"2024-09-14T10:46:20.444134+0000","last_peered":"2024-09-14T10:46:20.444134+0000","last_clean":"2024-09-14T10:46:20.444134+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:46:20.444134+0000","last_undegraded":"2024-09-14T10:46:20.444134+0000","last_fullsized":"2024-09-14T10:46:20.444134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.480619+0000","last_change":"2024-09-14T10:48:15.480619+0000","last_active":"2024-09-14T10:48:15.480619+0000","last_peered":"2024-09-14T10:48:15.480619+0000","last_clean":"2024-09-14T10:48:15.480619+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:48:15.480619+0000","last_undegraded":"2024-09-14T10:48:15.480619+0000","last_fullsized":"2024-09-14T10:48:15.480619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:15.480424+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:15.480424+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.480424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:35.371076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.058250+0000","last_change":"2024-09-14T10:48:02.058107+0000","last_active":"2024-09-14T10:48:02.058250+0000","last_peered":"2024-09-14T10:48:02.058250+0000","last_clean":"2024-09-14T10:48:02.058250+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:48:02.058250+0000","last_undegraded":"2024-09-14T10:48:02.058250+0000","last_fullsized":"2024-09-14T10:48:02.058250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.057931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:29.184273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457361+0000","last_change":"2024-09-14T10:44:09.342479+0000","last_active":"2024-09-14T10:44:44.457361+0000","last_peered":"2024-09-14T10:44:44.457361+0000","last_clean":"2024-09-14T10:44:44.457361+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:44:44.457361+0000","last_undegraded":"2024-09-14T10:44:44.457361+0000","last_fullsized":"2024-09-14T10:44:44.457361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:27.907542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'41","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.074359+0000","last_change":"2024-09-14T10:44:11.332997+0000","last_active":"2024-09-14T10:47:53.074359+0000","last_peered":"2024-09-14T10:47:53.074359+0000","last_clean":"2024-09-14T10:47:53.074359+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:47:53.074359+0000","last_undegraded":"2024-09-14T10:47:53.074359+0000","last_fullsized":"2024-09-14T10:47:53.074359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:53.814557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436642+0000","last_change":"2024-09-14T10:44:13.374235+0000","last_active":"2024-09-14T10:44:44.436642+0000","last_peered":"2024-09-14T10:44:44.436642+0000","last_clean":"2024-09-14T10:44:44.436642+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:44:44.436642+0000","last_undegraded":"2024-09-14T10:44:44.436642+0000","last_fullsized":"2024-09-14T10:44:44.436642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:45.457582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.052353+0000","last_change":"2024-09-14T10:44:15.378896+0000","last_active":"2024-09-14T10:47:22.052353+0000","last_peered":"2024-09-14T10:47:22.052353+0000","last_clean":"2024-09-14T10:47:22.052353+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:47:22.052353+0000","last_undegraded":"2024-09-14T10:47:22.052353+0000","last_fullsized":"2024-09-14T10:47:22.052353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.904259+0000","last_change":"2024-09-14T10:48:26.904259+0000","last_active":"2024-09-14T10:48:26.904259+0000","last_peered":"2024-09-14T10:48:26.904259+0000","last_clean":"2024-09-14T10:48:26.904259+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:48:26.904259+0000","last_undegraded":"2024-09-14T10:48:26.904259+0000","last_fullsized":"2024-09-14T10:48:26.904259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:26.904057+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:26.904057+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.904057+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:00.215590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.245843+0000","last_change":"2024-09-14T10:47:57.245843+0000","last_active":"2024-09-14T10:47:57.245843+0000","last_peered":"2024-09-14T10:47:57.245843+0000","last_clean":"2024-09-14T10:47:57.245843+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:47:57.245843+0000","last_undegraded":"2024-09-14T10:47:57.245843+0000","last_fullsized":"2024-09-14T10:47:57.245843+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.245648+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:34.787201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.098357+0000","last_change":"2024-09-14T10:48:00.098121+0000","last_active":"2024-09-14T10:48:00.098357+0000","last_peered":"2024-09-14T10:48:00.098357+0000","last_clean":"2024-09-14T10:48:00.098357+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:48:00.098357+0000","last_undegraded":"2024-09-14T10:48:00.098357+0000","last_fullsized":"2024-09-14T10:48:00.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.097899+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:08.489566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.044417+0000","last_change":"2024-09-14T10:48:03.044221+0000","last_active":"2024-09-14T10:48:03.044417+0000","last_peered":"2024-09-14T10:48:03.044417+0000","last_clean":"2024-09-14T10:48:03.044417+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:48:03.044417+0000","last_undegraded":"2024-09-14T10:48:03.044417+0000","last_fullsized":"2024-09-14T10:48:03.044417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.044031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.988834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.446959+0000","last_change":"2024-09-14T10:48:31.446959+0000","last_active":"2024-09-14T10:48:31.446959+0000","last_peered":"2024-09-14T10:48:31.446959+0000","last_clean":"2024-09-14T10:48:31.446959+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:48:31.446959+0000","last_undegraded":"2024-09-14T10:48:31.446959+0000","last_fullsized":"2024-09-14T10:48:31.446959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:31.446787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:31.446787+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.446787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:40.642565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'86","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.156359+0000","last_change":"2024-09-14T10:44:11.357369+0000","last_active":"2024-09-14T10:47:53.156359+0000","last_peered":"2024-09-14T10:47:53.156359+0000","last_clean":"2024-09-14T10:47:53.156359+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:47:53.156359+0000","last_undegraded":"2024-09-14T10:47:53.156359+0000","last_fullsized":"2024-09-14T10:47:53.156359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:22.442275+0000","last_change":"2024-09-14T10:44:13.372619+0000","last_active":"2024-09-14T10:46:22.442275+0000","last_peered":"2024-09-14T10:46:22.442275+0000","last_clean":"2024-09-14T10:46:22.442275+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:46:22.442275+0000","last_undegraded":"2024-09-14T10:46:22.442275+0000","last_fullsized":"2024-09-14T10:46:22.442275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.919557+0000","last_change":"2024-09-14T10:44:15.380614+0000","last_active":"2024-09-14T10:47:21.919557+0000","last_peered":"2024-09-14T10:47:21.919557+0000","last_clean":"2024-09-14T10:47:21.919557+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:47:21.919557+0000","last_undegraded":"2024-09-14T10:47:21.919557+0000","last_fullsized":"2024-09-14T10:47:21.919557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.848964+0000","last_change":"2024-09-14T10:48:28.848791+0000","last_active":"2024-09-14T10:48:28.848964+0000","last_peered":"2024-09-14T10:48:28.848964+0000","last_clean":"2024-09-14T10:48:28.848964+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:48:28.848964+0000","last_undegraded":"2024-09-14T10:48:28.848964+0000","last_fullsized":"2024-09-14T10:48:28.848964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:28.848584+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:28.848584+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.848584+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:33.208461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.110721+0000","last_change":"2024-09-14T10:47:59.110585+0000","last_active":"2024-09-14T10:47:59.110721+0000","last_peered":"2024-09-14T10:47:59.110721+0000","last_clean":"2024-09-14T10:47:59.110721+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:47:59.110721+0000","last_undegraded":"2024-09-14T10:47:59.110721+0000","last_fullsized":"2024-09-14T10:47:59.110721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.110378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.838325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.456447+0000","last_change":"2024-09-14T10:48:00.456288+0000","last_active":"2024-09-14T10:48:00.456447+0000","last_peered":"2024-09-14T10:48:00.456447+0000","last_clean":"2024-09-14T10:48:00.456447+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:48:00.456447+0000","last_undegraded":"2024-09-14T10:48:00.456447+0000","last_fullsized":"2024-09-14T10:48:00.456447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.456099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:16.850631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.443416+0000","last_change":"2024-09-14T10:44:09.341477+0000","last_active":"2024-09-14T10:46:19.443416+0000","last_peered":"2024-09-14T10:46:19.443416+0000","last_clean":"2024-09-14T10:46:19.443416+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:46:19.443416+0000","last_undegraded":"2024-09-14T10:46:19.443416+0000","last_fullsized":"2024-09-14T10:46:19.443416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'284","reported_seq":503,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.194350+0000","last_change":"2024-09-14T10:44:11.347623+0000","last_active":"2024-09-14T10:47:53.194350+0000","last_peered":"2024-09-14T10:47:53.194350+0000","last_clean":"2024-09-14T10:47:53.194350+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:47:53.194350+0000","last_undegraded":"2024-09-14T10:47:53.194350+0000","last_fullsized":"2024-09-14T10:47:53.194350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.443340+0000","last_change":"2024-09-14T10:44:13.368580+0000","last_active":"2024-09-14T10:46:19.443340+0000","last_peered":"2024-09-14T10:46:19.443340+0000","last_clean":"2024-09-14T10:46:19.443340+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:46:19.443340+0000","last_undegraded":"2024-09-14T10:46:19.443340+0000","last_fullsized":"2024-09-14T10:46:19.443340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.442429+0000","last_change":"2024-09-14T10:44:15.392131+0000","last_active":"2024-09-14T10:46:24.442429+0000","last_peered":"2024-09-14T10:46:24.442429+0000","last_clean":"2024-09-14T10:46:24.442429+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:46:24.442429+0000","last_undegraded":"2024-09-14T10:46:24.442429+0000","last_fullsized":"2024-09-14T10:46:24.442429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.567720+0000","last_change":"2024-09-14T10:48:12.567549+0000","last_active":"2024-09-14T10:48:12.567720+0000","last_peered":"2024-09-14T10:48:12.567720+0000","last_clean":"2024-09-14T10:48:12.567720+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:48:12.567720+0000","last_undegraded":"2024-09-14T10:48:12.567720+0000","last_fullsized":"2024-09-14T10:48:12.567720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.567361+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:57.983269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.581742+0000","last_change":"2024-09-14T10:47:58.581615+0000","last_active":"2024-09-14T10:47:58.581742+0000","last_peered":"2024-09-14T10:47:58.581742+0000","last_clean":"2024-09-14T10:47:58.581742+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:47:58.581742+0000","last_undegraded":"2024-09-14T10:47:58.581742+0000","last_fullsized":"2024-09-14T10:47:58.581742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.581432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:45.392307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.414030+0000","last_change":"2024-09-14T10:48:01.413761+0000","last_active":"2024-09-14T10:48:01.414030+0000","last_peered":"2024-09-14T10:48:01.414030+0000","last_clean":"2024-09-14T10:48:01.414030+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:48:01.414030+0000","last_undegraded":"2024-09-14T10:48:01.414030+0000","last_fullsized":"2024-09-14T10:48:01.414030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.413492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.502183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.642698+0000","last_change":"2024-09-14T10:48:26.642521+0000","last_active":"2024-09-14T10:48:26.642698+0000","last_peered":"2024-09-14T10:48:26.642698+0000","last_clean":"2024-09-14T10:48:26.642698+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:48:26.642698+0000","last_undegraded":"2024-09-14T10:48:26.642698+0000","last_fullsized":"2024-09-14T10:48:26.642698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:26.642330+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:26.642330+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.642330+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:19.213154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.571067+0000","last_change":"2024-09-14T10:48:32.571067+0000","last_active":"2024-09-14T10:48:32.571067+0000","last_peered":"2024-09-14T10:48:32.571067+0000","last_clean":"2024-09-14T10:48:32.571067+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:48:32.571067+0000","last_undegraded":"2024-09-14T10:48:32.571067+0000","last_fullsized":"2024-09-14T10:48:32.571067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-14T10:48:32.570846+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-14T10:48:32.570846+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.570846+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:53:30.502745+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.440935+0000","last_change":"2024-09-14T10:44:13.372401+0000","last_active":"2024-09-14T10:46:17.440935+0000","last_peered":"2024-09-14T10:46:17.440935+0000","last_clean":"2024-09-14T10:46:17.440935+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:46:17.440935+0000","last_undegraded":"2024-09-14T10:46:17.440935+0000","last_fullsized":"2024-09-14T10:46:17.440935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451974+0000","last_change":"2024-09-14T10:44:15.379368+0000","last_active":"2024-09-14T10:44:44.451974+0000","last_peered":"2024-09-14T10:44:44.451974+0000","last_clean":"2024-09-14T10:44:44.451974+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:44:44.451974+0000","last_undegraded":"2024-09-14T10:44:44.451974+0000","last_fullsized":"2024-09-14T10:44:44.451974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:11.053978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.613733+0000","last_change":"2024-09-14T10:48:13.613570+0000","last_active":"2024-09-14T10:48:13.613733+0000","last_peered":"2024-09-14T10:48:13.613733+0000","last_clean":"2024-09-14T10:48:13.613733+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:48:13.613733+0000","last_undegraded":"2024-09-14T10:48:13.613733+0000","last_fullsized":"2024-09-14T10:48:13.613733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.613391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:50.163937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.149492+0000","last_change":"2024-09-14T10:47:58.149312+0000","last_active":"2024-09-14T10:47:58.149492+0000","last_peered":"2024-09-14T10:47:58.149492+0000","last_clean":"2024-09-14T10:47:58.149492+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:47:58.149492+0000","last_undegraded":"2024-09-14T10:47:58.149492+0000","last_fullsized":"2024-09-14T10:47:58.149492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.149127+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:37.977768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.572653+0000","last_change":"2024-09-14T10:48:00.572497+0000","last_active":"2024-09-14T10:48:00.572653+0000","last_peered":"2024-09-14T10:48:00.572653+0000","last_clean":"2024-09-14T10:48:00.572653+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:48:00.572653+0000","last_undegraded":"2024-09-14T10:48:00.572653+0000","last_fullsized":"2024-09-14T10:48:00.572653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.572309+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:24.566081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.559461+0000","last_change":"2024-09-14T10:48:23.559461+0000","last_active":"2024-09-14T10:48:23.559461+0000","last_peered":"2024-09-14T10:48:23.559461+0000","last_clean":"2024-09-14T10:48:23.559461+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:48:23.559461+0000","last_undegraded":"2024-09-14T10:48:23.559461+0000","last_fullsized":"2024-09-14T10:48:23.559461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:23.559204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:23.559204+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.559204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:28.629556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.750405+0000","last_change":"2024-09-14T10:44:11.362466+0000","last_active":"2024-09-14T10:47:20.750405+0000","last_peered":"2024-09-14T10:47:20.750405+0000","last_clean":"2024-09-14T10:47:20.750405+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:47:20.750405+0000","last_undegraded":"2024-09-14T10:47:20.750405+0000","last_fullsized":"2024-09-14T10:47:20.750405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444779+0000","last_change":"2024-09-14T10:44:13.368952+0000","last_active":"2024-09-14T10:46:24.444779+0000","last_peered":"2024-09-14T10:46:24.444779+0000","last_clean":"2024-09-14T10:46:24.444779+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:46:24.444779+0000","last_undegraded":"2024-09-14T10:46:24.444779+0000","last_fullsized":"2024-09-14T10:46:24.444779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.540734+0000","last_change":"2024-09-14T10:44:15.382665+0000","last_active":"2024-09-14T10:47:21.540734+0000","last_peered":"2024-09-14T10:47:21.540734+0000","last_clean":"2024-09-14T10:47:21.540734+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:47:21.540734+0000","last_undegraded":"2024-09-14T10:47:21.540734+0000","last_fullsized":"2024-09-14T10:47:21.540734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.468843+0000","last_change":"2024-09-14T10:48:11.468705+0000","last_active":"2024-09-14T10:48:11.468843+0000","last_peered":"2024-09-14T10:48:11.468843+0000","last_clean":"2024-09-14T10:48:11.468843+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:48:11.468843+0000","last_undegraded":"2024-09-14T10:48:11.468843+0000","last_fullsized":"2024-09-14T10:48:11.468843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.468533+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:45.152569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.623568+0000","last_change":"2024-09-14T10:47:57.623416+0000","last_active":"2024-09-14T10:47:57.623568+0000","last_peered":"2024-09-14T10:47:57.623568+0000","last_clean":"2024-09-14T10:47:57.623568+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:47:57.623568+0000","last_undegraded":"2024-09-14T10:47:57.623568+0000","last_fullsized":"2024-09-14T10:47:57.623568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.623229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:32.565978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.487932+0000","last_change":"2024-09-14T10:47:57.487828+0000","last_active":"2024-09-14T10:47:57.487932+0000","last_peered":"2024-09-14T10:47:57.487932+0000","last_clean":"2024-09-14T10:47:57.487932+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:47:57.487932+0000","last_undegraded":"2024-09-14T10:47:57.487932+0000","last_fullsized":"2024-09-14T10:47:57.487932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.487712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:43.722639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.624110+0000","last_change":"2024-09-14T10:48:25.624110+0000","last_active":"2024-09-14T10:48:25.624110+0000","last_peered":"2024-09-14T10:48:25.624110+0000","last_clean":"2024-09-14T10:48:25.624110+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:48:25.624110+0000","last_undegraded":"2024-09-14T10:48:25.624110+0000","last_fullsized":"2024-09-14T10:48:25.624110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:25.623922+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:25.623922+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.623922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:39.508678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'77","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.611378+0000","last_change":"2024-09-14T10:48:32.611378+0000","last_active":"2024-09-14T10:48:32.611378+0000","last_peered":"2024-09-14T10:48:32.611378+0000","last_clean":"2024-09-14T10:48:32.611378+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:48:32.611378+0000","last_undegraded":"2024-09-14T10:48:32.611378+0000","last_fullsized":"2024-09-14T10:48:32.611378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-09-14T10:48:32.611179+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-09-14T10:48:32.611179+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.611179+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.807488+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.443988+0000","last_change":"2024-09-14T10:44:13.362954+0000","last_active":"2024-09-14T10:46:20.443988+0000","last_peered":"2024-09-14T10:46:20.443988+0000","last_clean":"2024-09-14T10:46:20.443988+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:46:20.443988+0000","last_undegraded":"2024-09-14T10:46:20.443988+0000","last_fullsized":"2024-09-14T10:46:20.443988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.551637+0000","last_change":"2024-09-14T10:44:15.380020+0000","last_active":"2024-09-14T10:46:20.551637+0000","last_peered":"2024-09-14T10:46:20.551637+0000","last_clean":"2024-09-14T10:46:20.551637+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:46:20.551637+0000","last_undegraded":"2024-09-14T10:46:20.551637+0000","last_fullsized":"2024-09-14T10:46:20.551637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:17.206749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.481717+0000","last_change":"2024-09-14T10:48:12.481545+0000","last_active":"2024-09-14T10:48:12.481717+0000","last_peered":"2024-09-14T10:48:12.481717+0000","last_clean":"2024-09-14T10:48:12.481717+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:48:12.481717+0000","last_undegraded":"2024-09-14T10:48:12.481717+0000","last_fullsized":"2024-09-14T10:48:12.481717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.481368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.388398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.477560+0000","last_change":"2024-09-14T10:47:58.477358+0000","last_active":"2024-09-14T10:47:58.477560+0000","last_peered":"2024-09-14T10:47:58.477560+0000","last_clean":"2024-09-14T10:47:58.477560+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:58.477560+0000","last_undegraded":"2024-09-14T10:47:58.477560+0000","last_fullsized":"2024-09-14T10:47:58.477560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.477145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.383210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.998360+0000","last_change":"2024-09-14T10:48:03.998223+0000","last_active":"2024-09-14T10:48:03.998360+0000","last_peered":"2024-09-14T10:48:03.998360+0000","last_clean":"2024-09-14T10:48:03.998360+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:48:03.998360+0000","last_undegraded":"2024-09-14T10:48:03.998360+0000","last_fullsized":"2024-09-14T10:48:03.998360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.998046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.536432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.442362+0000","last_change":"2024-09-14T10:44:09.332697+0000","last_active":"2024-09-14T10:46:14.442362+0000","last_peered":"2024-09-14T10:46:14.442362+0000","last_clean":"2024-09-14T10:46:14.442362+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:46:14.442362+0000","last_undegraded":"2024-09-14T10:46:14.442362+0000","last_fullsized":"2024-09-14T10:46:14.442362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.441457+0000","last_change":"2024-09-14T10:44:11.338828+0000","last_active":"2024-09-14T10:46:19.441457+0000","last_peered":"2024-09-14T10:46:19.441457+0000","last_clean":"2024-09-14T10:46:19.441457+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:46:19.441457+0000","last_undegraded":"2024-09-14T10:46:19.441457+0000","last_fullsized":"2024-09-14T10:46:19.441457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.199526+0000","last_change":"2024-09-14T10:44:13.353577+0000","last_active":"2024-09-14T10:47:53.199526+0000","last_peered":"2024-09-14T10:47:53.199526+0000","last_clean":"2024-09-14T10:47:53.199526+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:47:53.199526+0000","last_undegraded":"2024-09-14T10:47:53.199526+0000","last_fullsized":"2024-09-14T10:47:53.199526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.459796+0000","last_change":"2024-09-14T10:44:15.371433+0000","last_active":"2024-09-14T10:44:44.459796+0000","last_peered":"2024-09-14T10:44:44.459796+0000","last_clean":"2024-09-14T10:44:44.459796+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:44:44.459796+0000","last_undegraded":"2024-09-14T10:44:44.459796+0000","last_fullsized":"2024-09-14T10:44:44.459796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:12.672256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.929810+0000","last_change":"2024-09-14T10:48:24.929810+0000","last_active":"2024-09-14T10:48:24.929810+0000","last_peered":"2024-09-14T10:48:24.929810+0000","last_clean":"2024-09-14T10:48:24.929810+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:48:24.929810+0000","last_undegraded":"2024-09-14T10:48:24.929810+0000","last_fullsized":"2024-09-14T10:48:24.929810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:24.929616+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:24.929616+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.929616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:39.211133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.041432+0000","last_change":"2024-09-14T10:48:06.041282+0000","last_active":"2024-09-14T10:48:06.041432+0000","last_peered":"2024-09-14T10:48:06.041432+0000","last_clean":"2024-09-14T10:48:06.041432+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:48:06.041432+0000","last_undegraded":"2024-09-14T10:48:06.041432+0000","last_fullsized":"2024-09-14T10:48:06.041432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.041120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:55.979958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:56.524180+0000","last_change":"2024-09-14T10:47:56.524057+0000","last_active":"2024-09-14T10:47:56.524180+0000","last_peered":"2024-09-14T10:47:56.524180+0000","last_clean":"2024-09-14T10:47:56.524180+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:47:56.524180+0000","last_undegraded":"2024-09-14T10:47:56.524180+0000","last_fullsized":"2024-09-14T10:47:56.524180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_clean_scrub_stamp":"2024-09-14T10:47:56.523860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:01.837471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:14.442294+0000","last_change":"2024-09-14T10:44:09.334472+0000","last_active":"2024-09-14T10:46:14.442294+0000","last_peered":"2024-09-14T10:46:14.442294+0000","last_clean":"2024-09-14T10:46:14.442294+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:46:14.442294+0000","last_undegraded":"2024-09-14T10:46:14.442294+0000","last_fullsized":"2024-09-14T10:46:14.442294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.443272+0000","last_change":"2024-09-14T10:44:11.360311+0000","last_active":"2024-09-14T10:46:19.443272+0000","last_peered":"2024-09-14T10:46:19.443272+0000","last_clean":"2024-09-14T10:46:19.443272+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:46:19.443272+0000","last_undegraded":"2024-09-14T10:46:19.443272+0000","last_fullsized":"2024-09-14T10:46:19.443272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":423,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.212622+0000","last_change":"2024-09-14T10:44:13.349515+0000","last_active":"2024-09-14T10:47:53.212622+0000","last_peered":"2024-09-14T10:47:53.212622+0000","last_clean":"2024-09-14T10:47:53.212622+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:47:53.212622+0000","last_undegraded":"2024-09-14T10:47:53.212622+0000","last_fullsized":"2024-09-14T10:47:53.212622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.867987+0000","last_change":"2024-09-14T10:44:15.380474+0000","last_active":"2024-09-14T10:45:35.867987+0000","last_peered":"2024-09-14T10:45:35.867987+0000","last_clean":"2024-09-14T10:45:35.867987+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:45:35.867987+0000","last_undegraded":"2024-09-14T10:45:35.867987+0000","last_fullsized":"2024-09-14T10:45:35.867987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:15.535271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.839501+0000","last_change":"2024-09-14T10:48:11.839361+0000","last_active":"2024-09-14T10:48:11.839501+0000","last_peered":"2024-09-14T10:48:11.839501+0000","last_clean":"2024-09-14T10:48:11.839501+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:48:11.839501+0000","last_undegraded":"2024-09-14T10:48:11.839501+0000","last_fullsized":"2024-09-14T10:48:11.839501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.839181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:55.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.217592+0000","last_change":"2024-09-14T10:47:58.217454+0000","last_active":"2024-09-14T10:47:58.217592+0000","last_peered":"2024-09-14T10:47:58.217592+0000","last_clean":"2024-09-14T10:47:58.217592+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:47:58.217592+0000","last_undegraded":"2024-09-14T10:47:58.217592+0000","last_fullsized":"2024-09-14T10:47:58.217592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.217266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:03.530877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.067246+0000","last_change":"2024-09-14T10:48:01.067081+0000","last_active":"2024-09-14T10:48:01.067246+0000","last_peered":"2024-09-14T10:48:01.067246+0000","last_clean":"2024-09-14T10:48:01.067246+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:48:01.067246+0000","last_undegraded":"2024-09-14T10:48:01.067246+0000","last_fullsized":"2024-09-14T10:48:01.067246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.066905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:15.602397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:09.440990+0000","last_change":"2024-09-14T10:44:09.335319+0000","last_active":"2024-09-14T10:46:09.440990+0000","last_peered":"2024-09-14T10:46:09.440990+0000","last_clean":"2024-09-14T10:46:09.440990+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:46:09.440990+0000","last_undegraded":"2024-09-14T10:46:09.440990+0000","last_fullsized":"2024-09-14T10:46:09.440990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'100","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.534479+0000","last_change":"2024-09-14T10:48:33.534479+0000","last_active":"2024-09-14T10:48:33.534479+0000","last_peered":"2024-09-14T10:48:33.534479+0000","last_clean":"2024-09-14T10:48:33.534479+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:48:33.534479+0000","last_undegraded":"2024-09-14T10:48:33.534479+0000","last_fullsized":"2024-09-14T10:48:33.534479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'100","last_scrub_stamp":"2024-09-14T10:48:33.534256+0000","last_deep_scrub":"34'100","last_deep_scrub_stamp":"2024-09-14T10:48:33.534256+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.534256+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:30.978930+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.440819+0000","last_change":"2024-09-14T10:44:13.361050+0000","last_active":"2024-09-14T10:46:17.440819+0000","last_peered":"2024-09-14T10:46:17.440819+0000","last_clean":"2024-09-14T10:46:17.440819+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:46:17.440819+0000","last_undegraded":"2024-09-14T10:46:17.440819+0000","last_fullsized":"2024-09-14T10:46:17.440819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.597367+0000","last_change":"2024-09-14T10:44:15.376175+0000","last_active":"2024-09-14T10:44:52.597367+0000","last_peered":"2024-09-14T10:44:52.597367+0000","last_clean":"2024-09-14T10:44:52.597367+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:44:52.597367+0000","last_undegraded":"2024-09-14T10:44:52.597367+0000","last_fullsized":"2024-09-14T10:44:52.597367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.409508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:22.072621+0000","last_change":"2024-09-14T10:44:15.381865+0000","last_active":"2024-09-14T10:47:22.072621+0000","last_peered":"2024-09-14T10:47:22.072621+0000","last_clean":"2024-09-14T10:47:22.072621+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:47:22.072621+0000","last_undegraded":"2024-09-14T10:47:22.072621+0000","last_fullsized":"2024-09-14T10:47:22.072621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.748979+0000","last_change":"2024-09-14T10:48:16.748979+0000","last_active":"2024-09-14T10:48:16.748979+0000","last_peered":"2024-09-14T10:48:16.748979+0000","last_clean":"2024-09-14T10:48:16.748979+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:48:16.748979+0000","last_undegraded":"2024-09-14T10:48:16.748979+0000","last_fullsized":"2024-09-14T10:48:16.748979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:16.748707+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:16.748707+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.748707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:29.127800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.979725+0000","last_change":"2024-09-14T10:48:11.979725+0000","last_active":"2024-09-14T10:48:11.979725+0000","last_peered":"2024-09-14T10:48:11.979725+0000","last_clean":"2024-09-14T10:48:11.979725+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:48:11.979725+0000","last_undegraded":"2024-09-14T10:48:11.979725+0000","last_fullsized":"2024-09-14T10:48:11.979725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.979551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:25.927244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445718+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:44:44.445718+0000","last_peered":"2024-09-14T10:44:44.445718+0000","last_clean":"2024-09-14T10:44:44.445718+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:44:44.445718+0000","last_undegraded":"2024-09-14T10:44:44.445718+0000","last_fullsized":"2024-09-14T10:44:44.445718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:02.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.100532+0000","last_change":"2024-09-14T10:44:11.356682+0000","last_active":"2024-09-14T10:47:53.100532+0000","last_peered":"2024-09-14T10:47:53.100532+0000","last_clean":"2024-09-14T10:47:53.100532+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:47:53.100532+0000","last_undegraded":"2024-09-14T10:47:53.100532+0000","last_fullsized":"2024-09-14T10:47:53.100532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:36.580622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442491+0000","last_change":"2024-09-14T10:44:13.370490+0000","last_active":"2024-09-14T10:44:44.442491+0000","last_peered":"2024-09-14T10:44:44.442491+0000","last_clean":"2024-09-14T10:44:44.442491+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:44:44.442491+0000","last_undegraded":"2024-09-14T10:44:44.442491+0000","last_fullsized":"2024-09-14T10:44:44.442491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:34.252881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.287971+0000","last_change":"2024-09-14T10:44:15.361905+0000","last_active":"2024-09-14T10:46:18.287971+0000","last_peered":"2024-09-14T10:46:18.287971+0000","last_clean":"2024-09-14T10:46:18.287971+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:46:18.287971+0000","last_undegraded":"2024-09-14T10:46:18.287971+0000","last_fullsized":"2024-09-14T10:46:18.287971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.470720+0000","last_change":"2024-09-14T10:48:16.470720+0000","last_active":"2024-09-14T10:48:16.470720+0000","last_peered":"2024-09-14T10:48:16.470720+0000","last_clean":"2024-09-14T10:48:16.470720+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:48:16.470720+0000","last_undegraded":"2024-09-14T10:48:16.470720+0000","last_fullsized":"2024-09-14T10:48:16.470720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:16.470534+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:16.470534+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.470534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:20.092198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.594367+0000","last_change":"2024-09-14T10:48:02.594367+0000","last_active":"2024-09-14T10:48:02.594367+0000","last_peered":"2024-09-14T10:48:02.594367+0000","last_clean":"2024-09-14T10:48:02.594367+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:48:02.594367+0000","last_undegraded":"2024-09-14T10:48:02.594367+0000","last_fullsized":"2024-09-14T10:48:02.594367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.594183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.132926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.464537+0000","last_change":"2024-09-14T10:44:44.463214+0000","last_active":"2024-09-14T10:44:44.464537+0000","last_peered":"2024-09-14T10:44:44.464537+0000","last_clean":"2024-09-14T10:44:44.464537+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:44:44.464537+0000","last_undegraded":"2024-09-14T10:44:44.464537+0000","last_fullsized":"2024-09-14T10:44:44.464537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:34.009805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.610413+0000","last_change":"2024-09-14T10:48:34.610413+0000","last_active":"2024-09-14T10:48:34.610413+0000","last_peered":"2024-09-14T10:48:34.610413+0000","last_clean":"2024-09-14T10:48:34.610413+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:48:34.610413+0000","last_undegraded":"2024-09-14T10:48:34.610413+0000","last_fullsized":"2024-09-14T10:48:34.610413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:34.610221+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:34.610221+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.610221+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:42.868537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434000+0000","last_change":"2024-09-14T10:44:13.371900+0000","last_active":"2024-09-14T10:44:44.434000+0000","last_peered":"2024-09-14T10:44:44.434000+0000","last_clean":"2024-09-14T10:44:44.434000+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:44:44.434000+0000","last_undegraded":"2024-09-14T10:44:44.434000+0000","last_fullsized":"2024-09-14T10:44:44.434000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:29.727463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440980+0000","last_change":"2024-09-14T10:44:15.386483+0000","last_active":"2024-09-14T10:44:44.440980+0000","last_peered":"2024-09-14T10:44:44.440980+0000","last_clean":"2024-09-14T10:44:44.440980+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:44:44.440980+0000","last_undegraded":"2024-09-14T10:44:44.440980+0000","last_fullsized":"2024-09-14T10:44:44.440980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.723831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.626010+0000","last_change":"2024-09-14T10:48:14.626010+0000","last_active":"2024-09-14T10:48:14.626010+0000","last_peered":"2024-09-14T10:48:14.626010+0000","last_clean":"2024-09-14T10:48:14.626010+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:48:14.626010+0000","last_undegraded":"2024-09-14T10:48:14.626010+0000","last_fullsized":"2024-09-14T10:48:14.626010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.625832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:18.247497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.596063+0000","last_change":"2024-09-14T10:48:04.596063+0000","last_active":"2024-09-14T10:48:04.596063+0000","last_peered":"2024-09-14T10:48:04.596063+0000","last_clean":"2024-09-14T10:48:04.596063+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:48:04.596063+0000","last_undegraded":"2024-09-14T10:48:04.596063+0000","last_fullsized":"2024-09-14T10:48:04.596063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.595874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:58.777417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.558189+0000","last_change":"2024-09-14T10:48:28.558189+0000","last_active":"2024-09-14T10:48:28.558189+0000","last_peered":"2024-09-14T10:48:28.558189+0000","last_clean":"2024-09-14T10:48:28.558189+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:48:28.558189+0000","last_undegraded":"2024-09-14T10:48:28.558189+0000","last_fullsized":"2024-09-14T10:48:28.558189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:28.558009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:28.558009+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.558009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:34.621600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.611887+0000","last_change":"2024-09-14T10:48:36.611887+0000","last_active":"2024-09-14T10:48:36.611887+0000","last_peered":"2024-09-14T10:48:36.611887+0000","last_clean":"2024-09-14T10:48:36.611887+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:48:36.611887+0000","last_undegraded":"2024-09-14T10:48:36.611887+0000","last_fullsized":"2024-09-14T10:48:36.611887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-14T10:48:36.611684+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-14T10:48:36.611684+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.611684+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:12.339630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.444917+0000","last_change":"2024-09-14T10:44:13.354345+0000","last_active":"2024-09-14T10:44:44.444917+0000","last_peered":"2024-09-14T10:44:44.444917+0000","last_clean":"2024-09-14T10:44:44.444917+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:44:44.444917+0000","last_undegraded":"2024-09-14T10:44:44.444917+0000","last_fullsized":"2024-09-14T10:44:44.444917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451891+0000","last_change":"2024-09-14T10:44:15.378526+0000","last_active":"2024-09-14T10:44:44.451891+0000","last_peered":"2024-09-14T10:44:44.451891+0000","last_clean":"2024-09-14T10:44:44.451891+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:44:44.451891+0000","last_undegraded":"2024-09-14T10:44:44.451891+0000","last_fullsized":"2024-09-14T10:44:44.451891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:34.239574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.902377+0000","last_change":"2024-09-14T10:48:30.902377+0000","last_active":"2024-09-14T10:48:30.902377+0000","last_peered":"2024-09-14T10:48:30.902377+0000","last_clean":"2024-09-14T10:48:30.902377+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:48:30.902377+0000","last_undegraded":"2024-09-14T10:48:30.902377+0000","last_fullsized":"2024-09-14T10:48:30.902377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:30.902193+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:30.902193+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.902193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:41.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.280211+0000","last_change":"2024-09-14T10:48:00.280211+0000","last_active":"2024-09-14T10:48:00.280211+0000","last_peered":"2024-09-14T10:48:00.280211+0000","last_clean":"2024-09-14T10:48:00.280211+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:48:00.280211+0000","last_undegraded":"2024-09-14T10:48:00.280211+0000","last_fullsized":"2024-09-14T10:48:00.280211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.280016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:02.623876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.442567+0000","last_change":"2024-09-14T10:44:09.338478+0000","last_active":"2024-09-14T10:44:44.442567+0000","last_peered":"2024-09-14T10:44:44.442567+0000","last_clean":"2024-09-14T10:44:44.442567+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:44:44.442567+0000","last_undegraded":"2024-09-14T10:44:44.442567+0000","last_fullsized":"2024-09-14T10:44:44.442567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:42.543570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.010478+0000","last_change":"2024-09-14T10:44:11.321761+0000","last_active":"2024-09-14T10:47:53.010478+0000","last_peered":"2024-09-14T10:47:53.010478+0000","last_clean":"2024-09-14T10:47:53.010478+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:47:53.010478+0000","last_undegraded":"2024-09-14T10:47:53.010478+0000","last_fullsized":"2024-09-14T10:47:53.010478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:39.326575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.434240+0000","last_change":"2024-09-14T10:44:13.356507+0000","last_active":"2024-09-14T10:44:44.434240+0000","last_peered":"2024-09-14T10:44:44.434240+0000","last_clean":"2024-09-14T10:44:44.434240+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:44:44.434240+0000","last_undegraded":"2024-09-14T10:44:44.434240+0000","last_fullsized":"2024-09-14T10:44:44.434240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.825429+0000","last_change":"2024-09-14T10:44:07.313195+0000","last_active":"2024-09-14T10:47:21.825429+0000","last_peered":"2024-09-14T10:47:21.825429+0000","last_clean":"2024-09-14T10:47:21.825429+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:47:21.825429+0000","last_undegraded":"2024-09-14T10:47:21.825429+0000","last_fullsized":"2024-09-14T10:47:21.825429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.008639+0000","last_change":"2024-09-14T10:48:13.008639+0000","last_active":"2024-09-14T10:48:13.008639+0000","last_peered":"2024-09-14T10:48:13.008639+0000","last_clean":"2024-09-14T10:48:13.008639+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:48:13.008639+0000","last_undegraded":"2024-09-14T10:48:13.008639+0000","last_fullsized":"2024-09-14T10:48:13.008639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.008350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:31.362974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.630021+0000","last_change":"2024-09-14T10:48:29.630021+0000","last_active":"2024-09-14T10:48:29.630021+0000","last_peered":"2024-09-14T10:48:29.630021+0000","last_clean":"2024-09-14T10:48:29.630021+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:48:29.630021+0000","last_undegraded":"2024-09-14T10:48:29.630021+0000","last_fullsized":"2024-09-14T10:48:29.630021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:29.629844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:29.629844+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.629844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:51.400468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.149219+0000","last_change":"2024-09-14T10:44:11.340857+0000","last_active":"2024-09-14T10:47:53.149219+0000","last_peered":"2024-09-14T10:47:53.149219+0000","last_clean":"2024-09-14T10:47:53.149219+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:47:53.149219+0000","last_undegraded":"2024-09-14T10:47:53.149219+0000","last_fullsized":"2024-09-14T10:47:53.149219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:58.117101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436429+0000","last_change":"2024-09-14T10:44:13.356783+0000","last_active":"2024-09-14T10:44:44.436429+0000","last_peered":"2024-09-14T10:44:44.436429+0000","last_clean":"2024-09-14T10:44:44.436429+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:44:44.436429+0000","last_undegraded":"2024-09-14T10:44:44.436429+0000","last_fullsized":"2024-09-14T10:44:44.436429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:57.886038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.426338+0000","last_change":"2024-09-14T10:44:15.390085+0000","last_active":"2024-09-14T10:47:21.426338+0000","last_peered":"2024-09-14T10:47:21.426338+0000","last_clean":"2024-09-14T10:47:21.426338+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:47:21.426338+0000","last_undegraded":"2024-09-14T10:47:21.426338+0000","last_fullsized":"2024-09-14T10:47:21.426338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:09.836232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.496839+0000","last_change":"2024-09-14T10:48:19.496839+0000","last_active":"2024-09-14T10:48:19.496839+0000","last_peered":"2024-09-14T10:48:19.496839+0000","last_clean":"2024-09-14T10:48:19.496839+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:48:19.496839+0000","last_undegraded":"2024-09-14T10:48:19.496839+0000","last_fullsized":"2024-09-14T10:48:19.496839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:19.496651+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:19.496651+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.496651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:16.610106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.271045+0000","last_change":"2024-09-14T10:48:01.271045+0000","last_active":"2024-09-14T10:48:01.271045+0000","last_peered":"2024-09-14T10:48:01.271045+0000","last_clean":"2024-09-14T10:48:01.271045+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:48:01.271045+0000","last_undegraded":"2024-09-14T10:48:01.271045+0000","last_fullsized":"2024-09-14T10:48:01.271045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.270861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:42.910644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.522928+0000","last_change":"2024-09-14T10:48:30.522928+0000","last_active":"2024-09-14T10:48:30.522928+0000","last_peered":"2024-09-14T10:48:30.522928+0000","last_clean":"2024-09-14T10:48:30.522928+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:48:30.522928+0000","last_undegraded":"2024-09-14T10:48:30.522928+0000","last_fullsized":"2024-09-14T10:48:30.522928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:30.522747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:30.522747+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.522747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.439750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.016361+0000","last_change":"2024-09-14T10:44:11.359808+0000","last_active":"2024-09-14T10:47:53.016361+0000","last_peered":"2024-09-14T10:47:53.016361+0000","last_clean":"2024-09-14T10:47:53.016361+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:47:53.016361+0000","last_undegraded":"2024-09-14T10:47:53.016361+0000","last_fullsized":"2024-09-14T10:47:53.016361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:51.224366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.445366+0000","last_change":"2024-09-14T10:44:13.371652+0000","last_active":"2024-09-14T10:44:44.445366+0000","last_peered":"2024-09-14T10:44:44.445366+0000","last_clean":"2024-09-14T10:44:44.445366+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:44:44.445366+0000","last_undegraded":"2024-09-14T10:44:44.445366+0000","last_fullsized":"2024-09-14T10:44:44.445366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:58.091190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.450551+0000","last_change":"2024-09-14T10:44:15.379606+0000","last_active":"2024-09-14T10:44:44.450551+0000","last_peered":"2024-09-14T10:44:44.450551+0000","last_clean":"2024-09-14T10:44:44.450551+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:44:44.450551+0000","last_undegraded":"2024-09-14T10:44:44.450551+0000","last_fullsized":"2024-09-14T10:44:44.450551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:37.639739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:52.298696+0000","last_change":"2024-09-14T10:44:07.317281+0000","last_active":"2024-09-14T10:44:52.298696+0000","last_peered":"2024-09-14T10:44:52.298696+0000","last_clean":"2024-09-14T10:44:52.298696+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:44:52.298696+0000","last_undegraded":"2024-09-14T10:44:52.298696+0000","last_fullsized":"2024-09-14T10:44:52.298696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:19.569186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.292893+0000","last_change":"2024-09-14T10:48:02.292893+0000","last_active":"2024-09-14T10:48:02.292893+0000","last_peered":"2024-09-14T10:48:02.292893+0000","last_clean":"2024-09-14T10:48:02.292893+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:48:02.292893+0000","last_undegraded":"2024-09-14T10:48:02.292893+0000","last_fullsized":"2024-09-14T10:48:02.292893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.292668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:18.687200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.549300+0000","last_change":"2024-09-14T10:48:31.549300+0000","last_active":"2024-09-14T10:48:31.549300+0000","last_peered":"2024-09-14T10:48:31.549300+0000","last_clean":"2024-09-14T10:48:31.549300+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:48:31.549300+0000","last_undegraded":"2024-09-14T10:48:31.549300+0000","last_fullsized":"2024-09-14T10:48:31.549300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:31.549097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:31.549097+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.549097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:35.467929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.136678+0000","last_change":"2024-09-14T10:44:11.330416+0000","last_active":"2024-09-14T10:47:53.136678+0000","last_peered":"2024-09-14T10:47:53.136678+0000","last_clean":"2024-09-14T10:47:53.136678+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:47:53.136678+0000","last_undegraded":"2024-09-14T10:47:53.136678+0000","last_fullsized":"2024-09-14T10:47:53.136678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:12.439821+0000","last_change":"2024-09-14T10:44:13.364526+0000","last_active":"2024-09-14T10:46:12.439821+0000","last_peered":"2024-09-14T10:46:12.439821+0000","last_clean":"2024-09-14T10:46:12.439821+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:46:12.439821+0000","last_undegraded":"2024-09-14T10:46:12.439821+0000","last_fullsized":"2024-09-14T10:46:12.439821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:20.685006+0000","last_change":"2024-09-14T10:44:15.379535+0000","last_active":"2024-09-14T10:46:20.685006+0000","last_peered":"2024-09-14T10:46:20.685006+0000","last_clean":"2024-09-14T10:46:20.685006+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:46:20.685006+0000","last_undegraded":"2024-09-14T10:46:20.685006+0000","last_fullsized":"2024-09-14T10:46:20.685006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:20.408629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.588402+0000","last_change":"2024-09-14T10:48:16.588402+0000","last_active":"2024-09-14T10:48:16.588402+0000","last_peered":"2024-09-14T10:48:16.588402+0000","last_clean":"2024-09-14T10:48:16.588402+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:48:16.588402+0000","last_undegraded":"2024-09-14T10:48:16.588402+0000","last_fullsized":"2024-09-14T10:48:16.588402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.588185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:49.661160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.969100+0000","last_change":"2024-09-14T10:48:13.969100+0000","last_active":"2024-09-14T10:48:13.969100+0000","last_peered":"2024-09-14T10:48:13.969100+0000","last_clean":"2024-09-14T10:48:13.969100+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:48:13.969100+0000","last_undegraded":"2024-09-14T10:48:13.969100+0000","last_fullsized":"2024-09-14T10:48:13.969100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.968917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:56.650501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"25'1","reported_seq":221,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.841801+0000","last_change":"2024-09-14T10:44:09.313857+0000","last_active":"2024-09-14T10:47:52.841801+0000","last_peered":"2024-09-14T10:47:52.841801+0000","last_clean":"2024-09-14T10:47:52.841801+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:47:52.841801+0000","last_undegraded":"2024-09-14T10:47:52.841801+0000","last_fullsized":"2024-09-14T10:47:52.841801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:53.790922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.526716+0000","last_change":"2024-09-14T10:44:11.365067+0000","last_active":"2024-09-14T10:46:16.526716+0000","last_peered":"2024-09-14T10:46:16.526716+0000","last_clean":"2024-09-14T10:46:16.526716+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:46:16.526716+0000","last_undegraded":"2024-09-14T10:46:16.526716+0000","last_fullsized":"2024-09-14T10:46:16.526716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":372,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.196814+0000","last_change":"2024-09-14T10:44:13.372845+0000","last_active":"2024-09-14T10:47:53.196814+0000","last_peered":"2024-09-14T10:47:53.196814+0000","last_clean":"2024-09-14T10:47:53.196814+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:47:53.196814+0000","last_undegraded":"2024-09-14T10:47:53.196814+0000","last_fullsized":"2024-09-14T10:47:53.196814+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.813949+0000","last_change":"2024-09-14T10:44:15.388635+0000","last_active":"2024-09-14T10:47:21.813949+0000","last_peered":"2024-09-14T10:47:21.813949+0000","last_clean":"2024-09-14T10:47:21.813949+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:47:21.813949+0000","last_undegraded":"2024-09-14T10:47:21.813949+0000","last_fullsized":"2024-09-14T10:47:21.813949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:00.563368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.760834+0000","last_change":"2024-09-14T10:48:20.760834+0000","last_active":"2024-09-14T10:48:20.760834+0000","last_peered":"2024-09-14T10:48:20.760834+0000","last_clean":"2024-09-14T10:48:20.760834+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:48:20.760834+0000","last_undegraded":"2024-09-14T10:48:20.760834+0000","last_fullsized":"2024-09-14T10:48:20.760834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:20.760654+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:20.760654+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.760654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:00.206789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.279857+0000","last_change":"2024-09-14T10:48:03.279857+0000","last_active":"2024-09-14T10:48:03.279857+0000","last_peered":"2024-09-14T10:48:03.279857+0000","last_clean":"2024-09-14T10:48:03.279857+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:48:03.279857+0000","last_undegraded":"2024-09-14T10:48:03.279857+0000","last_fullsized":"2024-09-14T10:48:03.279857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.279672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:11.368363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'4","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.841020+0000","last_change":"2024-09-14T10:44:09.323154+0000","last_active":"2024-09-14T10:47:52.841020+0000","last_peered":"2024-09-14T10:47:52.841020+0000","last_clean":"2024-09-14T10:47:52.841020+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:47:52.841020+0000","last_undegraded":"2024-09-14T10:47:52.841020+0000","last_fullsized":"2024-09-14T10:47:52.841020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:58.082949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.178369+0000","last_change":"2024-09-14T10:44:11.327509+0000","last_active":"2024-09-14T10:47:53.178369+0000","last_peered":"2024-09-14T10:47:53.178369+0000","last_clean":"2024-09-14T10:47:53.178369+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:47:53.178369+0000","last_undegraded":"2024-09-14T10:47:53.178369+0000","last_fullsized":"2024-09-14T10:47:53.178369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.860344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.438767+0000","last_change":"2024-09-14T10:44:13.376040+0000","last_active":"2024-09-14T10:44:44.438767+0000","last_peered":"2024-09-14T10:44:44.438767+0000","last_clean":"2024-09-14T10:44:44.438767+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:44:44.438767+0000","last_undegraded":"2024-09-14T10:44:44.438767+0000","last_fullsized":"2024-09-14T10:44:44.438767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:13.299075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452541+0000","last_change":"2024-09-14T10:44:15.388404+0000","last_active":"2024-09-14T10:44:44.452541+0000","last_peered":"2024-09-14T10:44:44.452541+0000","last_clean":"2024-09-14T10:44:44.452541+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:44:44.452541+0000","last_undegraded":"2024-09-14T10:44:44.452541+0000","last_fullsized":"2024-09-14T10:44:44.452541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.765236+0000","last_change":"2024-09-14T10:48:19.765236+0000","last_active":"2024-09-14T10:48:19.765236+0000","last_peered":"2024-09-14T10:48:19.765236+0000","last_clean":"2024-09-14T10:48:19.765236+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:48:19.765236+0000","last_undegraded":"2024-09-14T10:48:19.765236+0000","last_fullsized":"2024-09-14T10:48:19.765236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:19.765058+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:19.765058+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.765058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.778145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.957292+0000","last_change":"2024-09-14T10:48:14.957292+0000","last_active":"2024-09-14T10:48:14.957292+0000","last_peered":"2024-09-14T10:48:14.957292+0000","last_clean":"2024-09-14T10:48:14.957292+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:48:14.957292+0000","last_undegraded":"2024-09-14T10:48:14.957292+0000","last_fullsized":"2024-09-14T10:48:14.957292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:14.957115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:14.957115+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.957115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.999307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.533192+0000","last_change":"2024-09-14T10:48:29.533192+0000","last_active":"2024-09-14T10:48:29.533192+0000","last_peered":"2024-09-14T10:48:29.533192+0000","last_clean":"2024-09-14T10:48:29.533192+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:48:29.533192+0000","last_undegraded":"2024-09-14T10:48:29.533192+0000","last_fullsized":"2024-09-14T10:48:29.533192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:29.532987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:29.532987+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.532987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:36.699790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.584703+0000","last_change":"2024-09-14T10:48:35.584703+0000","last_active":"2024-09-14T10:48:35.584703+0000","last_peered":"2024-09-14T10:48:35.584703+0000","last_clean":"2024-09-14T10:48:35.584703+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:48:35.584703+0000","last_undegraded":"2024-09-14T10:48:35.584703+0000","last_fullsized":"2024-09-14T10:48:35.584703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-14T10:48:35.584572+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-14T10:48:35.584572+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.584572+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:15.413214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441744+0000","last_change":"2024-09-14T10:44:13.369101+0000","last_active":"2024-09-14T10:44:44.441744+0000","last_peered":"2024-09-14T10:44:44.441744+0000","last_clean":"2024-09-14T10:44:44.441744+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:44:44.441744+0000","last_undegraded":"2024-09-14T10:44:44.441744+0000","last_fullsized":"2024-09-14T10:44:44.441744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:12.164053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457651+0000","last_change":"2024-09-14T10:44:15.386917+0000","last_active":"2024-09-14T10:44:44.457651+0000","last_peered":"2024-09-14T10:44:44.457651+0000","last_clean":"2024-09-14T10:44:44.457651+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:44:44.457651+0000","last_undegraded":"2024-09-14T10:44:44.457651+0000","last_fullsized":"2024-09-14T10:44:44.457651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:38.536486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.729791+0000","last_change":"2024-09-14T10:48:18.729791+0000","last_active":"2024-09-14T10:48:18.729791+0000","last_peered":"2024-09-14T10:48:18.729791+0000","last_clean":"2024-09-14T10:48:18.729791+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:48:18.729791+0000","last_undegraded":"2024-09-14T10:48:18.729791+0000","last_fullsized":"2024-09-14T10:48:18.729791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:18.729528+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:18.729528+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.729528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.709783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.470373+0000","last_change":"2024-09-14T10:47:59.470192+0000","last_active":"2024-09-14T10:47:59.470373+0000","last_peered":"2024-09-14T10:47:59.470373+0000","last_clean":"2024-09-14T10:47:59.470373+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:59.470373+0000","last_undegraded":"2024-09-14T10:47:59.470373+0000","last_fullsized":"2024-09-14T10:47:59.470373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.470009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:41.109792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.436523+0000","last_change":"2024-09-14T10:44:09.318111+0000","last_active":"2024-09-14T10:44:44.436523+0000","last_peered":"2024-09-14T10:44:44.436523+0000","last_clean":"2024-09-14T10:44:44.436523+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:44:44.436523+0000","last_undegraded":"2024-09-14T10:44:44.436523+0000","last_fullsized":"2024-09-14T10:44:44.436523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:12.821605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.114087+0000","last_change":"2024-09-14T10:44:11.356523+0000","last_active":"2024-09-14T10:47:53.114087+0000","last_peered":"2024-09-14T10:47:53.114087+0000","last_clean":"2024-09-14T10:47:53.114087+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:47:53.114087+0000","last_undegraded":"2024-09-14T10:47:53.114087+0000","last_fullsized":"2024-09-14T10:47:53.114087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:30.747229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451553+0000","last_change":"2024-09-14T10:44:13.367321+0000","last_active":"2024-09-14T10:44:44.451553+0000","last_peered":"2024-09-14T10:44:44.451553+0000","last_clean":"2024-09-14T10:44:44.451553+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:44:44.451553+0000","last_undegraded":"2024-09-14T10:44:44.451553+0000","last_fullsized":"2024-09-14T10:44:44.451553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:58.066611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.662711+0000","last_change":"2024-09-14T10:44:15.385986+0000","last_active":"2024-09-14T10:46:18.662711+0000","last_peered":"2024-09-14T10:46:18.662711+0000","last_clean":"2024-09-14T10:46:18.662711+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:46:18.662711+0000","last_undegraded":"2024-09-14T10:46:18.662711+0000","last_fullsized":"2024-09-14T10:46:18.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:58.059454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.723592+0000","last_change":"2024-09-14T10:48:17.723592+0000","last_active":"2024-09-14T10:48:17.723592+0000","last_peered":"2024-09-14T10:48:17.723592+0000","last_clean":"2024-09-14T10:48:17.723592+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:48:17.723592+0000","last_undegraded":"2024-09-14T10:48:17.723592+0000","last_fullsized":"2024-09-14T10:48:17.723592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:17.723405+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:17.723405+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.723405+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:16.395502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.315403+0000","last_change":"2024-09-14T10:48:04.315262+0000","last_active":"2024-09-14T10:48:04.315403+0000","last_peered":"2024-09-14T10:48:04.315403+0000","last_clean":"2024-09-14T10:48:04.315403+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:48:04.315403+0000","last_undegraded":"2024-09-14T10:48:04.315403+0000","last_fullsized":"2024-09-14T10:48:04.315403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.315084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:09.501850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:17.016574+0000","last_change":"2024-09-14T10:44:09.327924+0000","last_active":"2024-09-14T10:46:17.016574+0000","last_peered":"2024-09-14T10:46:17.016574+0000","last_clean":"2024-09-14T10:46:17.016574+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:46:17.016574+0000","last_undegraded":"2024-09-14T10:46:17.016574+0000","last_fullsized":"2024-09-14T10:46:17.016574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:08.284968+0000","last_clean_scrub_stamp":"2024-09-14T10:44:08.284968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:38.718169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.137521+0000","last_change":"2024-09-14T10:44:11.357069+0000","last_active":"2024-09-14T10:47:53.137521+0000","last_peered":"2024-09-14T10:47:53.137521+0000","last_clean":"2024-09-14T10:47:53.137521+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:47:53.137521+0000","last_undegraded":"2024-09-14T10:47:53.137521+0000","last_fullsized":"2024-09-14T10:47:53.137521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.439393+0000","last_change":"2024-09-14T10:44:13.373389+0000","last_active":"2024-09-14T10:44:44.439393+0000","last_peered":"2024-09-14T10:44:44.439393+0000","last_clean":"2024-09-14T10:44:44.439393+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:44:44.439393+0000","last_undegraded":"2024-09-14T10:44:44.439393+0000","last_fullsized":"2024-09-14T10:44:44.439393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:34.517874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:20.852899+0000","last_change":"2024-09-14T10:44:15.386649+0000","last_active":"2024-09-14T10:47:20.852899+0000","last_peered":"2024-09-14T10:47:20.852899+0000","last_clean":"2024-09-14T10:47:20.852899+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:47:20.852899+0000","last_undegraded":"2024-09-14T10:47:20.852899+0000","last_fullsized":"2024-09-14T10:47:20.852899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:48.236396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.468297+0000","last_change":"2024-09-14T10:48:19.468123+0000","last_active":"2024-09-14T10:48:19.468297+0000","last_peered":"2024-09-14T10:48:19.468297+0000","last_clean":"2024-09-14T10:48:19.468297+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:48:19.468297+0000","last_undegraded":"2024-09-14T10:48:19.468297+0000","last_fullsized":"2024-09-14T10:48:19.468297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:19.467939+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:19.467939+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.467939+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:55.076769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.685193+0000","last_change":"2024-09-14T10:48:06.684936+0000","last_active":"2024-09-14T10:48:06.685193+0000","last_peered":"2024-09-14T10:48:06.685193+0000","last_clean":"2024-09-14T10:48:06.685193+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:48:06.685193+0000","last_undegraded":"2024-09-14T10:48:06.685193+0000","last_fullsized":"2024-09-14T10:48:06.685193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.684579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:30.618905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.540206+0000","last_change":"2024-09-14T10:48:22.539962+0000","last_active":"2024-09-14T10:48:22.540206+0000","last_peered":"2024-09-14T10:48:22.540206+0000","last_clean":"2024-09-14T10:48:22.540206+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:48:22.540206+0000","last_undegraded":"2024-09-14T10:48:22.540206+0000","last_fullsized":"2024-09-14T10:48:22.540206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:22.539696+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:22.539696+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.539696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:19.296367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.500388+0000","last_change":"2024-09-14T10:48:03.500209+0000","last_active":"2024-09-14T10:48:03.500388+0000","last_peered":"2024-09-14T10:48:03.500388+0000","last_clean":"2024-09-14T10:48:03.500388+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:48:03.500388+0000","last_undegraded":"2024-09-14T10:48:03.500388+0000","last_fullsized":"2024-09-14T10:48:03.500388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.500037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:09.580224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.396874+0000","last_change":"2024-09-14T10:44:07.300105+0000","last_active":"2024-09-14T10:47:21.396874+0000","last_peered":"2024-09-14T10:47:21.396874+0000","last_clean":"2024-09-14T10:47:21.396874+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:47:21.396874+0000","last_undegraded":"2024-09-14T10:47:21.396874+0000","last_fullsized":"2024-09-14T10:47:21.396874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.948514+0000","last_change":"2024-09-14T10:48:15.948514+0000","last_active":"2024-09-14T10:48:15.948514+0000","last_peered":"2024-09-14T10:48:15.948514+0000","last_clean":"2024-09-14T10:48:15.948514+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:48:15.948514+0000","last_undegraded":"2024-09-14T10:48:15.948514+0000","last_fullsized":"2024-09-14T10:48:15.948514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:15.948330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:15.948330+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.948330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:51.612757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.620971+0000","last_change":"2024-09-14T10:48:31.620971+0000","last_active":"2024-09-14T10:48:31.620971+0000","last_peered":"2024-09-14T10:48:31.620971+0000","last_clean":"2024-09-14T10:48:31.620971+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:48:31.620971+0000","last_undegraded":"2024-09-14T10:48:31.620971+0000","last_fullsized":"2024-09-14T10:48:31.620971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-14T10:48:31.620785+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-14T10:48:31.620785+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.620785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:12.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.437129+0000","last_change":"2024-09-14T10:48:06.436938+0000","last_active":"2024-09-14T10:48:06.437129+0000","last_peered":"2024-09-14T10:48:06.437129+0000","last_clean":"2024-09-14T10:48:06.437129+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:48:06.437129+0000","last_undegraded":"2024-09-14T10:48:06.437129+0000","last_fullsized":"2024-09-14T10:48:06.437129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.436743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:28.064799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.535992+0000","last_change":"2024-09-14T10:48:18.535992+0000","last_active":"2024-09-14T10:48:18.535992+0000","last_peered":"2024-09-14T10:48:18.535992+0000","last_clean":"2024-09-14T10:48:18.535992+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:48:18.535992+0000","last_undegraded":"2024-09-14T10:48:18.535992+0000","last_fullsized":"2024-09-14T10:48:18.535992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:18.535801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:18.535801+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.535801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:37.962177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.477417+0000","last_change":"2024-09-14T10:48:07.477245+0000","last_active":"2024-09-14T10:48:07.477417+0000","last_peered":"2024-09-14T10:48:07.477417+0000","last_clean":"2024-09-14T10:48:07.477417+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:48:07.477417+0000","last_undegraded":"2024-09-14T10:48:07.477417+0000","last_fullsized":"2024-09-14T10:48:07.477417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.477054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.420346+0000","last_change":"2024-09-14T10:48:18.420100+0000","last_active":"2024-09-14T10:48:18.420346+0000","last_peered":"2024-09-14T10:48:18.420346+0000","last_clean":"2024-09-14T10:48:18.420346+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:48:18.420346+0000","last_undegraded":"2024-09-14T10:48:18.420346+0000","last_fullsized":"2024-09-14T10:48:18.420346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:18.419824+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:18.419824+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.419824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:51.492799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.344100+0000","last_change":"2024-09-14T10:48:05.343952+0000","last_active":"2024-09-14T10:48:05.344100+0000","last_peered":"2024-09-14T10:48:05.344100+0000","last_clean":"2024-09-14T10:48:05.344100+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:48:05.344100+0000","last_undegraded":"2024-09-14T10:48:05.344100+0000","last_fullsized":"2024-09-14T10:48:05.344100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.343728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:11.423916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.572507+0000","last_change":"2024-09-14T10:48:17.572507+0000","last_active":"2024-09-14T10:48:17.572507+0000","last_peered":"2024-09-14T10:48:17.572507+0000","last_clean":"2024-09-14T10:48:17.572507+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:48:17.572507+0000","last_undegraded":"2024-09-14T10:48:17.572507+0000","last_fullsized":"2024-09-14T10:48:17.572507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:17.572324+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:17.572324+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.572324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:53.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.636701+0000","last_change":"2024-09-14T10:48:05.636531+0000","last_active":"2024-09-14T10:48:05.636701+0000","last_peered":"2024-09-14T10:48:05.636701+0000","last_clean":"2024-09-14T10:48:05.636701+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:48:05.636701+0000","last_undegraded":"2024-09-14T10:48:05.636701+0000","last_fullsized":"2024-09-14T10:48:05.636701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.636345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:39.594590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.445845+0000","last_change":"2024-09-14T10:48:17.445719+0000","last_active":"2024-09-14T10:48:17.445845+0000","last_peered":"2024-09-14T10:48:17.445845+0000","last_clean":"2024-09-14T10:48:17.445845+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:48:17.445845+0000","last_undegraded":"2024-09-14T10:48:17.445845+0000","last_fullsized":"2024-09-14T10:48:17.445845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:17.445534+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:17.445534+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.445534+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.253965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.493171+0000","last_change":"2024-09-14T10:48:04.492991+0000","last_active":"2024-09-14T10:48:04.493171+0000","last_peered":"2024-09-14T10:48:04.493171+0000","last_clean":"2024-09-14T10:48:04.493171+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:48:04.493171+0000","last_undegraded":"2024-09-14T10:48:04.493171+0000","last_fullsized":"2024-09-14T10:48:04.493171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.492802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:02.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.423969+0000","last_change":"2024-09-14T10:48:23.423969+0000","last_active":"2024-09-14T10:48:23.423969+0000","last_peered":"2024-09-14T10:48:23.423969+0000","last_clean":"2024-09-14T10:48:23.423969+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:48:23.423969+0000","last_undegraded":"2024-09-14T10:48:23.423969+0000","last_fullsized":"2024-09-14T10:48:23.423969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:23.423787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:23.423787+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.423787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:32.029468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.905728+0000","last_change":"2024-09-14T10:48:16.905587+0000","last_active":"2024-09-14T10:48:16.905728+0000","last_peered":"2024-09-14T10:48:16.905728+0000","last_clean":"2024-09-14T10:48:16.905728+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:48:16.905728+0000","last_undegraded":"2024-09-14T10:48:16.905728+0000","last_fullsized":"2024-09-14T10:48:16.905728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:16.905404+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:16.905404+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.905404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:41.403056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:51.848468+0000","last_change":"2024-09-14T10:44:07.309384+0000","last_active":"2024-09-14T10:44:51.848468+0000","last_peered":"2024-09-14T10:44:51.848468+0000","last_clean":"2024-09-14T10:44:51.848468+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:44:51.848468+0000","last_undegraded":"2024-09-14T10:44:51.848468+0000","last_fullsized":"2024-09-14T10:44:51.848468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:20.889100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.451669+0000","last_change":"2024-09-14T10:48:05.451486+0000","last_active":"2024-09-14T10:48:05.451669+0000","last_peered":"2024-09-14T10:48:05.451669+0000","last_clean":"2024-09-14T10:48:05.451669+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:48:05.451669+0000","last_undegraded":"2024-09-14T10:48:05.451669+0000","last_fullsized":"2024-09-14T10:48:05.451669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.451302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:31.147968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.489122+0000","last_change":"2024-09-14T10:48:20.488933+0000","last_active":"2024-09-14T10:48:20.489122+0000","last_peered":"2024-09-14T10:48:20.489122+0000","last_clean":"2024-09-14T10:48:20.489122+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:48:20.489122+0000","last_undegraded":"2024-09-14T10:48:20.489122+0000","last_fullsized":"2024-09-14T10:48:20.489122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:20.488751+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:20.488751+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.488751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:13.985690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.364360+0000","last_change":"2024-09-14T10:48:08.364214+0000","last_active":"2024-09-14T10:48:08.364360+0000","last_peered":"2024-09-14T10:48:08.364360+0000","last_clean":"2024-09-14T10:48:08.364360+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:48:08.364360+0000","last_undegraded":"2024-09-14T10:48:08.364360+0000","last_fullsized":"2024-09-14T10:48:08.364360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.364025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:29.992081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.418342+0000","last_change":"2024-09-14T10:48:22.418342+0000","last_active":"2024-09-14T10:48:22.418342+0000","last_peered":"2024-09-14T10:48:22.418342+0000","last_clean":"2024-09-14T10:48:22.418342+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:48:22.418342+0000","last_undegraded":"2024-09-14T10:48:22.418342+0000","last_fullsized":"2024-09-14T10:48:22.418342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:22.418134+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:22.418134+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.418134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:30.725200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.363509+0000","last_change":"2024-09-14T10:48:06.363263+0000","last_active":"2024-09-14T10:48:06.363509+0000","last_peered":"2024-09-14T10:48:06.363509+0000","last_clean":"2024-09-14T10:48:06.363509+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:48:06.363509+0000","last_undegraded":"2024-09-14T10:48:06.363509+0000","last_fullsized":"2024-09-14T10:48:06.363509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.363044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:10.900801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.465950+0000","last_change":"2024-09-14T10:48:21.465950+0000","last_active":"2024-09-14T10:48:21.465950+0000","last_peered":"2024-09-14T10:48:21.465950+0000","last_clean":"2024-09-14T10:48:21.465950+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:48:21.465950+0000","last_undegraded":"2024-09-14T10:48:21.465950+0000","last_fullsized":"2024-09-14T10:48:21.465950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:21.465744+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:21.465744+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.465744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:03.866722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.869049+0000","last_change":"2024-09-14T10:48:17.868897+0000","last_active":"2024-09-14T10:48:17.869049+0000","last_peered":"2024-09-14T10:48:17.869049+0000","last_clean":"2024-09-14T10:48:17.869049+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:48:17.869049+0000","last_undegraded":"2024-09-14T10:48:17.869049+0000","last_fullsized":"2024-09-14T10:48:17.869049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:17.868688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:17.868688+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.868688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:00.016716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.426484+0000","last_change":"2024-09-14T10:48:24.426484+0000","last_active":"2024-09-14T10:48:24.426484+0000","last_peered":"2024-09-14T10:48:24.426484+0000","last_clean":"2024-09-14T10:48:24.426484+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:48:24.426484+0000","last_undegraded":"2024-09-14T10:48:24.426484+0000","last_fullsized":"2024-09-14T10:48:24.426484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:24.426271+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:24.426271+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.426271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:29.496623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.841640+0000","last_change":"2024-09-14T10:48:18.841503+0000","last_active":"2024-09-14T10:48:18.841640+0000","last_peered":"2024-09-14T10:48:18.841640+0000","last_clean":"2024-09-14T10:48:18.841640+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:48:18.841640+0000","last_undegraded":"2024-09-14T10:48:18.841640+0000","last_fullsized":"2024-09-14T10:48:18.841640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:18.841299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:18.841299+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.841299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:50.935286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.521412+0000","last_change":"2024-09-14T10:44:07.309006+0000","last_active":"2024-09-14T10:47:21.521412+0000","last_peered":"2024-09-14T10:47:21.521412+0000","last_clean":"2024-09-14T10:47:21.521412+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:47:21.521412+0000","last_undegraded":"2024-09-14T10:47:21.521412+0000","last_fullsized":"2024-09-14T10:47:21.521412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:06.271423+0000","last_clean_scrub_stamp":"2024-09-14T10:44:06.271423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.461874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.692142+0000","last_change":"2024-09-14T10:48:07.692142+0000","last_active":"2024-09-14T10:48:07.692142+0000","last_peered":"2024-09-14T10:48:07.692142+0000","last_clean":"2024-09-14T10:48:07.692142+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:48:07.692142+0000","last_undegraded":"2024-09-14T10:48:07.692142+0000","last_fullsized":"2024-09-14T10:48:07.692142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.691953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:20.730540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.428035+0000","last_change":"2024-09-14T10:48:20.427795+0000","last_active":"2024-09-14T10:48:20.428035+0000","last_peered":"2024-09-14T10:48:20.428035+0000","last_clean":"2024-09-14T10:48:20.428035+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:48:20.428035+0000","last_undegraded":"2024-09-14T10:48:20.428035+0000","last_fullsized":"2024-09-14T10:48:20.428035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:20.427585+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:20.427585+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.427585+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:39.853960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.871271+0000","last_change":"2024-09-14T10:48:19.871271+0000","last_active":"2024-09-14T10:48:19.871271+0000","last_peered":"2024-09-14T10:48:19.871271+0000","last_clean":"2024-09-14T10:48:19.871271+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:48:19.871271+0000","last_undegraded":"2024-09-14T10:48:19.871271+0000","last_fullsized":"2024-09-14T10:48:19.871271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:19.871088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:19.871088+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.871088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:33.745202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.904343+0000","last_change":"2024-09-14T10:48:23.904343+0000","last_active":"2024-09-14T10:48:23.904343+0000","last_peered":"2024-09-14T10:48:23.904343+0000","last_clean":"2024-09-14T10:48:23.904343+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:48:23.904343+0000","last_undegraded":"2024-09-14T10:48:23.904343+0000","last_fullsized":"2024-09-14T10:48:23.904343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:23.904146+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:23.904146+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.904146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:56.282823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.506316+0000","last_change":"2024-09-14T10:48:21.506316+0000","last_active":"2024-09-14T10:48:21.506316+0000","last_peered":"2024-09-14T10:48:21.506316+0000","last_clean":"2024-09-14T10:48:21.506316+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:48:21.506316+0000","last_undegraded":"2024-09-14T10:48:21.506316+0000","last_fullsized":"2024-09-14T10:48:21.506316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:21.506141+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:21.506141+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.506141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:41.836176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.454843+0000","last_change":"2024-09-14T10:48:08.454843+0000","last_active":"2024-09-14T10:48:08.454843+0000","last_peered":"2024-09-14T10:48:08.454843+0000","last_clean":"2024-09-14T10:48:08.454843+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:48:08.454843+0000","last_undegraded":"2024-09-14T10:48:08.454843+0000","last_fullsized":"2024-09-14T10:48:08.454843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.454661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:34.179499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.473573+0000","last_change":"2024-09-14T10:48:27.473573+0000","last_active":"2024-09-14T10:48:27.473573+0000","last_peered":"2024-09-14T10:48:27.473573+0000","last_clean":"2024-09-14T10:48:27.473573+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:48:27.473573+0000","last_undegraded":"2024-09-14T10:48:27.473573+0000","last_fullsized":"2024-09-14T10:48:27.473573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:27.473358+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:27.473358+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.473358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:40.064188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1428,"ondisk_log_size":1428,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640318,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":740626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1040384,"data_stored":742212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":152178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:48:38.861 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.862 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.862 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.862 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.862 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.862 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.862 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.863 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.863 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.863 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.863 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.863 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.863 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.863 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.864 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.864 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.864 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.864 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.864 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.864 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.864 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.864 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.865 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.865 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.865 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.865 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.865 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.865 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.865 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.866 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.866 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.866 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.866 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.866 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.866 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.866 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.866 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.867 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.867 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.867 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.867 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.867 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.867 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.867 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.868 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.868 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.868 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.868 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.868 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.868 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.868 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.869 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.869 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.869 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.869 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.869 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.869 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.869 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.870 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.870 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.870 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.870 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.870 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.870 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.870 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.870 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.871 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.871 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.871 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.871 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.871 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.871 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.871 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.872 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.872 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.872 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.872 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.872 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.872 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.872 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.873 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.873 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.873 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.873 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.873 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.873 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.873 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.873 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.874 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.874 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.874 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.874 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.874 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.874 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.874 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.874 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.875 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.875 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.875 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.875 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.875 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.875 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.875 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.876 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.876 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:44:08.284968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=8, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.876 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.876 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.876 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.876 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.877 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.877 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:44:06.271423+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:38.877 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:48:58.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:48:59.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.019+0000 7fe6847c0640 1 Processor -- start 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.019+0000 7fe6847c0640 1 -- start start 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe6847c0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe67c12d390 0x7fe67c12d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe6847c0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67c0724f0 con 0x7fe67c12dcb0 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe6847c0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe67c099e20 con 0x7fe67c12d390 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe68255c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe67c12d390 0x7fe67c12d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe681d5b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe67c12dcb0 0x7fe67c06e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42128/0 (socket says 172.21.15.70:42128) 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe681d5b640 1 -- 172.21.15.70:0/3522123063 learned_addr learned my addr 172.21.15.70:0/3522123063 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe68255c640 1 -- 172.21.15.70:0/3522123063 >> v1:172.21.15.70:6789/0 conn(0x7fe67c12dcb0 legacy=0x7fe67c06e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:59.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe68255c640 1 -- 172.21.15.70:0/3522123063 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c0713f0 con 0x7fe67c12d390 2024-09-14T10:48:59.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe68255c640 1 --2- 172.21.15.70:0/3522123063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c12d770 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009740 tx=0x7fe66c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7924d7acdf2cdfc server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:59.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe68155a640 1 -- 172.21.15.70:0/3522123063 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe66c0b1070 con 0x7fe67c12d390 2024-09-14T10:48:59.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe68155a640 1 -- 172.21.15.70:0/3522123063 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66c0ac520 con 0x7fe67c12d390 2024-09-14T10:48:59.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.023+0000 7fe68155a640 1 -- 172.21.15.70:0/3522123063 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe66c0ac820 con 0x7fe67c12d390 2024-09-14T10:48:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- 172.21.15.70:0/3522123063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 msgr2=0x7fe67c12d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 --2- 172.21.15.70:0/3522123063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c12d770 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009740 tx=0x7fe66c01c330 comp rx=0 tx=0).stop 2024-09-14T10:48:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- 172.21.15.70:0/3522123063 shutdown_connections 2024-09-14T10:48:59.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 --2- 172.21.15.70:0/3522123063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c12d770 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:59.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- 172.21.15.70:0/3522123063 >> 172.21.15.70:0/3522123063 conn(0x7fe67c09aba0 msgr2=0x7fe67c0984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:48:59.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- 172.21.15.70:0/3522123063 shutdown_connections 2024-09-14T10:48:59.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- 172.21.15.70:0/3522123063 wait complete. 2024-09-14T10:48:59.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 Processor -- start 2024-09-14T10:48:59.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- start start 2024-09-14T10:48:59.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c06f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c135740 con 0x7fe67c12d390 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe68255c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c06f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe68255c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c06f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56660/0 (socket says 172.21.15.70:56660) 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe68255c640 1 -- 172.21.15.70:0/3734446500 learned_addr learned my addr 172.21.15.70:0/3734446500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe68255c640 1 -- 172.21.15.70:0/3734446500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c0705a0 con 0x7fe67c12d390 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe68255c640 1 --2- 172.21.15.70:0/3734446500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c06f170 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0af040 tx=0x7fe66c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe672ffd640 1 -- 172.21.15.70:0/3734446500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe66c0b1050 con 0x7fe67c12d390 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe672ffd640 1 -- 172.21.15.70:0/3734446500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66c0b2040 con 0x7fe67c12d390 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe672ffd640 1 -- 172.21.15.70:0/3734446500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe66c0abb70 con 0x7fe67c12d390 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c12a840 con 0x7fe67c12d390 2024-09-14T10:48:59.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c070f10 con 0x7fe67c12d390 2024-09-14T10:48:59.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67c12d770 con 0x7fe67c12d390 2024-09-14T10:48:59.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.027+0000 7fe672ffd640 1 -- 172.21.15.70:0/3734446500 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fe66c0bf030 con 0x7fe67c12d390 2024-09-14T10:48:59.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.031+0000 7fe672ffd640 1 --2- 172.21.15.70:0/3734446500 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe66003b8b0 0x7fe66003dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:48:59.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.031+0000 7fe672ffd640 1 -- 172.21.15.70:0/3734446500 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe66c0bd070 con 0x7fe67c12d390 2024-09-14T10:48:59.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.031+0000 7fe681d5b640 1 --2- 172.21.15.70:0/3734446500 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe66003b8b0 0x7fe66003dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:48:59.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.031+0000 7fe681d5b640 1 --2- 172.21.15.70:0/3734446500 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe66003b8b0 0x7fe66003dd70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe678005890 tx=0x7fe678007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:48:59.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.035+0000 7fe672ffd640 1 -- 172.21.15.70:0/3734446500 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fe66c0c6060 con 0x7fe67c12d390 2024-09-14T10:48:59.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.203+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe67c070a00 con 0x7fe66003b8b0 2024-09-14T10:48:59.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.231+0000 7fe672ffd640 1 -- 172.21.15.70:0/3734446500 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665596 (secure 0 0 0) 0x7fe67c070a00 con 0x7fe66003b8b0 2024-09-14T10:48:59.233 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:48:59.241 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe66003b8b0 msgr2=0x7fe66003dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 --2- 172.21.15.70:0/3734446500 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe66003b8b0 0x7fe66003dd70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe678005890 tx=0x7fe678007ab0 comp rx=0 tx=0).stop 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 msgr2=0x7fe67c06f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 --2- 172.21.15.70:0/3734446500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c06f170 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0af040 tx=0x7fe66c01ab70 comp rx=0 tx=0).stop 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 shutdown_connections 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 --2- 172.21.15.70:0/3734446500 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fe66003b8b0 0x7fe66003dd70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 --2- 172.21.15.70:0/3734446500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe67c12d390 0x7fe67c06f170 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 >> 172.21.15.70:0/3734446500 conn(0x7fe67c09aba0 msgr2=0x7fe67c09b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 shutdown_connections 2024-09-14T10:48:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:48:59.243+0000 7fe6847c0640 1 -- 172.21.15.70:0/3734446500 wait complete. 2024-09-14T10:48:59.257 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-14T10:48:57.502547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5157,"num_read_kb":4699,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4730,"ondisk_log_size":4730,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148448,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338912,"statfs":{"total":386547056640,"available":386395045888,"internally_reserved":0,"allocated":2981888,"data_stored":1786956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007516"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.798951+0000","last_change":"2024-09-14T10:48:10.798810+0000","last_active":"2024-09-14T10:48:10.798951+0000","last_peered":"2024-09-14T10:48:10.798951+0000","last_clean":"2024-09-14T10:48:10.798951+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:48:10.798951+0000","last_undegraded":"2024-09-14T10:48:10.798951+0000","last_fullsized":"2024-09-14T10:48:10.798951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.798632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:20.160081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.490121+0000","last_change":"2024-09-14T10:48:29.490121+0000","last_active":"2024-09-14T10:48:29.490121+0000","last_peered":"2024-09-14T10:48:29.490121+0000","last_clean":"2024-09-14T10:48:29.490121+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:48:29.490121+0000","last_undegraded":"2024-09-14T10:48:29.490121+0000","last_fullsized":"2024-09-14T10:48:29.490121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:29.489905+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:29.489905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.489905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:03.916811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.492325+0000","last_change":"2024-09-14T10:48:10.492066+0000","last_active":"2024-09-14T10:48:10.492325+0000","last_peered":"2024-09-14T10:48:10.492325+0000","last_clean":"2024-09-14T10:48:10.492325+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:48:10.492325+0000","last_undegraded":"2024-09-14T10:48:10.492325+0000","last_fullsized":"2024-09-14T10:48:10.492325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.491821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:30.410764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.699286+0000","last_change":"2024-09-14T10:48:39.699286+0000","last_active":"2024-09-14T10:48:39.699286+0000","last_peered":"2024-09-14T10:48:39.699286+0000","last_clean":"2024-09-14T10:48:39.699286+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:48:39.699286+0000","last_undegraded":"2024-09-14T10:48:39.699286+0000","last_fullsized":"2024-09-14T10:48:39.699286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:39.699100+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:39.699100+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.699100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:40.664213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.891397+0000","last_change":"2024-09-14T10:48:25.891397+0000","last_active":"2024-09-14T10:48:25.891397+0000","last_peered":"2024-09-14T10:48:25.891397+0000","last_clean":"2024-09-14T10:48:25.891397+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:48:25.891397+0000","last_undegraded":"2024-09-14T10:48:25.891397+0000","last_fullsized":"2024-09-14T10:48:25.891397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:25.891164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:25.891164+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.891164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:32.955966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.618761+0000","last_change":"2024-09-14T10:48:41.618761+0000","last_active":"2024-09-14T10:48:41.618761+0000","last_peered":"2024-09-14T10:48:41.618761+0000","last_clean":"2024-09-14T10:48:41.618761+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:48:41.618761+0000","last_undegraded":"2024-09-14T10:48:41.618761+0000","last_fullsized":"2024-09-14T10:48:41.618761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:41.618584+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:41.618584+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.618584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:26.437900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.801154+0000","last_change":"2024-09-14T10:48:13.801154+0000","last_active":"2024-09-14T10:48:13.801154+0000","last_peered":"2024-09-14T10:48:13.801154+0000","last_clean":"2024-09-14T10:48:13.801154+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:48:13.801154+0000","last_undegraded":"2024-09-14T10:48:13.801154+0000","last_fullsized":"2024-09-14T10:48:13.801154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.800954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:10.498468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.667640+0000","last_change":"2024-09-14T10:48:42.667640+0000","last_active":"2024-09-14T10:48:42.667640+0000","last_peered":"2024-09-14T10:48:42.667640+0000","last_clean":"2024-09-14T10:48:42.667640+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:48:42.667640+0000","last_undegraded":"2024-09-14T10:48:42.667640+0000","last_fullsized":"2024-09-14T10:48:42.667640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:42.667441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:42.667441+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.667441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:28.664593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.884659+0000","last_change":"2024-09-14T10:48:21.884659+0000","last_active":"2024-09-14T10:48:21.884659+0000","last_peered":"2024-09-14T10:48:21.884659+0000","last_clean":"2024-09-14T10:48:21.884659+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:48:21.884659+0000","last_undegraded":"2024-09-14T10:48:21.884659+0000","last_fullsized":"2024-09-14T10:48:21.884659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:21.884467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:21.884467+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.884467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:25.811308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.474754+0000","last_change":"2024-09-14T10:48:30.474754+0000","last_active":"2024-09-14T10:48:30.474754+0000","last_peered":"2024-09-14T10:48:30.474754+0000","last_clean":"2024-09-14T10:48:30.474754+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:48:30.474754+0000","last_undegraded":"2024-09-14T10:48:30.474754+0000","last_fullsized":"2024-09-14T10:48:30.474754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:30.474471+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:30.474471+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.474471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:13.709808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.752350+0000","last_change":"2024-09-14T10:48:09.752350+0000","last_active":"2024-09-14T10:48:09.752350+0000","last_peered":"2024-09-14T10:48:09.752350+0000","last_clean":"2024-09-14T10:48:09.752350+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:48:09.752350+0000","last_undegraded":"2024-09-14T10:48:09.752350+0000","last_fullsized":"2024-09-14T10:48:09.752350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.752173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:57.545208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.714300+0000","last_change":"2024-09-14T10:48:22.713985+0000","last_active":"2024-09-14T10:48:22.714300+0000","last_peered":"2024-09-14T10:48:22.714300+0000","last_clean":"2024-09-14T10:48:22.714300+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:48:22.714300+0000","last_undegraded":"2024-09-14T10:48:22.714300+0000","last_fullsized":"2024-09-14T10:48:22.714300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:22.713714+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:22.713714+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.713714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:32.805970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.887921+0000","last_change":"2024-09-14T10:48:22.887921+0000","last_active":"2024-09-14T10:48:22.887921+0000","last_peered":"2024-09-14T10:48:22.887921+0000","last_clean":"2024-09-14T10:48:22.887921+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:48:22.887921+0000","last_undegraded":"2024-09-14T10:48:22.887921+0000","last_fullsized":"2024-09-14T10:48:22.887921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:22.887731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:22.887731+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.887731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.608934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.690389+0000","last_change":"2024-09-14T10:48:23.690389+0000","last_active":"2024-09-14T10:48:23.690389+0000","last_peered":"2024-09-14T10:48:23.690389+0000","last_clean":"2024-09-14T10:48:23.690389+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:48:23.690389+0000","last_undegraded":"2024-09-14T10:48:23.690389+0000","last_fullsized":"2024-09-14T10:48:23.690389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:23.690127+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:23.690127+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.690127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:31.933431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.503799+0000","last_change":"2024-09-14T10:48:09.503799+0000","last_active":"2024-09-14T10:48:09.503799+0000","last_peered":"2024-09-14T10:48:09.503799+0000","last_clean":"2024-09-14T10:48:09.503799+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:48:09.503799+0000","last_undegraded":"2024-09-14T10:48:09.503799+0000","last_fullsized":"2024-09-14T10:48:09.503799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.503614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:43.187650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.653888+0000","last_change":"2024-09-14T10:48:24.653888+0000","last_active":"2024-09-14T10:48:24.653888+0000","last_peered":"2024-09-14T10:48:24.653888+0000","last_clean":"2024-09-14T10:48:24.653888+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:48:24.653888+0000","last_undegraded":"2024-09-14T10:48:24.653888+0000","last_fullsized":"2024-09-14T10:48:24.653888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:24.653671+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:24.653671+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.653671+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:36.631176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.665143+0000","last_change":"2024-09-14T10:48:40.664900+0000","last_active":"2024-09-14T10:48:40.665143+0000","last_peered":"2024-09-14T10:48:40.665143+0000","last_clean":"2024-09-14T10:48:40.665143+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:48:40.665143+0000","last_undegraded":"2024-09-14T10:48:40.665143+0000","last_fullsized":"2024-09-14T10:48:40.665143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:40.664677+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:40.664677+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.664677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:45.108181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.434266+0000","last_change":"2024-09-14T10:48:10.434015+0000","last_active":"2024-09-14T10:48:10.434266+0000","last_peered":"2024-09-14T10:48:10.434266+0000","last_clean":"2024-09-14T10:48:10.434266+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:48:10.434266+0000","last_undegraded":"2024-09-14T10:48:10.434266+0000","last_fullsized":"2024-09-14T10:48:10.434266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.433796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:25.542559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.442358+0000","last_change":"2024-09-14T10:48:25.442195+0000","last_active":"2024-09-14T10:48:25.442358+0000","last_peered":"2024-09-14T10:48:25.442358+0000","last_clean":"2024-09-14T10:48:25.442358+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:48:25.442358+0000","last_undegraded":"2024-09-14T10:48:25.442358+0000","last_fullsized":"2024-09-14T10:48:25.442358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:25.442006+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:25.442006+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.442006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:27.650647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.731707+0000","last_change":"2024-09-14T10:48:08.731550+0000","last_active":"2024-09-14T10:48:08.731707+0000","last_peered":"2024-09-14T10:48:08.731707+0000","last_clean":"2024-09-14T10:48:08.731707+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:48:08.731707+0000","last_undegraded":"2024-09-14T10:48:08.731707+0000","last_fullsized":"2024-09-14T10:48:08.731707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.731374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:25.870502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.521955+0000","last_change":"2024-09-14T10:48:28.521815+0000","last_active":"2024-09-14T10:48:28.521955+0000","last_peered":"2024-09-14T10:48:28.521955+0000","last_clean":"2024-09-14T10:48:28.521955+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:48:28.521955+0000","last_undegraded":"2024-09-14T10:48:28.521955+0000","last_fullsized":"2024-09-14T10:48:28.521955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:28.521636+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:28.521636+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.521636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:47.105831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.413206+0000","last_change":"2024-09-14T10:48:09.413034+0000","last_active":"2024-09-14T10:48:09.413206+0000","last_peered":"2024-09-14T10:48:09.413206+0000","last_clean":"2024-09-14T10:48:09.413206+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:48:09.413206+0000","last_undegraded":"2024-09-14T10:48:09.413206+0000","last_fullsized":"2024-09-14T10:48:09.413206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.412833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:35.318942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.597525+0000","last_change":"2024-09-14T10:48:28.597380+0000","last_active":"2024-09-14T10:48:28.597525+0000","last_peered":"2024-09-14T10:48:28.597525+0000","last_clean":"2024-09-14T10:48:28.597525+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:48:28.597525+0000","last_undegraded":"2024-09-14T10:48:28.597525+0000","last_fullsized":"2024-09-14T10:48:28.597525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:28.597180+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:28.597180+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.597180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:04.719964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.345403+0000","last_change":"2024-09-14T10:48:07.345264+0000","last_active":"2024-09-14T10:48:07.345403+0000","last_peered":"2024-09-14T10:48:07.345403+0000","last_clean":"2024-09-14T10:48:07.345403+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:48:07.345403+0000","last_undegraded":"2024-09-14T10:48:07.345403+0000","last_fullsized":"2024-09-14T10:48:07.345403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.345074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.041740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.761411+0000","last_change":"2024-09-14T10:48:21.761411+0000","last_active":"2024-09-14T10:48:21.761411+0000","last_peered":"2024-09-14T10:48:21.761411+0000","last_clean":"2024-09-14T10:48:21.761411+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:48:21.761411+0000","last_undegraded":"2024-09-14T10:48:21.761411+0000","last_fullsized":"2024-09-14T10:48:21.761411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:21.761222+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:21.761222+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.761222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:14.714371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.538174+0000","last_change":"2024-09-14T10:48:11.537992+0000","last_active":"2024-09-14T10:48:11.538174+0000","last_peered":"2024-09-14T10:48:11.538174+0000","last_clean":"2024-09-14T10:48:11.538174+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:48:11.538174+0000","last_undegraded":"2024-09-14T10:48:11.538174+0000","last_fullsized":"2024-09-14T10:48:11.538174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.537799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:49.788688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.458972+0000","last_change":"2024-09-14T10:48:26.458972+0000","last_active":"2024-09-14T10:48:26.458972+0000","last_peered":"2024-09-14T10:48:26.458972+0000","last_clean":"2024-09-14T10:48:26.458972+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:48:26.458972+0000","last_undegraded":"2024-09-14T10:48:26.458972+0000","last_fullsized":"2024-09-14T10:48:26.458972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:26.458789+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:26.458789+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.458789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:37.373380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.835917+0000","last_change":"2024-09-14T10:48:20.835752+0000","last_active":"2024-09-14T10:48:20.835917+0000","last_peered":"2024-09-14T10:48:20.835917+0000","last_clean":"2024-09-14T10:48:20.835917+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:48:20.835917+0000","last_undegraded":"2024-09-14T10:48:20.835917+0000","last_fullsized":"2024-09-14T10:48:20.835917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:20.835574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:20.835574+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.835574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:37.288457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.891282+0000","last_change":"2024-09-14T10:44:15.384222+0000","last_active":"2024-09-14T10:47:21.891282+0000","last_peered":"2024-09-14T10:47:21.891282+0000","last_clean":"2024-09-14T10:47:21.891282+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:47:21.891282+0000","last_undegraded":"2024-09-14T10:47:21.891282+0000","last_fullsized":"2024-09-14T10:47:21.891282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:52.493514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.868412+0000","last_change":"2024-09-14T10:48:31.868270+0000","last_active":"2024-09-14T10:48:31.868412+0000","last_peered":"2024-09-14T10:48:31.868412+0000","last_clean":"2024-09-14T10:48:31.868412+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:48:31.868412+0000","last_undegraded":"2024-09-14T10:48:31.868412+0000","last_fullsized":"2024-09-14T10:48:31.868412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:31.868080+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:31.868080+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.868080+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:24.962231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.016482+0000","last_change":"2024-09-14T10:48:11.016248+0000","last_active":"2024-09-14T10:48:11.016482+0000","last_peered":"2024-09-14T10:48:11.016482+0000","last_clean":"2024-09-14T10:48:11.016482+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:48:11.016482+0000","last_undegraded":"2024-09-14T10:48:11.016482+0000","last_fullsized":"2024-09-14T10:48:11.016482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.016029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.143146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.709065+0000","last_change":"2024-09-14T10:48:50.709065+0000","last_active":"2024-09-14T10:48:50.709065+0000","last_peered":"2024-09-14T10:48:50.709065+0000","last_clean":"2024-09-14T10:48:50.709065+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:48:50.709065+0000","last_undegraded":"2024-09-14T10:48:50.709065+0000","last_fullsized":"2024-09-14T10:48:50.709065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:50.708840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:50.708840+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.708840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:06.261826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.068511+0000","last_change":"2024-09-14T10:44:11.366230+0000","last_active":"2024-09-14T10:47:53.068511+0000","last_peered":"2024-09-14T10:47:53.068511+0000","last_clean":"2024-09-14T10:47:53.068511+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:47:53.068511+0000","last_undegraded":"2024-09-14T10:47:53.068511+0000","last_fullsized":"2024-09-14T10:47:53.068511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.695051+0000","last_change":"2024-09-14T10:48:49.695051+0000","last_active":"2024-09-14T10:48:49.695051+0000","last_peered":"2024-09-14T10:48:49.695051+0000","last_clean":"2024-09-14T10:48:49.695051+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:48:49.695051+0000","last_undegraded":"2024-09-14T10:48:49.695051+0000","last_fullsized":"2024-09-14T10:48:49.695051+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.694840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.694840+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.694840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:31.821957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.607941+0000","last_change":"2024-09-14T10:44:15.377551+0000","last_active":"2024-09-14T10:45:35.607941+0000","last_peered":"2024-09-14T10:45:35.607941+0000","last_clean":"2024-09-14T10:45:35.607941+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:45:35.607941+0000","last_undegraded":"2024-09-14T10:45:35.607941+0000","last_fullsized":"2024-09-14T10:45:35.607941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:02.205723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.826539+0000","last_change":"2024-09-14T10:48:32.826539+0000","last_active":"2024-09-14T10:48:32.826539+0000","last_peered":"2024-09-14T10:48:32.826539+0000","last_clean":"2024-09-14T10:48:32.826539+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:48:32.826539+0000","last_undegraded":"2024-09-14T10:48:32.826539+0000","last_fullsized":"2024-09-14T10:48:32.826539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-14T10:48:32.826333+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-14T10:48:32.826333+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.826333+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:05.422320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.606030+0000","last_change":"2024-09-14T10:48:01.605793+0000","last_active":"2024-09-14T10:48:01.606030+0000","last_peered":"2024-09-14T10:48:01.606030+0000","last_clean":"2024-09-14T10:48:01.606030+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:48:01.606030+0000","last_undegraded":"2024-09-14T10:48:01.606030+0000","last_fullsized":"2024-09-14T10:48:01.606030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.605543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:33.748359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.619909+0000","last_change":"2024-09-14T10:48:33.619763+0000","last_active":"2024-09-14T10:48:33.619909+0000","last_peered":"2024-09-14T10:48:33.619909+0000","last_clean":"2024-09-14T10:48:33.619909+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:48:33.619909+0000","last_undegraded":"2024-09-14T10:48:33.619909+0000","last_fullsized":"2024-09-14T10:48:33.619909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:33.619581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:33.619581+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.619581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.570850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.606072+0000","last_change":"2024-09-14T10:48:43.606072+0000","last_active":"2024-09-14T10:48:43.606072+0000","last_peered":"2024-09-14T10:48:43.606072+0000","last_clean":"2024-09-14T10:48:43.606072+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:48:43.606072+0000","last_undegraded":"2024-09-14T10:48:43.606072+0000","last_fullsized":"2024-09-14T10:48:43.606072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:43.605875+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:43.605875+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.605875+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:11.774070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.715637+0000","last_change":"2024-09-14T10:48:48.715637+0000","last_active":"2024-09-14T10:48:48.715637+0000","last_peered":"2024-09-14T10:48:48.715637+0000","last_clean":"2024-09-14T10:48:48.715637+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:48:48.715637+0000","last_undegraded":"2024-09-14T10:48:48.715637+0000","last_fullsized":"2024-09-14T10:48:48.715637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:48.715463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:48.715463+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.715463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:51.871305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:56.704395+0000","last_change":"2024-09-14T10:48:56.704395+0000","last_active":"2024-09-14T10:48:56.704395+0000","last_peered":"2024-09-14T10:48:56.704395+0000","last_clean":"2024-09-14T10:48:56.704395+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:48:56.704395+0000","last_undegraded":"2024-09-14T10:48:56.704395+0000","last_fullsized":"2024-09-14T10:48:56.704395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:56.704209+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:56.704209+0000","last_clean_scrub_stamp":"2024-09-14T10:48:56.704209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:28.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.801688+0000","last_change":"2024-09-14T10:48:33.801688+0000","last_active":"2024-09-14T10:48:33.801688+0000","last_peered":"2024-09-14T10:48:33.801688+0000","last_clean":"2024-09-14T10:48:33.801688+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:48:33.801688+0000","last_undegraded":"2024-09-14T10:48:33.801688+0000","last_fullsized":"2024-09-14T10:48:33.801688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-14T10:48:33.801495+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-14T10:48:33.801495+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.801495+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:25.809741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.984658+0000","last_change":"2024-09-14T10:48:09.984385+0000","last_active":"2024-09-14T10:48:09.984658+0000","last_peered":"2024-09-14T10:48:09.984658+0000","last_clean":"2024-09-14T10:48:09.984658+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:48:09.984658+0000","last_undegraded":"2024-09-14T10:48:09.984658+0000","last_fullsized":"2024-09-14T10:48:09.984658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.984177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:13.140019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.606320+0000","last_change":"2024-09-14T10:48:27.606320+0000","last_active":"2024-09-14T10:48:27.606320+0000","last_peered":"2024-09-14T10:48:27.606320+0000","last_clean":"2024-09-14T10:48:27.606320+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:48:27.606320+0000","last_undegraded":"2024-09-14T10:48:27.606320+0000","last_fullsized":"2024-09-14T10:48:27.606320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:27.606121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:27.606121+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.606121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.007371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.455539+0000","last_change":"2024-09-14T10:48:39.455381+0000","last_active":"2024-09-14T10:48:39.455539+0000","last_peered":"2024-09-14T10:48:39.455539+0000","last_clean":"2024-09-14T10:48:39.455539+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:48:39.455539+0000","last_undegraded":"2024-09-14T10:48:39.455539+0000","last_fullsized":"2024-09-14T10:48:39.455539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:39.455160+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:39.455160+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.455160+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:00.891457+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.880932+0000","last_change":"2024-09-14T10:44:13.370887+0000","last_active":"2024-09-14T10:47:52.880932+0000","last_peered":"2024-09-14T10:47:52.880932+0000","last_clean":"2024-09-14T10:47:52.880932+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:47:52.880932+0000","last_undegraded":"2024-09-14T10:47:52.880932+0000","last_fullsized":"2024-09-14T10:47:52.880932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.397294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.453452+0000","last_change":"2024-09-14T10:48:51.453452+0000","last_active":"2024-09-14T10:48:51.453452+0000","last_peered":"2024-09-14T10:48:51.453452+0000","last_clean":"2024-09-14T10:48:51.453452+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:48:51.453452+0000","last_undegraded":"2024-09-14T10:48:51.453452+0000","last_fullsized":"2024-09-14T10:48:51.453452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.453232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.453232+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.453232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.042348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.635653+0000","last_change":"2024-09-14T10:48:15.635473+0000","last_active":"2024-09-14T10:48:15.635653+0000","last_peered":"2024-09-14T10:48:15.635653+0000","last_clean":"2024-09-14T10:48:15.635653+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:48:15.635653+0000","last_undegraded":"2024-09-14T10:48:15.635653+0000","last_fullsized":"2024-09-14T10:48:15.635653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.635292+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:37.356846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.255721+0000","last_change":"2024-09-14T10:47:59.255546+0000","last_active":"2024-09-14T10:47:59.255721+0000","last_peered":"2024-09-14T10:47:59.255721+0000","last_clean":"2024-09-14T10:47:59.255721+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:47:59.255721+0000","last_undegraded":"2024-09-14T10:47:59.255721+0000","last_fullsized":"2024-09-14T10:47:59.255721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.255367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.490294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.679715+0000","last_change":"2024-09-14T10:48:51.679715+0000","last_active":"2024-09-14T10:48:51.679715+0000","last_peered":"2024-09-14T10:48:51.679715+0000","last_clean":"2024-09-14T10:48:51.679715+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:48:51.679715+0000","last_undegraded":"2024-09-14T10:48:51.679715+0000","last_fullsized":"2024-09-14T10:48:51.679715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.679543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.679543+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.679543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:20.562988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.443171+0000","last_change":"2024-09-14T10:48:37.443171+0000","last_active":"2024-09-14T10:48:37.443171+0000","last_peered":"2024-09-14T10:48:37.443171+0000","last_clean":"2024-09-14T10:48:37.443171+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:48:37.443171+0000","last_undegraded":"2024-09-14T10:48:37.443171+0000","last_fullsized":"2024-09-14T10:48:37.443171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-14T10:48:37.442971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-14T10:48:37.442971+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.442971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:50.930609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":425,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.654908+0000","last_change":"2024-09-14T10:48:48.654747+0000","last_active":"2024-09-14T10:48:48.654908+0000","last_peered":"2024-09-14T10:48:48.654908+0000","last_clean":"2024-09-14T10:48:48.654908+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:48:48.654908+0000","last_undegraded":"2024-09-14T10:48:48.654908+0000","last_fullsized":"2024-09-14T10:48:48.654908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:48.654557+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:48.654557+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.654557+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:30.781674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.881054+0000","last_change":"2024-09-14T10:48:27.880910+0000","last_active":"2024-09-14T10:48:27.881054+0000","last_peered":"2024-09-14T10:48:27.881054+0000","last_clean":"2024-09-14T10:48:27.881054+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:48:27.881054+0000","last_undegraded":"2024-09-14T10:48:27.881054+0000","last_fullsized":"2024-09-14T10:48:27.881054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:27.880708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:27.880708+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.880708+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:31.359099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.552491+0000","last_change":"2024-09-14T10:48:03.552213+0000","last_active":"2024-09-14T10:48:03.552491+0000","last_peered":"2024-09-14T10:48:03.552491+0000","last_clean":"2024-09-14T10:48:03.552491+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:48:03.552491+0000","last_undegraded":"2024-09-14T10:48:03.552491+0000","last_fullsized":"2024-09-14T10:48:03.552491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.551983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.648129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.489804+0000","last_change":"2024-09-14T10:48:32.489804+0000","last_active":"2024-09-14T10:48:32.489804+0000","last_peered":"2024-09-14T10:48:32.489804+0000","last_clean":"2024-09-14T10:48:32.489804+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:48:32.489804+0000","last_undegraded":"2024-09-14T10:48:32.489804+0000","last_fullsized":"2024-09-14T10:48:32.489804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:32.489524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:32.489524+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.489524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:13.102091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.485022+0000","last_change":"2024-09-14T10:48:34.485022+0000","last_active":"2024-09-14T10:48:34.485022+0000","last_peered":"2024-09-14T10:48:34.485022+0000","last_clean":"2024-09-14T10:48:34.485022+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:48:34.485022+0000","last_undegraded":"2024-09-14T10:48:34.485022+0000","last_fullsized":"2024-09-14T10:48:34.485022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-14T10:48:34.484782+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-14T10:48:34.484782+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.484782+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:29.171627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.589885+0000","last_change":"2024-09-14T10:48:45.589885+0000","last_active":"2024-09-14T10:48:45.589885+0000","last_peered":"2024-09-14T10:48:45.589885+0000","last_clean":"2024-09-14T10:48:45.589885+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:48:45.589885+0000","last_undegraded":"2024-09-14T10:48:45.589885+0000","last_fullsized":"2024-09-14T10:48:45.589885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:45.589679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:45.589679+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.589679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:09.037609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.448179+0000","last_change":"2024-09-14T10:48:49.448179+0000","last_active":"2024-09-14T10:48:49.448179+0000","last_peered":"2024-09-14T10:48:49.448179+0000","last_clean":"2024-09-14T10:48:49.448179+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:48:49.448179+0000","last_undegraded":"2024-09-14T10:48:49.448179+0000","last_fullsized":"2024-09-14T10:48:49.448179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:49.447960+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:49.447960+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.447960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:59.478591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.497753+0000","last_change":"2024-09-14T10:48:14.497618+0000","last_active":"2024-09-14T10:48:14.497753+0000","last_peered":"2024-09-14T10:48:14.497753+0000","last_clean":"2024-09-14T10:48:14.497753+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:48:14.497753+0000","last_undegraded":"2024-09-14T10:48:14.497753+0000","last_fullsized":"2024-09-14T10:48:14.497753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:14.497416+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:14.497416+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.497416+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:54.322425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.618993+0000","last_change":"2024-09-14T10:47:59.618709+0000","last_active":"2024-09-14T10:47:59.618993+0000","last_peered":"2024-09-14T10:47:59.618993+0000","last_clean":"2024-09-14T10:47:59.618993+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:59.618993+0000","last_undegraded":"2024-09-14T10:47:59.618993+0000","last_fullsized":"2024-09-14T10:47:59.618993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.618492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:36.397328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.600141+0000","last_change":"2024-09-14T10:48:26.599902+0000","last_active":"2024-09-14T10:48:26.600141+0000","last_peered":"2024-09-14T10:48:26.600141+0000","last_clean":"2024-09-14T10:48:26.600141+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:48:26.600141+0000","last_undegraded":"2024-09-14T10:48:26.600141+0000","last_fullsized":"2024-09-14T10:48:26.600141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:26.599635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:26.599635+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.599635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:39.190465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:52.976767+0000","last_change":"2024-09-14T10:44:11.361862+0000","last_active":"2024-09-14T10:47:52.976767+0000","last_peered":"2024-09-14T10:47:52.976767+0000","last_clean":"2024-09-14T10:47:52.976767+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:47:52.976767+0000","last_undegraded":"2024-09-14T10:47:52.976767+0000","last_fullsized":"2024-09-14T10:47:52.976767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.578139+0000","last_change":"2024-09-14T10:48:44.578139+0000","last_active":"2024-09-14T10:48:44.578139+0000","last_peered":"2024-09-14T10:48:44.578139+0000","last_clean":"2024-09-14T10:48:44.578139+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:48:44.578139+0000","last_undegraded":"2024-09-14T10:48:44.578139+0000","last_fullsized":"2024-09-14T10:48:44.578139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.577958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.577958+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.577958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:50.475596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.746978+0000","last_change":"2024-09-14T10:48:52.746978+0000","last_active":"2024-09-14T10:48:52.746978+0000","last_peered":"2024-09-14T10:48:52.746978+0000","last_clean":"2024-09-14T10:48:52.746978+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:48:52.746978+0000","last_undegraded":"2024-09-14T10:48:52.746978+0000","last_fullsized":"2024-09-14T10:48:52.746978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:52.746797+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:52.746797+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.746797+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:35.428380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.831292+0000","last_change":"2024-09-14T10:48:12.831150+0000","last_active":"2024-09-14T10:48:12.831292+0000","last_peered":"2024-09-14T10:48:12.831292+0000","last_clean":"2024-09-14T10:48:12.831292+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:48:12.831292+0000","last_undegraded":"2024-09-14T10:48:12.831292+0000","last_fullsized":"2024-09-14T10:48:12.831292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.830946+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:42.495812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.990560+0000","last_change":"2024-09-14T10:48:08.990298+0000","last_active":"2024-09-14T10:48:08.990560+0000","last_peered":"2024-09-14T10:48:08.990560+0000","last_clean":"2024-09-14T10:48:08.990560+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:48:08.990560+0000","last_undegraded":"2024-09-14T10:48:08.990560+0000","last_fullsized":"2024-09-14T10:48:08.990560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.990075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:54.174799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.571920+0000","last_change":"2024-09-14T10:48:25.571660+0000","last_active":"2024-09-14T10:48:25.571920+0000","last_peered":"2024-09-14T10:48:25.571920+0000","last_clean":"2024-09-14T10:48:25.571920+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:48:25.571920+0000","last_undegraded":"2024-09-14T10:48:25.571920+0000","last_fullsized":"2024-09-14T10:48:25.571920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:25.571436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:25.571436+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.571436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:36.486026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'41","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.109551+0000","last_change":"2024-09-14T10:44:11.356327+0000","last_active":"2024-09-14T10:47:53.109551+0000","last_peered":"2024-09-14T10:47:53.109551+0000","last_clean":"2024-09-14T10:47:53.109551+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:47:53.109551+0000","last_undegraded":"2024-09-14T10:47:53.109551+0000","last_fullsized":"2024-09-14T10:47:53.109551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":390,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.617555+0000","last_change":"2024-09-14T10:48:46.617555+0000","last_active":"2024-09-14T10:48:46.617555+0000","last_peered":"2024-09-14T10:48:46.617555+0000","last_clean":"2024-09-14T10:48:46.617555+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:48:46.617555+0000","last_undegraded":"2024-09-14T10:48:46.617555+0000","last_fullsized":"2024-09-14T10:48:46.617555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:46.617369+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:46.617369+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.617369+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:31.802093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.688455+0000","last_change":"2024-09-14T10:48:53.688455+0000","last_active":"2024-09-14T10:48:53.688455+0000","last_peered":"2024-09-14T10:48:53.688455+0000","last_clean":"2024-09-14T10:48:53.688455+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:48:53.688455+0000","last_undegraded":"2024-09-14T10:48:53.688455+0000","last_fullsized":"2024-09-14T10:48:53.688455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:53.688183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:53.688183+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.688183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:29.352610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.781873+0000","last_change":"2024-09-14T10:48:14.781725+0000","last_active":"2024-09-14T10:48:14.781873+0000","last_peered":"2024-09-14T10:48:14.781873+0000","last_clean":"2024-09-14T10:48:14.781873+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:48:14.781873+0000","last_undegraded":"2024-09-14T10:48:14.781873+0000","last_fullsized":"2024-09-14T10:48:14.781873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.781515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:43.801565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.031970+0000","last_change":"2024-09-14T10:48:08.031832+0000","last_active":"2024-09-14T10:48:08.031970+0000","last_peered":"2024-09-14T10:48:08.031970+0000","last_clean":"2024-09-14T10:48:08.031970+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:48:08.031970+0000","last_undegraded":"2024-09-14T10:48:08.031970+0000","last_fullsized":"2024-09-14T10:48:08.031970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.031656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:31.479586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.600776+0000","last_change":"2024-09-14T10:48:24.600606+0000","last_active":"2024-09-14T10:48:24.600776+0000","last_peered":"2024-09-14T10:48:24.600776+0000","last_clean":"2024-09-14T10:48:24.600776+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:48:24.600776+0000","last_undegraded":"2024-09-14T10:48:24.600776+0000","last_fullsized":"2024-09-14T10:48:24.600776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:24.600403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:24.600403+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.600403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:26.809043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'61","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.122706+0000","last_change":"2024-09-14T10:44:11.356796+0000","last_active":"2024-09-14T10:47:53.122706+0000","last_peered":"2024-09-14T10:47:53.122706+0000","last_clean":"2024-09-14T10:47:53.122706+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:47:53.122706+0000","last_undegraded":"2024-09-14T10:47:53.122706+0000","last_fullsized":"2024-09-14T10:47:53.122706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.539291+0000","last_change":"2024-09-14T10:48:43.539291+0000","last_active":"2024-09-14T10:48:43.539291+0000","last_peered":"2024-09-14T10:48:43.539291+0000","last_clean":"2024-09-14T10:48:43.539291+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:48:43.539291+0000","last_undegraded":"2024-09-14T10:48:43.539291+0000","last_fullsized":"2024-09-14T10:48:43.539291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.539104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.539104+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.539104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:51.312807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.729545+0000","last_change":"2024-09-14T10:48:52.729545+0000","last_active":"2024-09-14T10:48:52.729545+0000","last_peered":"2024-09-14T10:48:52.729545+0000","last_clean":"2024-09-14T10:48:52.729545+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:48:52.729545+0000","last_undegraded":"2024-09-14T10:48:52.729545+0000","last_fullsized":"2024-09-14T10:48:52.729545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-14T10:48:52.729295+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-14T10:48:52.729295+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.729295+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:41.771486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.499890+0000","last_change":"2024-09-14T10:48:13.499703+0000","last_active":"2024-09-14T10:48:13.499890+0000","last_peered":"2024-09-14T10:48:13.499890+0000","last_clean":"2024-09-14T10:48:13.499890+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:48:13.499890+0000","last_undegraded":"2024-09-14T10:48:13.499890+0000","last_fullsized":"2024-09-14T10:48:13.499890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.499518+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:35.604108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.461131+0000","last_change":"2024-09-14T10:48:02.460875+0000","last_active":"2024-09-14T10:48:02.461131+0000","last_peered":"2024-09-14T10:48:02.461131+0000","last_clean":"2024-09-14T10:48:02.461131+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:48:02.461131+0000","last_undegraded":"2024-09-14T10:48:02.461131+0000","last_fullsized":"2024-09-14T10:48:02.461131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.460647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:07.647413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.607283+0000","last_change":"2024-09-14T10:48:27.607156+0000","last_active":"2024-09-14T10:48:27.607283+0000","last_peered":"2024-09-14T10:48:27.607283+0000","last_clean":"2024-09-14T10:48:27.607283+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:48:27.607283+0000","last_undegraded":"2024-09-14T10:48:27.607283+0000","last_fullsized":"2024-09-14T10:48:27.607283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:27.606970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:27.606970+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.606970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:41.101194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.599156+0000","last_change":"2024-09-14T10:48:39.599004+0000","last_active":"2024-09-14T10:48:39.599156+0000","last_peered":"2024-09-14T10:48:39.599156+0000","last_clean":"2024-09-14T10:48:39.599156+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:48:39.599156+0000","last_undegraded":"2024-09-14T10:48:39.599156+0000","last_fullsized":"2024-09-14T10:48:39.599156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-14T10:48:39.598805+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-14T10:48:39.598805+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.598805+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:03.925784+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.446272+0000","last_change":"2024-09-14T10:44:13.368817+0000","last_active":"2024-09-14T10:46:29.446272+0000","last_peered":"2024-09-14T10:46:29.446272+0000","last_clean":"2024-09-14T10:46:29.446272+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:46:29.446272+0000","last_undegraded":"2024-09-14T10:46:29.446272+0000","last_fullsized":"2024-09-14T10:46:29.446272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.995889+0000","last_change":"2024-09-14T10:44:15.388555+0000","last_active":"2024-09-14T10:47:21.995889+0000","last_peered":"2024-09-14T10:47:21.995889+0000","last_clean":"2024-09-14T10:47:21.995889+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:47:21.995889+0000","last_undegraded":"2024-09-14T10:47:21.995889+0000","last_fullsized":"2024-09-14T10:47:21.995889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.862582+0000","last_change":"2024-09-14T10:48:29.862407+0000","last_active":"2024-09-14T10:48:29.862582+0000","last_peered":"2024-09-14T10:48:29.862582+0000","last_clean":"2024-09-14T10:48:29.862582+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:48:29.862582+0000","last_undegraded":"2024-09-14T10:48:29.862582+0000","last_fullsized":"2024-09-14T10:48:29.862582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:29.862217+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:29.862217+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.862217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:24.391104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.079073+0000","last_change":"2024-09-14T10:48:07.078927+0000","last_active":"2024-09-14T10:48:07.079073+0000","last_peered":"2024-09-14T10:48:07.079073+0000","last_clean":"2024-09-14T10:48:07.079073+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:48:07.079073+0000","last_undegraded":"2024-09-14T10:48:07.079073+0000","last_fullsized":"2024-09-14T10:48:07.079073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.078726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.976365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.657391+0000","last_change":"2024-09-14T10:48:30.657101+0000","last_active":"2024-09-14T10:48:30.657391+0000","last_peered":"2024-09-14T10:48:30.657391+0000","last_clean":"2024-09-14T10:48:30.657391+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:48:30.657391+0000","last_undegraded":"2024-09-14T10:48:30.657391+0000","last_fullsized":"2024-09-14T10:48:30.657391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:30.656887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:30.656887+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.656887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:28.780823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.472740+0000","last_change":"2024-09-14T10:48:35.472601+0000","last_active":"2024-09-14T10:48:35.472740+0000","last_peered":"2024-09-14T10:48:35.472740+0000","last_clean":"2024-09-14T10:48:35.472740+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:48:35.472740+0000","last_undegraded":"2024-09-14T10:48:35.472740+0000","last_fullsized":"2024-09-14T10:48:35.472740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:48:35.472394+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:48:35.472394+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.472394+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.251475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.473021+0000","last_change":"2024-09-14T10:48:41.472852+0000","last_active":"2024-09-14T10:48:41.473021+0000","last_peered":"2024-09-14T10:48:41.473021+0000","last_clean":"2024-09-14T10:48:41.473021+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:48:41.473021+0000","last_undegraded":"2024-09-14T10:48:41.473021+0000","last_fullsized":"2024-09-14T10:48:41.473021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:41.472667+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:41.472667+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.472667+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:45.971791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.674805+0000","last_change":"2024-09-14T10:48:50.674805+0000","last_active":"2024-09-14T10:48:50.674805+0000","last_peered":"2024-09-14T10:48:50.674805+0000","last_clean":"2024-09-14T10:48:50.674805+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:48:50.674805+0000","last_undegraded":"2024-09-14T10:48:50.674805+0000","last_fullsized":"2024-09-14T10:48:50.674805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:50.674615+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:50.674615+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.674615+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:09.029239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.780035+0000","last_change":"2024-09-14T10:48:15.779894+0000","last_active":"2024-09-14T10:48:15.780035+0000","last_peered":"2024-09-14T10:48:15.780035+0000","last_clean":"2024-09-14T10:48:15.780035+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:48:15.780035+0000","last_undegraded":"2024-09-14T10:48:15.780035+0000","last_fullsized":"2024-09-14T10:48:15.780035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.779722+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.779722+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.779722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:54.382214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.033800+0000","last_change":"2024-09-14T10:48:05.033536+0000","last_active":"2024-09-14T10:48:05.033800+0000","last_peered":"2024-09-14T10:48:05.033800+0000","last_clean":"2024-09-14T10:48:05.033800+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:48:05.033800+0000","last_undegraded":"2024-09-14T10:48:05.033800+0000","last_fullsized":"2024-09-14T10:48:05.033800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.033307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:22.683683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.532367+0000","last_change":"2024-09-14T10:48:33.532122+0000","last_active":"2024-09-14T10:48:33.532367+0000","last_peered":"2024-09-14T10:48:33.532367+0000","last_clean":"2024-09-14T10:48:33.532367+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:48:33.532367+0000","last_undegraded":"2024-09-14T10:48:33.532367+0000","last_fullsized":"2024-09-14T10:48:33.532367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:33.531807+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:33.531807+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.531807+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:30.728116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.446139+0000","last_change":"2024-09-14T10:44:11.365421+0000","last_active":"2024-09-14T10:46:29.446139+0000","last_peered":"2024-09-14T10:46:29.446139+0000","last_clean":"2024-09-14T10:46:29.446139+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:46:29.446139+0000","last_undegraded":"2024-09-14T10:46:29.446139+0000","last_fullsized":"2024-09-14T10:46:29.446139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":514,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.689447+0000","last_change":"2024-09-14T10:48:46.689447+0000","last_active":"2024-09-14T10:48:46.689447+0000","last_peered":"2024-09-14T10:48:46.689447+0000","last_clean":"2024-09-14T10:48:46.689447+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:48:46.689447+0000","last_undegraded":"2024-09-14T10:48:46.689447+0000","last_fullsized":"2024-09-14T10:48:46.689447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:46.689269+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:46.689269+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.689269+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:54.147990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.533081+0000","last_change":"2024-09-14T10:48:46.533081+0000","last_active":"2024-09-14T10:48:46.533081+0000","last_peered":"2024-09-14T10:48:46.533081+0000","last_clean":"2024-09-14T10:48:46.533081+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:48:46.533081+0000","last_undegraded":"2024-09-14T10:48:46.533081+0000","last_fullsized":"2024-09-14T10:48:46.533081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:46.532898+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:46.532898+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.532898+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:04.625405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.480761+0000","last_change":"2024-09-14T10:48:15.480619+0000","last_active":"2024-09-14T10:48:15.480761+0000","last_peered":"2024-09-14T10:48:15.480761+0000","last_clean":"2024-09-14T10:48:15.480761+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:48:15.480761+0000","last_undegraded":"2024-09-14T10:48:15.480761+0000","last_fullsized":"2024-09-14T10:48:15.480761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:15.480424+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:15.480424+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.480424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:35.371076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.058250+0000","last_change":"2024-09-14T10:48:02.058107+0000","last_active":"2024-09-14T10:48:02.058250+0000","last_peered":"2024-09-14T10:48:02.058250+0000","last_clean":"2024-09-14T10:48:02.058250+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:48:02.058250+0000","last_undegraded":"2024-09-14T10:48:02.058250+0000","last_fullsized":"2024-09-14T10:48:02.058250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.057931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:29.184273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.694350+0000","last_change":"2024-09-14T10:48:47.694350+0000","last_active":"2024-09-14T10:48:47.694350+0000","last_peered":"2024-09-14T10:48:47.694350+0000","last_clean":"2024-09-14T10:48:47.694350+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:48:47.694350+0000","last_undegraded":"2024-09-14T10:48:47.694350+0000","last_fullsized":"2024-09-14T10:48:47.694350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.694176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.694176+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.694176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:03.255974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.633480+0000","last_change":"2024-09-14T10:48:42.633335+0000","last_active":"2024-09-14T10:48:42.633480+0000","last_peered":"2024-09-14T10:48:42.633480+0000","last_clean":"2024-09-14T10:48:42.633480+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:48:42.633480+0000","last_undegraded":"2024-09-14T10:48:42.633480+0000","last_fullsized":"2024-09-14T10:48:42.633480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-14T10:48:42.633151+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-14T10:48:42.633151+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.633151+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:24.160724+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.439615+0000","last_change":"2024-09-14T10:48:40.439449+0000","last_active":"2024-09-14T10:48:40.439615+0000","last_peered":"2024-09-14T10:48:40.439615+0000","last_clean":"2024-09-14T10:48:40.439615+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:48:40.439615+0000","last_undegraded":"2024-09-14T10:48:40.439615+0000","last_fullsized":"2024-09-14T10:48:40.439615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:40.439262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:40.439262+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.439262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:38.874795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.777596+0000","last_change":"2024-09-14T10:48:51.777596+0000","last_active":"2024-09-14T10:48:51.777596+0000","last_peered":"2024-09-14T10:48:51.777596+0000","last_clean":"2024-09-14T10:48:51.777596+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:48:51.777596+0000","last_undegraded":"2024-09-14T10:48:51.777596+0000","last_fullsized":"2024-09-14T10:48:51.777596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-14T10:48:51.777409+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-14T10:48:51.777409+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.777409+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:10.132034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.904259+0000","last_change":"2024-09-14T10:48:26.904259+0000","last_active":"2024-09-14T10:48:26.904259+0000","last_peered":"2024-09-14T10:48:26.904259+0000","last_clean":"2024-09-14T10:48:26.904259+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:48:26.904259+0000","last_undegraded":"2024-09-14T10:48:26.904259+0000","last_fullsized":"2024-09-14T10:48:26.904259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:26.904057+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:26.904057+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.904057+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:00.215590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.245843+0000","last_change":"2024-09-14T10:47:57.245843+0000","last_active":"2024-09-14T10:47:57.245843+0000","last_peered":"2024-09-14T10:47:57.245843+0000","last_clean":"2024-09-14T10:47:57.245843+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:47:57.245843+0000","last_undegraded":"2024-09-14T10:47:57.245843+0000","last_fullsized":"2024-09-14T10:47:57.245843+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.245648+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:34.787201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.098357+0000","last_change":"2024-09-14T10:48:00.098121+0000","last_active":"2024-09-14T10:48:00.098357+0000","last_peered":"2024-09-14T10:48:00.098357+0000","last_clean":"2024-09-14T10:48:00.098357+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:48:00.098357+0000","last_undegraded":"2024-09-14T10:48:00.098357+0000","last_fullsized":"2024-09-14T10:48:00.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.097899+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:08.489566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.044417+0000","last_change":"2024-09-14T10:48:03.044221+0000","last_active":"2024-09-14T10:48:03.044417+0000","last_peered":"2024-09-14T10:48:03.044417+0000","last_clean":"2024-09-14T10:48:03.044417+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:48:03.044417+0000","last_undegraded":"2024-09-14T10:48:03.044417+0000","last_fullsized":"2024-09-14T10:48:03.044417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.044031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.988834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.446959+0000","last_change":"2024-09-14T10:48:31.446959+0000","last_active":"2024-09-14T10:48:31.446959+0000","last_peered":"2024-09-14T10:48:31.446959+0000","last_clean":"2024-09-14T10:48:31.446959+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:48:31.446959+0000","last_undegraded":"2024-09-14T10:48:31.446959+0000","last_fullsized":"2024-09-14T10:48:31.446959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:31.446787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:31.446787+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.446787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:40.642565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'86","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.156359+0000","last_change":"2024-09-14T10:44:11.357369+0000","last_active":"2024-09-14T10:47:53.156359+0000","last_peered":"2024-09-14T10:47:53.156359+0000","last_clean":"2024-09-14T10:47:53.156359+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:47:53.156359+0000","last_undegraded":"2024-09-14T10:47:53.156359+0000","last_fullsized":"2024-09-14T10:47:53.156359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.557229+0000","last_change":"2024-09-14T10:48:42.557229+0000","last_active":"2024-09-14T10:48:42.557229+0000","last_peered":"2024-09-14T10:48:42.557229+0000","last_clean":"2024-09-14T10:48:42.557229+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:48:42.557229+0000","last_undegraded":"2024-09-14T10:48:42.557229+0000","last_fullsized":"2024-09-14T10:48:42.557229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:42.557031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:42.557031+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.557031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:10.725225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.499364+0000","last_change":"2024-09-14T10:48:47.499364+0000","last_active":"2024-09-14T10:48:47.499364+0000","last_peered":"2024-09-14T10:48:47.499364+0000","last_clean":"2024-09-14T10:48:47.499364+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:48:47.499364+0000","last_undegraded":"2024-09-14T10:48:47.499364+0000","last_fullsized":"2024-09-14T10:48:47.499364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'84","last_scrub_stamp":"2024-09-14T10:48:47.499134+0000","last_deep_scrub":"34'84","last_deep_scrub_stamp":"2024-09-14T10:48:47.499134+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.499134+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:00.278486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.848964+0000","last_change":"2024-09-14T10:48:28.848791+0000","last_active":"2024-09-14T10:48:28.848964+0000","last_peered":"2024-09-14T10:48:28.848964+0000","last_clean":"2024-09-14T10:48:28.848964+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:48:28.848964+0000","last_undegraded":"2024-09-14T10:48:28.848964+0000","last_fullsized":"2024-09-14T10:48:28.848964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:28.848584+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:28.848584+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.848584+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:33.208461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.110721+0000","last_change":"2024-09-14T10:47:59.110585+0000","last_active":"2024-09-14T10:47:59.110721+0000","last_peered":"2024-09-14T10:47:59.110721+0000","last_clean":"2024-09-14T10:47:59.110721+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:47:59.110721+0000","last_undegraded":"2024-09-14T10:47:59.110721+0000","last_fullsized":"2024-09-14T10:47:59.110721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.110378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.838325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.456447+0000","last_change":"2024-09-14T10:48:00.456288+0000","last_active":"2024-09-14T10:48:00.456447+0000","last_peered":"2024-09-14T10:48:00.456447+0000","last_clean":"2024-09-14T10:48:00.456447+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:48:00.456447+0000","last_undegraded":"2024-09-14T10:48:00.456447+0000","last_fullsized":"2024-09-14T10:48:00.456447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.456099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:16.850631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.716345+0000","last_change":"2024-09-14T10:48:46.716345+0000","last_active":"2024-09-14T10:48:46.716345+0000","last_peered":"2024-09-14T10:48:46.716345+0000","last_clean":"2024-09-14T10:48:46.716345+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:48:46.716345+0000","last_undegraded":"2024-09-14T10:48:46.716345+0000","last_fullsized":"2024-09-14T10:48:46.716345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:46.716165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:46.716165+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.716165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:46.735357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'294","reported_seq":521,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.638776+0000","last_change":"2024-09-14T10:48:40.638776+0000","last_active":"2024-09-14T10:48:40.638776+0000","last_peered":"2024-09-14T10:48:40.638776+0000","last_clean":"2024-09-14T10:48:40.638776+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:48:40.638776+0000","last_undegraded":"2024-09-14T10:48:40.638776+0000","last_fullsized":"2024-09-14T10:48:40.638776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'294","last_scrub_stamp":"2024-09-14T10:48:40.638529+0000","last_deep_scrub":"34'294","last_deep_scrub_stamp":"2024-09-14T10:48:40.638529+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.638529+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.944766+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:19.443340+0000","last_change":"2024-09-14T10:44:13.368580+0000","last_active":"2024-09-14T10:46:19.443340+0000","last_peered":"2024-09-14T10:46:19.443340+0000","last_clean":"2024-09-14T10:46:19.443340+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:46:19.443340+0000","last_undegraded":"2024-09-14T10:46:19.443340+0000","last_fullsized":"2024-09-14T10:46:19.443340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.442429+0000","last_change":"2024-09-14T10:44:15.392131+0000","last_active":"2024-09-14T10:46:24.442429+0000","last_peered":"2024-09-14T10:46:24.442429+0000","last_clean":"2024-09-14T10:46:24.442429+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:46:24.442429+0000","last_undegraded":"2024-09-14T10:46:24.442429+0000","last_fullsized":"2024-09-14T10:46:24.442429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.567720+0000","last_change":"2024-09-14T10:48:12.567549+0000","last_active":"2024-09-14T10:48:12.567720+0000","last_peered":"2024-09-14T10:48:12.567720+0000","last_clean":"2024-09-14T10:48:12.567720+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:48:12.567720+0000","last_undegraded":"2024-09-14T10:48:12.567720+0000","last_fullsized":"2024-09-14T10:48:12.567720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.567361+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:57.983269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.581742+0000","last_change":"2024-09-14T10:47:58.581615+0000","last_active":"2024-09-14T10:47:58.581742+0000","last_peered":"2024-09-14T10:47:58.581742+0000","last_clean":"2024-09-14T10:47:58.581742+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:47:58.581742+0000","last_undegraded":"2024-09-14T10:47:58.581742+0000","last_fullsized":"2024-09-14T10:47:58.581742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.581432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:45.392307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.414030+0000","last_change":"2024-09-14T10:48:01.413761+0000","last_active":"2024-09-14T10:48:01.414030+0000","last_peered":"2024-09-14T10:48:01.414030+0000","last_clean":"2024-09-14T10:48:01.414030+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:48:01.414030+0000","last_undegraded":"2024-09-14T10:48:01.414030+0000","last_fullsized":"2024-09-14T10:48:01.414030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.413492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.502183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.642698+0000","last_change":"2024-09-14T10:48:26.642521+0000","last_active":"2024-09-14T10:48:26.642698+0000","last_peered":"2024-09-14T10:48:26.642698+0000","last_clean":"2024-09-14T10:48:26.642698+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:48:26.642698+0000","last_undegraded":"2024-09-14T10:48:26.642698+0000","last_fullsized":"2024-09-14T10:48:26.642698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:26.642330+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:26.642330+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.642330+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:19.213154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.571067+0000","last_change":"2024-09-14T10:48:32.571067+0000","last_active":"2024-09-14T10:48:32.571067+0000","last_peered":"2024-09-14T10:48:32.571067+0000","last_clean":"2024-09-14T10:48:32.571067+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:48:32.571067+0000","last_undegraded":"2024-09-14T10:48:32.571067+0000","last_fullsized":"2024-09-14T10:48:32.571067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-14T10:48:32.570846+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-14T10:48:32.570846+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.570846+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:53:30.502745+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.520232+0000","last_change":"2024-09-14T10:48:41.520232+0000","last_active":"2024-09-14T10:48:41.520232+0000","last_peered":"2024-09-14T10:48:41.520232+0000","last_clean":"2024-09-14T10:48:41.520232+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:48:41.520232+0000","last_undegraded":"2024-09-14T10:48:41.520232+0000","last_fullsized":"2024-09-14T10:48:41.520232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:41.520044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:41.520044+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.520044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:23.047617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.446016+0000","last_change":"2024-09-14T10:44:15.379368+0000","last_active":"2024-09-14T10:46:29.446016+0000","last_peered":"2024-09-14T10:46:29.446016+0000","last_clean":"2024-09-14T10:46:29.446016+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:46:29.446016+0000","last_undegraded":"2024-09-14T10:46:29.446016+0000","last_fullsized":"2024-09-14T10:46:29.446016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.613733+0000","last_change":"2024-09-14T10:48:13.613570+0000","last_active":"2024-09-14T10:48:13.613733+0000","last_peered":"2024-09-14T10:48:13.613733+0000","last_clean":"2024-09-14T10:48:13.613733+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:48:13.613733+0000","last_undegraded":"2024-09-14T10:48:13.613733+0000","last_fullsized":"2024-09-14T10:48:13.613733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.613391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:50.163937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.149492+0000","last_change":"2024-09-14T10:47:58.149312+0000","last_active":"2024-09-14T10:47:58.149492+0000","last_peered":"2024-09-14T10:47:58.149492+0000","last_clean":"2024-09-14T10:47:58.149492+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:47:58.149492+0000","last_undegraded":"2024-09-14T10:47:58.149492+0000","last_fullsized":"2024-09-14T10:47:58.149492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.149127+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:37.977768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.572653+0000","last_change":"2024-09-14T10:48:00.572497+0000","last_active":"2024-09-14T10:48:00.572653+0000","last_peered":"2024-09-14T10:48:00.572653+0000","last_clean":"2024-09-14T10:48:00.572653+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:48:00.572653+0000","last_undegraded":"2024-09-14T10:48:00.572653+0000","last_fullsized":"2024-09-14T10:48:00.572653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.572309+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:24.566081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.559461+0000","last_change":"2024-09-14T10:48:23.559461+0000","last_active":"2024-09-14T10:48:23.559461+0000","last_peered":"2024-09-14T10:48:23.559461+0000","last_clean":"2024-09-14T10:48:23.559461+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:48:23.559461+0000","last_undegraded":"2024-09-14T10:48:23.559461+0000","last_fullsized":"2024-09-14T10:48:23.559461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:23.559204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:23.559204+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.559204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:28.629556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.694473+0000","last_change":"2024-09-14T10:48:53.694473+0000","last_active":"2024-09-14T10:48:53.694473+0000","last_peered":"2024-09-14T10:48:53.694473+0000","last_clean":"2024-09-14T10:48:53.694473+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:48:53.694473+0000","last_undegraded":"2024-09-14T10:48:53.694473+0000","last_fullsized":"2024-09-14T10:48:53.694473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-14T10:48:53.694274+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-14T10:48:53.694274+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.694274+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:45.043117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:24.444779+0000","last_change":"2024-09-14T10:44:13.368952+0000","last_active":"2024-09-14T10:46:24.444779+0000","last_peered":"2024-09-14T10:46:24.444779+0000","last_clean":"2024-09-14T10:46:24.444779+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:46:24.444779+0000","last_undegraded":"2024-09-14T10:46:24.444779+0000","last_fullsized":"2024-09-14T10:46:24.444779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.717566+0000","last_change":"2024-09-14T10:48:53.717566+0000","last_active":"2024-09-14T10:48:53.717566+0000","last_peered":"2024-09-14T10:48:53.717566+0000","last_clean":"2024-09-14T10:48:53.717566+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:48:53.717566+0000","last_undegraded":"2024-09-14T10:48:53.717566+0000","last_fullsized":"2024-09-14T10:48:53.717566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:53.717357+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:53.717357+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.717357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:42.759549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.468843+0000","last_change":"2024-09-14T10:48:11.468705+0000","last_active":"2024-09-14T10:48:11.468843+0000","last_peered":"2024-09-14T10:48:11.468843+0000","last_clean":"2024-09-14T10:48:11.468843+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:48:11.468843+0000","last_undegraded":"2024-09-14T10:48:11.468843+0000","last_fullsized":"2024-09-14T10:48:11.468843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.468533+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:45.152569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.623568+0000","last_change":"2024-09-14T10:47:57.623416+0000","last_active":"2024-09-14T10:47:57.623568+0000","last_peered":"2024-09-14T10:47:57.623568+0000","last_clean":"2024-09-14T10:47:57.623568+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:47:57.623568+0000","last_undegraded":"2024-09-14T10:47:57.623568+0000","last_fullsized":"2024-09-14T10:47:57.623568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.623229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:32.565978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.487932+0000","last_change":"2024-09-14T10:47:57.487828+0000","last_active":"2024-09-14T10:47:57.487932+0000","last_peered":"2024-09-14T10:47:57.487932+0000","last_clean":"2024-09-14T10:47:57.487932+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:47:57.487932+0000","last_undegraded":"2024-09-14T10:47:57.487932+0000","last_fullsized":"2024-09-14T10:47:57.487932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.487712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:43.722639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.624258+0000","last_change":"2024-09-14T10:48:25.624110+0000","last_active":"2024-09-14T10:48:25.624258+0000","last_peered":"2024-09-14T10:48:25.624258+0000","last_clean":"2024-09-14T10:48:25.624258+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:48:25.624258+0000","last_undegraded":"2024-09-14T10:48:25.624258+0000","last_fullsized":"2024-09-14T10:48:25.624258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:25.623922+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:25.623922+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.623922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:39.508678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'77","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.611378+0000","last_change":"2024-09-14T10:48:32.611378+0000","last_active":"2024-09-14T10:48:32.611378+0000","last_peered":"2024-09-14T10:48:32.611378+0000","last_clean":"2024-09-14T10:48:32.611378+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:48:32.611378+0000","last_undegraded":"2024-09-14T10:48:32.611378+0000","last_fullsized":"2024-09-14T10:48:32.611378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-09-14T10:48:32.611179+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-09-14T10:48:32.611179+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.611179+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.807488+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.425772+0000","last_change":"2024-09-14T10:48:38.425772+0000","last_active":"2024-09-14T10:48:38.425772+0000","last_peered":"2024-09-14T10:48:38.425772+0000","last_clean":"2024-09-14T10:48:38.425772+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:48:38.425772+0000","last_undegraded":"2024-09-14T10:48:38.425772+0000","last_fullsized":"2024-09-14T10:48:38.425772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:38.425580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:38.425580+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.425580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:05.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:55.716129+0000","last_change":"2024-09-14T10:48:55.716129+0000","last_active":"2024-09-14T10:48:55.716129+0000","last_peered":"2024-09-14T10:48:55.716129+0000","last_clean":"2024-09-14T10:48:55.716129+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:48:55.716129+0000","last_undegraded":"2024-09-14T10:48:55.716129+0000","last_fullsized":"2024-09-14T10:48:55.716129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:55.715943+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:55.715943+0000","last_clean_scrub_stamp":"2024-09-14T10:48:55.715943+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:37.863971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.481717+0000","last_change":"2024-09-14T10:48:12.481545+0000","last_active":"2024-09-14T10:48:12.481717+0000","last_peered":"2024-09-14T10:48:12.481717+0000","last_clean":"2024-09-14T10:48:12.481717+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:48:12.481717+0000","last_undegraded":"2024-09-14T10:48:12.481717+0000","last_fullsized":"2024-09-14T10:48:12.481717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.481368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.388398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.477560+0000","last_change":"2024-09-14T10:47:58.477358+0000","last_active":"2024-09-14T10:47:58.477560+0000","last_peered":"2024-09-14T10:47:58.477560+0000","last_clean":"2024-09-14T10:47:58.477560+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:58.477560+0000","last_undegraded":"2024-09-14T10:47:58.477560+0000","last_fullsized":"2024-09-14T10:47:58.477560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.477145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.383210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.998360+0000","last_change":"2024-09-14T10:48:03.998223+0000","last_active":"2024-09-14T10:48:03.998360+0000","last_peered":"2024-09-14T10:48:03.998360+0000","last_clean":"2024-09-14T10:48:03.998360+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:48:03.998360+0000","last_undegraded":"2024-09-14T10:48:03.998360+0000","last_fullsized":"2024-09-14T10:48:03.998360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.998046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.536432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.728758+0000","last_change":"2024-09-14T10:48:45.728758+0000","last_active":"2024-09-14T10:48:45.728758+0000","last_peered":"2024-09-14T10:48:45.728758+0000","last_clean":"2024-09-14T10:48:45.728758+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:48:45.728758+0000","last_undegraded":"2024-09-14T10:48:45.728758+0000","last_fullsized":"2024-09-14T10:48:45.728758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:45.728586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:45.728586+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.728586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:21.992740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.550457+0000","last_change":"2024-09-14T10:48:38.550457+0000","last_active":"2024-09-14T10:48:38.550457+0000","last_peered":"2024-09-14T10:48:38.550457+0000","last_clean":"2024-09-14T10:48:38.550457+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:48:38.550457+0000","last_undegraded":"2024-09-14T10:48:38.550457+0000","last_fullsized":"2024-09-14T10:48:38.550457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-14T10:48:38.550231+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-14T10:48:38.550231+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.550231+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:25.910802+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.677575+0000","last_change":"2024-09-14T10:48:45.677575+0000","last_active":"2024-09-14T10:48:45.677575+0000","last_peered":"2024-09-14T10:48:45.677575+0000","last_clean":"2024-09-14T10:48:45.677575+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:48:45.677575+0000","last_undegraded":"2024-09-14T10:48:45.677575+0000","last_fullsized":"2024-09-14T10:48:45.677575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:45.677384+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:45.677384+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.677384+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:51.575023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.446252+0000","last_change":"2024-09-14T10:44:15.371433+0000","last_active":"2024-09-14T10:46:29.446252+0000","last_peered":"2024-09-14T10:46:29.446252+0000","last_clean":"2024-09-14T10:46:29.446252+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:46:29.446252+0000","last_undegraded":"2024-09-14T10:46:29.446252+0000","last_fullsized":"2024-09-14T10:46:29.446252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.929810+0000","last_change":"2024-09-14T10:48:24.929810+0000","last_active":"2024-09-14T10:48:24.929810+0000","last_peered":"2024-09-14T10:48:24.929810+0000","last_clean":"2024-09-14T10:48:24.929810+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:48:24.929810+0000","last_undegraded":"2024-09-14T10:48:24.929810+0000","last_fullsized":"2024-09-14T10:48:24.929810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:24.929616+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:24.929616+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.929616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:39.211133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.041432+0000","last_change":"2024-09-14T10:48:06.041282+0000","last_active":"2024-09-14T10:48:06.041432+0000","last_peered":"2024-09-14T10:48:06.041432+0000","last_clean":"2024-09-14T10:48:06.041432+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:48:06.041432+0000","last_undegraded":"2024-09-14T10:48:06.041432+0000","last_fullsized":"2024-09-14T10:48:06.041432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.041120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:55.979958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:56.524180+0000","last_change":"2024-09-14T10:47:56.524057+0000","last_active":"2024-09-14T10:47:56.524180+0000","last_peered":"2024-09-14T10:47:56.524180+0000","last_clean":"2024-09-14T10:47:56.524180+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:47:56.524180+0000","last_undegraded":"2024-09-14T10:47:56.524180+0000","last_fullsized":"2024-09-14T10:47:56.524180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_clean_scrub_stamp":"2024-09-14T10:47:56.523860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:01.837471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.694914+0000","last_change":"2024-09-14T10:48:44.694914+0000","last_active":"2024-09-14T10:48:44.694914+0000","last_peered":"2024-09-14T10:48:44.694914+0000","last_clean":"2024-09-14T10:48:44.694914+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:48:44.694914+0000","last_undegraded":"2024-09-14T10:48:44.694914+0000","last_fullsized":"2024-09-14T10:48:44.694914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.694737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.694737+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.694737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:48.362904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.717581+0000","last_change":"2024-09-14T10:48:52.717581+0000","last_active":"2024-09-14T10:48:52.717581+0000","last_peered":"2024-09-14T10:48:52.717581+0000","last_clean":"2024-09-14T10:48:52.717581+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:48:52.717581+0000","last_undegraded":"2024-09-14T10:48:52.717581+0000","last_fullsized":"2024-09-14T10:48:52.717581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:52.717383+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:52.717383+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.717383+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:24.329304+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":432,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.565178+0000","last_change":"2024-09-14T10:48:40.565178+0000","last_active":"2024-09-14T10:48:40.565178+0000","last_peered":"2024-09-14T10:48:40.565178+0000","last_clean":"2024-09-14T10:48:40.565178+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:48:40.565178+0000","last_undegraded":"2024-09-14T10:48:40.565178+0000","last_fullsized":"2024-09-14T10:48:40.565178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:40.564999+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:40.564999+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.564999+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:30.676479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:29.443869+0000","last_change":"2024-09-14T10:44:15.380474+0000","last_active":"2024-09-14T10:46:29.443869+0000","last_peered":"2024-09-14T10:46:29.443869+0000","last_clean":"2024-09-14T10:46:29.443869+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:46:29.443869+0000","last_undegraded":"2024-09-14T10:46:29.443869+0000","last_fullsized":"2024-09-14T10:46:29.443869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.839501+0000","last_change":"2024-09-14T10:48:11.839361+0000","last_active":"2024-09-14T10:48:11.839501+0000","last_peered":"2024-09-14T10:48:11.839501+0000","last_clean":"2024-09-14T10:48:11.839501+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:48:11.839501+0000","last_undegraded":"2024-09-14T10:48:11.839501+0000","last_fullsized":"2024-09-14T10:48:11.839501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.839181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:55.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.217592+0000","last_change":"2024-09-14T10:47:58.217454+0000","last_active":"2024-09-14T10:47:58.217592+0000","last_peered":"2024-09-14T10:47:58.217592+0000","last_clean":"2024-09-14T10:47:58.217592+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:47:58.217592+0000","last_undegraded":"2024-09-14T10:47:58.217592+0000","last_fullsized":"2024-09-14T10:47:58.217592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.217266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:03.530877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.067246+0000","last_change":"2024-09-14T10:48:01.067081+0000","last_active":"2024-09-14T10:48:01.067246+0000","last_peered":"2024-09-14T10:48:01.067246+0000","last_clean":"2024-09-14T10:48:01.067246+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:48:01.067246+0000","last_undegraded":"2024-09-14T10:48:01.067246+0000","last_fullsized":"2024-09-14T10:48:01.067246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.066905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:15.602397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.692185+0000","last_change":"2024-09-14T10:48:43.692185+0000","last_active":"2024-09-14T10:48:43.692185+0000","last_peered":"2024-09-14T10:48:43.692185+0000","last_clean":"2024-09-14T10:48:43.692185+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:48:43.692185+0000","last_undegraded":"2024-09-14T10:48:43.692185+0000","last_fullsized":"2024-09-14T10:48:43.692185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.692008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.692008+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.692008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:45.530106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'100","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.534479+0000","last_change":"2024-09-14T10:48:33.534479+0000","last_active":"2024-09-14T10:48:33.534479+0000","last_peered":"2024-09-14T10:48:33.534479+0000","last_clean":"2024-09-14T10:48:33.534479+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:48:33.534479+0000","last_undegraded":"2024-09-14T10:48:33.534479+0000","last_fullsized":"2024-09-14T10:48:33.534479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'100","last_scrub_stamp":"2024-09-14T10:48:33.534256+0000","last_deep_scrub":"34'100","last_deep_scrub_stamp":"2024-09-14T10:48:33.534256+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.534256+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:30.978930+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.621964+0000","last_change":"2024-09-14T10:48:38.621964+0000","last_active":"2024-09-14T10:48:38.621964+0000","last_peered":"2024-09-14T10:48:38.621964+0000","last_clean":"2024-09-14T10:48:38.621964+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:48:38.621964+0000","last_undegraded":"2024-09-14T10:48:38.621964+0000","last_fullsized":"2024-09-14T10:48:38.621964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:38.621875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:38.621875+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.621875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:02.948854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.481579+0000","last_change":"2024-09-14T10:48:48.481579+0000","last_active":"2024-09-14T10:48:48.481579+0000","last_peered":"2024-09-14T10:48:48.481579+0000","last_clean":"2024-09-14T10:48:48.481579+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:48:48.481579+0000","last_undegraded":"2024-09-14T10:48:48.481579+0000","last_fullsized":"2024-09-14T10:48:48.481579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:48.481360+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:48.481360+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.481360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:00.754346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.465376+0000","last_change":"2024-09-14T10:48:50.465376+0000","last_active":"2024-09-14T10:48:50.465376+0000","last_peered":"2024-09-14T10:48:50.465376+0000","last_clean":"2024-09-14T10:48:50.465376+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:48:50.465376+0000","last_undegraded":"2024-09-14T10:48:50.465376+0000","last_fullsized":"2024-09-14T10:48:50.465376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:50.465198+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:50.465198+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.465198+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:19.453603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.749236+0000","last_change":"2024-09-14T10:48:16.748979+0000","last_active":"2024-09-14T10:48:16.749236+0000","last_peered":"2024-09-14T10:48:16.749236+0000","last_clean":"2024-09-14T10:48:16.749236+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:48:16.749236+0000","last_undegraded":"2024-09-14T10:48:16.749236+0000","last_fullsized":"2024-09-14T10:48:16.749236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:16.748707+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:16.748707+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.748707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:29.127800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.979894+0000","last_change":"2024-09-14T10:48:11.979725+0000","last_active":"2024-09-14T10:48:11.979894+0000","last_peered":"2024-09-14T10:48:11.979894+0000","last_clean":"2024-09-14T10:48:11.979894+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:48:11.979894+0000","last_undegraded":"2024-09-14T10:48:11.979894+0000","last_fullsized":"2024-09-14T10:48:11.979894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.979551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:25.927244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.549319+0000","last_change":"2024-09-14T10:48:34.549173+0000","last_active":"2024-09-14T10:48:34.549319+0000","last_peered":"2024-09-14T10:48:34.549319+0000","last_clean":"2024-09-14T10:48:34.549319+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:48:34.549319+0000","last_undegraded":"2024-09-14T10:48:34.549319+0000","last_fullsized":"2024-09-14T10:48:34.549319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:34.548997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:34.548997+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.548997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:34.500266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.102759+0000","last_change":"2024-09-14T10:44:11.356682+0000","last_active":"2024-09-14T10:47:53.102759+0000","last_peered":"2024-09-14T10:47:53.102759+0000","last_clean":"2024-09-14T10:47:53.102759+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:47:53.102759+0000","last_undegraded":"2024-09-14T10:47:53.102759+0000","last_fullsized":"2024-09-14T10:47:53.102759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:34.447241+0000","last_change":"2024-09-14T10:44:13.370490+0000","last_active":"2024-09-14T10:46:34.447241+0000","last_peered":"2024-09-14T10:46:34.447241+0000","last_clean":"2024-09-14T10:46:34.447241+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:46:34.447241+0000","last_undegraded":"2024-09-14T10:46:34.447241+0000","last_fullsized":"2024-09-14T10:46:34.447241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.287971+0000","last_change":"2024-09-14T10:44:15.361905+0000","last_active":"2024-09-14T10:46:18.287971+0000","last_peered":"2024-09-14T10:46:18.287971+0000","last_clean":"2024-09-14T10:46:18.287971+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:46:18.287971+0000","last_undegraded":"2024-09-14T10:46:18.287971+0000","last_fullsized":"2024-09-14T10:46:18.287971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.470865+0000","last_change":"2024-09-14T10:48:16.470720+0000","last_active":"2024-09-14T10:48:16.470865+0000","last_peered":"2024-09-14T10:48:16.470865+0000","last_clean":"2024-09-14T10:48:16.470865+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:48:16.470865+0000","last_undegraded":"2024-09-14T10:48:16.470865+0000","last_fullsized":"2024-09-14T10:48:16.470865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:16.470534+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:16.470534+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.470534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:20.092198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.594514+0000","last_change":"2024-09-14T10:48:02.594367+0000","last_active":"2024-09-14T10:48:02.594514+0000","last_peered":"2024-09-14T10:48:02.594514+0000","last_clean":"2024-09-14T10:48:02.594514+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:48:02.594514+0000","last_undegraded":"2024-09-14T10:48:02.594514+0000","last_fullsized":"2024-09-14T10:48:02.594514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.594183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.132926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.676176+0000","last_change":"2024-09-14T10:48:49.676176+0000","last_active":"2024-09-14T10:48:49.676176+0000","last_peered":"2024-09-14T10:48:49.676176+0000","last_clean":"2024-09-14T10:48:49.676176+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:48:49.676176+0000","last_undegraded":"2024-09-14T10:48:49.676176+0000","last_fullsized":"2024-09-14T10:48:49.676176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.675950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.675950+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.675950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:38.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.610556+0000","last_change":"2024-09-14T10:48:34.610413+0000","last_active":"2024-09-14T10:48:34.610556+0000","last_peered":"2024-09-14T10:48:34.610556+0000","last_clean":"2024-09-14T10:48:34.610556+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:48:34.610556+0000","last_undegraded":"2024-09-14T10:48:34.610556+0000","last_fullsized":"2024-09-14T10:48:34.610556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:34.610221+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:34.610221+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.610221+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:42.868537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.492445+0000","last_change":"2024-09-14T10:48:42.492309+0000","last_active":"2024-09-14T10:48:42.492445+0000","last_peered":"2024-09-14T10:48:42.492445+0000","last_clean":"2024-09-14T10:48:42.492445+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:48:42.492445+0000","last_undegraded":"2024-09-14T10:48:42.492445+0000","last_fullsized":"2024-09-14T10:48:42.492445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:42.492140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:42.492140+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.492140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:31.192955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.440980+0000","last_change":"2024-09-14T10:44:15.386483+0000","last_active":"2024-09-14T10:44:44.440980+0000","last_peered":"2024-09-14T10:44:44.440980+0000","last_clean":"2024-09-14T10:44:44.440980+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:44:44.440980+0000","last_undegraded":"2024-09-14T10:44:44.440980+0000","last_fullsized":"2024-09-14T10:44:44.440980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.723831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.626201+0000","last_change":"2024-09-14T10:48:14.626010+0000","last_active":"2024-09-14T10:48:14.626201+0000","last_peered":"2024-09-14T10:48:14.626201+0000","last_clean":"2024-09-14T10:48:14.626201+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:48:14.626201+0000","last_undegraded":"2024-09-14T10:48:14.626201+0000","last_fullsized":"2024-09-14T10:48:14.626201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.625832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:18.247497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.596198+0000","last_change":"2024-09-14T10:48:04.596063+0000","last_active":"2024-09-14T10:48:04.596198+0000","last_peered":"2024-09-14T10:48:04.596198+0000","last_clean":"2024-09-14T10:48:04.596198+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:48:04.596198+0000","last_undegraded":"2024-09-14T10:48:04.596198+0000","last_fullsized":"2024-09-14T10:48:04.596198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.595874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:58.777417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.558337+0000","last_change":"2024-09-14T10:48:28.558189+0000","last_active":"2024-09-14T10:48:28.558337+0000","last_peered":"2024-09-14T10:48:28.558337+0000","last_clean":"2024-09-14T10:48:28.558337+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:48:28.558337+0000","last_undegraded":"2024-09-14T10:48:28.558337+0000","last_fullsized":"2024-09-14T10:48:28.558337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:28.558009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:28.558009+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.558009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:34.621600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.612052+0000","last_change":"2024-09-14T10:48:36.611887+0000","last_active":"2024-09-14T10:48:36.612052+0000","last_peered":"2024-09-14T10:48:36.612052+0000","last_clean":"2024-09-14T10:48:36.612052+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:48:36.612052+0000","last_undegraded":"2024-09-14T10:48:36.612052+0000","last_fullsized":"2024-09-14T10:48:36.612052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-14T10:48:36.611684+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-14T10:48:36.611684+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.611684+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:12.339630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.723368+0000","last_change":"2024-09-14T10:48:47.723250+0000","last_active":"2024-09-14T10:48:47.723368+0000","last_peered":"2024-09-14T10:48:47.723368+0000","last_clean":"2024-09-14T10:48:47.723368+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:48:47.723368+0000","last_undegraded":"2024-09-14T10:48:47.723368+0000","last_fullsized":"2024-09-14T10:48:47.723368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.723075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.723075+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.723075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:32.907799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451891+0000","last_change":"2024-09-14T10:44:15.378526+0000","last_active":"2024-09-14T10:44:44.451891+0000","last_peered":"2024-09-14T10:44:44.451891+0000","last_clean":"2024-09-14T10:44:44.451891+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:44:44.451891+0000","last_undegraded":"2024-09-14T10:44:44.451891+0000","last_fullsized":"2024-09-14T10:44:44.451891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:34.239574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.902526+0000","last_change":"2024-09-14T10:48:30.902377+0000","last_active":"2024-09-14T10:48:30.902526+0000","last_peered":"2024-09-14T10:48:30.902526+0000","last_clean":"2024-09-14T10:48:30.902526+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:48:30.902526+0000","last_undegraded":"2024-09-14T10:48:30.902526+0000","last_fullsized":"2024-09-14T10:48:30.902526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:30.902193+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:30.902193+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.902193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:41.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.280343+0000","last_change":"2024-09-14T10:48:00.280211+0000","last_active":"2024-09-14T10:48:00.280343+0000","last_peered":"2024-09-14T10:48:00.280343+0000","last_clean":"2024-09-14T10:48:00.280343+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:48:00.280343+0000","last_undegraded":"2024-09-14T10:48:00.280343+0000","last_fullsized":"2024-09-14T10:48:00.280343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.280016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:02.623876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.673942+0000","last_change":"2024-09-14T10:48:48.673806+0000","last_active":"2024-09-14T10:48:48.673942+0000","last_peered":"2024-09-14T10:48:48.673942+0000","last_clean":"2024-09-14T10:48:48.673942+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:48:48.673942+0000","last_undegraded":"2024-09-14T10:48:48.673942+0000","last_fullsized":"2024-09-14T10:48:48.673942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:48.673623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:48.673623+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.673623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:12.881111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.430971+0000","last_change":"2024-09-14T10:48:36.430697+0000","last_active":"2024-09-14T10:48:36.430971+0000","last_peered":"2024-09-14T10:48:36.430971+0000","last_clean":"2024-09-14T10:48:36.430971+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:48:36.430971+0000","last_undegraded":"2024-09-14T10:48:36.430971+0000","last_fullsized":"2024-09-14T10:48:36.430971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-14T10:48:36.430445+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-14T10:48:36.430445+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.430445+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:46.137903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.466977+0000","last_change":"2024-09-14T10:48:43.466834+0000","last_active":"2024-09-14T10:48:43.466977+0000","last_peered":"2024-09-14T10:48:43.466977+0000","last_clean":"2024-09-14T10:48:43.466977+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:48:43.466977+0000","last_undegraded":"2024-09-14T10:48:43.466977+0000","last_fullsized":"2024-09-14T10:48:43.466977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.466665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.466665+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.466665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:38.006360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.760508+0000","last_change":"2024-09-14T10:48:34.760508+0000","last_active":"2024-09-14T10:48:34.760508+0000","last_peered":"2024-09-14T10:48:34.760508+0000","last_clean":"2024-09-14T10:48:34.760508+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:48:34.760508+0000","last_undegraded":"2024-09-14T10:48:34.760508+0000","last_fullsized":"2024-09-14T10:48:34.760508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:34.760328+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:34.760328+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.760328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:30.695415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.008939+0000","last_change":"2024-09-14T10:48:13.008639+0000","last_active":"2024-09-14T10:48:13.008939+0000","last_peered":"2024-09-14T10:48:13.008939+0000","last_clean":"2024-09-14T10:48:13.008939+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:48:13.008939+0000","last_undegraded":"2024-09-14T10:48:13.008939+0000","last_fullsized":"2024-09-14T10:48:13.008939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.008350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:31.362974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.630021+0000","last_change":"2024-09-14T10:48:29.630021+0000","last_active":"2024-09-14T10:48:29.630021+0000","last_peered":"2024-09-14T10:48:29.630021+0000","last_clean":"2024-09-14T10:48:29.630021+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:48:29.630021+0000","last_undegraded":"2024-09-14T10:48:29.630021+0000","last_fullsized":"2024-09-14T10:48:29.630021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:29.629844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:29.629844+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.629844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:51.400468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.587768+0000","last_change":"2024-09-14T10:48:39.587768+0000","last_active":"2024-09-14T10:48:39.587768+0000","last_peered":"2024-09-14T10:48:39.587768+0000","last_clean":"2024-09-14T10:48:39.587768+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:48:39.587768+0000","last_undegraded":"2024-09-14T10:48:39.587768+0000","last_fullsized":"2024-09-14T10:48:39.587768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-14T10:48:39.587554+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-14T10:48:39.587554+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.587554+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:58.893791+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.511426+0000","last_change":"2024-09-14T10:48:44.511426+0000","last_active":"2024-09-14T10:48:44.511426+0000","last_peered":"2024-09-14T10:48:44.511426+0000","last_clean":"2024-09-14T10:48:44.511426+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:48:44.511426+0000","last_undegraded":"2024-09-14T10:48:44.511426+0000","last_fullsized":"2024-09-14T10:48:44.511426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.511202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.511202+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.511202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:16.374234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:54.713184+0000","last_change":"2024-09-14T10:48:54.712895+0000","last_active":"2024-09-14T10:48:54.713184+0000","last_peered":"2024-09-14T10:48:54.713184+0000","last_clean":"2024-09-14T10:48:54.713184+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:48:54.713184+0000","last_undegraded":"2024-09-14T10:48:54.713184+0000","last_fullsized":"2024-09-14T10:48:54.713184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-14T10:48:54.712628+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-14T10:48:54.712628+0000","last_clean_scrub_stamp":"2024-09-14T10:48:54.712628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:19.210280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.496839+0000","last_change":"2024-09-14T10:48:19.496839+0000","last_active":"2024-09-14T10:48:19.496839+0000","last_peered":"2024-09-14T10:48:19.496839+0000","last_clean":"2024-09-14T10:48:19.496839+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:48:19.496839+0000","last_undegraded":"2024-09-14T10:48:19.496839+0000","last_fullsized":"2024-09-14T10:48:19.496839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:19.496651+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:19.496651+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.496651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:16.610106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.271212+0000","last_change":"2024-09-14T10:48:01.271045+0000","last_active":"2024-09-14T10:48:01.271212+0000","last_peered":"2024-09-14T10:48:01.271212+0000","last_clean":"2024-09-14T10:48:01.271212+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:48:01.271212+0000","last_undegraded":"2024-09-14T10:48:01.271212+0000","last_fullsized":"2024-09-14T10:48:01.271212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.270861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:42.910644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.522928+0000","last_change":"2024-09-14T10:48:30.522928+0000","last_active":"2024-09-14T10:48:30.522928+0000","last_peered":"2024-09-14T10:48:30.522928+0000","last_clean":"2024-09-14T10:48:30.522928+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:48:30.522928+0000","last_undegraded":"2024-09-14T10:48:30.522928+0000","last_fullsized":"2024-09-14T10:48:30.522928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:30.522747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:30.522747+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.522747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.439750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.016361+0000","last_change":"2024-09-14T10:44:11.359808+0000","last_active":"2024-09-14T10:47:53.016361+0000","last_peered":"2024-09-14T10:47:53.016361+0000","last_clean":"2024-09-14T10:47:53.016361+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:47:53.016361+0000","last_undegraded":"2024-09-14T10:47:53.016361+0000","last_fullsized":"2024-09-14T10:47:53.016361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:51.224366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.741123+0000","last_change":"2024-09-14T10:48:50.741123+0000","last_active":"2024-09-14T10:48:50.741123+0000","last_peered":"2024-09-14T10:48:50.741123+0000","last_clean":"2024-09-14T10:48:50.741123+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:48:50.741123+0000","last_undegraded":"2024-09-14T10:48:50.741123+0000","last_fullsized":"2024-09-14T10:48:50.741123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:50.740934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:50.740934+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.740934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:04.688628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:34.447360+0000","last_change":"2024-09-14T10:44:15.379606+0000","last_active":"2024-09-14T10:46:34.447360+0000","last_peered":"2024-09-14T10:46:34.447360+0000","last_clean":"2024-09-14T10:46:34.447360+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:46:34.447360+0000","last_undegraded":"2024-09-14T10:46:34.447360+0000","last_fullsized":"2024-09-14T10:46:34.447360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.738014+0000","last_change":"2024-09-14T10:48:35.738014+0000","last_active":"2024-09-14T10:48:35.738014+0000","last_peered":"2024-09-14T10:48:35.738014+0000","last_clean":"2024-09-14T10:48:35.738014+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:48:35.738014+0000","last_undegraded":"2024-09-14T10:48:35.738014+0000","last_fullsized":"2024-09-14T10:48:35.738014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:35.737790+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:35.737790+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.737790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:30.363223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.292893+0000","last_change":"2024-09-14T10:48:02.292893+0000","last_active":"2024-09-14T10:48:02.292893+0000","last_peered":"2024-09-14T10:48:02.292893+0000","last_clean":"2024-09-14T10:48:02.292893+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:48:02.292893+0000","last_undegraded":"2024-09-14T10:48:02.292893+0000","last_fullsized":"2024-09-14T10:48:02.292893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.292668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:18.687200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.549300+0000","last_change":"2024-09-14T10:48:31.549300+0000","last_active":"2024-09-14T10:48:31.549300+0000","last_peered":"2024-09-14T10:48:31.549300+0000","last_clean":"2024-09-14T10:48:31.549300+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:48:31.549300+0000","last_undegraded":"2024-09-14T10:48:31.549300+0000","last_fullsized":"2024-09-14T10:48:31.549300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:31.549097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:31.549097+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.549097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:35.467929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.650518+0000","last_change":"2024-09-14T10:48:37.650518+0000","last_active":"2024-09-14T10:48:37.650518+0000","last_peered":"2024-09-14T10:48:37.650518+0000","last_clean":"2024-09-14T10:48:37.650518+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:48:37.650518+0000","last_undegraded":"2024-09-14T10:48:37.650518+0000","last_fullsized":"2024-09-14T10:48:37.650518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-14T10:48:37.650331+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-14T10:48:37.650331+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.650331+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:25.010902+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.703578+0000","last_change":"2024-09-14T10:48:51.703578+0000","last_active":"2024-09-14T10:48:51.703578+0000","last_peered":"2024-09-14T10:48:51.703578+0000","last_clean":"2024-09-14T10:48:51.703578+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:48:51.703578+0000","last_undegraded":"2024-09-14T10:48:51.703578+0000","last_fullsized":"2024-09-14T10:48:51.703578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.703396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.703396+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.703396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:34.384980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:34.447333+0000","last_change":"2024-09-14T10:44:15.379535+0000","last_active":"2024-09-14T10:46:34.447333+0000","last_peered":"2024-09-14T10:46:34.447333+0000","last_clean":"2024-09-14T10:46:34.447333+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:46:34.447333+0000","last_undegraded":"2024-09-14T10:46:34.447333+0000","last_fullsized":"2024-09-14T10:46:34.447333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.588402+0000","last_change":"2024-09-14T10:48:16.588402+0000","last_active":"2024-09-14T10:48:16.588402+0000","last_peered":"2024-09-14T10:48:16.588402+0000","last_clean":"2024-09-14T10:48:16.588402+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:48:16.588402+0000","last_undegraded":"2024-09-14T10:48:16.588402+0000","last_fullsized":"2024-09-14T10:48:16.588402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.588185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:49.661160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.969100+0000","last_change":"2024-09-14T10:48:13.969100+0000","last_active":"2024-09-14T10:48:13.969100+0000","last_peered":"2024-09-14T10:48:13.969100+0000","last_clean":"2024-09-14T10:48:13.969100+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:48:13.969100+0000","last_undegraded":"2024-09-14T10:48:13.969100+0000","last_fullsized":"2024-09-14T10:48:13.969100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.968917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:56.650501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.603809+0000","last_change":"2024-09-14T10:48:41.603809+0000","last_active":"2024-09-14T10:48:41.603809+0000","last_peered":"2024-09-14T10:48:41.603809+0000","last_clean":"2024-09-14T10:48:41.603809+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:48:41.603809+0000","last_undegraded":"2024-09-14T10:48:41.603809+0000","last_fullsized":"2024-09-14T10:48:41.603809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:41.603602+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:41.603602+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.603602+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:31.715081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:16.526716+0000","last_change":"2024-09-14T10:44:11.365067+0000","last_active":"2024-09-14T10:46:16.526716+0000","last_peered":"2024-09-14T10:46:16.526716+0000","last_clean":"2024-09-14T10:46:16.526716+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:46:16.526716+0000","last_undegraded":"2024-09-14T10:46:16.526716+0000","last_fullsized":"2024-09-14T10:46:16.526716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.527739+0000","last_change":"2024-09-14T10:48:45.527739+0000","last_active":"2024-09-14T10:48:45.527739+0000","last_peered":"2024-09-14T10:48:45.527739+0000","last_clean":"2024-09-14T10:48:45.527739+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:48:45.527739+0000","last_undegraded":"2024-09-14T10:48:45.527739+0000","last_fullsized":"2024-09-14T10:48:45.527739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:45.527537+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:45.527537+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.527537+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:57.709365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.830816+0000","last_change":"2024-09-14T10:44:15.388635+0000","last_active":"2024-09-14T10:47:21.830816+0000","last_peered":"2024-09-14T10:47:21.830816+0000","last_clean":"2024-09-14T10:47:21.830816+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:47:21.830816+0000","last_undegraded":"2024-09-14T10:47:21.830816+0000","last_fullsized":"2024-09-14T10:47:21.830816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.760834+0000","last_change":"2024-09-14T10:48:20.760834+0000","last_active":"2024-09-14T10:48:20.760834+0000","last_peered":"2024-09-14T10:48:20.760834+0000","last_clean":"2024-09-14T10:48:20.760834+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:48:20.760834+0000","last_undegraded":"2024-09-14T10:48:20.760834+0000","last_fullsized":"2024-09-14T10:48:20.760834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:20.760654+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:20.760654+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.760654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:00.206789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.279857+0000","last_change":"2024-09-14T10:48:03.279857+0000","last_active":"2024-09-14T10:48:03.279857+0000","last_peered":"2024-09-14T10:48:03.279857+0000","last_clean":"2024-09-14T10:48:03.279857+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:48:03.279857+0000","last_undegraded":"2024-09-14T10:48:03.279857+0000","last_fullsized":"2024-09-14T10:48:03.279857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.279672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:11.368363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.564658+0000","last_change":"2024-09-14T10:48:37.564658+0000","last_active":"2024-09-14T10:48:37.564658+0000","last_peered":"2024-09-14T10:48:37.564658+0000","last_clean":"2024-09-14T10:48:37.564658+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:48:37.564658+0000","last_undegraded":"2024-09-14T10:48:37.564658+0000","last_fullsized":"2024-09-14T10:48:37.564658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:37.564481+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:37.564481+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.564481+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:19.854700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.640308+0000","last_change":"2024-09-14T10:48:44.640308+0000","last_active":"2024-09-14T10:48:44.640308+0000","last_peered":"2024-09-14T10:48:44.640308+0000","last_clean":"2024-09-14T10:48:44.640308+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:48:44.640308+0000","last_undegraded":"2024-09-14T10:48:44.640308+0000","last_fullsized":"2024-09-14T10:48:44.640308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:48:44.640106+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:48:44.640106+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.640106+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.413809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.614160+0000","last_change":"2024-09-14T10:48:47.614160+0000","last_active":"2024-09-14T10:48:47.614160+0000","last_peered":"2024-09-14T10:48:47.614160+0000","last_clean":"2024-09-14T10:48:47.614160+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:48:47.614160+0000","last_undegraded":"2024-09-14T10:48:47.614160+0000","last_fullsized":"2024-09-14T10:48:47.614160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.614005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.614005+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.614005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:50.769847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.452541+0000","last_change":"2024-09-14T10:44:15.388404+0000","last_active":"2024-09-14T10:44:44.452541+0000","last_peered":"2024-09-14T10:44:44.452541+0000","last_clean":"2024-09-14T10:44:44.452541+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:44:44.452541+0000","last_undegraded":"2024-09-14T10:44:44.452541+0000","last_fullsized":"2024-09-14T10:44:44.452541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:52.530325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.765236+0000","last_change":"2024-09-14T10:48:19.765236+0000","last_active":"2024-09-14T10:48:19.765236+0000","last_peered":"2024-09-14T10:48:19.765236+0000","last_clean":"2024-09-14T10:48:19.765236+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:48:19.765236+0000","last_undegraded":"2024-09-14T10:48:19.765236+0000","last_fullsized":"2024-09-14T10:48:19.765236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:19.765058+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:19.765058+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.765058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.778145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.957292+0000","last_change":"2024-09-14T10:48:14.957292+0000","last_active":"2024-09-14T10:48:14.957292+0000","last_peered":"2024-09-14T10:48:14.957292+0000","last_clean":"2024-09-14T10:48:14.957292+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:48:14.957292+0000","last_undegraded":"2024-09-14T10:48:14.957292+0000","last_fullsized":"2024-09-14T10:48:14.957292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:14.957115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:14.957115+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.957115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.999307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.533192+0000","last_change":"2024-09-14T10:48:29.533192+0000","last_active":"2024-09-14T10:48:29.533192+0000","last_peered":"2024-09-14T10:48:29.533192+0000","last_clean":"2024-09-14T10:48:29.533192+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:48:29.533192+0000","last_undegraded":"2024-09-14T10:48:29.533192+0000","last_fullsized":"2024-09-14T10:48:29.533192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:29.532987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:29.532987+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.532987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:36.699790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.584703+0000","last_change":"2024-09-14T10:48:35.584703+0000","last_active":"2024-09-14T10:48:35.584703+0000","last_peered":"2024-09-14T10:48:35.584703+0000","last_clean":"2024-09-14T10:48:35.584703+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:48:35.584703+0000","last_undegraded":"2024-09-14T10:48:35.584703+0000","last_fullsized":"2024-09-14T10:48:35.584703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-14T10:48:35.584572+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-14T10:48:35.584572+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.584572+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:15.413214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.441744+0000","last_change":"2024-09-14T10:44:13.369101+0000","last_active":"2024-09-14T10:44:44.441744+0000","last_peered":"2024-09-14T10:44:44.441744+0000","last_clean":"2024-09-14T10:44:44.441744+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:44:44.441744+0000","last_undegraded":"2024-09-14T10:44:44.441744+0000","last_fullsized":"2024-09-14T10:44:44.441744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:12.164053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.457651+0000","last_change":"2024-09-14T10:44:15.386917+0000","last_active":"2024-09-14T10:44:44.457651+0000","last_peered":"2024-09-14T10:44:44.457651+0000","last_clean":"2024-09-14T10:44:44.457651+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:44:44.457651+0000","last_undegraded":"2024-09-14T10:44:44.457651+0000","last_fullsized":"2024-09-14T10:44:44.457651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:38.536486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.729791+0000","last_change":"2024-09-14T10:48:18.729791+0000","last_active":"2024-09-14T10:48:18.729791+0000","last_peered":"2024-09-14T10:48:18.729791+0000","last_clean":"2024-09-14T10:48:18.729791+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:48:18.729791+0000","last_undegraded":"2024-09-14T10:48:18.729791+0000","last_fullsized":"2024-09-14T10:48:18.729791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:18.729528+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:18.729528+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.729528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.709783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.470373+0000","last_change":"2024-09-14T10:47:59.470192+0000","last_active":"2024-09-14T10:47:59.470373+0000","last_peered":"2024-09-14T10:47:59.470373+0000","last_clean":"2024-09-14T10:47:59.470373+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:59.470373+0000","last_undegraded":"2024-09-14T10:47:59.470373+0000","last_fullsized":"2024-09-14T10:47:59.470373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.470009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:41.109792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.601461+0000","last_change":"2024-09-14T10:48:36.601461+0000","last_active":"2024-09-14T10:48:36.601461+0000","last_peered":"2024-09-14T10:48:36.601461+0000","last_clean":"2024-09-14T10:48:36.601461+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:48:36.601461+0000","last_undegraded":"2024-09-14T10:48:36.601461+0000","last_fullsized":"2024-09-14T10:48:36.601461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:36.601284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:36.601284+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.601284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:15.572560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.114087+0000","last_change":"2024-09-14T10:44:11.356523+0000","last_active":"2024-09-14T10:47:53.114087+0000","last_peered":"2024-09-14T10:47:53.114087+0000","last_clean":"2024-09-14T10:47:53.114087+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:47:53.114087+0000","last_undegraded":"2024-09-14T10:47:53.114087+0000","last_fullsized":"2024-09-14T10:47:53.114087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:30.747229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:44:44.451553+0000","last_change":"2024-09-14T10:44:13.367321+0000","last_active":"2024-09-14T10:44:44.451553+0000","last_peered":"2024-09-14T10:44:44.451553+0000","last_clean":"2024-09-14T10:44:44.451553+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:44:44.451553+0000","last_undegraded":"2024-09-14T10:44:44.451553+0000","last_fullsized":"2024-09-14T10:44:44.451553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:12.314060+0000","last_clean_scrub_stamp":"2024-09-14T10:44:12.314060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:58.066611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:18.662711+0000","last_change":"2024-09-14T10:44:15.385986+0000","last_active":"2024-09-14T10:46:18.662711+0000","last_peered":"2024-09-14T10:46:18.662711+0000","last_clean":"2024-09-14T10:46:18.662711+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:46:18.662711+0000","last_undegraded":"2024-09-14T10:46:18.662711+0000","last_fullsized":"2024-09-14T10:46:18.662711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:58.059454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.723592+0000","last_change":"2024-09-14T10:48:17.723592+0000","last_active":"2024-09-14T10:48:17.723592+0000","last_peered":"2024-09-14T10:48:17.723592+0000","last_clean":"2024-09-14T10:48:17.723592+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:48:17.723592+0000","last_undegraded":"2024-09-14T10:48:17.723592+0000","last_fullsized":"2024-09-14T10:48:17.723592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:17.723405+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:17.723405+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.723405+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:16.395502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.315403+0000","last_change":"2024-09-14T10:48:04.315262+0000","last_active":"2024-09-14T10:48:04.315403+0000","last_peered":"2024-09-14T10:48:04.315403+0000","last_clean":"2024-09-14T10:48:04.315403+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:48:04.315403+0000","last_undegraded":"2024-09-14T10:48:04.315403+0000","last_fullsized":"2024-09-14T10:48:04.315403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.315084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:09.501850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.598708+0000","last_change":"2024-09-14T10:48:35.598708+0000","last_active":"2024-09-14T10:48:35.598708+0000","last_peered":"2024-09-14T10:48:35.598708+0000","last_clean":"2024-09-14T10:48:35.598708+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:48:35.598708+0000","last_undegraded":"2024-09-14T10:48:35.598708+0000","last_fullsized":"2024-09-14T10:48:35.598708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:35.598542+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:35.598542+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.598542+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:06.821482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:53.137521+0000","last_change":"2024-09-14T10:44:11.357069+0000","last_active":"2024-09-14T10:47:53.137521+0000","last_peered":"2024-09-14T10:47:53.137521+0000","last_clean":"2024-09-14T10:47:53.137521+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:47:53.137521+0000","last_undegraded":"2024-09-14T10:47:53.137521+0000","last_fullsized":"2024-09-14T10:47:53.137521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:10.299721+0000","last_clean_scrub_stamp":"2024-09-14T10:44:10.299721+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.681527+0000","last_change":"2024-09-14T10:48:49.681527+0000","last_active":"2024-09-14T10:48:49.681527+0000","last_peered":"2024-09-14T10:48:49.681527+0000","last_clean":"2024-09-14T10:48:49.681527+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:48:49.681527+0000","last_undegraded":"2024-09-14T10:48:49.681527+0000","last_fullsized":"2024-09-14T10:48:49.681527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.681287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.681287+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.681287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:03.628980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:21.389912+0000","last_change":"2024-09-14T10:44:15.386649+0000","last_active":"2024-09-14T10:47:21.389912+0000","last_peered":"2024-09-14T10:47:21.389912+0000","last_clean":"2024-09-14T10:47:21.389912+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:47:21.389912+0000","last_undegraded":"2024-09-14T10:47:21.389912+0000","last_fullsized":"2024-09-14T10:47:21.389912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.468297+0000","last_change":"2024-09-14T10:48:19.468123+0000","last_active":"2024-09-14T10:48:19.468297+0000","last_peered":"2024-09-14T10:48:19.468297+0000","last_clean":"2024-09-14T10:48:19.468297+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:48:19.468297+0000","last_undegraded":"2024-09-14T10:48:19.468297+0000","last_fullsized":"2024-09-14T10:48:19.468297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:19.467939+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:19.467939+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.467939+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:55.076769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.685193+0000","last_change":"2024-09-14T10:48:06.684936+0000","last_active":"2024-09-14T10:48:06.685193+0000","last_peered":"2024-09-14T10:48:06.685193+0000","last_clean":"2024-09-14T10:48:06.685193+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:48:06.685193+0000","last_undegraded":"2024-09-14T10:48:06.685193+0000","last_fullsized":"2024-09-14T10:48:06.685193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.684579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:30.618905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.540206+0000","last_change":"2024-09-14T10:48:22.539962+0000","last_active":"2024-09-14T10:48:22.540206+0000","last_peered":"2024-09-14T10:48:22.540206+0000","last_clean":"2024-09-14T10:48:22.540206+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:48:22.540206+0000","last_undegraded":"2024-09-14T10:48:22.540206+0000","last_fullsized":"2024-09-14T10:48:22.540206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:22.539696+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:22.539696+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.539696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:19.296367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.500388+0000","last_change":"2024-09-14T10:48:03.500209+0000","last_active":"2024-09-14T10:48:03.500388+0000","last_peered":"2024-09-14T10:48:03.500388+0000","last_clean":"2024-09-14T10:48:03.500388+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:48:03.500388+0000","last_undegraded":"2024-09-14T10:48:03.500388+0000","last_fullsized":"2024-09-14T10:48:03.500388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.500037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:09.580224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.713248+0000","last_change":"2024-09-14T10:48:36.713248+0000","last_active":"2024-09-14T10:48:36.713248+0000","last_peered":"2024-09-14T10:48:36.713248+0000","last_clean":"2024-09-14T10:48:36.713248+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:48:36.713248+0000","last_undegraded":"2024-09-14T10:48:36.713248+0000","last_fullsized":"2024-09-14T10:48:36.713248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:36.713060+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:36.713060+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.713060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:14.937115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.948514+0000","last_change":"2024-09-14T10:48:15.948514+0000","last_active":"2024-09-14T10:48:15.948514+0000","last_peered":"2024-09-14T10:48:15.948514+0000","last_clean":"2024-09-14T10:48:15.948514+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:48:15.948514+0000","last_undegraded":"2024-09-14T10:48:15.948514+0000","last_fullsized":"2024-09-14T10:48:15.948514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:15.948330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:15.948330+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.948330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:51.612757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.620971+0000","last_change":"2024-09-14T10:48:31.620971+0000","last_active":"2024-09-14T10:48:31.620971+0000","last_peered":"2024-09-14T10:48:31.620971+0000","last_clean":"2024-09-14T10:48:31.620971+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:48:31.620971+0000","last_undegraded":"2024-09-14T10:48:31.620971+0000","last_fullsized":"2024-09-14T10:48:31.620971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-14T10:48:31.620785+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-14T10:48:31.620785+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.620785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:12.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.437129+0000","last_change":"2024-09-14T10:48:06.436938+0000","last_active":"2024-09-14T10:48:06.437129+0000","last_peered":"2024-09-14T10:48:06.437129+0000","last_clean":"2024-09-14T10:48:06.437129+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:48:06.437129+0000","last_undegraded":"2024-09-14T10:48:06.437129+0000","last_fullsized":"2024-09-14T10:48:06.437129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.436743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:28.064799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.535992+0000","last_change":"2024-09-14T10:48:18.535992+0000","last_active":"2024-09-14T10:48:18.535992+0000","last_peered":"2024-09-14T10:48:18.535992+0000","last_clean":"2024-09-14T10:48:18.535992+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:48:18.535992+0000","last_undegraded":"2024-09-14T10:48:18.535992+0000","last_fullsized":"2024-09-14T10:48:18.535992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:18.535801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:18.535801+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.535801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:37.962177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.477417+0000","last_change":"2024-09-14T10:48:07.477245+0000","last_active":"2024-09-14T10:48:07.477417+0000","last_peered":"2024-09-14T10:48:07.477417+0000","last_clean":"2024-09-14T10:48:07.477417+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:48:07.477417+0000","last_undegraded":"2024-09-14T10:48:07.477417+0000","last_fullsized":"2024-09-14T10:48:07.477417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.477054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.420346+0000","last_change":"2024-09-14T10:48:18.420100+0000","last_active":"2024-09-14T10:48:18.420346+0000","last_peered":"2024-09-14T10:48:18.420346+0000","last_clean":"2024-09-14T10:48:18.420346+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:48:18.420346+0000","last_undegraded":"2024-09-14T10:48:18.420346+0000","last_fullsized":"2024-09-14T10:48:18.420346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:18.419824+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:18.419824+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.419824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:51.492799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.344100+0000","last_change":"2024-09-14T10:48:05.343952+0000","last_active":"2024-09-14T10:48:05.344100+0000","last_peered":"2024-09-14T10:48:05.344100+0000","last_clean":"2024-09-14T10:48:05.344100+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:48:05.344100+0000","last_undegraded":"2024-09-14T10:48:05.344100+0000","last_fullsized":"2024-09-14T10:48:05.344100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.343728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:11.423916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.572507+0000","last_change":"2024-09-14T10:48:17.572507+0000","last_active":"2024-09-14T10:48:17.572507+0000","last_peered":"2024-09-14T10:48:17.572507+0000","last_clean":"2024-09-14T10:48:17.572507+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:48:17.572507+0000","last_undegraded":"2024-09-14T10:48:17.572507+0000","last_fullsized":"2024-09-14T10:48:17.572507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:17.572324+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:17.572324+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.572324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:53.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.636701+0000","last_change":"2024-09-14T10:48:05.636531+0000","last_active":"2024-09-14T10:48:05.636701+0000","last_peered":"2024-09-14T10:48:05.636701+0000","last_clean":"2024-09-14T10:48:05.636701+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:48:05.636701+0000","last_undegraded":"2024-09-14T10:48:05.636701+0000","last_fullsized":"2024-09-14T10:48:05.636701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.636345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:39.594590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.445845+0000","last_change":"2024-09-14T10:48:17.445719+0000","last_active":"2024-09-14T10:48:17.445845+0000","last_peered":"2024-09-14T10:48:17.445845+0000","last_clean":"2024-09-14T10:48:17.445845+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:48:17.445845+0000","last_undegraded":"2024-09-14T10:48:17.445845+0000","last_fullsized":"2024-09-14T10:48:17.445845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:17.445534+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:17.445534+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.445534+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.253965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.493171+0000","last_change":"2024-09-14T10:48:04.492991+0000","last_active":"2024-09-14T10:48:04.493171+0000","last_peered":"2024-09-14T10:48:04.493171+0000","last_clean":"2024-09-14T10:48:04.493171+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:48:04.493171+0000","last_undegraded":"2024-09-14T10:48:04.493171+0000","last_fullsized":"2024-09-14T10:48:04.493171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.492802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:02.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.424125+0000","last_change":"2024-09-14T10:48:23.423969+0000","last_active":"2024-09-14T10:48:23.424125+0000","last_peered":"2024-09-14T10:48:23.424125+0000","last_clean":"2024-09-14T10:48:23.424125+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:48:23.424125+0000","last_undegraded":"2024-09-14T10:48:23.424125+0000","last_fullsized":"2024-09-14T10:48:23.424125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:23.423787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:23.423787+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.423787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:32.029468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.905728+0000","last_change":"2024-09-14T10:48:16.905587+0000","last_active":"2024-09-14T10:48:16.905728+0000","last_peered":"2024-09-14T10:48:16.905728+0000","last_clean":"2024-09-14T10:48:16.905728+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:48:16.905728+0000","last_undegraded":"2024-09-14T10:48:16.905728+0000","last_fullsized":"2024-09-14T10:48:16.905728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:16.905404+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:16.905404+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.905404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:41.403056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.683826+0000","last_change":"2024-09-14T10:48:38.683583+0000","last_active":"2024-09-14T10:48:38.683826+0000","last_peered":"2024-09-14T10:48:38.683826+0000","last_clean":"2024-09-14T10:48:38.683826+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:48:38.683826+0000","last_undegraded":"2024-09-14T10:48:38.683826+0000","last_fullsized":"2024-09-14T10:48:38.683826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:38.683371+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:38.683371+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.683371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:37.975683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.451669+0000","last_change":"2024-09-14T10:48:05.451486+0000","last_active":"2024-09-14T10:48:05.451669+0000","last_peered":"2024-09-14T10:48:05.451669+0000","last_clean":"2024-09-14T10:48:05.451669+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:48:05.451669+0000","last_undegraded":"2024-09-14T10:48:05.451669+0000","last_fullsized":"2024-09-14T10:48:05.451669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.451302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:31.147968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.489122+0000","last_change":"2024-09-14T10:48:20.488933+0000","last_active":"2024-09-14T10:48:20.489122+0000","last_peered":"2024-09-14T10:48:20.489122+0000","last_clean":"2024-09-14T10:48:20.489122+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:48:20.489122+0000","last_undegraded":"2024-09-14T10:48:20.489122+0000","last_fullsized":"2024-09-14T10:48:20.489122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:20.488751+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:20.488751+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.488751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:13.985690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.364360+0000","last_change":"2024-09-14T10:48:08.364214+0000","last_active":"2024-09-14T10:48:08.364360+0000","last_peered":"2024-09-14T10:48:08.364360+0000","last_clean":"2024-09-14T10:48:08.364360+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:48:08.364360+0000","last_undegraded":"2024-09-14T10:48:08.364360+0000","last_fullsized":"2024-09-14T10:48:08.364360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.364025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:29.992081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.418619+0000","last_change":"2024-09-14T10:48:22.418342+0000","last_active":"2024-09-14T10:48:22.418619+0000","last_peered":"2024-09-14T10:48:22.418619+0000","last_clean":"2024-09-14T10:48:22.418619+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:48:22.418619+0000","last_undegraded":"2024-09-14T10:48:22.418619+0000","last_fullsized":"2024-09-14T10:48:22.418619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:22.418134+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:22.418134+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.418134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:30.725200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.363509+0000","last_change":"2024-09-14T10:48:06.363263+0000","last_active":"2024-09-14T10:48:06.363509+0000","last_peered":"2024-09-14T10:48:06.363509+0000","last_clean":"2024-09-14T10:48:06.363509+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:48:06.363509+0000","last_undegraded":"2024-09-14T10:48:06.363509+0000","last_fullsized":"2024-09-14T10:48:06.363509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.363044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:10.900801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.466094+0000","last_change":"2024-09-14T10:48:21.465950+0000","last_active":"2024-09-14T10:48:21.466094+0000","last_peered":"2024-09-14T10:48:21.466094+0000","last_clean":"2024-09-14T10:48:21.466094+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:48:21.466094+0000","last_undegraded":"2024-09-14T10:48:21.466094+0000","last_fullsized":"2024-09-14T10:48:21.466094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:21.465744+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:21.465744+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.465744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:03.866722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.869049+0000","last_change":"2024-09-14T10:48:17.868897+0000","last_active":"2024-09-14T10:48:17.869049+0000","last_peered":"2024-09-14T10:48:17.869049+0000","last_clean":"2024-09-14T10:48:17.869049+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:48:17.869049+0000","last_undegraded":"2024-09-14T10:48:17.869049+0000","last_fullsized":"2024-09-14T10:48:17.869049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:17.868688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:17.868688+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.868688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:00.016716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.426613+0000","last_change":"2024-09-14T10:48:24.426484+0000","last_active":"2024-09-14T10:48:24.426613+0000","last_peered":"2024-09-14T10:48:24.426613+0000","last_clean":"2024-09-14T10:48:24.426613+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:48:24.426613+0000","last_undegraded":"2024-09-14T10:48:24.426613+0000","last_fullsized":"2024-09-14T10:48:24.426613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:24.426271+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:24.426271+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.426271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:29.496623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.841640+0000","last_change":"2024-09-14T10:48:18.841503+0000","last_active":"2024-09-14T10:48:18.841640+0000","last_peered":"2024-09-14T10:48:18.841640+0000","last_clean":"2024-09-14T10:48:18.841640+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:48:18.841640+0000","last_undegraded":"2024-09-14T10:48:18.841640+0000","last_fullsized":"2024-09-14T10:48:18.841640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:18.841299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:18.841299+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.841299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:50.935286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.677116+0000","last_change":"2024-09-14T10:48:37.676947+0000","last_active":"2024-09-14T10:48:37.677116+0000","last_peered":"2024-09-14T10:48:37.677116+0000","last_clean":"2024-09-14T10:48:37.677116+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:48:37.677116+0000","last_undegraded":"2024-09-14T10:48:37.677116+0000","last_fullsized":"2024-09-14T10:48:37.677116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:37.676736+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:37.676736+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.676736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:29.904245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'5","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.692298+0000","last_change":"2024-09-14T10:48:07.692142+0000","last_active":"2024-09-14T10:48:07.692298+0000","last_peered":"2024-09-14T10:48:07.692298+0000","last_clean":"2024-09-14T10:48:07.692298+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:48:07.692298+0000","last_undegraded":"2024-09-14T10:48:07.692298+0000","last_fullsized":"2024-09-14T10:48:07.692298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.691953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:20.730540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.428035+0000","last_change":"2024-09-14T10:48:20.427795+0000","last_active":"2024-09-14T10:48:20.428035+0000","last_peered":"2024-09-14T10:48:20.428035+0000","last_clean":"2024-09-14T10:48:20.428035+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:48:20.428035+0000","last_undegraded":"2024-09-14T10:48:20.428035+0000","last_fullsized":"2024-09-14T10:48:20.428035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:20.427585+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:20.427585+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.427585+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:39.853960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.871416+0000","last_change":"2024-09-14T10:48:19.871271+0000","last_active":"2024-09-14T10:48:19.871416+0000","last_peered":"2024-09-14T10:48:19.871416+0000","last_clean":"2024-09-14T10:48:19.871416+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:48:19.871416+0000","last_undegraded":"2024-09-14T10:48:19.871416+0000","last_fullsized":"2024-09-14T10:48:19.871416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:19.871088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:19.871088+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.871088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:33.745202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.904530+0000","last_change":"2024-09-14T10:48:23.904343+0000","last_active":"2024-09-14T10:48:23.904530+0000","last_peered":"2024-09-14T10:48:23.904530+0000","last_clean":"2024-09-14T10:48:23.904530+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:48:23.904530+0000","last_undegraded":"2024-09-14T10:48:23.904530+0000","last_fullsized":"2024-09-14T10:48:23.904530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:23.904146+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:23.904146+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.904146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:56.282823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.506497+0000","last_change":"2024-09-14T10:48:21.506316+0000","last_active":"2024-09-14T10:48:21.506497+0000","last_peered":"2024-09-14T10:48:21.506497+0000","last_clean":"2024-09-14T10:48:21.506497+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:48:21.506497+0000","last_undegraded":"2024-09-14T10:48:21.506497+0000","last_fullsized":"2024-09-14T10:48:21.506497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:21.506141+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:21.506141+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.506141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:41.836176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.454991+0000","last_change":"2024-09-14T10:48:08.454843+0000","last_active":"2024-09-14T10:48:08.454991+0000","last_peered":"2024-09-14T10:48:08.454991+0000","last_clean":"2024-09-14T10:48:08.454991+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:48:08.454991+0000","last_undegraded":"2024-09-14T10:48:08.454991+0000","last_fullsized":"2024-09-14T10:48:08.454991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.454661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:34.179499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.473573+0000","last_change":"2024-09-14T10:48:27.473573+0000","last_active":"2024-09-14T10:48:27.473573+0000","last_peered":"2024-09-14T10:48:27.473573+0000","last_clean":"2024-09-14T10:48:27.473573+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:48:27.473573+0000","last_undegraded":"2024-09-14T10:48:27.473573+0000","last_fullsized":"2024-09-14T10:48:27.473573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:27.473358+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:27.473358+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.473358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:40.064188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1503,"ondisk_log_size":1503,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640322,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":740626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673024,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1040384,"data_stored":742212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":152178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:48:59.269 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.269 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.270 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.270 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.270 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.270 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.271 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.271 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.271 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.271 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.271 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.272 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.272 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.272 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.272 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.272 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.273 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.273 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.273 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.273 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.273 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.274 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.274 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.274 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.274 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.274 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.274 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.275 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.275 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.275 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.275 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.275 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:44:12.314060+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.275 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.275 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:44:10.299721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.276 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:48:59.276 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:49:19.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:49:19.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.415+0000 7f6ee72fe640 1 Processor -- start 2024-09-14T10:49:19.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.415+0000 7f6ee72fe640 1 -- start start 2024-09-14T10:49:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.415+0000 7f6ee72fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6ee0071d80 0x7f6ee0132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.415+0000 7f6ee72fe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee00724f0 con 0x7f6ee012d390 2024-09-14T10:49:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.415+0000 7f6ee72fe640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee0099e20 con 0x7f6ee0071d80 2024-09-14T10:49:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee4899640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6ee0071d80 0x7f6ee0132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee509a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6ee012d390 0x7f6ee012d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39532/0 (socket says 172.21.15.70:39532) 2024-09-14T10:49:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee509a640 1 -- 172.21.15.70:0/2248046767 learned_addr learned my addr 172.21.15.70:0/2248046767 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:49:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee4899640 1 -- 172.21.15.70:0/2248046767 >> v1:172.21.15.70:6789/0 conn(0x7f6ee012d390 legacy=0x7f6ee012d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:19.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee4899640 1 -- 172.21.15.70:0/2248046767 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee012de80 con 0x7f6ee0071d80 2024-09-14T10:49:19.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee4899640 1 --2- 172.21.15.70:0/2248046767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee0132390 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009770 tx=0x7f6ed001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bd6cf019820b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:19.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ed7fff640 1 -- 172.21.15.70:0/2248046767 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ed00b1070 con 0x7f6ee0071d80 2024-09-14T10:49:19.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ed7fff640 1 -- 172.21.15.70:0/2248046767 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed00ac520 con 0x7f6ee0071d80 2024-09-14T10:49:19.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ed7fff640 1 -- 172.21.15.70:0/2248046767 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ed00ac820 con 0x7f6ee0071d80 2024-09-14T10:49:19.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2248046767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 msgr2=0x7f6ee0132390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:19.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee72fe640 1 --2- 172.21.15.70:0/2248046767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee0132390 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009770 tx=0x7f6ed001c370 comp rx=0 tx=0).stop 2024-09-14T10:49:19.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2248046767 shutdown_connections 2024-09-14T10:49:19.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee72fe640 1 --2- 172.21.15.70:0/2248046767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee0132390 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:19.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2248046767 >> 172.21.15.70:0/2248046767 conn(0x7f6ee009aba0 msgr2=0x7f6ee00984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:49:19.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2248046767 shutdown_connections 2024-09-14T10:49:19.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.419+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2248046767 wait complete. 2024-09-14T10:49:19.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee72fe640 1 Processor -- start 2024-09-14T10:49:19.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee72fe640 1 -- start start 2024-09-14T10:49:19.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee72fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee01297a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee72fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee0135480 con 0x7f6ee0071d80 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee509a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee01297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee509a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee01297a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55620/0 (socket says 172.21.15.70:55620) 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee509a640 1 -- 172.21.15.70:0/2908676316 learned_addr learned my addr 172.21.15.70:0/2908676316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee509a640 1 -- 172.21.15.70:0/2908676316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee0127550 con 0x7f6ee0071d80 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee509a640 1 --2- 172.21.15.70:0/2908676316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee01297a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c480 tx=0x7f6edc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ed5ffb640 1 -- 172.21.15.70:0/2908676316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6edc017070 con 0x7f6ee0071d80 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ed5ffb640 1 -- 172.21.15.70:0/2908676316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc005c20 con 0x7f6ee0071d80 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee0129230 con 0x7f6ee0071d80 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ed5ffb640 1 -- 172.21.15.70:0/2908676316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6edc007070 con 0x7f6ee0071d80 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee0129ce0 con 0x7f6ee0071d80 2024-09-14T10:49:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee0128150 con 0x7f6ee0071d80 2024-09-14T10:49:19.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ed5ffb640 1 -- 172.21.15.70:0/2908676316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f6edc01a070 con 0x7f6ee0071d80 2024-09-14T10:49:19.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ed5ffb640 1 --2- 172.21.15.70:0/2908676316 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ec403b8b0 0x7f6ec403dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:19.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ed5ffb640 1 -- 172.21.15.70:0/2908676316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6edc04f2f0 con 0x7f6ee0071d80 2024-09-14T10:49:19.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee4899640 1 --2- 172.21.15.70:0/2908676316 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ec403b8b0 0x7f6ec403dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:19.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.423+0000 7f6ee4899640 1 --2- 172.21.15.70:0/2908676316 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ec403b8b0 0x7f6ec403dd70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00ae000 tx=0x7f6ed0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:19.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.427+0000 7f6ed5ffb640 1 -- 172.21.15.70:0/2908676316 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f6edc01ac60 con 0x7f6ee0071d80 2024-09-14T10:49:19.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.587+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ee01285e0 con 0x7f6ec403b8b0 2024-09-14T10:49:19.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.615+0000 7f6ed5ffb640 1 -- 172.21.15.70:0/2908676316 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666343 (secure 0 0 0) 0x7f6ed00b2040 con 0x7f6ec403b8b0 2024-09-14T10:49:19.617 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:49:19.623 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:49:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ec403b8b0 msgr2=0x7f6ec403dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 --2- 172.21.15.70:0/2908676316 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ec403b8b0 0x7f6ec403dd70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00ae000 tx=0x7f6ed0008040 comp rx=0 tx=0).stop 2024-09-14T10:49:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 msgr2=0x7f6ee01297a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 --2- 172.21.15.70:0/2908676316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee01297a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c480 tx=0x7f6edc00c940 comp rx=0 tx=0).stop 2024-09-14T10:49:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 shutdown_connections 2024-09-14T10:49:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 --2- 172.21.15.70:0/2908676316 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f6ec403b8b0 0x7f6ec403dd70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 --2- 172.21.15.70:0/2908676316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee0071d80 0x7f6ee01297a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 >> 172.21.15.70:0/2908676316 conn(0x7f6ee009aba0 msgr2=0x7f6ee012e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:49:19.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 shutdown_connections 2024-09-14T10:49:19.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:19.623+0000 7f6ee72fe640 1 -- 172.21.15.70:0/2908676316 wait complete. 2024-09-14T10:49:19.635 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-14T10:49:19.515362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5157,"num_read_kb":4699,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1786956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006690"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.798951+0000","last_change":"2024-09-14T10:48:10.798810+0000","last_active":"2024-09-14T10:48:10.798951+0000","last_peered":"2024-09-14T10:48:10.798951+0000","last_clean":"2024-09-14T10:48:10.798951+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:48:10.798951+0000","last_undegraded":"2024-09-14T10:48:10.798951+0000","last_fullsized":"2024-09-14T10:48:10.798951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.798632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:20.160081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.490293+0000","last_change":"2024-09-14T10:48:29.490121+0000","last_active":"2024-09-14T10:48:29.490293+0000","last_peered":"2024-09-14T10:48:29.490293+0000","last_clean":"2024-09-14T10:48:29.490293+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:48:29.490293+0000","last_undegraded":"2024-09-14T10:48:29.490293+0000","last_fullsized":"2024-09-14T10:48:29.490293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:29.489905+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:29.489905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.489905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:03.916811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.492325+0000","last_change":"2024-09-14T10:48:10.492066+0000","last_active":"2024-09-14T10:48:10.492325+0000","last_peered":"2024-09-14T10:48:10.492325+0000","last_clean":"2024-09-14T10:48:10.492325+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:48:10.492325+0000","last_undegraded":"2024-09-14T10:48:10.492325+0000","last_fullsized":"2024-09-14T10:48:10.492325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.491821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:30.410764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.699427+0000","last_change":"2024-09-14T10:48:39.699286+0000","last_active":"2024-09-14T10:48:39.699427+0000","last_peered":"2024-09-14T10:48:39.699427+0000","last_clean":"2024-09-14T10:48:39.699427+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:48:39.699427+0000","last_undegraded":"2024-09-14T10:48:39.699427+0000","last_fullsized":"2024-09-14T10:48:39.699427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:39.699100+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:39.699100+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.699100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:40.664213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.891397+0000","last_change":"2024-09-14T10:48:25.891397+0000","last_active":"2024-09-14T10:48:25.891397+0000","last_peered":"2024-09-14T10:48:25.891397+0000","last_clean":"2024-09-14T10:48:25.891397+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:48:25.891397+0000","last_undegraded":"2024-09-14T10:48:25.891397+0000","last_fullsized":"2024-09-14T10:48:25.891397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:25.891164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:25.891164+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.891164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:32.955966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.618931+0000","last_change":"2024-09-14T10:48:41.618761+0000","last_active":"2024-09-14T10:48:41.618931+0000","last_peered":"2024-09-14T10:48:41.618931+0000","last_clean":"2024-09-14T10:48:41.618931+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:48:41.618931+0000","last_undegraded":"2024-09-14T10:48:41.618931+0000","last_fullsized":"2024-09-14T10:48:41.618931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:41.618584+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:41.618584+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.618584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:26.437900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.801154+0000","last_change":"2024-09-14T10:48:13.801154+0000","last_active":"2024-09-14T10:48:13.801154+0000","last_peered":"2024-09-14T10:48:13.801154+0000","last_clean":"2024-09-14T10:48:13.801154+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:48:13.801154+0000","last_undegraded":"2024-09-14T10:48:13.801154+0000","last_fullsized":"2024-09-14T10:48:13.801154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.800954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:10.498468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.667818+0000","last_change":"2024-09-14T10:48:42.667640+0000","last_active":"2024-09-14T10:48:42.667818+0000","last_peered":"2024-09-14T10:48:42.667818+0000","last_clean":"2024-09-14T10:48:42.667818+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:48:42.667818+0000","last_undegraded":"2024-09-14T10:48:42.667818+0000","last_fullsized":"2024-09-14T10:48:42.667818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:42.667441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:42.667441+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.667441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:28.664593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.884804+0000","last_change":"2024-09-14T10:48:21.884659+0000","last_active":"2024-09-14T10:48:21.884804+0000","last_peered":"2024-09-14T10:48:21.884804+0000","last_clean":"2024-09-14T10:48:21.884804+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:48:21.884804+0000","last_undegraded":"2024-09-14T10:48:21.884804+0000","last_fullsized":"2024-09-14T10:48:21.884804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:21.884467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:21.884467+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.884467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:25.811308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.474754+0000","last_change":"2024-09-14T10:48:30.474754+0000","last_active":"2024-09-14T10:48:30.474754+0000","last_peered":"2024-09-14T10:48:30.474754+0000","last_clean":"2024-09-14T10:48:30.474754+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:48:30.474754+0000","last_undegraded":"2024-09-14T10:48:30.474754+0000","last_fullsized":"2024-09-14T10:48:30.474754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:30.474471+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:30.474471+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.474471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:13.709808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.752513+0000","last_change":"2024-09-14T10:48:09.752350+0000","last_active":"2024-09-14T10:48:09.752513+0000","last_peered":"2024-09-14T10:48:09.752513+0000","last_clean":"2024-09-14T10:48:09.752513+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:48:09.752513+0000","last_undegraded":"2024-09-14T10:48:09.752513+0000","last_fullsized":"2024-09-14T10:48:09.752513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.752173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:57.545208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.714300+0000","last_change":"2024-09-14T10:48:22.713985+0000","last_active":"2024-09-14T10:48:22.714300+0000","last_peered":"2024-09-14T10:48:22.714300+0000","last_clean":"2024-09-14T10:48:22.714300+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:48:22.714300+0000","last_undegraded":"2024-09-14T10:48:22.714300+0000","last_fullsized":"2024-09-14T10:48:22.714300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:22.713714+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:22.713714+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.713714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:32.805970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.888067+0000","last_change":"2024-09-14T10:48:22.887921+0000","last_active":"2024-09-14T10:48:22.888067+0000","last_peered":"2024-09-14T10:48:22.888067+0000","last_clean":"2024-09-14T10:48:22.888067+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:48:22.888067+0000","last_undegraded":"2024-09-14T10:48:22.888067+0000","last_fullsized":"2024-09-14T10:48:22.888067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:22.887731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:22.887731+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.887731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.608934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.690389+0000","last_change":"2024-09-14T10:48:23.690389+0000","last_active":"2024-09-14T10:48:23.690389+0000","last_peered":"2024-09-14T10:48:23.690389+0000","last_clean":"2024-09-14T10:48:23.690389+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:48:23.690389+0000","last_undegraded":"2024-09-14T10:48:23.690389+0000","last_fullsized":"2024-09-14T10:48:23.690389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:23.690127+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:23.690127+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.690127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:31.933431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.503967+0000","last_change":"2024-09-14T10:48:09.503799+0000","last_active":"2024-09-14T10:48:09.503967+0000","last_peered":"2024-09-14T10:48:09.503967+0000","last_clean":"2024-09-14T10:48:09.503967+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:48:09.503967+0000","last_undegraded":"2024-09-14T10:48:09.503967+0000","last_fullsized":"2024-09-14T10:48:09.503967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.503614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:43.187650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.653888+0000","last_change":"2024-09-14T10:48:24.653888+0000","last_active":"2024-09-14T10:48:24.653888+0000","last_peered":"2024-09-14T10:48:24.653888+0000","last_clean":"2024-09-14T10:48:24.653888+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:48:24.653888+0000","last_undegraded":"2024-09-14T10:48:24.653888+0000","last_fullsized":"2024-09-14T10:48:24.653888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:24.653671+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:24.653671+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.653671+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:36.631176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.665143+0000","last_change":"2024-09-14T10:48:40.664900+0000","last_active":"2024-09-14T10:48:40.665143+0000","last_peered":"2024-09-14T10:48:40.665143+0000","last_clean":"2024-09-14T10:48:40.665143+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:48:40.665143+0000","last_undegraded":"2024-09-14T10:48:40.665143+0000","last_fullsized":"2024-09-14T10:48:40.665143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:40.664677+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:40.664677+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.664677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:45.108181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.434266+0000","last_change":"2024-09-14T10:48:10.434015+0000","last_active":"2024-09-14T10:48:10.434266+0000","last_peered":"2024-09-14T10:48:10.434266+0000","last_clean":"2024-09-14T10:48:10.434266+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:48:10.434266+0000","last_undegraded":"2024-09-14T10:48:10.434266+0000","last_fullsized":"2024-09-14T10:48:10.434266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.433796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:25.542559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.442358+0000","last_change":"2024-09-14T10:48:25.442195+0000","last_active":"2024-09-14T10:48:25.442358+0000","last_peered":"2024-09-14T10:48:25.442358+0000","last_clean":"2024-09-14T10:48:25.442358+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:48:25.442358+0000","last_undegraded":"2024-09-14T10:48:25.442358+0000","last_fullsized":"2024-09-14T10:48:25.442358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:25.442006+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:25.442006+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.442006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:27.650647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.731707+0000","last_change":"2024-09-14T10:48:08.731550+0000","last_active":"2024-09-14T10:48:08.731707+0000","last_peered":"2024-09-14T10:48:08.731707+0000","last_clean":"2024-09-14T10:48:08.731707+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:48:08.731707+0000","last_undegraded":"2024-09-14T10:48:08.731707+0000","last_fullsized":"2024-09-14T10:48:08.731707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.731374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:25.870502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.521955+0000","last_change":"2024-09-14T10:48:28.521815+0000","last_active":"2024-09-14T10:48:28.521955+0000","last_peered":"2024-09-14T10:48:28.521955+0000","last_clean":"2024-09-14T10:48:28.521955+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:48:28.521955+0000","last_undegraded":"2024-09-14T10:48:28.521955+0000","last_fullsized":"2024-09-14T10:48:28.521955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:28.521636+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:28.521636+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.521636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:47.105831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.413206+0000","last_change":"2024-09-14T10:48:09.413034+0000","last_active":"2024-09-14T10:48:09.413206+0000","last_peered":"2024-09-14T10:48:09.413206+0000","last_clean":"2024-09-14T10:48:09.413206+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:48:09.413206+0000","last_undegraded":"2024-09-14T10:48:09.413206+0000","last_fullsized":"2024-09-14T10:48:09.413206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.412833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:35.318942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.597525+0000","last_change":"2024-09-14T10:48:28.597380+0000","last_active":"2024-09-14T10:48:28.597525+0000","last_peered":"2024-09-14T10:48:28.597525+0000","last_clean":"2024-09-14T10:48:28.597525+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:48:28.597525+0000","last_undegraded":"2024-09-14T10:48:28.597525+0000","last_fullsized":"2024-09-14T10:48:28.597525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:28.597180+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:28.597180+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.597180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:04.719964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.345403+0000","last_change":"2024-09-14T10:48:07.345264+0000","last_active":"2024-09-14T10:48:07.345403+0000","last_peered":"2024-09-14T10:48:07.345403+0000","last_clean":"2024-09-14T10:48:07.345403+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:48:07.345403+0000","last_undegraded":"2024-09-14T10:48:07.345403+0000","last_fullsized":"2024-09-14T10:48:07.345403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.345074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.041740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.761538+0000","last_change":"2024-09-14T10:48:21.761411+0000","last_active":"2024-09-14T10:48:21.761538+0000","last_peered":"2024-09-14T10:48:21.761538+0000","last_clean":"2024-09-14T10:48:21.761538+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:48:21.761538+0000","last_undegraded":"2024-09-14T10:48:21.761538+0000","last_fullsized":"2024-09-14T10:48:21.761538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:21.761222+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:21.761222+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.761222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:14.714371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.538174+0000","last_change":"2024-09-14T10:48:11.537992+0000","last_active":"2024-09-14T10:48:11.538174+0000","last_peered":"2024-09-14T10:48:11.538174+0000","last_clean":"2024-09-14T10:48:11.538174+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:48:11.538174+0000","last_undegraded":"2024-09-14T10:48:11.538174+0000","last_fullsized":"2024-09-14T10:48:11.538174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.537799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:49.788688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.459135+0000","last_change":"2024-09-14T10:48:26.458972+0000","last_active":"2024-09-14T10:48:26.459135+0000","last_peered":"2024-09-14T10:48:26.459135+0000","last_clean":"2024-09-14T10:48:26.459135+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:48:26.459135+0000","last_undegraded":"2024-09-14T10:48:26.459135+0000","last_fullsized":"2024-09-14T10:48:26.459135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:26.458789+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:26.458789+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.458789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:37.373380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.835917+0000","last_change":"2024-09-14T10:48:20.835752+0000","last_active":"2024-09-14T10:48:20.835917+0000","last_peered":"2024-09-14T10:48:20.835917+0000","last_clean":"2024-09-14T10:48:20.835917+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:48:20.835917+0000","last_undegraded":"2024-09-14T10:48:20.835917+0000","last_fullsized":"2024-09-14T10:48:20.835917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:20.835574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:20.835574+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.835574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:37.288457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:57.684203+0000","last_change":"2024-09-14T10:48:57.683910+0000","last_active":"2024-09-14T10:48:57.684203+0000","last_peered":"2024-09-14T10:48:57.684203+0000","last_clean":"2024-09-14T10:48:57.684203+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:48:57.684203+0000","last_undegraded":"2024-09-14T10:48:57.684203+0000","last_fullsized":"2024-09-14T10:48:57.684203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-14T10:48:57.683636+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-14T10:48:57.683636+0000","last_clean_scrub_stamp":"2024-09-14T10:48:57.683636+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:29.777623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.868412+0000","last_change":"2024-09-14T10:48:31.868270+0000","last_active":"2024-09-14T10:48:31.868412+0000","last_peered":"2024-09-14T10:48:31.868412+0000","last_clean":"2024-09-14T10:48:31.868412+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:48:31.868412+0000","last_undegraded":"2024-09-14T10:48:31.868412+0000","last_fullsized":"2024-09-14T10:48:31.868412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:31.868080+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:31.868080+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.868080+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:24.962231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.016482+0000","last_change":"2024-09-14T10:48:11.016248+0000","last_active":"2024-09-14T10:48:11.016482+0000","last_peered":"2024-09-14T10:48:11.016482+0000","last_clean":"2024-09-14T10:48:11.016482+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:48:11.016482+0000","last_undegraded":"2024-09-14T10:48:11.016482+0000","last_fullsized":"2024-09-14T10:48:11.016482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.016029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.143146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.709223+0000","last_change":"2024-09-14T10:48:50.709065+0000","last_active":"2024-09-14T10:48:50.709223+0000","last_peered":"2024-09-14T10:48:50.709223+0000","last_clean":"2024-09-14T10:48:50.709223+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:48:50.709223+0000","last_undegraded":"2024-09-14T10:48:50.709223+0000","last_fullsized":"2024-09-14T10:48:50.709223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:50.708840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:50.708840+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.708840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:06.261826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:00.765327+0000","last_change":"2024-09-14T10:49:00.765166+0000","last_active":"2024-09-14T10:49:00.765327+0000","last_peered":"2024-09-14T10:49:00.765327+0000","last_clean":"2024-09-14T10:49:00.765327+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:49:00.765327+0000","last_undegraded":"2024-09-14T10:49:00.765327+0000","last_fullsized":"2024-09-14T10:49:00.765327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-14T10:49:00.764971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-14T10:49:00.764971+0000","last_clean_scrub_stamp":"2024-09-14T10:49:00.764971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:53.764219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.695187+0000","last_change":"2024-09-14T10:48:49.695051+0000","last_active":"2024-09-14T10:48:49.695187+0000","last_peered":"2024-09-14T10:48:49.695187+0000","last_clean":"2024-09-14T10:48:49.695187+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:48:49.695187+0000","last_undegraded":"2024-09-14T10:48:49.695187+0000","last_fullsized":"2024-09-14T10:48:49.695187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.694840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.694840+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.694840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:31.821957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:58.644675+0000","last_change":"2024-09-14T10:48:58.644405+0000","last_active":"2024-09-14T10:48:58.644675+0000","last_peered":"2024-09-14T10:48:58.644675+0000","last_clean":"2024-09-14T10:48:58.644675+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:48:58.644675+0000","last_undegraded":"2024-09-14T10:48:58.644675+0000","last_fullsized":"2024-09-14T10:48:58.644675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-14T10:48:58.644192+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-14T10:48:58.644192+0000","last_clean_scrub_stamp":"2024-09-14T10:48:58.644192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:12.518306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.826793+0000","last_change":"2024-09-14T10:48:32.826539+0000","last_active":"2024-09-14T10:48:32.826793+0000","last_peered":"2024-09-14T10:48:32.826793+0000","last_clean":"2024-09-14T10:48:32.826793+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:48:32.826793+0000","last_undegraded":"2024-09-14T10:48:32.826793+0000","last_fullsized":"2024-09-14T10:48:32.826793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-14T10:48:32.826333+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-14T10:48:32.826333+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.826333+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:05.422320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.606030+0000","last_change":"2024-09-14T10:48:01.605793+0000","last_active":"2024-09-14T10:48:01.606030+0000","last_peered":"2024-09-14T10:48:01.606030+0000","last_clean":"2024-09-14T10:48:01.606030+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:48:01.606030+0000","last_undegraded":"2024-09-14T10:48:01.606030+0000","last_fullsized":"2024-09-14T10:48:01.606030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.605543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:33.748359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.619909+0000","last_change":"2024-09-14T10:48:33.619763+0000","last_active":"2024-09-14T10:48:33.619909+0000","last_peered":"2024-09-14T10:48:33.619909+0000","last_clean":"2024-09-14T10:48:33.619909+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:48:33.619909+0000","last_undegraded":"2024-09-14T10:48:33.619909+0000","last_fullsized":"2024-09-14T10:48:33.619909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:33.619581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:33.619581+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.619581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.570850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.606243+0000","last_change":"2024-09-14T10:48:43.606072+0000","last_active":"2024-09-14T10:48:43.606243+0000","last_peered":"2024-09-14T10:48:43.606243+0000","last_clean":"2024-09-14T10:48:43.606243+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:48:43.606243+0000","last_undegraded":"2024-09-14T10:48:43.606243+0000","last_fullsized":"2024-09-14T10:48:43.606243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:43.605875+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:43.605875+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.605875+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:11.774070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.715776+0000","last_change":"2024-09-14T10:48:48.715637+0000","last_active":"2024-09-14T10:48:48.715776+0000","last_peered":"2024-09-14T10:48:48.715776+0000","last_clean":"2024-09-14T10:48:48.715776+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:48:48.715776+0000","last_undegraded":"2024-09-14T10:48:48.715776+0000","last_fullsized":"2024-09-14T10:48:48.715776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:48.715463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:48.715463+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.715463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:51.871305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:56.704568+0000","last_change":"2024-09-14T10:48:56.704395+0000","last_active":"2024-09-14T10:48:56.704568+0000","last_peered":"2024-09-14T10:48:56.704568+0000","last_clean":"2024-09-14T10:48:56.704568+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:48:56.704568+0000","last_undegraded":"2024-09-14T10:48:56.704568+0000","last_fullsized":"2024-09-14T10:48:56.704568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:56.704209+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:56.704209+0000","last_clean_scrub_stamp":"2024-09-14T10:48:56.704209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:28.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.801868+0000","last_change":"2024-09-14T10:48:33.801688+0000","last_active":"2024-09-14T10:48:33.801868+0000","last_peered":"2024-09-14T10:48:33.801868+0000","last_clean":"2024-09-14T10:48:33.801868+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:48:33.801868+0000","last_undegraded":"2024-09-14T10:48:33.801868+0000","last_fullsized":"2024-09-14T10:48:33.801868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-14T10:48:33.801495+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-14T10:48:33.801495+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.801495+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:25.809741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.984658+0000","last_change":"2024-09-14T10:48:09.984385+0000","last_active":"2024-09-14T10:48:09.984658+0000","last_peered":"2024-09-14T10:48:09.984658+0000","last_clean":"2024-09-14T10:48:09.984658+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:48:09.984658+0000","last_undegraded":"2024-09-14T10:48:09.984658+0000","last_fullsized":"2024-09-14T10:48:09.984658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.984177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:13.140019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.606557+0000","last_change":"2024-09-14T10:48:27.606320+0000","last_active":"2024-09-14T10:48:27.606557+0000","last_peered":"2024-09-14T10:48:27.606557+0000","last_clean":"2024-09-14T10:48:27.606557+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:48:27.606557+0000","last_undegraded":"2024-09-14T10:48:27.606557+0000","last_fullsized":"2024-09-14T10:48:27.606557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:27.606121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:27.606121+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.606121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.007371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.455539+0000","last_change":"2024-09-14T10:48:39.455381+0000","last_active":"2024-09-14T10:48:39.455539+0000","last_peered":"2024-09-14T10:48:39.455539+0000","last_clean":"2024-09-14T10:48:39.455539+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:48:39.455539+0000","last_undegraded":"2024-09-14T10:48:39.455539+0000","last_fullsized":"2024-09-14T10:48:39.455539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:39.455160+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:39.455160+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.455160+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:00.891457+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":396,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:08.723214+0000","last_change":"2024-09-14T10:49:08.723214+0000","last_active":"2024-09-14T10:49:08.723214+0000","last_peered":"2024-09-14T10:49:08.723214+0000","last_clean":"2024-09-14T10:49:08.723214+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:49:08.723214+0000","last_undegraded":"2024-09-14T10:49:08.723214+0000","last_fullsized":"2024-09-14T10:49:08.723214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:49:08.723032+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:49:08.723032+0000","last_clean_scrub_stamp":"2024-09-14T10:49:08.723032+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:32.771632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.453697+0000","last_change":"2024-09-14T10:48:51.453452+0000","last_active":"2024-09-14T10:48:51.453697+0000","last_peered":"2024-09-14T10:48:51.453697+0000","last_clean":"2024-09-14T10:48:51.453697+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:48:51.453697+0000","last_undegraded":"2024-09-14T10:48:51.453697+0000","last_fullsized":"2024-09-14T10:48:51.453697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.453232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.453232+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.453232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.042348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.635653+0000","last_change":"2024-09-14T10:48:15.635473+0000","last_active":"2024-09-14T10:48:15.635653+0000","last_peered":"2024-09-14T10:48:15.635653+0000","last_clean":"2024-09-14T10:48:15.635653+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:48:15.635653+0000","last_undegraded":"2024-09-14T10:48:15.635653+0000","last_fullsized":"2024-09-14T10:48:15.635653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.635292+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:37.356846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.255721+0000","last_change":"2024-09-14T10:47:59.255546+0000","last_active":"2024-09-14T10:47:59.255721+0000","last_peered":"2024-09-14T10:47:59.255721+0000","last_clean":"2024-09-14T10:47:59.255721+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:47:59.255721+0000","last_undegraded":"2024-09-14T10:47:59.255721+0000","last_fullsized":"2024-09-14T10:47:59.255721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.255367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.490294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.679887+0000","last_change":"2024-09-14T10:48:51.679715+0000","last_active":"2024-09-14T10:48:51.679887+0000","last_peered":"2024-09-14T10:48:51.679887+0000","last_clean":"2024-09-14T10:48:51.679887+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:48:51.679887+0000","last_undegraded":"2024-09-14T10:48:51.679887+0000","last_fullsized":"2024-09-14T10:48:51.679887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.679543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.679543+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.679543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:20.562988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.443317+0000","last_change":"2024-09-14T10:48:37.443171+0000","last_active":"2024-09-14T10:48:37.443317+0000","last_peered":"2024-09-14T10:48:37.443317+0000","last_clean":"2024-09-14T10:48:37.443317+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:48:37.443317+0000","last_undegraded":"2024-09-14T10:48:37.443317+0000","last_fullsized":"2024-09-14T10:48:37.443317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-14T10:48:37.442971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-14T10:48:37.442971+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.442971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:50.930609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":425,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.654908+0000","last_change":"2024-09-14T10:48:48.654747+0000","last_active":"2024-09-14T10:48:48.654908+0000","last_peered":"2024-09-14T10:48:48.654908+0000","last_clean":"2024-09-14T10:48:48.654908+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:48:48.654908+0000","last_undegraded":"2024-09-14T10:48:48.654908+0000","last_fullsized":"2024-09-14T10:48:48.654908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:48.654557+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:48.654557+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.654557+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:30.781674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.881054+0000","last_change":"2024-09-14T10:48:27.880910+0000","last_active":"2024-09-14T10:48:27.881054+0000","last_peered":"2024-09-14T10:48:27.881054+0000","last_clean":"2024-09-14T10:48:27.881054+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:48:27.881054+0000","last_undegraded":"2024-09-14T10:48:27.881054+0000","last_fullsized":"2024-09-14T10:48:27.881054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:27.880708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:27.880708+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.880708+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:31.359099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.552491+0000","last_change":"2024-09-14T10:48:03.552213+0000","last_active":"2024-09-14T10:48:03.552491+0000","last_peered":"2024-09-14T10:48:03.552491+0000","last_clean":"2024-09-14T10:48:03.552491+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:48:03.552491+0000","last_undegraded":"2024-09-14T10:48:03.552491+0000","last_fullsized":"2024-09-14T10:48:03.552491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.551983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.648129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.489804+0000","last_change":"2024-09-14T10:48:32.489804+0000","last_active":"2024-09-14T10:48:32.489804+0000","last_peered":"2024-09-14T10:48:32.489804+0000","last_clean":"2024-09-14T10:48:32.489804+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:48:32.489804+0000","last_undegraded":"2024-09-14T10:48:32.489804+0000","last_fullsized":"2024-09-14T10:48:32.489804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:32.489524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:32.489524+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.489524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:13.102091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.485022+0000","last_change":"2024-09-14T10:48:34.485022+0000","last_active":"2024-09-14T10:48:34.485022+0000","last_peered":"2024-09-14T10:48:34.485022+0000","last_clean":"2024-09-14T10:48:34.485022+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:48:34.485022+0000","last_undegraded":"2024-09-14T10:48:34.485022+0000","last_fullsized":"2024-09-14T10:48:34.485022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-14T10:48:34.484782+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-14T10:48:34.484782+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.484782+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:29.171627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.589885+0000","last_change":"2024-09-14T10:48:45.589885+0000","last_active":"2024-09-14T10:48:45.589885+0000","last_peered":"2024-09-14T10:48:45.589885+0000","last_clean":"2024-09-14T10:48:45.589885+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:48:45.589885+0000","last_undegraded":"2024-09-14T10:48:45.589885+0000","last_fullsized":"2024-09-14T10:48:45.589885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:45.589679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:45.589679+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.589679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:09.037609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.448179+0000","last_change":"2024-09-14T10:48:49.448179+0000","last_active":"2024-09-14T10:48:49.448179+0000","last_peered":"2024-09-14T10:48:49.448179+0000","last_clean":"2024-09-14T10:48:49.448179+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:48:49.448179+0000","last_undegraded":"2024-09-14T10:48:49.448179+0000","last_fullsized":"2024-09-14T10:48:49.448179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:49.447960+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:49.447960+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.447960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:59.478591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.497753+0000","last_change":"2024-09-14T10:48:14.497618+0000","last_active":"2024-09-14T10:48:14.497753+0000","last_peered":"2024-09-14T10:48:14.497753+0000","last_clean":"2024-09-14T10:48:14.497753+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:48:14.497753+0000","last_undegraded":"2024-09-14T10:48:14.497753+0000","last_fullsized":"2024-09-14T10:48:14.497753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:14.497416+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:14.497416+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.497416+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:54.322425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.618993+0000","last_change":"2024-09-14T10:47:59.618709+0000","last_active":"2024-09-14T10:47:59.618993+0000","last_peered":"2024-09-14T10:47:59.618993+0000","last_clean":"2024-09-14T10:47:59.618993+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:59.618993+0000","last_undegraded":"2024-09-14T10:47:59.618993+0000","last_fullsized":"2024-09-14T10:47:59.618993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.618492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:36.397328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.600141+0000","last_change":"2024-09-14T10:48:26.599902+0000","last_active":"2024-09-14T10:48:26.600141+0000","last_peered":"2024-09-14T10:48:26.600141+0000","last_clean":"2024-09-14T10:48:26.600141+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:48:26.600141+0000","last_undegraded":"2024-09-14T10:48:26.600141+0000","last_fullsized":"2024-09-14T10:48:26.600141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:26.599635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:26.599635+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.599635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:39.190465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:57.688311+0000","last_change":"2024-09-14T10:48:57.688311+0000","last_active":"2024-09-14T10:48:57.688311+0000","last_peered":"2024-09-14T10:48:57.688311+0000","last_clean":"2024-09-14T10:48:57.688311+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:48:57.688311+0000","last_undegraded":"2024-09-14T10:48:57.688311+0000","last_fullsized":"2024-09-14T10:48:57.688311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-14T10:48:57.688094+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-14T10:48:57.688094+0000","last_clean_scrub_stamp":"2024-09-14T10:48:57.688094+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:07.231206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.578139+0000","last_change":"2024-09-14T10:48:44.578139+0000","last_active":"2024-09-14T10:48:44.578139+0000","last_peered":"2024-09-14T10:48:44.578139+0000","last_clean":"2024-09-14T10:48:44.578139+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:48:44.578139+0000","last_undegraded":"2024-09-14T10:48:44.578139+0000","last_fullsized":"2024-09-14T10:48:44.578139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.577958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.577958+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.577958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:50.475596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.746978+0000","last_change":"2024-09-14T10:48:52.746978+0000","last_active":"2024-09-14T10:48:52.746978+0000","last_peered":"2024-09-14T10:48:52.746978+0000","last_clean":"2024-09-14T10:48:52.746978+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:48:52.746978+0000","last_undegraded":"2024-09-14T10:48:52.746978+0000","last_fullsized":"2024-09-14T10:48:52.746978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:52.746797+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:52.746797+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.746797+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:35.428380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.831292+0000","last_change":"2024-09-14T10:48:12.831150+0000","last_active":"2024-09-14T10:48:12.831292+0000","last_peered":"2024-09-14T10:48:12.831292+0000","last_clean":"2024-09-14T10:48:12.831292+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:48:12.831292+0000","last_undegraded":"2024-09-14T10:48:12.831292+0000","last_fullsized":"2024-09-14T10:48:12.831292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.830946+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:42.495812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.990560+0000","last_change":"2024-09-14T10:48:08.990298+0000","last_active":"2024-09-14T10:48:08.990560+0000","last_peered":"2024-09-14T10:48:08.990560+0000","last_clean":"2024-09-14T10:48:08.990560+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:48:08.990560+0000","last_undegraded":"2024-09-14T10:48:08.990560+0000","last_fullsized":"2024-09-14T10:48:08.990560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.990075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:54.174799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.571920+0000","last_change":"2024-09-14T10:48:25.571660+0000","last_active":"2024-09-14T10:48:25.571920+0000","last_peered":"2024-09-14T10:48:25.571920+0000","last_clean":"2024-09-14T10:48:25.571920+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:48:25.571920+0000","last_undegraded":"2024-09-14T10:48:25.571920+0000","last_fullsized":"2024-09-14T10:48:25.571920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:25.571436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:25.571436+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.571436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:36.486026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:55.718348+0000","last_change":"2024-09-14T10:48:55.718348+0000","last_active":"2024-09-14T10:48:55.718348+0000","last_peered":"2024-09-14T10:48:55.718348+0000","last_clean":"2024-09-14T10:48:55.718348+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:48:55.718348+0000","last_undegraded":"2024-09-14T10:48:55.718348+0000","last_fullsized":"2024-09-14T10:48:55.718348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-14T10:48:55.718125+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-14T10:48:55.718125+0000","last_clean_scrub_stamp":"2024-09-14T10:48:55.718125+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:52.608781+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":390,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.617555+0000","last_change":"2024-09-14T10:48:46.617555+0000","last_active":"2024-09-14T10:48:46.617555+0000","last_peered":"2024-09-14T10:48:46.617555+0000","last_clean":"2024-09-14T10:48:46.617555+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:48:46.617555+0000","last_undegraded":"2024-09-14T10:48:46.617555+0000","last_fullsized":"2024-09-14T10:48:46.617555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:46.617369+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:46.617369+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.617369+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:31.802093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.688455+0000","last_change":"2024-09-14T10:48:53.688455+0000","last_active":"2024-09-14T10:48:53.688455+0000","last_peered":"2024-09-14T10:48:53.688455+0000","last_clean":"2024-09-14T10:48:53.688455+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:48:53.688455+0000","last_undegraded":"2024-09-14T10:48:53.688455+0000","last_fullsized":"2024-09-14T10:48:53.688455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:53.688183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:53.688183+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.688183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:29.352610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.781873+0000","last_change":"2024-09-14T10:48:14.781725+0000","last_active":"2024-09-14T10:48:14.781873+0000","last_peered":"2024-09-14T10:48:14.781873+0000","last_clean":"2024-09-14T10:48:14.781873+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:48:14.781873+0000","last_undegraded":"2024-09-14T10:48:14.781873+0000","last_fullsized":"2024-09-14T10:48:14.781873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.781515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:43.801565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.031970+0000","last_change":"2024-09-14T10:48:08.031832+0000","last_active":"2024-09-14T10:48:08.031970+0000","last_peered":"2024-09-14T10:48:08.031970+0000","last_clean":"2024-09-14T10:48:08.031970+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:48:08.031970+0000","last_undegraded":"2024-09-14T10:48:08.031970+0000","last_fullsized":"2024-09-14T10:48:08.031970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.031656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:31.479586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.600776+0000","last_change":"2024-09-14T10:48:24.600606+0000","last_active":"2024-09-14T10:48:24.600776+0000","last_peered":"2024-09-14T10:48:24.600776+0000","last_clean":"2024-09-14T10:48:24.600776+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:48:24.600776+0000","last_undegraded":"2024-09-14T10:48:24.600776+0000","last_fullsized":"2024-09-14T10:48:24.600776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:24.600403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:24.600403+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.600403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:26.809043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:56.705437+0000","last_change":"2024-09-14T10:48:56.705437+0000","last_active":"2024-09-14T10:48:56.705437+0000","last_peered":"2024-09-14T10:48:56.705437+0000","last_clean":"2024-09-14T10:48:56.705437+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:48:56.705437+0000","last_undegraded":"2024-09-14T10:48:56.705437+0000","last_fullsized":"2024-09-14T10:48:56.705437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-09-14T10:48:56.705231+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-09-14T10:48:56.705231+0000","last_clean_scrub_stamp":"2024-09-14T10:48:56.705231+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:25.519512+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.539291+0000","last_change":"2024-09-14T10:48:43.539291+0000","last_active":"2024-09-14T10:48:43.539291+0000","last_peered":"2024-09-14T10:48:43.539291+0000","last_clean":"2024-09-14T10:48:43.539291+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:48:43.539291+0000","last_undegraded":"2024-09-14T10:48:43.539291+0000","last_fullsized":"2024-09-14T10:48:43.539291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.539104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.539104+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.539104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:51.312807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.729545+0000","last_change":"2024-09-14T10:48:52.729545+0000","last_active":"2024-09-14T10:48:52.729545+0000","last_peered":"2024-09-14T10:48:52.729545+0000","last_clean":"2024-09-14T10:48:52.729545+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:48:52.729545+0000","last_undegraded":"2024-09-14T10:48:52.729545+0000","last_fullsized":"2024-09-14T10:48:52.729545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-14T10:48:52.729295+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-14T10:48:52.729295+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.729295+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:41.771486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.499890+0000","last_change":"2024-09-14T10:48:13.499703+0000","last_active":"2024-09-14T10:48:13.499890+0000","last_peered":"2024-09-14T10:48:13.499890+0000","last_clean":"2024-09-14T10:48:13.499890+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:48:13.499890+0000","last_undegraded":"2024-09-14T10:48:13.499890+0000","last_fullsized":"2024-09-14T10:48:13.499890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.499518+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:35.604108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.461131+0000","last_change":"2024-09-14T10:48:02.460875+0000","last_active":"2024-09-14T10:48:02.461131+0000","last_peered":"2024-09-14T10:48:02.461131+0000","last_clean":"2024-09-14T10:48:02.461131+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:48:02.461131+0000","last_undegraded":"2024-09-14T10:48:02.461131+0000","last_fullsized":"2024-09-14T10:48:02.461131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.460647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:07.647413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.607283+0000","last_change":"2024-09-14T10:48:27.607156+0000","last_active":"2024-09-14T10:48:27.607283+0000","last_peered":"2024-09-14T10:48:27.607283+0000","last_clean":"2024-09-14T10:48:27.607283+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:48:27.607283+0000","last_undegraded":"2024-09-14T10:48:27.607283+0000","last_fullsized":"2024-09-14T10:48:27.607283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:27.606970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:27.606970+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.606970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:41.101194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.599156+0000","last_change":"2024-09-14T10:48:39.599004+0000","last_active":"2024-09-14T10:48:39.599156+0000","last_peered":"2024-09-14T10:48:39.599156+0000","last_clean":"2024-09-14T10:48:39.599156+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:48:39.599156+0000","last_undegraded":"2024-09-14T10:48:39.599156+0000","last_fullsized":"2024-09-14T10:48:39.599156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-14T10:48:39.598805+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-14T10:48:39.598805+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.598805+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:03.925784+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:10.788050+0000","last_change":"2024-09-14T10:49:10.788050+0000","last_active":"2024-09-14T10:49:10.788050+0000","last_peered":"2024-09-14T10:49:10.788050+0000","last_clean":"2024-09-14T10:49:10.788050+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:49:10.788050+0000","last_undegraded":"2024-09-14T10:49:10.788050+0000","last_fullsized":"2024-09-14T10:49:10.788050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:10.787867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:10.787867+0000","last_clean_scrub_stamp":"2024-09-14T10:49:10.787867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:22.130716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:11.753211+0000","last_change":"2024-09-14T10:49:11.753211+0000","last_active":"2024-09-14T10:49:11.753211+0000","last_peered":"2024-09-14T10:49:11.753211+0000","last_clean":"2024-09-14T10:49:11.753211+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:49:11.753211+0000","last_undegraded":"2024-09-14T10:49:11.753211+0000","last_fullsized":"2024-09-14T10:49:11.753211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:49:11.753027+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:49:11.753027+0000","last_clean_scrub_stamp":"2024-09-14T10:49:11.753027+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:02.168286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.862582+0000","last_change":"2024-09-14T10:48:29.862407+0000","last_active":"2024-09-14T10:48:29.862582+0000","last_peered":"2024-09-14T10:48:29.862582+0000","last_clean":"2024-09-14T10:48:29.862582+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:48:29.862582+0000","last_undegraded":"2024-09-14T10:48:29.862582+0000","last_fullsized":"2024-09-14T10:48:29.862582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:29.862217+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:29.862217+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.862217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:24.391104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.079073+0000","last_change":"2024-09-14T10:48:07.078927+0000","last_active":"2024-09-14T10:48:07.079073+0000","last_peered":"2024-09-14T10:48:07.079073+0000","last_clean":"2024-09-14T10:48:07.079073+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:48:07.079073+0000","last_undegraded":"2024-09-14T10:48:07.079073+0000","last_fullsized":"2024-09-14T10:48:07.079073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.078726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.976365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.657391+0000","last_change":"2024-09-14T10:48:30.657101+0000","last_active":"2024-09-14T10:48:30.657391+0000","last_peered":"2024-09-14T10:48:30.657391+0000","last_clean":"2024-09-14T10:48:30.657391+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:48:30.657391+0000","last_undegraded":"2024-09-14T10:48:30.657391+0000","last_fullsized":"2024-09-14T10:48:30.657391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:30.656887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:30.656887+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.656887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:28.780823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.472740+0000","last_change":"2024-09-14T10:48:35.472601+0000","last_active":"2024-09-14T10:48:35.472740+0000","last_peered":"2024-09-14T10:48:35.472740+0000","last_clean":"2024-09-14T10:48:35.472740+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:48:35.472740+0000","last_undegraded":"2024-09-14T10:48:35.472740+0000","last_fullsized":"2024-09-14T10:48:35.472740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:48:35.472394+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:48:35.472394+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.472394+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.251475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.473021+0000","last_change":"2024-09-14T10:48:41.472852+0000","last_active":"2024-09-14T10:48:41.473021+0000","last_peered":"2024-09-14T10:48:41.473021+0000","last_clean":"2024-09-14T10:48:41.473021+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:48:41.473021+0000","last_undegraded":"2024-09-14T10:48:41.473021+0000","last_fullsized":"2024-09-14T10:48:41.473021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:41.472667+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:41.472667+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.472667+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:45.971791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.674805+0000","last_change":"2024-09-14T10:48:50.674805+0000","last_active":"2024-09-14T10:48:50.674805+0000","last_peered":"2024-09-14T10:48:50.674805+0000","last_clean":"2024-09-14T10:48:50.674805+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:48:50.674805+0000","last_undegraded":"2024-09-14T10:48:50.674805+0000","last_fullsized":"2024-09-14T10:48:50.674805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:50.674615+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:50.674615+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.674615+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:09.029239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.780035+0000","last_change":"2024-09-14T10:48:15.779894+0000","last_active":"2024-09-14T10:48:15.780035+0000","last_peered":"2024-09-14T10:48:15.780035+0000","last_clean":"2024-09-14T10:48:15.780035+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:48:15.780035+0000","last_undegraded":"2024-09-14T10:48:15.780035+0000","last_fullsized":"2024-09-14T10:48:15.780035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.779722+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.779722+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.779722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:54.382214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.033800+0000","last_change":"2024-09-14T10:48:05.033536+0000","last_active":"2024-09-14T10:48:05.033800+0000","last_peered":"2024-09-14T10:48:05.033800+0000","last_clean":"2024-09-14T10:48:05.033800+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:48:05.033800+0000","last_undegraded":"2024-09-14T10:48:05.033800+0000","last_fullsized":"2024-09-14T10:48:05.033800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.033307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:22.683683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.532367+0000","last_change":"2024-09-14T10:48:33.532122+0000","last_active":"2024-09-14T10:48:33.532367+0000","last_peered":"2024-09-14T10:48:33.532367+0000","last_clean":"2024-09-14T10:48:33.532367+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:48:33.532367+0000","last_undegraded":"2024-09-14T10:48:33.532367+0000","last_fullsized":"2024-09-14T10:48:33.532367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:33.531807+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:33.531807+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.531807+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:30.728116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:58.709247+0000","last_change":"2024-09-14T10:48:58.709247+0000","last_active":"2024-09-14T10:48:58.709247+0000","last_peered":"2024-09-14T10:48:58.709247+0000","last_clean":"2024-09-14T10:48:58.709247+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:48:58.709247+0000","last_undegraded":"2024-09-14T10:48:58.709247+0000","last_fullsized":"2024-09-14T10:48:58.709247+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:58.709052+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:58.709052+0000","last_clean_scrub_stamp":"2024-09-14T10:48:58.709052+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:20.663397+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":514,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.689447+0000","last_change":"2024-09-14T10:48:46.689447+0000","last_active":"2024-09-14T10:48:46.689447+0000","last_peered":"2024-09-14T10:48:46.689447+0000","last_clean":"2024-09-14T10:48:46.689447+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:48:46.689447+0000","last_undegraded":"2024-09-14T10:48:46.689447+0000","last_fullsized":"2024-09-14T10:48:46.689447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:46.689269+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:46.689269+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.689269+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:54.147990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.533081+0000","last_change":"2024-09-14T10:48:46.533081+0000","last_active":"2024-09-14T10:48:46.533081+0000","last_peered":"2024-09-14T10:48:46.533081+0000","last_clean":"2024-09-14T10:48:46.533081+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:48:46.533081+0000","last_undegraded":"2024-09-14T10:48:46.533081+0000","last_fullsized":"2024-09-14T10:48:46.533081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:46.532898+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:46.532898+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.532898+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:04.625405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.480761+0000","last_change":"2024-09-14T10:48:15.480619+0000","last_active":"2024-09-14T10:48:15.480761+0000","last_peered":"2024-09-14T10:48:15.480761+0000","last_clean":"2024-09-14T10:48:15.480761+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:48:15.480761+0000","last_undegraded":"2024-09-14T10:48:15.480761+0000","last_fullsized":"2024-09-14T10:48:15.480761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:15.480424+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:15.480424+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.480424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:35.371076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.058250+0000","last_change":"2024-09-14T10:48:02.058107+0000","last_active":"2024-09-14T10:48:02.058250+0000","last_peered":"2024-09-14T10:48:02.058250+0000","last_clean":"2024-09-14T10:48:02.058250+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:48:02.058250+0000","last_undegraded":"2024-09-14T10:48:02.058250+0000","last_fullsized":"2024-09-14T10:48:02.058250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.057931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:29.184273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.694350+0000","last_change":"2024-09-14T10:48:47.694350+0000","last_active":"2024-09-14T10:48:47.694350+0000","last_peered":"2024-09-14T10:48:47.694350+0000","last_clean":"2024-09-14T10:48:47.694350+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:48:47.694350+0000","last_undegraded":"2024-09-14T10:48:47.694350+0000","last_fullsized":"2024-09-14T10:48:47.694350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.694176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.694176+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.694176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:03.255974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.633480+0000","last_change":"2024-09-14T10:48:42.633335+0000","last_active":"2024-09-14T10:48:42.633480+0000","last_peered":"2024-09-14T10:48:42.633480+0000","last_clean":"2024-09-14T10:48:42.633480+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:48:42.633480+0000","last_undegraded":"2024-09-14T10:48:42.633480+0000","last_fullsized":"2024-09-14T10:48:42.633480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-14T10:48:42.633151+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-14T10:48:42.633151+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.633151+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:24.160724+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.439615+0000","last_change":"2024-09-14T10:48:40.439449+0000","last_active":"2024-09-14T10:48:40.439615+0000","last_peered":"2024-09-14T10:48:40.439615+0000","last_clean":"2024-09-14T10:48:40.439615+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:48:40.439615+0000","last_undegraded":"2024-09-14T10:48:40.439615+0000","last_fullsized":"2024-09-14T10:48:40.439615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:40.439262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:40.439262+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.439262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:38.874795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.777596+0000","last_change":"2024-09-14T10:48:51.777596+0000","last_active":"2024-09-14T10:48:51.777596+0000","last_peered":"2024-09-14T10:48:51.777596+0000","last_clean":"2024-09-14T10:48:51.777596+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:48:51.777596+0000","last_undegraded":"2024-09-14T10:48:51.777596+0000","last_fullsized":"2024-09-14T10:48:51.777596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-14T10:48:51.777409+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-14T10:48:51.777409+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.777409+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:10.132034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.904259+0000","last_change":"2024-09-14T10:48:26.904259+0000","last_active":"2024-09-14T10:48:26.904259+0000","last_peered":"2024-09-14T10:48:26.904259+0000","last_clean":"2024-09-14T10:48:26.904259+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:48:26.904259+0000","last_undegraded":"2024-09-14T10:48:26.904259+0000","last_fullsized":"2024-09-14T10:48:26.904259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:26.904057+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:26.904057+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.904057+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:00.215590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.245843+0000","last_change":"2024-09-14T10:47:57.245843+0000","last_active":"2024-09-14T10:47:57.245843+0000","last_peered":"2024-09-14T10:47:57.245843+0000","last_clean":"2024-09-14T10:47:57.245843+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:47:57.245843+0000","last_undegraded":"2024-09-14T10:47:57.245843+0000","last_fullsized":"2024-09-14T10:47:57.245843+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.245648+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:34.787201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.098357+0000","last_change":"2024-09-14T10:48:00.098121+0000","last_active":"2024-09-14T10:48:00.098357+0000","last_peered":"2024-09-14T10:48:00.098357+0000","last_clean":"2024-09-14T10:48:00.098357+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:48:00.098357+0000","last_undegraded":"2024-09-14T10:48:00.098357+0000","last_fullsized":"2024-09-14T10:48:00.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.097899+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:08.489566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.044417+0000","last_change":"2024-09-14T10:48:03.044221+0000","last_active":"2024-09-14T10:48:03.044417+0000","last_peered":"2024-09-14T10:48:03.044417+0000","last_clean":"2024-09-14T10:48:03.044417+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:48:03.044417+0000","last_undegraded":"2024-09-14T10:48:03.044417+0000","last_fullsized":"2024-09-14T10:48:03.044417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.044031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.988834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.446959+0000","last_change":"2024-09-14T10:48:31.446959+0000","last_active":"2024-09-14T10:48:31.446959+0000","last_peered":"2024-09-14T10:48:31.446959+0000","last_clean":"2024-09-14T10:48:31.446959+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:48:31.446959+0000","last_undegraded":"2024-09-14T10:48:31.446959+0000","last_fullsized":"2024-09-14T10:48:31.446959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:31.446787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:31.446787+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.446787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:40.642565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'91","reported_seq":182,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:54.698326+0000","last_change":"2024-09-14T10:48:54.698326+0000","last_active":"2024-09-14T10:48:54.698326+0000","last_peered":"2024-09-14T10:48:54.698326+0000","last_clean":"2024-09-14T10:48:54.698326+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:48:54.698326+0000","last_undegraded":"2024-09-14T10:48:54.698326+0000","last_fullsized":"2024-09-14T10:48:54.698326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'91","last_scrub_stamp":"2024-09-14T10:48:54.698150+0000","last_deep_scrub":"34'91","last_deep_scrub_stamp":"2024-09-14T10:48:54.698150+0000","last_clean_scrub_stamp":"2024-09-14T10:48:54.698150+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:28.990213+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.557229+0000","last_change":"2024-09-14T10:48:42.557229+0000","last_active":"2024-09-14T10:48:42.557229+0000","last_peered":"2024-09-14T10:48:42.557229+0000","last_clean":"2024-09-14T10:48:42.557229+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:48:42.557229+0000","last_undegraded":"2024-09-14T10:48:42.557229+0000","last_fullsized":"2024-09-14T10:48:42.557229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:42.557031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:42.557031+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.557031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:10.725225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.499364+0000","last_change":"2024-09-14T10:48:47.499364+0000","last_active":"2024-09-14T10:48:47.499364+0000","last_peered":"2024-09-14T10:48:47.499364+0000","last_clean":"2024-09-14T10:48:47.499364+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:48:47.499364+0000","last_undegraded":"2024-09-14T10:48:47.499364+0000","last_fullsized":"2024-09-14T10:48:47.499364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'84","last_scrub_stamp":"2024-09-14T10:48:47.499134+0000","last_deep_scrub":"34'84","last_deep_scrub_stamp":"2024-09-14T10:48:47.499134+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.499134+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:00.278486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.848964+0000","last_change":"2024-09-14T10:48:28.848791+0000","last_active":"2024-09-14T10:48:28.848964+0000","last_peered":"2024-09-14T10:48:28.848964+0000","last_clean":"2024-09-14T10:48:28.848964+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:48:28.848964+0000","last_undegraded":"2024-09-14T10:48:28.848964+0000","last_fullsized":"2024-09-14T10:48:28.848964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:28.848584+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:28.848584+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.848584+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:33.208461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.110721+0000","last_change":"2024-09-14T10:47:59.110585+0000","last_active":"2024-09-14T10:47:59.110721+0000","last_peered":"2024-09-14T10:47:59.110721+0000","last_clean":"2024-09-14T10:47:59.110721+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:47:59.110721+0000","last_undegraded":"2024-09-14T10:47:59.110721+0000","last_fullsized":"2024-09-14T10:47:59.110721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.110378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.838325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.456447+0000","last_change":"2024-09-14T10:48:00.456288+0000","last_active":"2024-09-14T10:48:00.456447+0000","last_peered":"2024-09-14T10:48:00.456447+0000","last_clean":"2024-09-14T10:48:00.456447+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:48:00.456447+0000","last_undegraded":"2024-09-14T10:48:00.456447+0000","last_fullsized":"2024-09-14T10:48:00.456447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.456099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:16.850631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.716345+0000","last_change":"2024-09-14T10:48:46.716345+0000","last_active":"2024-09-14T10:48:46.716345+0000","last_peered":"2024-09-14T10:48:46.716345+0000","last_clean":"2024-09-14T10:48:46.716345+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:48:46.716345+0000","last_undegraded":"2024-09-14T10:48:46.716345+0000","last_fullsized":"2024-09-14T10:48:46.716345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:46.716165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:46.716165+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.716165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:46.735357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'294","reported_seq":521,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.638776+0000","last_change":"2024-09-14T10:48:40.638776+0000","last_active":"2024-09-14T10:48:40.638776+0000","last_peered":"2024-09-14T10:48:40.638776+0000","last_clean":"2024-09-14T10:48:40.638776+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:48:40.638776+0000","last_undegraded":"2024-09-14T10:48:40.638776+0000","last_fullsized":"2024-09-14T10:48:40.638776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'294","last_scrub_stamp":"2024-09-14T10:48:40.638529+0000","last_deep_scrub":"34'294","last_deep_scrub_stamp":"2024-09-14T10:48:40.638529+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.638529+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.944766+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:05.693628+0000","last_change":"2024-09-14T10:49:05.693628+0000","last_active":"2024-09-14T10:49:05.693628+0000","last_peered":"2024-09-14T10:49:05.693628+0000","last_clean":"2024-09-14T10:49:05.693628+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:49:05.693628+0000","last_undegraded":"2024-09-14T10:49:05.693628+0000","last_fullsized":"2024-09-14T10:49:05.693628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:05.693441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:05.693441+0000","last_clean_scrub_stamp":"2024-09-14T10:49:05.693441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:25.601418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:54.685833+0000","last_change":"2024-09-14T10:48:54.685833+0000","last_active":"2024-09-14T10:48:54.685833+0000","last_peered":"2024-09-14T10:48:54.685833+0000","last_clean":"2024-09-14T10:48:54.685833+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:48:54.685833+0000","last_undegraded":"2024-09-14T10:48:54.685833+0000","last_fullsized":"2024-09-14T10:48:54.685833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-14T10:48:54.685618+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-14T10:48:54.685618+0000","last_clean_scrub_stamp":"2024-09-14T10:48:54.685618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:30.350045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.567720+0000","last_change":"2024-09-14T10:48:12.567549+0000","last_active":"2024-09-14T10:48:12.567720+0000","last_peered":"2024-09-14T10:48:12.567720+0000","last_clean":"2024-09-14T10:48:12.567720+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:48:12.567720+0000","last_undegraded":"2024-09-14T10:48:12.567720+0000","last_fullsized":"2024-09-14T10:48:12.567720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.567361+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:57.983269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.581742+0000","last_change":"2024-09-14T10:47:58.581615+0000","last_active":"2024-09-14T10:47:58.581742+0000","last_peered":"2024-09-14T10:47:58.581742+0000","last_clean":"2024-09-14T10:47:58.581742+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:47:58.581742+0000","last_undegraded":"2024-09-14T10:47:58.581742+0000","last_fullsized":"2024-09-14T10:47:58.581742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.581432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:45.392307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.414030+0000","last_change":"2024-09-14T10:48:01.413761+0000","last_active":"2024-09-14T10:48:01.414030+0000","last_peered":"2024-09-14T10:48:01.414030+0000","last_clean":"2024-09-14T10:48:01.414030+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:48:01.414030+0000","last_undegraded":"2024-09-14T10:48:01.414030+0000","last_fullsized":"2024-09-14T10:48:01.414030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.413492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.502183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.642698+0000","last_change":"2024-09-14T10:48:26.642521+0000","last_active":"2024-09-14T10:48:26.642698+0000","last_peered":"2024-09-14T10:48:26.642698+0000","last_clean":"2024-09-14T10:48:26.642698+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:48:26.642698+0000","last_undegraded":"2024-09-14T10:48:26.642698+0000","last_fullsized":"2024-09-14T10:48:26.642698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:26.642330+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:26.642330+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.642330+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:19.213154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.571067+0000","last_change":"2024-09-14T10:48:32.571067+0000","last_active":"2024-09-14T10:48:32.571067+0000","last_peered":"2024-09-14T10:48:32.571067+0000","last_clean":"2024-09-14T10:48:32.571067+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:48:32.571067+0000","last_undegraded":"2024-09-14T10:48:32.571067+0000","last_fullsized":"2024-09-14T10:48:32.571067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-14T10:48:32.570846+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-14T10:48:32.570846+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.570846+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:53:30.502745+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.520232+0000","last_change":"2024-09-14T10:48:41.520232+0000","last_active":"2024-09-14T10:48:41.520232+0000","last_peered":"2024-09-14T10:48:41.520232+0000","last_clean":"2024-09-14T10:48:41.520232+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:48:41.520232+0000","last_undegraded":"2024-09-14T10:48:41.520232+0000","last_fullsized":"2024-09-14T10:48:41.520232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:41.520044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:41.520044+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.520044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:23.047617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:15.783267+0000","last_change":"2024-09-14T10:49:15.783267+0000","last_active":"2024-09-14T10:49:15.783267+0000","last_peered":"2024-09-14T10:49:15.783267+0000","last_clean":"2024-09-14T10:49:15.783267+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:49:15.783267+0000","last_undegraded":"2024-09-14T10:49:15.783267+0000","last_fullsized":"2024-09-14T10:49:15.783267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:15.783085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:15.783085+0000","last_clean_scrub_stamp":"2024-09-14T10:49:15.783085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:39.100338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.613733+0000","last_change":"2024-09-14T10:48:13.613570+0000","last_active":"2024-09-14T10:48:13.613733+0000","last_peered":"2024-09-14T10:48:13.613733+0000","last_clean":"2024-09-14T10:48:13.613733+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:48:13.613733+0000","last_undegraded":"2024-09-14T10:48:13.613733+0000","last_fullsized":"2024-09-14T10:48:13.613733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.613391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:50.163937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.149492+0000","last_change":"2024-09-14T10:47:58.149312+0000","last_active":"2024-09-14T10:47:58.149492+0000","last_peered":"2024-09-14T10:47:58.149492+0000","last_clean":"2024-09-14T10:47:58.149492+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:47:58.149492+0000","last_undegraded":"2024-09-14T10:47:58.149492+0000","last_fullsized":"2024-09-14T10:47:58.149492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.149127+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:37.977768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.572653+0000","last_change":"2024-09-14T10:48:00.572497+0000","last_active":"2024-09-14T10:48:00.572653+0000","last_peered":"2024-09-14T10:48:00.572653+0000","last_clean":"2024-09-14T10:48:00.572653+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:48:00.572653+0000","last_undegraded":"2024-09-14T10:48:00.572653+0000","last_fullsized":"2024-09-14T10:48:00.572653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.572309+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:24.566081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.559461+0000","last_change":"2024-09-14T10:48:23.559461+0000","last_active":"2024-09-14T10:48:23.559461+0000","last_peered":"2024-09-14T10:48:23.559461+0000","last_clean":"2024-09-14T10:48:23.559461+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:48:23.559461+0000","last_undegraded":"2024-09-14T10:48:23.559461+0000","last_fullsized":"2024-09-14T10:48:23.559461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:23.559204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:23.559204+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.559204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:28.629556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.694473+0000","last_change":"2024-09-14T10:48:53.694473+0000","last_active":"2024-09-14T10:48:53.694473+0000","last_peered":"2024-09-14T10:48:53.694473+0000","last_clean":"2024-09-14T10:48:53.694473+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:48:53.694473+0000","last_undegraded":"2024-09-14T10:48:53.694473+0000","last_fullsized":"2024-09-14T10:48:53.694473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-14T10:48:53.694274+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-14T10:48:53.694274+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.694274+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:45.043117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:06.649907+0000","last_change":"2024-09-14T10:49:06.649907+0000","last_active":"2024-09-14T10:49:06.649907+0000","last_peered":"2024-09-14T10:49:06.649907+0000","last_clean":"2024-09-14T10:49:06.649907+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:49:06.649907+0000","last_undegraded":"2024-09-14T10:49:06.649907+0000","last_fullsized":"2024-09-14T10:49:06.649907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.649694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.649694+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.649694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:08.973745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.717566+0000","last_change":"2024-09-14T10:48:53.717566+0000","last_active":"2024-09-14T10:48:53.717566+0000","last_peered":"2024-09-14T10:48:53.717566+0000","last_clean":"2024-09-14T10:48:53.717566+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:48:53.717566+0000","last_undegraded":"2024-09-14T10:48:53.717566+0000","last_fullsized":"2024-09-14T10:48:53.717566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:53.717357+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:53.717357+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.717357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:42.759549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.468843+0000","last_change":"2024-09-14T10:48:11.468705+0000","last_active":"2024-09-14T10:48:11.468843+0000","last_peered":"2024-09-14T10:48:11.468843+0000","last_clean":"2024-09-14T10:48:11.468843+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:48:11.468843+0000","last_undegraded":"2024-09-14T10:48:11.468843+0000","last_fullsized":"2024-09-14T10:48:11.468843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.468533+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:45.152569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.623568+0000","last_change":"2024-09-14T10:47:57.623416+0000","last_active":"2024-09-14T10:47:57.623568+0000","last_peered":"2024-09-14T10:47:57.623568+0000","last_clean":"2024-09-14T10:47:57.623568+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:47:57.623568+0000","last_undegraded":"2024-09-14T10:47:57.623568+0000","last_fullsized":"2024-09-14T10:47:57.623568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.623229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:32.565978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.487932+0000","last_change":"2024-09-14T10:47:57.487828+0000","last_active":"2024-09-14T10:47:57.487932+0000","last_peered":"2024-09-14T10:47:57.487932+0000","last_clean":"2024-09-14T10:47:57.487932+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:47:57.487932+0000","last_undegraded":"2024-09-14T10:47:57.487932+0000","last_fullsized":"2024-09-14T10:47:57.487932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.487712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:43.722639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.624258+0000","last_change":"2024-09-14T10:48:25.624110+0000","last_active":"2024-09-14T10:48:25.624258+0000","last_peered":"2024-09-14T10:48:25.624258+0000","last_clean":"2024-09-14T10:48:25.624258+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:48:25.624258+0000","last_undegraded":"2024-09-14T10:48:25.624258+0000","last_fullsized":"2024-09-14T10:48:25.624258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:25.623922+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:25.623922+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.623922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:39.508678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'77","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.611378+0000","last_change":"2024-09-14T10:48:32.611378+0000","last_active":"2024-09-14T10:48:32.611378+0000","last_peered":"2024-09-14T10:48:32.611378+0000","last_clean":"2024-09-14T10:48:32.611378+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:48:32.611378+0000","last_undegraded":"2024-09-14T10:48:32.611378+0000","last_fullsized":"2024-09-14T10:48:32.611378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-09-14T10:48:32.611179+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-09-14T10:48:32.611179+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.611179+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.807488+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.425772+0000","last_change":"2024-09-14T10:48:38.425772+0000","last_active":"2024-09-14T10:48:38.425772+0000","last_peered":"2024-09-14T10:48:38.425772+0000","last_clean":"2024-09-14T10:48:38.425772+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:48:38.425772+0000","last_undegraded":"2024-09-14T10:48:38.425772+0000","last_fullsized":"2024-09-14T10:48:38.425772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:38.425580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:38.425580+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.425580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:05.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:55.716129+0000","last_change":"2024-09-14T10:48:55.716129+0000","last_active":"2024-09-14T10:48:55.716129+0000","last_peered":"2024-09-14T10:48:55.716129+0000","last_clean":"2024-09-14T10:48:55.716129+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:48:55.716129+0000","last_undegraded":"2024-09-14T10:48:55.716129+0000","last_fullsized":"2024-09-14T10:48:55.716129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:55.715943+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:55.715943+0000","last_clean_scrub_stamp":"2024-09-14T10:48:55.715943+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:37.863971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.481717+0000","last_change":"2024-09-14T10:48:12.481545+0000","last_active":"2024-09-14T10:48:12.481717+0000","last_peered":"2024-09-14T10:48:12.481717+0000","last_clean":"2024-09-14T10:48:12.481717+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:48:12.481717+0000","last_undegraded":"2024-09-14T10:48:12.481717+0000","last_fullsized":"2024-09-14T10:48:12.481717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.481368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.388398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.477560+0000","last_change":"2024-09-14T10:47:58.477358+0000","last_active":"2024-09-14T10:47:58.477560+0000","last_peered":"2024-09-14T10:47:58.477560+0000","last_clean":"2024-09-14T10:47:58.477560+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:58.477560+0000","last_undegraded":"2024-09-14T10:47:58.477560+0000","last_fullsized":"2024-09-14T10:47:58.477560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.477145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.383210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.998360+0000","last_change":"2024-09-14T10:48:03.998223+0000","last_active":"2024-09-14T10:48:03.998360+0000","last_peered":"2024-09-14T10:48:03.998360+0000","last_clean":"2024-09-14T10:48:03.998360+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:48:03.998360+0000","last_undegraded":"2024-09-14T10:48:03.998360+0000","last_fullsized":"2024-09-14T10:48:03.998360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.998046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.536432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.728758+0000","last_change":"2024-09-14T10:48:45.728758+0000","last_active":"2024-09-14T10:48:45.728758+0000","last_peered":"2024-09-14T10:48:45.728758+0000","last_clean":"2024-09-14T10:48:45.728758+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:48:45.728758+0000","last_undegraded":"2024-09-14T10:48:45.728758+0000","last_fullsized":"2024-09-14T10:48:45.728758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:45.728586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:45.728586+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.728586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:21.992740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.550457+0000","last_change":"2024-09-14T10:48:38.550457+0000","last_active":"2024-09-14T10:48:38.550457+0000","last_peered":"2024-09-14T10:48:38.550457+0000","last_clean":"2024-09-14T10:48:38.550457+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:48:38.550457+0000","last_undegraded":"2024-09-14T10:48:38.550457+0000","last_fullsized":"2024-09-14T10:48:38.550457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-14T10:48:38.550231+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-14T10:48:38.550231+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.550231+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:25.910802+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.677575+0000","last_change":"2024-09-14T10:48:45.677575+0000","last_active":"2024-09-14T10:48:45.677575+0000","last_peered":"2024-09-14T10:48:45.677575+0000","last_clean":"2024-09-14T10:48:45.677575+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:48:45.677575+0000","last_undegraded":"2024-09-14T10:48:45.677575+0000","last_fullsized":"2024-09-14T10:48:45.677575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:45.677384+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:45.677384+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.677384+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:51.575023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:12.716190+0000","last_change":"2024-09-14T10:49:12.716190+0000","last_active":"2024-09-14T10:49:12.716190+0000","last_peered":"2024-09-14T10:49:12.716190+0000","last_clean":"2024-09-14T10:49:12.716190+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:49:12.716190+0000","last_undegraded":"2024-09-14T10:49:12.716190+0000","last_fullsized":"2024-09-14T10:49:12.716190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:12.716008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:12.716008+0000","last_clean_scrub_stamp":"2024-09-14T10:49:12.716008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:50.925067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.929810+0000","last_change":"2024-09-14T10:48:24.929810+0000","last_active":"2024-09-14T10:48:24.929810+0000","last_peered":"2024-09-14T10:48:24.929810+0000","last_clean":"2024-09-14T10:48:24.929810+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:48:24.929810+0000","last_undegraded":"2024-09-14T10:48:24.929810+0000","last_fullsized":"2024-09-14T10:48:24.929810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:24.929616+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:24.929616+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.929616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:39.211133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.041432+0000","last_change":"2024-09-14T10:48:06.041282+0000","last_active":"2024-09-14T10:48:06.041432+0000","last_peered":"2024-09-14T10:48:06.041432+0000","last_clean":"2024-09-14T10:48:06.041432+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:48:06.041432+0000","last_undegraded":"2024-09-14T10:48:06.041432+0000","last_fullsized":"2024-09-14T10:48:06.041432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.041120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:55.979958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:56.524180+0000","last_change":"2024-09-14T10:47:56.524057+0000","last_active":"2024-09-14T10:47:56.524180+0000","last_peered":"2024-09-14T10:47:56.524180+0000","last_clean":"2024-09-14T10:47:56.524180+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:47:56.524180+0000","last_undegraded":"2024-09-14T10:47:56.524180+0000","last_fullsized":"2024-09-14T10:47:56.524180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_clean_scrub_stamp":"2024-09-14T10:47:56.523860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:01.837471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.694914+0000","last_change":"2024-09-14T10:48:44.694914+0000","last_active":"2024-09-14T10:48:44.694914+0000","last_peered":"2024-09-14T10:48:44.694914+0000","last_clean":"2024-09-14T10:48:44.694914+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:48:44.694914+0000","last_undegraded":"2024-09-14T10:48:44.694914+0000","last_fullsized":"2024-09-14T10:48:44.694914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.694737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.694737+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.694737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:48.362904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.717581+0000","last_change":"2024-09-14T10:48:52.717581+0000","last_active":"2024-09-14T10:48:52.717581+0000","last_peered":"2024-09-14T10:48:52.717581+0000","last_clean":"2024-09-14T10:48:52.717581+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:48:52.717581+0000","last_undegraded":"2024-09-14T10:48:52.717581+0000","last_fullsized":"2024-09-14T10:48:52.717581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:52.717383+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:52.717383+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.717383+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:24.329304+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":432,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.565178+0000","last_change":"2024-09-14T10:48:40.565178+0000","last_active":"2024-09-14T10:48:40.565178+0000","last_peered":"2024-09-14T10:48:40.565178+0000","last_clean":"2024-09-14T10:48:40.565178+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:48:40.565178+0000","last_undegraded":"2024-09-14T10:48:40.565178+0000","last_fullsized":"2024-09-14T10:48:40.565178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:40.564999+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:40.564999+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.564999+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:30.676479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:55.711758+0000","last_change":"2024-09-14T10:48:55.711758+0000","last_active":"2024-09-14T10:48:55.711758+0000","last_peered":"2024-09-14T10:48:55.711758+0000","last_clean":"2024-09-14T10:48:55.711758+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:48:55.711758+0000","last_undegraded":"2024-09-14T10:48:55.711758+0000","last_fullsized":"2024-09-14T10:48:55.711758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-14T10:48:55.711503+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-14T10:48:55.711503+0000","last_clean_scrub_stamp":"2024-09-14T10:48:55.711503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:20.209155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.839501+0000","last_change":"2024-09-14T10:48:11.839361+0000","last_active":"2024-09-14T10:48:11.839501+0000","last_peered":"2024-09-14T10:48:11.839501+0000","last_clean":"2024-09-14T10:48:11.839501+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:48:11.839501+0000","last_undegraded":"2024-09-14T10:48:11.839501+0000","last_fullsized":"2024-09-14T10:48:11.839501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.839181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:55.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.217592+0000","last_change":"2024-09-14T10:47:58.217454+0000","last_active":"2024-09-14T10:47:58.217592+0000","last_peered":"2024-09-14T10:47:58.217592+0000","last_clean":"2024-09-14T10:47:58.217592+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:47:58.217592+0000","last_undegraded":"2024-09-14T10:47:58.217592+0000","last_fullsized":"2024-09-14T10:47:58.217592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.217266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:03.530877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.067246+0000","last_change":"2024-09-14T10:48:01.067081+0000","last_active":"2024-09-14T10:48:01.067246+0000","last_peered":"2024-09-14T10:48:01.067246+0000","last_clean":"2024-09-14T10:48:01.067246+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:48:01.067246+0000","last_undegraded":"2024-09-14T10:48:01.067246+0000","last_fullsized":"2024-09-14T10:48:01.067246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.066905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:15.602397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.692185+0000","last_change":"2024-09-14T10:48:43.692185+0000","last_active":"2024-09-14T10:48:43.692185+0000","last_peered":"2024-09-14T10:48:43.692185+0000","last_clean":"2024-09-14T10:48:43.692185+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:48:43.692185+0000","last_undegraded":"2024-09-14T10:48:43.692185+0000","last_fullsized":"2024-09-14T10:48:43.692185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.692008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.692008+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.692008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:45.530106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'100","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.534479+0000","last_change":"2024-09-14T10:48:33.534479+0000","last_active":"2024-09-14T10:48:33.534479+0000","last_peered":"2024-09-14T10:48:33.534479+0000","last_clean":"2024-09-14T10:48:33.534479+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:48:33.534479+0000","last_undegraded":"2024-09-14T10:48:33.534479+0000","last_fullsized":"2024-09-14T10:48:33.534479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'100","last_scrub_stamp":"2024-09-14T10:48:33.534256+0000","last_deep_scrub":"34'100","last_deep_scrub_stamp":"2024-09-14T10:48:33.534256+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.534256+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:30.978930+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.621964+0000","last_change":"2024-09-14T10:48:38.621964+0000","last_active":"2024-09-14T10:48:38.621964+0000","last_peered":"2024-09-14T10:48:38.621964+0000","last_clean":"2024-09-14T10:48:38.621964+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:48:38.621964+0000","last_undegraded":"2024-09-14T10:48:38.621964+0000","last_fullsized":"2024-09-14T10:48:38.621964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:38.621875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:38.621875+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.621875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:02.948854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.481579+0000","last_change":"2024-09-14T10:48:48.481579+0000","last_active":"2024-09-14T10:48:48.481579+0000","last_peered":"2024-09-14T10:48:48.481579+0000","last_clean":"2024-09-14T10:48:48.481579+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:48:48.481579+0000","last_undegraded":"2024-09-14T10:48:48.481579+0000","last_fullsized":"2024-09-14T10:48:48.481579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:48.481360+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:48.481360+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.481360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:00.754346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.465376+0000","last_change":"2024-09-14T10:48:50.465376+0000","last_active":"2024-09-14T10:48:50.465376+0000","last_peered":"2024-09-14T10:48:50.465376+0000","last_clean":"2024-09-14T10:48:50.465376+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:48:50.465376+0000","last_undegraded":"2024-09-14T10:48:50.465376+0000","last_fullsized":"2024-09-14T10:48:50.465376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:50.465198+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:50.465198+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.465198+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:19.453603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.749236+0000","last_change":"2024-09-14T10:48:16.748979+0000","last_active":"2024-09-14T10:48:16.749236+0000","last_peered":"2024-09-14T10:48:16.749236+0000","last_clean":"2024-09-14T10:48:16.749236+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:48:16.749236+0000","last_undegraded":"2024-09-14T10:48:16.749236+0000","last_fullsized":"2024-09-14T10:48:16.749236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:16.748707+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:16.748707+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.748707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:29.127800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.979894+0000","last_change":"2024-09-14T10:48:11.979725+0000","last_active":"2024-09-14T10:48:11.979894+0000","last_peered":"2024-09-14T10:48:11.979894+0000","last_clean":"2024-09-14T10:48:11.979894+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:48:11.979894+0000","last_undegraded":"2024-09-14T10:48:11.979894+0000","last_fullsized":"2024-09-14T10:48:11.979894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.979551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:25.927244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.549319+0000","last_change":"2024-09-14T10:48:34.549173+0000","last_active":"2024-09-14T10:48:34.549319+0000","last_peered":"2024-09-14T10:48:34.549319+0000","last_clean":"2024-09-14T10:48:34.549319+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:48:34.549319+0000","last_undegraded":"2024-09-14T10:48:34.549319+0000","last_fullsized":"2024-09-14T10:48:34.549319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:34.548997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:34.548997+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.548997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:34.500266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:59.752796+0000","last_change":"2024-09-14T10:48:59.752796+0000","last_active":"2024-09-14T10:48:59.752796+0000","last_peered":"2024-09-14T10:48:59.752796+0000","last_clean":"2024-09-14T10:48:59.752796+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:48:59.752796+0000","last_undegraded":"2024-09-14T10:48:59.752796+0000","last_fullsized":"2024-09-14T10:48:59.752796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-14T10:48:59.752606+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-14T10:48:59.752606+0000","last_clean_scrub_stamp":"2024-09-14T10:48:59.752606+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:39.741730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:07.680821+0000","last_change":"2024-09-14T10:49:07.680821+0000","last_active":"2024-09-14T10:49:07.680821+0000","last_peered":"2024-09-14T10:49:07.680821+0000","last_clean":"2024-09-14T10:49:07.680821+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:49:07.680821+0000","last_undegraded":"2024-09-14T10:49:07.680821+0000","last_fullsized":"2024-09-14T10:49:07.680821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:07.680615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:07.680615+0000","last_clean_scrub_stamp":"2024-09-14T10:49:07.680615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:36.921373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:58.648532+0000","last_change":"2024-09-14T10:48:58.648532+0000","last_active":"2024-09-14T10:48:58.648532+0000","last_peered":"2024-09-14T10:48:58.648532+0000","last_clean":"2024-09-14T10:48:58.648532+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:48:58.648532+0000","last_undegraded":"2024-09-14T10:48:58.648532+0000","last_fullsized":"2024-09-14T10:48:58.648532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:58.648352+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:58.648352+0000","last_clean_scrub_stamp":"2024-09-14T10:48:58.648352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:15.101235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.470865+0000","last_change":"2024-09-14T10:48:16.470720+0000","last_active":"2024-09-14T10:48:16.470865+0000","last_peered":"2024-09-14T10:48:16.470865+0000","last_clean":"2024-09-14T10:48:16.470865+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:48:16.470865+0000","last_undegraded":"2024-09-14T10:48:16.470865+0000","last_fullsized":"2024-09-14T10:48:16.470865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:16.470534+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:16.470534+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.470534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:20.092198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.594514+0000","last_change":"2024-09-14T10:48:02.594367+0000","last_active":"2024-09-14T10:48:02.594514+0000","last_peered":"2024-09-14T10:48:02.594514+0000","last_clean":"2024-09-14T10:48:02.594514+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:48:02.594514+0000","last_undegraded":"2024-09-14T10:48:02.594514+0000","last_fullsized":"2024-09-14T10:48:02.594514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.594183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.132926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.676176+0000","last_change":"2024-09-14T10:48:49.676176+0000","last_active":"2024-09-14T10:48:49.676176+0000","last_peered":"2024-09-14T10:48:49.676176+0000","last_clean":"2024-09-14T10:48:49.676176+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:48:49.676176+0000","last_undegraded":"2024-09-14T10:48:49.676176+0000","last_fullsized":"2024-09-14T10:48:49.676176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.675950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.675950+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.675950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:38.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.610556+0000","last_change":"2024-09-14T10:48:34.610413+0000","last_active":"2024-09-14T10:48:34.610556+0000","last_peered":"2024-09-14T10:48:34.610556+0000","last_clean":"2024-09-14T10:48:34.610556+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:48:34.610556+0000","last_undegraded":"2024-09-14T10:48:34.610556+0000","last_fullsized":"2024-09-14T10:48:34.610556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:34.610221+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:34.610221+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.610221+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:42.868537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.492445+0000","last_change":"2024-09-14T10:48:42.492309+0000","last_active":"2024-09-14T10:48:42.492445+0000","last_peered":"2024-09-14T10:48:42.492445+0000","last_clean":"2024-09-14T10:48:42.492445+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:48:42.492445+0000","last_undegraded":"2024-09-14T10:48:42.492445+0000","last_fullsized":"2024-09-14T10:48:42.492445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:42.492140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:42.492140+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.492140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:31.192955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:57.696454+0000","last_change":"2024-09-14T10:48:57.696288+0000","last_active":"2024-09-14T10:48:57.696454+0000","last_peered":"2024-09-14T10:48:57.696454+0000","last_clean":"2024-09-14T10:48:57.696454+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:48:57.696454+0000","last_undegraded":"2024-09-14T10:48:57.696454+0000","last_fullsized":"2024-09-14T10:48:57.696454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:57.696109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:57.696109+0000","last_clean_scrub_stamp":"2024-09-14T10:48:57.696109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:11.570223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.626201+0000","last_change":"2024-09-14T10:48:14.626010+0000","last_active":"2024-09-14T10:48:14.626201+0000","last_peered":"2024-09-14T10:48:14.626201+0000","last_clean":"2024-09-14T10:48:14.626201+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:48:14.626201+0000","last_undegraded":"2024-09-14T10:48:14.626201+0000","last_fullsized":"2024-09-14T10:48:14.626201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.625832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:18.247497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.596198+0000","last_change":"2024-09-14T10:48:04.596063+0000","last_active":"2024-09-14T10:48:04.596198+0000","last_peered":"2024-09-14T10:48:04.596198+0000","last_clean":"2024-09-14T10:48:04.596198+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:48:04.596198+0000","last_undegraded":"2024-09-14T10:48:04.596198+0000","last_fullsized":"2024-09-14T10:48:04.596198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.595874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:58.777417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.558337+0000","last_change":"2024-09-14T10:48:28.558189+0000","last_active":"2024-09-14T10:48:28.558337+0000","last_peered":"2024-09-14T10:48:28.558337+0000","last_clean":"2024-09-14T10:48:28.558337+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:48:28.558337+0000","last_undegraded":"2024-09-14T10:48:28.558337+0000","last_fullsized":"2024-09-14T10:48:28.558337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:28.558009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:28.558009+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.558009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:34.621600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.612052+0000","last_change":"2024-09-14T10:48:36.611887+0000","last_active":"2024-09-14T10:48:36.612052+0000","last_peered":"2024-09-14T10:48:36.612052+0000","last_clean":"2024-09-14T10:48:36.612052+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:48:36.612052+0000","last_undegraded":"2024-09-14T10:48:36.612052+0000","last_fullsized":"2024-09-14T10:48:36.612052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-14T10:48:36.611684+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-14T10:48:36.611684+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.611684+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:12.339630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.723368+0000","last_change":"2024-09-14T10:48:47.723250+0000","last_active":"2024-09-14T10:48:47.723368+0000","last_peered":"2024-09-14T10:48:47.723368+0000","last_clean":"2024-09-14T10:48:47.723368+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:48:47.723368+0000","last_undegraded":"2024-09-14T10:48:47.723368+0000","last_fullsized":"2024-09-14T10:48:47.723368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.723075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.723075+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.723075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:32.907799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:44.450045+0000","last_change":"2024-09-14T10:44:15.378526+0000","last_active":"2024-09-14T10:46:44.450045+0000","last_peered":"2024-09-14T10:46:44.450045+0000","last_clean":"2024-09-14T10:46:44.450045+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:46:44.450045+0000","last_undegraded":"2024-09-14T10:46:44.450045+0000","last_fullsized":"2024-09-14T10:46:44.450045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.902526+0000","last_change":"2024-09-14T10:48:30.902377+0000","last_active":"2024-09-14T10:48:30.902526+0000","last_peered":"2024-09-14T10:48:30.902526+0000","last_clean":"2024-09-14T10:48:30.902526+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:48:30.902526+0000","last_undegraded":"2024-09-14T10:48:30.902526+0000","last_fullsized":"2024-09-14T10:48:30.902526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:30.902193+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:30.902193+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.902193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:41.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.280343+0000","last_change":"2024-09-14T10:48:00.280211+0000","last_active":"2024-09-14T10:48:00.280343+0000","last_peered":"2024-09-14T10:48:00.280343+0000","last_clean":"2024-09-14T10:48:00.280343+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:48:00.280343+0000","last_undegraded":"2024-09-14T10:48:00.280343+0000","last_fullsized":"2024-09-14T10:48:00.280343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.280016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:02.623876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.673942+0000","last_change":"2024-09-14T10:48:48.673806+0000","last_active":"2024-09-14T10:48:48.673942+0000","last_peered":"2024-09-14T10:48:48.673942+0000","last_clean":"2024-09-14T10:48:48.673942+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:48:48.673942+0000","last_undegraded":"2024-09-14T10:48:48.673942+0000","last_fullsized":"2024-09-14T10:48:48.673942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:48.673623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:48.673623+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.673623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:12.881111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.430971+0000","last_change":"2024-09-14T10:48:36.430697+0000","last_active":"2024-09-14T10:48:36.430971+0000","last_peered":"2024-09-14T10:48:36.430971+0000","last_clean":"2024-09-14T10:48:36.430971+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:48:36.430971+0000","last_undegraded":"2024-09-14T10:48:36.430971+0000","last_fullsized":"2024-09-14T10:48:36.430971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-14T10:48:36.430445+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-14T10:48:36.430445+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.430445+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:46.137903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.466977+0000","last_change":"2024-09-14T10:48:43.466834+0000","last_active":"2024-09-14T10:48:43.466977+0000","last_peered":"2024-09-14T10:48:43.466977+0000","last_clean":"2024-09-14T10:48:43.466977+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:48:43.466977+0000","last_undegraded":"2024-09-14T10:48:43.466977+0000","last_fullsized":"2024-09-14T10:48:43.466977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.466665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.466665+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.466665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:38.006360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.760508+0000","last_change":"2024-09-14T10:48:34.760508+0000","last_active":"2024-09-14T10:48:34.760508+0000","last_peered":"2024-09-14T10:48:34.760508+0000","last_clean":"2024-09-14T10:48:34.760508+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:48:34.760508+0000","last_undegraded":"2024-09-14T10:48:34.760508+0000","last_fullsized":"2024-09-14T10:48:34.760508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:34.760328+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:34.760328+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.760328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:30.695415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.008939+0000","last_change":"2024-09-14T10:48:13.008639+0000","last_active":"2024-09-14T10:48:13.008939+0000","last_peered":"2024-09-14T10:48:13.008939+0000","last_clean":"2024-09-14T10:48:13.008939+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:48:13.008939+0000","last_undegraded":"2024-09-14T10:48:13.008939+0000","last_fullsized":"2024-09-14T10:48:13.008939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.008350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:31.362974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.630021+0000","last_change":"2024-09-14T10:48:29.630021+0000","last_active":"2024-09-14T10:48:29.630021+0000","last_peered":"2024-09-14T10:48:29.630021+0000","last_clean":"2024-09-14T10:48:29.630021+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:48:29.630021+0000","last_undegraded":"2024-09-14T10:48:29.630021+0000","last_fullsized":"2024-09-14T10:48:29.630021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:29.629844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:29.629844+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.629844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:51.400468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":141,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.587905+0000","last_change":"2024-09-14T10:48:39.587768+0000","last_active":"2024-09-14T10:48:39.587905+0000","last_peered":"2024-09-14T10:48:39.587905+0000","last_clean":"2024-09-14T10:48:39.587905+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:48:39.587905+0000","last_undegraded":"2024-09-14T10:48:39.587905+0000","last_fullsized":"2024-09-14T10:48:39.587905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-14T10:48:39.587554+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-14T10:48:39.587554+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.587554+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:58.893791+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.511570+0000","last_change":"2024-09-14T10:48:44.511426+0000","last_active":"2024-09-14T10:48:44.511570+0000","last_peered":"2024-09-14T10:48:44.511570+0000","last_clean":"2024-09-14T10:48:44.511570+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:48:44.511570+0000","last_undegraded":"2024-09-14T10:48:44.511570+0000","last_fullsized":"2024-09-14T10:48:44.511570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.511202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.511202+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.511202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:16.374234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:54.713184+0000","last_change":"2024-09-14T10:48:54.712895+0000","last_active":"2024-09-14T10:48:54.713184+0000","last_peered":"2024-09-14T10:48:54.713184+0000","last_clean":"2024-09-14T10:48:54.713184+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:48:54.713184+0000","last_undegraded":"2024-09-14T10:48:54.713184+0000","last_fullsized":"2024-09-14T10:48:54.713184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-14T10:48:54.712628+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-14T10:48:54.712628+0000","last_clean_scrub_stamp":"2024-09-14T10:48:54.712628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:19.210280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.496839+0000","last_change":"2024-09-14T10:48:19.496839+0000","last_active":"2024-09-14T10:48:19.496839+0000","last_peered":"2024-09-14T10:48:19.496839+0000","last_clean":"2024-09-14T10:48:19.496839+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:48:19.496839+0000","last_undegraded":"2024-09-14T10:48:19.496839+0000","last_fullsized":"2024-09-14T10:48:19.496839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:19.496651+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:19.496651+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.496651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:16.610106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.271212+0000","last_change":"2024-09-14T10:48:01.271045+0000","last_active":"2024-09-14T10:48:01.271212+0000","last_peered":"2024-09-14T10:48:01.271212+0000","last_clean":"2024-09-14T10:48:01.271212+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:48:01.271212+0000","last_undegraded":"2024-09-14T10:48:01.271212+0000","last_fullsized":"2024-09-14T10:48:01.271212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.270861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:42.910644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.522928+0000","last_change":"2024-09-14T10:48:30.522928+0000","last_active":"2024-09-14T10:48:30.522928+0000","last_peered":"2024-09-14T10:48:30.522928+0000","last_clean":"2024-09-14T10:48:30.522928+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:48:30.522928+0000","last_undegraded":"2024-09-14T10:48:30.522928+0000","last_fullsized":"2024-09-14T10:48:30.522928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:30.522747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:30.522747+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.522747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.439750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:03.734741+0000","last_change":"2024-09-14T10:49:03.734604+0000","last_active":"2024-09-14T10:49:03.734741+0000","last_peered":"2024-09-14T10:49:03.734741+0000","last_clean":"2024-09-14T10:49:03.734741+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:49:03.734741+0000","last_undegraded":"2024-09-14T10:49:03.734741+0000","last_fullsized":"2024-09-14T10:49:03.734741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:49:03.734408+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:49:03.734408+0000","last_clean_scrub_stamp":"2024-09-14T10:49:03.734408+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:03.428618+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.741289+0000","last_change":"2024-09-14T10:48:50.741123+0000","last_active":"2024-09-14T10:48:50.741289+0000","last_peered":"2024-09-14T10:48:50.741289+0000","last_clean":"2024-09-14T10:48:50.741289+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:48:50.741289+0000","last_undegraded":"2024-09-14T10:48:50.741289+0000","last_fullsized":"2024-09-14T10:48:50.741289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:50.740934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:50.740934+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.740934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:04.688628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:17.777948+0000","last_change":"2024-09-14T10:49:17.777948+0000","last_active":"2024-09-14T10:49:17.777948+0000","last_peered":"2024-09-14T10:49:17.777948+0000","last_clean":"2024-09-14T10:49:17.777948+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:49:17.777948+0000","last_undegraded":"2024-09-14T10:49:17.777948+0000","last_fullsized":"2024-09-14T10:49:17.777948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:17.777775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:17.777775+0000","last_clean_scrub_stamp":"2024-09-14T10:49:17.777775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:53.259424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.738250+0000","last_change":"2024-09-14T10:48:35.738014+0000","last_active":"2024-09-14T10:48:35.738250+0000","last_peered":"2024-09-14T10:48:35.738250+0000","last_clean":"2024-09-14T10:48:35.738250+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:48:35.738250+0000","last_undegraded":"2024-09-14T10:48:35.738250+0000","last_fullsized":"2024-09-14T10:48:35.738250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:35.737790+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:35.737790+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.737790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:30.363223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.293031+0000","last_change":"2024-09-14T10:48:02.292893+0000","last_active":"2024-09-14T10:48:02.293031+0000","last_peered":"2024-09-14T10:48:02.293031+0000","last_clean":"2024-09-14T10:48:02.293031+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:48:02.293031+0000","last_undegraded":"2024-09-14T10:48:02.293031+0000","last_fullsized":"2024-09-14T10:48:02.293031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.292668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:18.687200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.549567+0000","last_change":"2024-09-14T10:48:31.549300+0000","last_active":"2024-09-14T10:48:31.549567+0000","last_peered":"2024-09-14T10:48:31.549567+0000","last_clean":"2024-09-14T10:48:31.549567+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:48:31.549567+0000","last_undegraded":"2024-09-14T10:48:31.549567+0000","last_fullsized":"2024-09-14T10:48:31.549567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:31.549097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:31.549097+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.549097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:35.467929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.650518+0000","last_change":"2024-09-14T10:48:37.650518+0000","last_active":"2024-09-14T10:48:37.650518+0000","last_peered":"2024-09-14T10:48:37.650518+0000","last_clean":"2024-09-14T10:48:37.650518+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:48:37.650518+0000","last_undegraded":"2024-09-14T10:48:37.650518+0000","last_fullsized":"2024-09-14T10:48:37.650518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-14T10:48:37.650331+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-14T10:48:37.650331+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.650331+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:25.010902+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.703578+0000","last_change":"2024-09-14T10:48:51.703578+0000","last_active":"2024-09-14T10:48:51.703578+0000","last_peered":"2024-09-14T10:48:51.703578+0000","last_clean":"2024-09-14T10:48:51.703578+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:48:51.703578+0000","last_undegraded":"2024-09-14T10:48:51.703578+0000","last_fullsized":"2024-09-14T10:48:51.703578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.703396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.703396+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.703396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:34.384980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:13.749944+0000","last_change":"2024-09-14T10:49:13.749944+0000","last_active":"2024-09-14T10:49:13.749944+0000","last_peered":"2024-09-14T10:49:13.749944+0000","last_clean":"2024-09-14T10:49:13.749944+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:49:13.749944+0000","last_undegraded":"2024-09-14T10:49:13.749944+0000","last_fullsized":"2024-09-14T10:49:13.749944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:49:13.749758+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:49:13.749758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:13.749758+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:08.806701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.588638+0000","last_change":"2024-09-14T10:48:16.588402+0000","last_active":"2024-09-14T10:48:16.588638+0000","last_peered":"2024-09-14T10:48:16.588638+0000","last_clean":"2024-09-14T10:48:16.588638+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:48:16.588638+0000","last_undegraded":"2024-09-14T10:48:16.588638+0000","last_fullsized":"2024-09-14T10:48:16.588638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.588185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:49.661160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.969249+0000","last_change":"2024-09-14T10:48:13.969100+0000","last_active":"2024-09-14T10:48:13.969249+0000","last_peered":"2024-09-14T10:48:13.969249+0000","last_clean":"2024-09-14T10:48:13.969249+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:48:13.969249+0000","last_undegraded":"2024-09-14T10:48:13.969249+0000","last_fullsized":"2024-09-14T10:48:13.969249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.968917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:56.650501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.603967+0000","last_change":"2024-09-14T10:48:41.603809+0000","last_active":"2024-09-14T10:48:41.603967+0000","last_peered":"2024-09-14T10:48:41.603967+0000","last_clean":"2024-09-14T10:48:41.603967+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:48:41.603967+0000","last_undegraded":"2024-09-14T10:48:41.603967+0000","last_fullsized":"2024-09-14T10:48:41.603967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:41.603602+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:41.603602+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.603602+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:31.715081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'17","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:04.707084+0000","last_change":"2024-09-14T10:49:04.707084+0000","last_active":"2024-09-14T10:49:04.707084+0000","last_peered":"2024-09-14T10:49:04.707084+0000","last_clean":"2024-09-14T10:49:04.707084+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:49:04.707084+0000","last_undegraded":"2024-09-14T10:49:04.707084+0000","last_fullsized":"2024-09-14T10:49:04.707084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-14T10:49:04.706879+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-14T10:49:04.706879+0000","last_clean_scrub_stamp":"2024-09-14T10:49:04.706879+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:23.853796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.527739+0000","last_change":"2024-09-14T10:48:45.527739+0000","last_active":"2024-09-14T10:48:45.527739+0000","last_peered":"2024-09-14T10:48:45.527739+0000","last_clean":"2024-09-14T10:48:45.527739+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:48:45.527739+0000","last_undegraded":"2024-09-14T10:48:45.527739+0000","last_fullsized":"2024-09-14T10:48:45.527739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:45.527537+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:45.527537+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.527537+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:57.709365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:14.770511+0000","last_change":"2024-09-14T10:49:14.770511+0000","last_active":"2024-09-14T10:49:14.770511+0000","last_peered":"2024-09-14T10:49:14.770511+0000","last_clean":"2024-09-14T10:49:14.770511+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:49:14.770511+0000","last_undegraded":"2024-09-14T10:49:14.770511+0000","last_fullsized":"2024-09-14T10:49:14.770511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:49:14.770331+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:49:14.770331+0000","last_clean_scrub_stamp":"2024-09-14T10:49:14.770331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:51.164913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.761003+0000","last_change":"2024-09-14T10:48:20.760834+0000","last_active":"2024-09-14T10:48:20.761003+0000","last_peered":"2024-09-14T10:48:20.761003+0000","last_clean":"2024-09-14T10:48:20.761003+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:48:20.761003+0000","last_undegraded":"2024-09-14T10:48:20.761003+0000","last_fullsized":"2024-09-14T10:48:20.761003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:20.760654+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:20.760654+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.760654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:00.206789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.280007+0000","last_change":"2024-09-14T10:48:03.279857+0000","last_active":"2024-09-14T10:48:03.280007+0000","last_peered":"2024-09-14T10:48:03.280007+0000","last_clean":"2024-09-14T10:48:03.280007+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:48:03.280007+0000","last_undegraded":"2024-09-14T10:48:03.280007+0000","last_fullsized":"2024-09-14T10:48:03.280007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.279672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:11.368363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.564803+0000","last_change":"2024-09-14T10:48:37.564658+0000","last_active":"2024-09-14T10:48:37.564803+0000","last_peered":"2024-09-14T10:48:37.564803+0000","last_clean":"2024-09-14T10:48:37.564803+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:48:37.564803+0000","last_undegraded":"2024-09-14T10:48:37.564803+0000","last_fullsized":"2024-09-14T10:48:37.564803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:37.564481+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:37.564481+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.564481+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:19.854700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.640456+0000","last_change":"2024-09-14T10:48:44.640308+0000","last_active":"2024-09-14T10:48:44.640456+0000","last_peered":"2024-09-14T10:48:44.640456+0000","last_clean":"2024-09-14T10:48:44.640456+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:48:44.640456+0000","last_undegraded":"2024-09-14T10:48:44.640456+0000","last_fullsized":"2024-09-14T10:48:44.640456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:48:44.640106+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:48:44.640106+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.640106+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.413809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.614300+0000","last_change":"2024-09-14T10:48:47.614160+0000","last_active":"2024-09-14T10:48:47.614300+0000","last_peered":"2024-09-14T10:48:47.614300+0000","last_clean":"2024-09-14T10:48:47.614300+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:48:47.614300+0000","last_undegraded":"2024-09-14T10:48:47.614300+0000","last_fullsized":"2024-09-14T10:48:47.614300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.614005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.614005+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.614005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:50.769847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:56.701821+0000","last_change":"2024-09-14T10:48:56.701584+0000","last_active":"2024-09-14T10:48:56.701821+0000","last_peered":"2024-09-14T10:48:56.701821+0000","last_clean":"2024-09-14T10:48:56.701821+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:48:56.701821+0000","last_undegraded":"2024-09-14T10:48:56.701821+0000","last_fullsized":"2024-09-14T10:48:56.701821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:56.701311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:56.701311+0000","last_clean_scrub_stamp":"2024-09-14T10:48:56.701311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:38.849339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.765411+0000","last_change":"2024-09-14T10:48:19.765236+0000","last_active":"2024-09-14T10:48:19.765411+0000","last_peered":"2024-09-14T10:48:19.765411+0000","last_clean":"2024-09-14T10:48:19.765411+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:48:19.765411+0000","last_undegraded":"2024-09-14T10:48:19.765411+0000","last_fullsized":"2024-09-14T10:48:19.765411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:19.765058+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:19.765058+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.765058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.778145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.957419+0000","last_change":"2024-09-14T10:48:14.957292+0000","last_active":"2024-09-14T10:48:14.957419+0000","last_peered":"2024-09-14T10:48:14.957419+0000","last_clean":"2024-09-14T10:48:14.957419+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:48:14.957419+0000","last_undegraded":"2024-09-14T10:48:14.957419+0000","last_fullsized":"2024-09-14T10:48:14.957419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:14.957115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:14.957115+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.957115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.999307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.533325+0000","last_change":"2024-09-14T10:48:29.533192+0000","last_active":"2024-09-14T10:48:29.533325+0000","last_peered":"2024-09-14T10:48:29.533325+0000","last_clean":"2024-09-14T10:48:29.533325+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:48:29.533325+0000","last_undegraded":"2024-09-14T10:48:29.533325+0000","last_fullsized":"2024-09-14T10:48:29.533325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:29.532987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:29.532987+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.532987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:36.699790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.584971+0000","last_change":"2024-09-14T10:48:35.584703+0000","last_active":"2024-09-14T10:48:35.584971+0000","last_peered":"2024-09-14T10:48:35.584971+0000","last_clean":"2024-09-14T10:48:35.584971+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:48:35.584971+0000","last_undegraded":"2024-09-14T10:48:35.584971+0000","last_fullsized":"2024-09-14T10:48:35.584971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-14T10:48:35.584572+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-14T10:48:35.584572+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.584572+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:15.413214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.762527+0000","last_change":"2024-09-14T10:49:09.762527+0000","last_active":"2024-09-14T10:49:09.762527+0000","last_peered":"2024-09-14T10:49:09.762527+0000","last_clean":"2024-09-14T10:49:09.762527+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:49:09.762527+0000","last_undegraded":"2024-09-14T10:49:09.762527+0000","last_fullsized":"2024-09-14T10:49:09.762527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:09.762349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:09.762349+0000","last_clean_scrub_stamp":"2024-09-14T10:49:09.762349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:21.048395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:39.448967+0000","last_change":"2024-09-14T10:44:15.386917+0000","last_active":"2024-09-14T10:46:39.448967+0000","last_peered":"2024-09-14T10:46:39.448967+0000","last_clean":"2024-09-14T10:46:39.448967+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:46:39.448967+0000","last_undegraded":"2024-09-14T10:46:39.448967+0000","last_fullsized":"2024-09-14T10:46:39.448967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.729791+0000","last_change":"2024-09-14T10:48:18.729791+0000","last_active":"2024-09-14T10:48:18.729791+0000","last_peered":"2024-09-14T10:48:18.729791+0000","last_clean":"2024-09-14T10:48:18.729791+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:48:18.729791+0000","last_undegraded":"2024-09-14T10:48:18.729791+0000","last_fullsized":"2024-09-14T10:48:18.729791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:18.729528+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:18.729528+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.729528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.709783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.470373+0000","last_change":"2024-09-14T10:47:59.470192+0000","last_active":"2024-09-14T10:47:59.470373+0000","last_peered":"2024-09-14T10:47:59.470373+0000","last_clean":"2024-09-14T10:47:59.470373+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:59.470373+0000","last_undegraded":"2024-09-14T10:47:59.470373+0000","last_fullsized":"2024-09-14T10:47:59.470373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.470009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:41.109792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.601670+0000","last_change":"2024-09-14T10:48:36.601461+0000","last_active":"2024-09-14T10:48:36.601670+0000","last_peered":"2024-09-14T10:48:36.601670+0000","last_clean":"2024-09-14T10:48:36.601670+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:48:36.601670+0000","last_undegraded":"2024-09-14T10:48:36.601670+0000","last_fullsized":"2024-09-14T10:48:36.601670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:36.601284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:36.601284+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.601284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:15.572560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:02.736436+0000","last_change":"2024-09-14T10:49:02.736171+0000","last_active":"2024-09-14T10:49:02.736436+0000","last_peered":"2024-09-14T10:49:02.736436+0000","last_clean":"2024-09-14T10:49:02.736436+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:49:02.736436+0000","last_undegraded":"2024-09-14T10:49:02.736436+0000","last_fullsized":"2024-09-14T10:49:02.736436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-14T10:49:02.735925+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-14T10:49:02.735925+0000","last_clean_scrub_stamp":"2024-09-14T10:49:02.735925+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:35.204917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:16.772018+0000","last_change":"2024-09-14T10:49:16.772018+0000","last_active":"2024-09-14T10:49:16.772018+0000","last_peered":"2024-09-14T10:49:16.772018+0000","last_clean":"2024-09-14T10:49:16.772018+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:49:16.772018+0000","last_undegraded":"2024-09-14T10:49:16.772018+0000","last_fullsized":"2024-09-14T10:49:16.772018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:16.771747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:16.771747+0000","last_clean_scrub_stamp":"2024-09-14T10:49:16.771747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:58.769662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:46:39.448806+0000","last_change":"2024-09-14T10:44:15.385986+0000","last_active":"2024-09-14T10:46:39.448806+0000","last_peered":"2024-09-14T10:46:39.448806+0000","last_clean":"2024-09-14T10:46:39.448806+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:46:39.448806+0000","last_undegraded":"2024-09-14T10:46:39.448806+0000","last_fullsized":"2024-09-14T10:46:39.448806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:44:14.328441+0000","last_clean_scrub_stamp":"2024-09-14T10:44:14.328441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.723724+0000","last_change":"2024-09-14T10:48:17.723592+0000","last_active":"2024-09-14T10:48:17.723724+0000","last_peered":"2024-09-14T10:48:17.723724+0000","last_clean":"2024-09-14T10:48:17.723724+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:48:17.723724+0000","last_undegraded":"2024-09-14T10:48:17.723724+0000","last_fullsized":"2024-09-14T10:48:17.723724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:17.723405+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:17.723405+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.723405+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:16.395502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.315403+0000","last_change":"2024-09-14T10:48:04.315262+0000","last_active":"2024-09-14T10:48:04.315403+0000","last_peered":"2024-09-14T10:48:04.315403+0000","last_clean":"2024-09-14T10:48:04.315403+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:48:04.315403+0000","last_undegraded":"2024-09-14T10:48:04.315403+0000","last_fullsized":"2024-09-14T10:48:04.315403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.315084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:09.501850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.598879+0000","last_change":"2024-09-14T10:48:35.598708+0000","last_active":"2024-09-14T10:48:35.598879+0000","last_peered":"2024-09-14T10:48:35.598879+0000","last_clean":"2024-09-14T10:48:35.598879+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:48:35.598879+0000","last_undegraded":"2024-09-14T10:48:35.598879+0000","last_fullsized":"2024-09-14T10:48:35.598879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:35.598542+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:35.598542+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.598542+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:06.821482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'40","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:01.725303+0000","last_change":"2024-09-14T10:49:01.725155+0000","last_active":"2024-09-14T10:49:01.725303+0000","last_peered":"2024-09-14T10:49:01.725303+0000","last_clean":"2024-09-14T10:49:01.725303+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:49:01.725303+0000","last_undegraded":"2024-09-14T10:49:01.725303+0000","last_fullsized":"2024-09-14T10:49:01.725303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-14T10:49:01.724951+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-14T10:49:01.724951+0000","last_clean_scrub_stamp":"2024-09-14T10:49:01.724951+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:36.261655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.681766+0000","last_change":"2024-09-14T10:48:49.681527+0000","last_active":"2024-09-14T10:48:49.681766+0000","last_peered":"2024-09-14T10:48:49.681766+0000","last_clean":"2024-09-14T10:48:49.681766+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:48:49.681766+0000","last_undegraded":"2024-09-14T10:48:49.681766+0000","last_fullsized":"2024-09-14T10:48:49.681766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.681287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.681287+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.681287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:03.628980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:18.732254+0000","last_change":"2024-09-14T10:49:18.732254+0000","last_active":"2024-09-14T10:49:18.732254+0000","last_peered":"2024-09-14T10:49:18.732254+0000","last_clean":"2024-09-14T10:49:18.732254+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:49:18.732254+0000","last_undegraded":"2024-09-14T10:49:18.732254+0000","last_fullsized":"2024-09-14T10:49:18.732254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-14T10:49:18.732031+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-14T10:49:18.732031+0000","last_clean_scrub_stamp":"2024-09-14T10:49:18.732031+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:08.545363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.468297+0000","last_change":"2024-09-14T10:48:19.468123+0000","last_active":"2024-09-14T10:48:19.468297+0000","last_peered":"2024-09-14T10:48:19.468297+0000","last_clean":"2024-09-14T10:48:19.468297+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:48:19.468297+0000","last_undegraded":"2024-09-14T10:48:19.468297+0000","last_fullsized":"2024-09-14T10:48:19.468297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:19.467939+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:19.467939+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.467939+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:55.076769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.685193+0000","last_change":"2024-09-14T10:48:06.684936+0000","last_active":"2024-09-14T10:48:06.685193+0000","last_peered":"2024-09-14T10:48:06.685193+0000","last_clean":"2024-09-14T10:48:06.685193+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:48:06.685193+0000","last_undegraded":"2024-09-14T10:48:06.685193+0000","last_fullsized":"2024-09-14T10:48:06.685193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.684579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:30.618905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.540206+0000","last_change":"2024-09-14T10:48:22.539962+0000","last_active":"2024-09-14T10:48:22.540206+0000","last_peered":"2024-09-14T10:48:22.540206+0000","last_clean":"2024-09-14T10:48:22.540206+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:48:22.540206+0000","last_undegraded":"2024-09-14T10:48:22.540206+0000","last_fullsized":"2024-09-14T10:48:22.540206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:22.539696+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:22.539696+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.539696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:19.296367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.500388+0000","last_change":"2024-09-14T10:48:03.500209+0000","last_active":"2024-09-14T10:48:03.500388+0000","last_peered":"2024-09-14T10:48:03.500388+0000","last_clean":"2024-09-14T10:48:03.500388+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:48:03.500388+0000","last_undegraded":"2024-09-14T10:48:03.500388+0000","last_fullsized":"2024-09-14T10:48:03.500388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.500037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:09.580224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.713248+0000","last_change":"2024-09-14T10:48:36.713248+0000","last_active":"2024-09-14T10:48:36.713248+0000","last_peered":"2024-09-14T10:48:36.713248+0000","last_clean":"2024-09-14T10:48:36.713248+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:48:36.713248+0000","last_undegraded":"2024-09-14T10:48:36.713248+0000","last_fullsized":"2024-09-14T10:48:36.713248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:36.713060+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:36.713060+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.713060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:14.937115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.948514+0000","last_change":"2024-09-14T10:48:15.948514+0000","last_active":"2024-09-14T10:48:15.948514+0000","last_peered":"2024-09-14T10:48:15.948514+0000","last_clean":"2024-09-14T10:48:15.948514+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:48:15.948514+0000","last_undegraded":"2024-09-14T10:48:15.948514+0000","last_fullsized":"2024-09-14T10:48:15.948514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:15.948330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:15.948330+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.948330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:51.612757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.620971+0000","last_change":"2024-09-14T10:48:31.620971+0000","last_active":"2024-09-14T10:48:31.620971+0000","last_peered":"2024-09-14T10:48:31.620971+0000","last_clean":"2024-09-14T10:48:31.620971+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:48:31.620971+0000","last_undegraded":"2024-09-14T10:48:31.620971+0000","last_fullsized":"2024-09-14T10:48:31.620971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-14T10:48:31.620785+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-14T10:48:31.620785+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.620785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:12.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.437129+0000","last_change":"2024-09-14T10:48:06.436938+0000","last_active":"2024-09-14T10:48:06.437129+0000","last_peered":"2024-09-14T10:48:06.437129+0000","last_clean":"2024-09-14T10:48:06.437129+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:48:06.437129+0000","last_undegraded":"2024-09-14T10:48:06.437129+0000","last_fullsized":"2024-09-14T10:48:06.437129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.436743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:28.064799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.535992+0000","last_change":"2024-09-14T10:48:18.535992+0000","last_active":"2024-09-14T10:48:18.535992+0000","last_peered":"2024-09-14T10:48:18.535992+0000","last_clean":"2024-09-14T10:48:18.535992+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:48:18.535992+0000","last_undegraded":"2024-09-14T10:48:18.535992+0000","last_fullsized":"2024-09-14T10:48:18.535992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:18.535801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:18.535801+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.535801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:37.962177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.477417+0000","last_change":"2024-09-14T10:48:07.477245+0000","last_active":"2024-09-14T10:48:07.477417+0000","last_peered":"2024-09-14T10:48:07.477417+0000","last_clean":"2024-09-14T10:48:07.477417+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:48:07.477417+0000","last_undegraded":"2024-09-14T10:48:07.477417+0000","last_fullsized":"2024-09-14T10:48:07.477417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.477054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.420346+0000","last_change":"2024-09-14T10:48:18.420100+0000","last_active":"2024-09-14T10:48:18.420346+0000","last_peered":"2024-09-14T10:48:18.420346+0000","last_clean":"2024-09-14T10:48:18.420346+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:48:18.420346+0000","last_undegraded":"2024-09-14T10:48:18.420346+0000","last_fullsized":"2024-09-14T10:48:18.420346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:18.419824+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:18.419824+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.419824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:51.492799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.344100+0000","last_change":"2024-09-14T10:48:05.343952+0000","last_active":"2024-09-14T10:48:05.344100+0000","last_peered":"2024-09-14T10:48:05.344100+0000","last_clean":"2024-09-14T10:48:05.344100+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:48:05.344100+0000","last_undegraded":"2024-09-14T10:48:05.344100+0000","last_fullsized":"2024-09-14T10:48:05.344100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.343728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:11.423916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.572507+0000","last_change":"2024-09-14T10:48:17.572507+0000","last_active":"2024-09-14T10:48:17.572507+0000","last_peered":"2024-09-14T10:48:17.572507+0000","last_clean":"2024-09-14T10:48:17.572507+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:48:17.572507+0000","last_undegraded":"2024-09-14T10:48:17.572507+0000","last_fullsized":"2024-09-14T10:48:17.572507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:17.572324+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:17.572324+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.572324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:53.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.636701+0000","last_change":"2024-09-14T10:48:05.636531+0000","last_active":"2024-09-14T10:48:05.636701+0000","last_peered":"2024-09-14T10:48:05.636701+0000","last_clean":"2024-09-14T10:48:05.636701+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:48:05.636701+0000","last_undegraded":"2024-09-14T10:48:05.636701+0000","last_fullsized":"2024-09-14T10:48:05.636701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.636345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:39.594590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.445845+0000","last_change":"2024-09-14T10:48:17.445719+0000","last_active":"2024-09-14T10:48:17.445845+0000","last_peered":"2024-09-14T10:48:17.445845+0000","last_clean":"2024-09-14T10:48:17.445845+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:48:17.445845+0000","last_undegraded":"2024-09-14T10:48:17.445845+0000","last_fullsized":"2024-09-14T10:48:17.445845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:17.445534+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:17.445534+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.445534+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.253965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.493171+0000","last_change":"2024-09-14T10:48:04.492991+0000","last_active":"2024-09-14T10:48:04.493171+0000","last_peered":"2024-09-14T10:48:04.493171+0000","last_clean":"2024-09-14T10:48:04.493171+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:48:04.493171+0000","last_undegraded":"2024-09-14T10:48:04.493171+0000","last_fullsized":"2024-09-14T10:48:04.493171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.492802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:02.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.424125+0000","last_change":"2024-09-14T10:48:23.423969+0000","last_active":"2024-09-14T10:48:23.424125+0000","last_peered":"2024-09-14T10:48:23.424125+0000","last_clean":"2024-09-14T10:48:23.424125+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:48:23.424125+0000","last_undegraded":"2024-09-14T10:48:23.424125+0000","last_fullsized":"2024-09-14T10:48:23.424125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:23.423787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:23.423787+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.423787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:32.029468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.905728+0000","last_change":"2024-09-14T10:48:16.905587+0000","last_active":"2024-09-14T10:48:16.905728+0000","last_peered":"2024-09-14T10:48:16.905728+0000","last_clean":"2024-09-14T10:48:16.905728+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:48:16.905728+0000","last_undegraded":"2024-09-14T10:48:16.905728+0000","last_fullsized":"2024-09-14T10:48:16.905728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:16.905404+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:16.905404+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.905404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:41.403056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.683826+0000","last_change":"2024-09-14T10:48:38.683583+0000","last_active":"2024-09-14T10:48:38.683826+0000","last_peered":"2024-09-14T10:48:38.683826+0000","last_clean":"2024-09-14T10:48:38.683826+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:48:38.683826+0000","last_undegraded":"2024-09-14T10:48:38.683826+0000","last_fullsized":"2024-09-14T10:48:38.683826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:38.683371+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:38.683371+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.683371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:37.975683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.451669+0000","last_change":"2024-09-14T10:48:05.451486+0000","last_active":"2024-09-14T10:48:05.451669+0000","last_peered":"2024-09-14T10:48:05.451669+0000","last_clean":"2024-09-14T10:48:05.451669+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:48:05.451669+0000","last_undegraded":"2024-09-14T10:48:05.451669+0000","last_fullsized":"2024-09-14T10:48:05.451669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.451302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:31.147968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.489122+0000","last_change":"2024-09-14T10:48:20.488933+0000","last_active":"2024-09-14T10:48:20.489122+0000","last_peered":"2024-09-14T10:48:20.489122+0000","last_clean":"2024-09-14T10:48:20.489122+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:48:20.489122+0000","last_undegraded":"2024-09-14T10:48:20.489122+0000","last_fullsized":"2024-09-14T10:48:20.489122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:20.488751+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:20.488751+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.488751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:13.985690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.364360+0000","last_change":"2024-09-14T10:48:08.364214+0000","last_active":"2024-09-14T10:48:08.364360+0000","last_peered":"2024-09-14T10:48:08.364360+0000","last_clean":"2024-09-14T10:48:08.364360+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:48:08.364360+0000","last_undegraded":"2024-09-14T10:48:08.364360+0000","last_fullsized":"2024-09-14T10:48:08.364360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.364025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:29.992081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.418619+0000","last_change":"2024-09-14T10:48:22.418342+0000","last_active":"2024-09-14T10:48:22.418619+0000","last_peered":"2024-09-14T10:48:22.418619+0000","last_clean":"2024-09-14T10:48:22.418619+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:48:22.418619+0000","last_undegraded":"2024-09-14T10:48:22.418619+0000","last_fullsized":"2024-09-14T10:48:22.418619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:22.418134+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:22.418134+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.418134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:30.725200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.363509+0000","last_change":"2024-09-14T10:48:06.363263+0000","last_active":"2024-09-14T10:48:06.363509+0000","last_peered":"2024-09-14T10:48:06.363509+0000","last_clean":"2024-09-14T10:48:06.363509+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:48:06.363509+0000","last_undegraded":"2024-09-14T10:48:06.363509+0000","last_fullsized":"2024-09-14T10:48:06.363509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.363044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:10.900801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.466094+0000","last_change":"2024-09-14T10:48:21.465950+0000","last_active":"2024-09-14T10:48:21.466094+0000","last_peered":"2024-09-14T10:48:21.466094+0000","last_clean":"2024-09-14T10:48:21.466094+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:48:21.466094+0000","last_undegraded":"2024-09-14T10:48:21.466094+0000","last_fullsized":"2024-09-14T10:48:21.466094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:21.465744+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:21.465744+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.465744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:03.866722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.869049+0000","last_change":"2024-09-14T10:48:17.868897+0000","last_active":"2024-09-14T10:48:17.869049+0000","last_peered":"2024-09-14T10:48:17.869049+0000","last_clean":"2024-09-14T10:48:17.869049+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:48:17.869049+0000","last_undegraded":"2024-09-14T10:48:17.869049+0000","last_fullsized":"2024-09-14T10:48:17.869049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:17.868688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:17.868688+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.868688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:00.016716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.426613+0000","last_change":"2024-09-14T10:48:24.426484+0000","last_active":"2024-09-14T10:48:24.426613+0000","last_peered":"2024-09-14T10:48:24.426613+0000","last_clean":"2024-09-14T10:48:24.426613+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:48:24.426613+0000","last_undegraded":"2024-09-14T10:48:24.426613+0000","last_fullsized":"2024-09-14T10:48:24.426613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:24.426271+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:24.426271+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.426271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:29.496623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.841640+0000","last_change":"2024-09-14T10:48:18.841503+0000","last_active":"2024-09-14T10:48:18.841640+0000","last_peered":"2024-09-14T10:48:18.841640+0000","last_clean":"2024-09-14T10:48:18.841640+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:48:18.841640+0000","last_undegraded":"2024-09-14T10:48:18.841640+0000","last_fullsized":"2024-09-14T10:48:18.841640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:18.841299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:18.841299+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.841299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:50.935286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.677116+0000","last_change":"2024-09-14T10:48:37.676947+0000","last_active":"2024-09-14T10:48:37.677116+0000","last_peered":"2024-09-14T10:48:37.677116+0000","last_clean":"2024-09-14T10:48:37.677116+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:48:37.677116+0000","last_undegraded":"2024-09-14T10:48:37.677116+0000","last_fullsized":"2024-09-14T10:48:37.677116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:37.676736+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:37.676736+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.676736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:29.904245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'5","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.692298+0000","last_change":"2024-09-14T10:48:07.692142+0000","last_active":"2024-09-14T10:48:07.692298+0000","last_peered":"2024-09-14T10:48:07.692298+0000","last_clean":"2024-09-14T10:48:07.692298+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:48:07.692298+0000","last_undegraded":"2024-09-14T10:48:07.692298+0000","last_fullsized":"2024-09-14T10:48:07.692298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.691953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:20.730540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.428035+0000","last_change":"2024-09-14T10:48:20.427795+0000","last_active":"2024-09-14T10:48:20.428035+0000","last_peered":"2024-09-14T10:48:20.428035+0000","last_clean":"2024-09-14T10:48:20.428035+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:48:20.428035+0000","last_undegraded":"2024-09-14T10:48:20.428035+0000","last_fullsized":"2024-09-14T10:48:20.428035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:20.427585+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:20.427585+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.427585+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:39.853960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.871416+0000","last_change":"2024-09-14T10:48:19.871271+0000","last_active":"2024-09-14T10:48:19.871416+0000","last_peered":"2024-09-14T10:48:19.871416+0000","last_clean":"2024-09-14T10:48:19.871416+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:48:19.871416+0000","last_undegraded":"2024-09-14T10:48:19.871416+0000","last_fullsized":"2024-09-14T10:48:19.871416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:19.871088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:19.871088+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.871088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:33.745202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.904530+0000","last_change":"2024-09-14T10:48:23.904343+0000","last_active":"2024-09-14T10:48:23.904530+0000","last_peered":"2024-09-14T10:48:23.904530+0000","last_clean":"2024-09-14T10:48:23.904530+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:48:23.904530+0000","last_undegraded":"2024-09-14T10:48:23.904530+0000","last_fullsized":"2024-09-14T10:48:23.904530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:23.904146+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:23.904146+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.904146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:56.282823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.506497+0000","last_change":"2024-09-14T10:48:21.506316+0000","last_active":"2024-09-14T10:48:21.506497+0000","last_peered":"2024-09-14T10:48:21.506497+0000","last_clean":"2024-09-14T10:48:21.506497+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:48:21.506497+0000","last_undegraded":"2024-09-14T10:48:21.506497+0000","last_fullsized":"2024-09-14T10:48:21.506497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:21.506141+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:21.506141+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.506141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:41.836176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.454991+0000","last_change":"2024-09-14T10:48:08.454843+0000","last_active":"2024-09-14T10:48:08.454991+0000","last_peered":"2024-09-14T10:48:08.454991+0000","last_clean":"2024-09-14T10:48:08.454991+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:48:08.454991+0000","last_undegraded":"2024-09-14T10:48:08.454991+0000","last_fullsized":"2024-09-14T10:48:08.454991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.454661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:34.179499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.473712+0000","last_change":"2024-09-14T10:48:27.473573+0000","last_active":"2024-09-14T10:48:27.473712+0000","last_peered":"2024-09-14T10:48:27.473712+0000","last_clean":"2024-09-14T10:48:27.473712+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:48:27.473712+0000","last_undegraded":"2024-09-14T10:48:27.473712+0000","last_fullsized":"2024-09-14T10:48:27.473712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:27.473358+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:27.473358+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.473358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:40.064188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640326,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":740626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673029,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673029,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1040384,"data_stored":742212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":152178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:49:19.647 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:49:19.648 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:49:19.648 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:44:14.328441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=44, tm_sec=14, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=47, tm_sec=54, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:49:19.649 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:49:39.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:49:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.787+0000 7f0553036640 1 Processor -- start 2024-09-14T10:49:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.787+0000 7f0553036640 1 -- start start 2024-09-14T10:49:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.787+0000 7f0553036640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f054c099bc0 0x7f054c06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.787+0000 7f0553036640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054c070400 con 0x7f054c06e5a0 2024-09-14T10:49:39.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.787+0000 7f0553036640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f054c0707a0 con 0x7f054c099bc0 2024-09-14T10:49:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0550dd2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f054c099bc0 0x7f054c06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f054bfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f054c06e5a0 0x7f054c06e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52044/0 (socket says 172.21.15.70:52044) 2024-09-14T10:49:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f054bfff640 1 -- 172.21.15.70:0/2183217605 learned_addr learned my addr 172.21.15.70:0/2183217605 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:49:39.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0550dd2640 1 -- 172.21.15.70:0/2183217605 >> v1:172.21.15.70:6789/0 conn(0x7f054c06e5a0 legacy=0x7f054c06e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:39.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0550dd2640 1 -- 172.21.15.70:0/2183217605 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c06f0c0 con 0x7f054c099bc0 2024-09-14T10:49:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0550dd2640 1 --2- 172.21.15.70:0/2183217605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c099bc0 0x7f054c06e060 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f053c009740 tx=0x7f053c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5c4b2e4b28f5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f054b7fe640 1 -- 172.21.15.70:0/2183217605 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f053c0b0070 con 0x7f054c099bc0 2024-09-14T10:49:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f054b7fe640 1 -- 172.21.15.70:0/2183217605 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c0ab530 con 0x7f054c099bc0 2024-09-14T10:49:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f054b7fe640 1 -- 172.21.15.70:0/2183217605 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f053c0ab830 con 0x7f054c099bc0 2024-09-14T10:49:39.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0553036640 1 -- 172.21.15.70:0/2183217605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c099bc0 msgr2=0x7f054c06e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:39.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0553036640 1 --2- 172.21.15.70:0/2183217605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c099bc0 0x7f054c06e060 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f053c009740 tx=0x7f053c01c400 comp rx=0 tx=0).stop 2024-09-14T10:49:39.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0553036640 1 -- 172.21.15.70:0/2183217605 shutdown_connections 2024-09-14T10:49:39.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0553036640 1 --2- 172.21.15.70:0/2183217605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c099bc0 0x7f054c06e060 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:39.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0553036640 1 -- 172.21.15.70:0/2183217605 >> 172.21.15.70:0/2183217605 conn(0x7f054c09aba0 msgr2=0x7f054c0984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:49:39.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0553036640 1 -- 172.21.15.70:0/2183217605 shutdown_connections 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.791+0000 7f0553036640 1 -- 172.21.15.70:0/2183217605 wait complete. 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0553036640 1 Processor -- start 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0553036640 1 -- start start 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0553036640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c06e5a0 0x7f054c123c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0553036640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f054c137810 con 0x7f054c06e5a0 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0550dd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c06e5a0 0x7f054c123c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0550dd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c06e5a0 0x7f054c123c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58188/0 (socket says 172.21.15.70:58188) 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0550dd2640 1 -- 172.21.15.70:0/1628240647 learned_addr learned my addr 172.21.15.70:0/1628240647 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:49:39.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0550dd2640 1 -- 172.21.15.70:0/1628240647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c126cf0 con 0x7f054c06e5a0 2024-09-14T10:49:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0550dd2640 1 --2- 172.21.15.70:0/1628240647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c06e5a0 0x7f054c123c50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f053c0ae040 tx=0x7f053c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f05497fa640 1 -- 172.21.15.70:0/1628240647 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f053c0b8020 con 0x7f054c06e5a0 2024-09-14T10:49:39.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f05497fa640 1 -- 172.21.15.70:0/1628240647 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c0b4600 con 0x7f054c06e5a0 2024-09-14T10:49:39.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f05497fa640 1 -- 172.21.15.70:0/1628240647 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f053c0b0040 con 0x7f054c06e5a0 2024-09-14T10:49:39.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c127020 con 0x7f054c06e5a0 2024-09-14T10:49:39.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c1266b0 con 0x7f054c06e5a0 2024-09-14T10:49:39.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054c126370 con 0x7f054c06e5a0 2024-09-14T10:49:39.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f05497fa640 1 -- 172.21.15.70:0/1628240647 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7f053c0bb020 con 0x7f054c06e5a0 2024-09-14T10:49:39.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f05497fa640 1 --2- 172.21.15.70:0/1628240647 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f053803b8b0 0x7f053803dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:39.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f05497fa640 1 -- 172.21.15.70:0/1628240647 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f053c0ea0a0 con 0x7f054c06e5a0 2024-09-14T10:49:39.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.795+0000 7f054bfff640 1 --2- 172.21.15.70:0/1628240647 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f053803b8b0 0x7f053803dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:39.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.799+0000 7f054bfff640 1 --2- 172.21.15.70:0/1628240647 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f053803b8b0 0x7f053803dd70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0540005890 tx=0x7f0540007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.799+0000 7f05497fa640 1 -- 172.21.15.70:0/1628240647 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f054c126370 con 0x7f054c06e5a0 2024-09-14T10:49:39.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.967+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 --> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f054c06e060 con 0x7f053803b8b0 2024-09-14T10:49:39.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.995+0000 7f05497fa640 1 -- 172.21.15.70:0/1628240647 <== mgr.4100 v2:172.21.15.96:6824/992869166 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666456 (secure 0 0 0) 0x7f054c06e060 con 0x7f053803b8b0 2024-09-14T10:49:39.996 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-14T10:49:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-14T10:49:40.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.999+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f053803b8b0 msgr2=0x7f053803dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:40.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.999+0000 7f0553036640 1 --2- 172.21.15.70:0/1628240647 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f053803b8b0 0x7f053803dd70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0540005890 tx=0x7f0540007ab0 comp rx=0 tx=0).stop 2024-09-14T10:49:40.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.999+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c06e5a0 msgr2=0x7f054c123c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:40.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:39.999+0000 7f0553036640 1 --2- 172.21.15.70:0/1628240647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c06e5a0 0x7f054c123c50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f053c0ae040 tx=0x7f053c0191a0 comp rx=0 tx=0).stop 2024-09-14T10:49:40.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.003+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 shutdown_connections 2024-09-14T10:49:40.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.003+0000 7f0553036640 1 --2- 172.21.15.70:0/1628240647 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7f053803b8b0 0x7f053803dd70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:40.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.003+0000 7f0553036640 1 --2- 172.21.15.70:0/1628240647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f054c06e5a0 0x7f054c123c50 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:40.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.003+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 >> 172.21.15.70:0/1628240647 conn(0x7f054c09aba0 msgr2=0x7f054c09bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:49:40.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.003+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 shutdown_connections 2024-09-14T10:49:40.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.003+0000 7f0553036640 1 -- 172.21.15.70:0/1628240647 wait complete. 2024-09-14T10:49:40.015 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-09-14T10:49:39.526877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5157,"num_read_kb":4699,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1786956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006735"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.798951+0000","last_change":"2024-09-14T10:48:10.798810+0000","last_active":"2024-09-14T10:48:10.798951+0000","last_peered":"2024-09-14T10:48:10.798951+0000","last_clean":"2024-09-14T10:48:10.798951+0000","last_became_active":"2024-09-14T10:44:05.314074+0000","last_became_peered":"2024-09-14T10:44:05.314074+0000","last_unstale":"2024-09-14T10:48:10.798951+0000","last_undegraded":"2024-09-14T10:48:10.798951+0000","last_fullsized":"2024-09-14T10:48:10.798951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.798632+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.798632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:20.160081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.490293+0000","last_change":"2024-09-14T10:48:29.490121+0000","last_active":"2024-09-14T10:48:29.490293+0000","last_peered":"2024-09-14T10:48:29.490293+0000","last_clean":"2024-09-14T10:48:29.490293+0000","last_became_active":"2024-09-14T10:44:07.302378+0000","last_became_peered":"2024-09-14T10:44:07.302378+0000","last_unstale":"2024-09-14T10:48:29.490293+0000","last_undegraded":"2024-09-14T10:48:29.490293+0000","last_fullsized":"2024-09-14T10:48:29.490293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:29.489905+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:29.489905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.489905+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:03.916811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.492325+0000","last_change":"2024-09-14T10:48:10.492066+0000","last_active":"2024-09-14T10:48:10.492325+0000","last_peered":"2024-09-14T10:48:10.492325+0000","last_clean":"2024-09-14T10:48:10.492325+0000","last_became_active":"2024-09-14T10:44:05.319060+0000","last_became_peered":"2024-09-14T10:44:05.319060+0000","last_unstale":"2024-09-14T10:48:10.492325+0000","last_undegraded":"2024-09-14T10:48:10.492325+0000","last_fullsized":"2024-09-14T10:48:10.492325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:10.491821+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.491821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:30.410764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.699427+0000","last_change":"2024-09-14T10:48:39.699286+0000","last_active":"2024-09-14T10:48:39.699427+0000","last_peered":"2024-09-14T10:48:39.699427+0000","last_clean":"2024-09-14T10:48:39.699427+0000","last_became_active":"2024-09-14T10:44:07.309119+0000","last_became_peered":"2024-09-14T10:44:07.309119+0000","last_unstale":"2024-09-14T10:48:39.699427+0000","last_undegraded":"2024-09-14T10:48:39.699427+0000","last_fullsized":"2024-09-14T10:48:39.699427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:39.699100+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:39.699100+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.699100+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:40.664213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.891397+0000","last_change":"2024-09-14T10:48:25.891397+0000","last_active":"2024-09-14T10:48:25.891397+0000","last_peered":"2024-09-14T10:48:25.891397+0000","last_clean":"2024-09-14T10:48:25.891397+0000","last_became_active":"2024-09-14T10:44:05.321257+0000","last_became_peered":"2024-09-14T10:44:05.321257+0000","last_unstale":"2024-09-14T10:48:25.891397+0000","last_undegraded":"2024-09-14T10:48:25.891397+0000","last_fullsized":"2024-09-14T10:48:25.891397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:25.891164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:25.891164+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.891164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:32.955966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.618931+0000","last_change":"2024-09-14T10:48:41.618761+0000","last_active":"2024-09-14T10:48:41.618931+0000","last_peered":"2024-09-14T10:48:41.618931+0000","last_clean":"2024-09-14T10:48:41.618931+0000","last_became_active":"2024-09-14T10:44:07.309392+0000","last_became_peered":"2024-09-14T10:44:07.309392+0000","last_unstale":"2024-09-14T10:48:41.618931+0000","last_undegraded":"2024-09-14T10:48:41.618931+0000","last_fullsized":"2024-09-14T10:48:41.618931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:41.618584+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:41.618584+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.618584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:26.437900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.801154+0000","last_change":"2024-09-14T10:48:13.801154+0000","last_active":"2024-09-14T10:48:13.801154+0000","last_peered":"2024-09-14T10:48:13.801154+0000","last_clean":"2024-09-14T10:48:13.801154+0000","last_became_active":"2024-09-14T10:44:05.314192+0000","last_became_peered":"2024-09-14T10:44:05.314192+0000","last_unstale":"2024-09-14T10:48:13.801154+0000","last_undegraded":"2024-09-14T10:48:13.801154+0000","last_fullsized":"2024-09-14T10:48:13.801154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:13.800954+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.800954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:10.498468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.667818+0000","last_change":"2024-09-14T10:48:42.667640+0000","last_active":"2024-09-14T10:48:42.667818+0000","last_peered":"2024-09-14T10:48:42.667818+0000","last_clean":"2024-09-14T10:48:42.667818+0000","last_became_active":"2024-09-14T10:44:07.309295+0000","last_became_peered":"2024-09-14T10:44:07.309295+0000","last_unstale":"2024-09-14T10:48:42.667818+0000","last_undegraded":"2024-09-14T10:48:42.667818+0000","last_fullsized":"2024-09-14T10:48:42.667818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:42.667441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:42.667441+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.667441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:28.664593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.884804+0000","last_change":"2024-09-14T10:48:21.884659+0000","last_active":"2024-09-14T10:48:21.884804+0000","last_peered":"2024-09-14T10:48:21.884804+0000","last_clean":"2024-09-14T10:48:21.884804+0000","last_became_active":"2024-09-14T10:44:05.318322+0000","last_became_peered":"2024-09-14T10:44:05.318322+0000","last_unstale":"2024-09-14T10:48:21.884804+0000","last_undegraded":"2024-09-14T10:48:21.884804+0000","last_fullsized":"2024-09-14T10:48:21.884804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:21.884467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:21.884467+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.884467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:25.811308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.474754+0000","last_change":"2024-09-14T10:48:30.474754+0000","last_active":"2024-09-14T10:48:30.474754+0000","last_peered":"2024-09-14T10:48:30.474754+0000","last_clean":"2024-09-14T10:48:30.474754+0000","last_became_active":"2024-09-14T10:44:07.302879+0000","last_became_peered":"2024-09-14T10:44:07.302879+0000","last_unstale":"2024-09-14T10:48:30.474754+0000","last_undegraded":"2024-09-14T10:48:30.474754+0000","last_fullsized":"2024-09-14T10:48:30.474754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:30.474471+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:30.474471+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.474471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:13.709808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.752513+0000","last_change":"2024-09-14T10:48:09.752350+0000","last_active":"2024-09-14T10:48:09.752513+0000","last_peered":"2024-09-14T10:48:09.752513+0000","last_clean":"2024-09-14T10:48:09.752513+0000","last_became_active":"2024-09-14T10:44:05.314616+0000","last_became_peered":"2024-09-14T10:44:05.314616+0000","last_unstale":"2024-09-14T10:48:09.752513+0000","last_undegraded":"2024-09-14T10:48:09.752513+0000","last_fullsized":"2024-09-14T10:48:09.752513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.752173+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.752173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:57.545208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.714300+0000","last_change":"2024-09-14T10:48:22.713985+0000","last_active":"2024-09-14T10:48:22.714300+0000","last_peered":"2024-09-14T10:48:22.714300+0000","last_clean":"2024-09-14T10:48:22.714300+0000","last_became_active":"2024-09-14T10:44:44.461530+0000","last_became_peered":"2024-09-14T10:44:44.461530+0000","last_unstale":"2024-09-14T10:48:22.714300+0000","last_undegraded":"2024-09-14T10:48:22.714300+0000","last_fullsized":"2024-09-14T10:48:22.714300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:22.713714+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:22.713714+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.713714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:32.805970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.888067+0000","last_change":"2024-09-14T10:48:22.887921+0000","last_active":"2024-09-14T10:48:22.888067+0000","last_peered":"2024-09-14T10:48:22.888067+0000","last_clean":"2024-09-14T10:48:22.888067+0000","last_became_active":"2024-09-14T10:44:05.314981+0000","last_became_peered":"2024-09-14T10:44:05.314981+0000","last_unstale":"2024-09-14T10:48:22.888067+0000","last_undegraded":"2024-09-14T10:48:22.888067+0000","last_fullsized":"2024-09-14T10:48:22.888067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:22.887731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:22.887731+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.887731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.608934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'14","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.690389+0000","last_change":"2024-09-14T10:48:23.690389+0000","last_active":"2024-09-14T10:48:23.690389+0000","last_peered":"2024-09-14T10:48:23.690389+0000","last_clean":"2024-09-14T10:48:23.690389+0000","last_became_active":"2024-09-14T10:44:07.300944+0000","last_became_peered":"2024-09-14T10:44:07.300944+0000","last_unstale":"2024-09-14T10:48:23.690389+0000","last_undegraded":"2024-09-14T10:48:23.690389+0000","last_fullsized":"2024-09-14T10:48:23.690389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:23.690127+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:23.690127+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.690127+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:31.933431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.503967+0000","last_change":"2024-09-14T10:48:09.503799+0000","last_active":"2024-09-14T10:48:09.503967+0000","last_peered":"2024-09-14T10:48:09.503967+0000","last_clean":"2024-09-14T10:48:09.503967+0000","last_became_active":"2024-09-14T10:44:05.314042+0000","last_became_peered":"2024-09-14T10:44:05.314042+0000","last_unstale":"2024-09-14T10:48:09.503967+0000","last_undegraded":"2024-09-14T10:48:09.503967+0000","last_fullsized":"2024-09-14T10:48:09.503967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:09.503614+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.503614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:43.187650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.653888+0000","last_change":"2024-09-14T10:48:24.653888+0000","last_active":"2024-09-14T10:48:24.653888+0000","last_peered":"2024-09-14T10:48:24.653888+0000","last_clean":"2024-09-14T10:48:24.653888+0000","last_became_active":"2024-09-14T10:44:07.314664+0000","last_became_peered":"2024-09-14T10:44:07.314664+0000","last_unstale":"2024-09-14T10:48:24.653888+0000","last_undegraded":"2024-09-14T10:48:24.653888+0000","last_fullsized":"2024-09-14T10:48:24.653888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:24.653671+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:24.653671+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.653671+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:36.631176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.665143+0000","last_change":"2024-09-14T10:48:40.664900+0000","last_active":"2024-09-14T10:48:40.665143+0000","last_peered":"2024-09-14T10:48:40.665143+0000","last_clean":"2024-09-14T10:48:40.665143+0000","last_became_active":"2024-09-14T10:44:07.312822+0000","last_became_peered":"2024-09-14T10:44:07.312822+0000","last_unstale":"2024-09-14T10:48:40.665143+0000","last_undegraded":"2024-09-14T10:48:40.665143+0000","last_fullsized":"2024-09-14T10:48:40.665143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:40.664677+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:40.664677+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.664677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:45.108181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:10.434266+0000","last_change":"2024-09-14T10:48:10.434015+0000","last_active":"2024-09-14T10:48:10.434266+0000","last_peered":"2024-09-14T10:48:10.434266+0000","last_clean":"2024-09-14T10:48:10.434266+0000","last_became_active":"2024-09-14T10:44:05.320163+0000","last_became_peered":"2024-09-14T10:44:05.320163+0000","last_unstale":"2024-09-14T10:48:10.434266+0000","last_undegraded":"2024-09-14T10:48:10.434266+0000","last_fullsized":"2024-09-14T10:48:10.434266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:10.433796+0000","last_clean_scrub_stamp":"2024-09-14T10:48:10.433796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:25.542559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.442358+0000","last_change":"2024-09-14T10:48:25.442195+0000","last_active":"2024-09-14T10:48:25.442358+0000","last_peered":"2024-09-14T10:48:25.442358+0000","last_clean":"2024-09-14T10:48:25.442358+0000","last_became_active":"2024-09-14T10:44:07.302721+0000","last_became_peered":"2024-09-14T10:44:07.302721+0000","last_unstale":"2024-09-14T10:48:25.442358+0000","last_undegraded":"2024-09-14T10:48:25.442358+0000","last_fullsized":"2024-09-14T10:48:25.442358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:25.442006+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:25.442006+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.442006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:27.650647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.731707+0000","last_change":"2024-09-14T10:48:08.731550+0000","last_active":"2024-09-14T10:48:08.731707+0000","last_peered":"2024-09-14T10:48:08.731707+0000","last_clean":"2024-09-14T10:48:08.731707+0000","last_became_active":"2024-09-14T10:44:05.313907+0000","last_became_peered":"2024-09-14T10:44:05.313907+0000","last_unstale":"2024-09-14T10:48:08.731707+0000","last_undegraded":"2024-09-14T10:48:08.731707+0000","last_fullsized":"2024-09-14T10:48:08.731707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:08.731374+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.731374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:25.870502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.521955+0000","last_change":"2024-09-14T10:48:28.521815+0000","last_active":"2024-09-14T10:48:28.521955+0000","last_peered":"2024-09-14T10:48:28.521955+0000","last_clean":"2024-09-14T10:48:28.521955+0000","last_became_active":"2024-09-14T10:44:07.302243+0000","last_became_peered":"2024-09-14T10:44:07.302243+0000","last_unstale":"2024-09-14T10:48:28.521955+0000","last_undegraded":"2024-09-14T10:48:28.521955+0000","last_fullsized":"2024-09-14T10:48:28.521955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:28.521636+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:28.521636+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.521636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:47.105831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.413206+0000","last_change":"2024-09-14T10:48:09.413034+0000","last_active":"2024-09-14T10:48:09.413206+0000","last_peered":"2024-09-14T10:48:09.413206+0000","last_clean":"2024-09-14T10:48:09.413206+0000","last_became_active":"2024-09-14T10:44:05.316619+0000","last_became_peered":"2024-09-14T10:44:05.316619+0000","last_unstale":"2024-09-14T10:48:09.413206+0000","last_undegraded":"2024-09-14T10:48:09.413206+0000","last_fullsized":"2024-09-14T10:48:09.413206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.412833+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.412833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:35.318942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.597525+0000","last_change":"2024-09-14T10:48:28.597380+0000","last_active":"2024-09-14T10:48:28.597525+0000","last_peered":"2024-09-14T10:48:28.597525+0000","last_clean":"2024-09-14T10:48:28.597525+0000","last_became_active":"2024-09-14T10:44:07.313542+0000","last_became_peered":"2024-09-14T10:44:07.313542+0000","last_unstale":"2024-09-14T10:48:28.597525+0000","last_undegraded":"2024-09-14T10:48:28.597525+0000","last_fullsized":"2024-09-14T10:48:28.597525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:28.597180+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:28.597180+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.597180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:04.719964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.345403+0000","last_change":"2024-09-14T10:48:07.345264+0000","last_active":"2024-09-14T10:48:07.345403+0000","last_peered":"2024-09-14T10:48:07.345403+0000","last_clean":"2024-09-14T10:48:07.345403+0000","last_became_active":"2024-09-14T10:44:05.316634+0000","last_became_peered":"2024-09-14T10:44:05.316634+0000","last_unstale":"2024-09-14T10:48:07.345403+0000","last_undegraded":"2024-09-14T10:48:07.345403+0000","last_fullsized":"2024-09-14T10:48:07.345403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:07.345074+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.345074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.041740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.761538+0000","last_change":"2024-09-14T10:48:21.761411+0000","last_active":"2024-09-14T10:48:21.761538+0000","last_peered":"2024-09-14T10:48:21.761538+0000","last_clean":"2024-09-14T10:48:21.761538+0000","last_became_active":"2024-09-14T10:44:07.313391+0000","last_became_peered":"2024-09-14T10:44:07.313391+0000","last_unstale":"2024-09-14T10:48:21.761538+0000","last_undegraded":"2024-09-14T10:48:21.761538+0000","last_fullsized":"2024-09-14T10:48:21.761538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:21.761222+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:21.761222+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.761222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:14.714371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.538174+0000","last_change":"2024-09-14T10:48:11.537992+0000","last_active":"2024-09-14T10:48:11.538174+0000","last_peered":"2024-09-14T10:48:11.538174+0000","last_clean":"2024-09-14T10:48:11.538174+0000","last_became_active":"2024-09-14T10:44:05.320697+0000","last_became_peered":"2024-09-14T10:44:05.320697+0000","last_unstale":"2024-09-14T10:48:11.538174+0000","last_undegraded":"2024-09-14T10:48:11.538174+0000","last_fullsized":"2024-09-14T10:48:11.538174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:11.537799+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.537799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:49.788688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.459135+0000","last_change":"2024-09-14T10:48:26.458972+0000","last_active":"2024-09-14T10:48:26.459135+0000","last_peered":"2024-09-14T10:48:26.459135+0000","last_clean":"2024-09-14T10:48:26.459135+0000","last_became_active":"2024-09-14T10:44:07.303021+0000","last_became_peered":"2024-09-14T10:44:07.303021+0000","last_unstale":"2024-09-14T10:48:26.459135+0000","last_undegraded":"2024-09-14T10:48:26.459135+0000","last_fullsized":"2024-09-14T10:48:26.459135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:26.458789+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:26.458789+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.458789+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:37.373380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.835917+0000","last_change":"2024-09-14T10:48:20.835752+0000","last_active":"2024-09-14T10:48:20.835917+0000","last_peered":"2024-09-14T10:48:20.835917+0000","last_clean":"2024-09-14T10:48:20.835917+0000","last_became_active":"2024-09-14T10:44:05.311750+0000","last_became_peered":"2024-09-14T10:44:05.311750+0000","last_unstale":"2024-09-14T10:48:20.835917+0000","last_undegraded":"2024-09-14T10:48:20.835917+0000","last_fullsized":"2024-09-14T10:48:20.835917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:20.835574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:20.835574+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.835574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:37.288457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:57.684203+0000","last_change":"2024-09-14T10:48:57.683910+0000","last_active":"2024-09-14T10:48:57.684203+0000","last_peered":"2024-09-14T10:48:57.684203+0000","last_clean":"2024-09-14T10:48:57.684203+0000","last_became_active":"2024-09-14T10:44:15.383529+0000","last_became_peered":"2024-09-14T10:44:15.383529+0000","last_unstale":"2024-09-14T10:48:57.684203+0000","last_undegraded":"2024-09-14T10:48:57.684203+0000","last_fullsized":"2024-09-14T10:48:57.684203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-14T10:48:57.683636+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-14T10:48:57.683636+0000","last_clean_scrub_stamp":"2024-09-14T10:48:57.683636+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:29.777623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.868412+0000","last_change":"2024-09-14T10:48:31.868270+0000","last_active":"2024-09-14T10:48:31.868412+0000","last_peered":"2024-09-14T10:48:31.868412+0000","last_clean":"2024-09-14T10:48:31.868412+0000","last_became_active":"2024-09-14T10:44:07.299983+0000","last_became_peered":"2024-09-14T10:44:07.299983+0000","last_unstale":"2024-09-14T10:48:31.868412+0000","last_undegraded":"2024-09-14T10:48:31.868412+0000","last_fullsized":"2024-09-14T10:48:31.868412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:31.868080+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:31.868080+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.868080+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:24.962231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.016482+0000","last_change":"2024-09-14T10:48:11.016248+0000","last_active":"2024-09-14T10:48:11.016482+0000","last_peered":"2024-09-14T10:48:11.016482+0000","last_clean":"2024-09-14T10:48:11.016482+0000","last_became_active":"2024-09-14T10:44:05.324613+0000","last_became_peered":"2024-09-14T10:44:05.324613+0000","last_unstale":"2024-09-14T10:48:11.016482+0000","last_undegraded":"2024-09-14T10:48:11.016482+0000","last_fullsized":"2024-09-14T10:48:11.016482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.016029+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.016029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.143146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.709223+0000","last_change":"2024-09-14T10:48:50.709065+0000","last_active":"2024-09-14T10:48:50.709223+0000","last_peered":"2024-09-14T10:48:50.709223+0000","last_clean":"2024-09-14T10:48:50.709223+0000","last_became_active":"2024-09-14T10:44:09.339212+0000","last_became_peered":"2024-09-14T10:44:09.339212+0000","last_unstale":"2024-09-14T10:48:50.709223+0000","last_undegraded":"2024-09-14T10:48:50.709223+0000","last_fullsized":"2024-09-14T10:48:50.709223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:50.708840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:50.708840+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.708840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:06.261826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:00.765327+0000","last_change":"2024-09-14T10:49:00.765166+0000","last_active":"2024-09-14T10:49:00.765327+0000","last_peered":"2024-09-14T10:49:00.765327+0000","last_clean":"2024-09-14T10:49:00.765327+0000","last_became_active":"2024-09-14T10:44:11.365171+0000","last_became_peered":"2024-09-14T10:44:11.365171+0000","last_unstale":"2024-09-14T10:49:00.765327+0000","last_undegraded":"2024-09-14T10:49:00.765327+0000","last_fullsized":"2024-09-14T10:49:00.765327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-14T10:49:00.764971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-14T10:49:00.764971+0000","last_clean_scrub_stamp":"2024-09-14T10:49:00.764971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:53.764219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.695187+0000","last_change":"2024-09-14T10:48:49.695051+0000","last_active":"2024-09-14T10:48:49.695187+0000","last_peered":"2024-09-14T10:48:49.695187+0000","last_clean":"2024-09-14T10:48:49.695187+0000","last_became_active":"2024-09-14T10:44:13.369791+0000","last_became_peered":"2024-09-14T10:44:13.369791+0000","last_unstale":"2024-09-14T10:48:49.695187+0000","last_undegraded":"2024-09-14T10:48:49.695187+0000","last_fullsized":"2024-09-14T10:48:49.695187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.694840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.694840+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.694840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:31.821957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:58.644675+0000","last_change":"2024-09-14T10:48:58.644405+0000","last_active":"2024-09-14T10:48:58.644675+0000","last_peered":"2024-09-14T10:48:58.644675+0000","last_clean":"2024-09-14T10:48:58.644675+0000","last_became_active":"2024-09-14T10:44:15.376906+0000","last_became_peered":"2024-09-14T10:44:15.376906+0000","last_unstale":"2024-09-14T10:48:58.644675+0000","last_undegraded":"2024-09-14T10:48:58.644675+0000","last_fullsized":"2024-09-14T10:48:58.644675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-14T10:48:58.644192+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-14T10:48:58.644192+0000","last_clean_scrub_stamp":"2024-09-14T10:48:58.644192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:12.518306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'22","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.826793+0000","last_change":"2024-09-14T10:48:32.826539+0000","last_active":"2024-09-14T10:48:32.826793+0000","last_peered":"2024-09-14T10:48:32.826793+0000","last_clean":"2024-09-14T10:48:32.826793+0000","last_became_active":"2024-09-14T10:44:07.306572+0000","last_became_peered":"2024-09-14T10:44:07.306572+0000","last_unstale":"2024-09-14T10:48:32.826793+0000","last_undegraded":"2024-09-14T10:48:32.826793+0000","last_fullsized":"2024-09-14T10:48:32.826793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-14T10:48:32.826333+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-14T10:48:32.826333+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.826333+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:05.422320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":89,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.606030+0000","last_change":"2024-09-14T10:48:01.605793+0000","last_active":"2024-09-14T10:48:01.606030+0000","last_peered":"2024-09-14T10:48:01.606030+0000","last_clean":"2024-09-14T10:48:01.606030+0000","last_became_active":"2024-09-14T10:44:05.322637+0000","last_became_peered":"2024-09-14T10:44:05.322637+0000","last_unstale":"2024-09-14T10:48:01.606030+0000","last_undegraded":"2024-09-14T10:48:01.606030+0000","last_fullsized":"2024-09-14T10:48:01.606030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.605543+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.605543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:33.748359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.619909+0000","last_change":"2024-09-14T10:48:33.619763+0000","last_active":"2024-09-14T10:48:33.619909+0000","last_peered":"2024-09-14T10:48:33.619909+0000","last_clean":"2024-09-14T10:48:33.619909+0000","last_became_active":"2024-09-14T10:44:09.318353+0000","last_became_peered":"2024-09-14T10:44:09.318353+0000","last_unstale":"2024-09-14T10:48:33.619909+0000","last_undegraded":"2024-09-14T10:48:33.619909+0000","last_fullsized":"2024-09-14T10:48:33.619909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:33.619581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:33.619581+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.619581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:33.570850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.606243+0000","last_change":"2024-09-14T10:48:43.606072+0000","last_active":"2024-09-14T10:48:43.606243+0000","last_peered":"2024-09-14T10:48:43.606243+0000","last_clean":"2024-09-14T10:48:43.606243+0000","last_became_active":"2024-09-14T10:44:11.326469+0000","last_became_peered":"2024-09-14T10:44:11.326469+0000","last_unstale":"2024-09-14T10:48:43.606243+0000","last_undegraded":"2024-09-14T10:48:43.606243+0000","last_fullsized":"2024-09-14T10:48:43.606243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:43.605875+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:43.605875+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.605875+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:11.774070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.715776+0000","last_change":"2024-09-14T10:48:48.715637+0000","last_active":"2024-09-14T10:48:48.715776+0000","last_peered":"2024-09-14T10:48:48.715776+0000","last_clean":"2024-09-14T10:48:48.715776+0000","last_became_active":"2024-09-14T10:44:13.359159+0000","last_became_peered":"2024-09-14T10:44:13.359159+0000","last_unstale":"2024-09-14T10:48:48.715776+0000","last_undegraded":"2024-09-14T10:48:48.715776+0000","last_fullsized":"2024-09-14T10:48:48.715776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:48.715463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:48.715463+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.715463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:51.871305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:56.704568+0000","last_change":"2024-09-14T10:48:56.704395+0000","last_active":"2024-09-14T10:48:56.704568+0000","last_peered":"2024-09-14T10:48:56.704568+0000","last_clean":"2024-09-14T10:48:56.704568+0000","last_became_active":"2024-09-14T10:44:15.384900+0000","last_became_peered":"2024-09-14T10:44:15.384900+0000","last_unstale":"2024-09-14T10:48:56.704568+0000","last_undegraded":"2024-09-14T10:48:56.704568+0000","last_fullsized":"2024-09-14T10:48:56.704568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:56.704209+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:56.704209+0000","last_clean_scrub_stamp":"2024-09-14T10:48:56.704209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:28.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'22","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.801868+0000","last_change":"2024-09-14T10:48:33.801688+0000","last_active":"2024-09-14T10:48:33.801868+0000","last_peered":"2024-09-14T10:48:33.801868+0000","last_clean":"2024-09-14T10:48:33.801868+0000","last_became_active":"2024-09-14T10:44:07.309453+0000","last_became_peered":"2024-09-14T10:44:07.309453+0000","last_unstale":"2024-09-14T10:48:33.801868+0000","last_undegraded":"2024-09-14T10:48:33.801868+0000","last_fullsized":"2024-09-14T10:48:33.801868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-09-14T10:48:33.801495+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-09-14T10:48:33.801495+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.801495+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:25.809741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":83,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:09.984658+0000","last_change":"2024-09-14T10:48:09.984385+0000","last_active":"2024-09-14T10:48:09.984658+0000","last_peered":"2024-09-14T10:48:09.984658+0000","last_clean":"2024-09-14T10:48:09.984658+0000","last_became_active":"2024-09-14T10:44:05.318500+0000","last_became_peered":"2024-09-14T10:44:05.318500+0000","last_unstale":"2024-09-14T10:48:09.984658+0000","last_undegraded":"2024-09-14T10:48:09.984658+0000","last_fullsized":"2024-09-14T10:48:09.984658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:09.984177+0000","last_clean_scrub_stamp":"2024-09-14T10:48:09.984177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:13.140019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.606557+0000","last_change":"2024-09-14T10:48:27.606320+0000","last_active":"2024-09-14T10:48:27.606557+0000","last_peered":"2024-09-14T10:48:27.606557+0000","last_clean":"2024-09-14T10:48:27.606557+0000","last_became_active":"2024-09-14T10:44:09.325205+0000","last_became_peered":"2024-09-14T10:44:09.325205+0000","last_unstale":"2024-09-14T10:48:27.606557+0000","last_undegraded":"2024-09-14T10:48:27.606557+0000","last_fullsized":"2024-09-14T10:48:27.606557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:27.606121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:27.606121+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.606121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:42.007371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.455539+0000","last_change":"2024-09-14T10:48:39.455381+0000","last_active":"2024-09-14T10:48:39.455539+0000","last_peered":"2024-09-14T10:48:39.455539+0000","last_clean":"2024-09-14T10:48:39.455539+0000","last_became_active":"2024-09-14T10:44:11.354429+0000","last_became_peered":"2024-09-14T10:44:11.354429+0000","last_unstale":"2024-09-14T10:48:39.455539+0000","last_undegraded":"2024-09-14T10:48:39.455539+0000","last_fullsized":"2024-09-14T10:48:39.455539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:39.455160+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:39.455160+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.455160+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:00.891457+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":396,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:08.723214+0000","last_change":"2024-09-14T10:49:08.723214+0000","last_active":"2024-09-14T10:49:08.723214+0000","last_peered":"2024-09-14T10:49:08.723214+0000","last_clean":"2024-09-14T10:49:08.723214+0000","last_became_active":"2024-09-14T10:44:13.370103+0000","last_became_peered":"2024-09-14T10:44:13.370103+0000","last_unstale":"2024-09-14T10:49:08.723214+0000","last_undegraded":"2024-09-14T10:49:08.723214+0000","last_fullsized":"2024-09-14T10:49:08.723214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:49:08.723032+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:49:08.723032+0000","last_clean_scrub_stamp":"2024-09-14T10:49:08.723032+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:32.771632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.453697+0000","last_change":"2024-09-14T10:48:51.453452+0000","last_active":"2024-09-14T10:48:51.453697+0000","last_peered":"2024-09-14T10:48:51.453697+0000","last_clean":"2024-09-14T10:48:51.453697+0000","last_became_active":"2024-09-14T10:44:15.392453+0000","last_became_peered":"2024-09-14T10:44:15.392453+0000","last_unstale":"2024-09-14T10:48:51.453697+0000","last_undegraded":"2024-09-14T10:48:51.453697+0000","last_fullsized":"2024-09-14T10:48:51.453697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.453232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.453232+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.453232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:22.042348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.635653+0000","last_change":"2024-09-14T10:48:15.635473+0000","last_active":"2024-09-14T10:48:15.635653+0000","last_peered":"2024-09-14T10:48:15.635653+0000","last_clean":"2024-09-14T10:48:15.635653+0000","last_became_active":"2024-09-14T10:44:07.308630+0000","last_became_peered":"2024-09-14T10:44:07.308630+0000","last_unstale":"2024-09-14T10:48:15.635653+0000","last_undegraded":"2024-09-14T10:48:15.635653+0000","last_fullsized":"2024-09-14T10:48:15.635653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.635292+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.635292+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:37.356846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.255721+0000","last_change":"2024-09-14T10:47:59.255546+0000","last_active":"2024-09-14T10:47:59.255721+0000","last_peered":"2024-09-14T10:47:59.255721+0000","last_clean":"2024-09-14T10:47:59.255721+0000","last_became_active":"2024-09-14T10:44:05.313810+0000","last_became_peered":"2024-09-14T10:44:05.313810+0000","last_unstale":"2024-09-14T10:47:59.255721+0000","last_undegraded":"2024-09-14T10:47:59.255721+0000","last_fullsized":"2024-09-14T10:47:59.255721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:59.255367+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.255367+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:45.490294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.679887+0000","last_change":"2024-09-14T10:48:51.679715+0000","last_active":"2024-09-14T10:48:51.679887+0000","last_peered":"2024-09-14T10:48:51.679887+0000","last_clean":"2024-09-14T10:48:51.679887+0000","last_became_active":"2024-09-14T10:44:09.340377+0000","last_became_peered":"2024-09-14T10:44:09.340377+0000","last_unstale":"2024-09-14T10:48:51.679887+0000","last_undegraded":"2024-09-14T10:48:51.679887+0000","last_fullsized":"2024-09-14T10:48:51.679887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.679543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.679543+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.679543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:20.562988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.443317+0000","last_change":"2024-09-14T10:48:37.443171+0000","last_active":"2024-09-14T10:48:37.443317+0000","last_peered":"2024-09-14T10:48:37.443317+0000","last_clean":"2024-09-14T10:48:37.443317+0000","last_became_active":"2024-09-14T10:44:11.345917+0000","last_became_peered":"2024-09-14T10:44:11.345917+0000","last_unstale":"2024-09-14T10:48:37.443317+0000","last_undegraded":"2024-09-14T10:48:37.443317+0000","last_fullsized":"2024-09-14T10:48:37.443317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-14T10:48:37.442971+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-14T10:48:37.442971+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.442971+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:50.930609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":425,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.654908+0000","last_change":"2024-09-14T10:48:48.654747+0000","last_active":"2024-09-14T10:48:48.654908+0000","last_peered":"2024-09-14T10:48:48.654908+0000","last_clean":"2024-09-14T10:48:48.654908+0000","last_became_active":"2024-09-14T10:44:13.358571+0000","last_became_peered":"2024-09-14T10:44:13.358571+0000","last_unstale":"2024-09-14T10:48:48.654908+0000","last_undegraded":"2024-09-14T10:48:48.654908+0000","last_fullsized":"2024-09-14T10:48:48.654908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:48.654557+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:48.654557+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.654557+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:30.781674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.881054+0000","last_change":"2024-09-14T10:48:27.880910+0000","last_active":"2024-09-14T10:48:27.881054+0000","last_peered":"2024-09-14T10:48:27.881054+0000","last_clean":"2024-09-14T10:48:27.881054+0000","last_became_active":"2024-09-14T10:44:07.309253+0000","last_became_peered":"2024-09-14T10:44:07.309253+0000","last_unstale":"2024-09-14T10:48:27.881054+0000","last_undegraded":"2024-09-14T10:48:27.881054+0000","last_fullsized":"2024-09-14T10:48:27.881054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:27.880708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:27.880708+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.880708+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:31.359099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.552491+0000","last_change":"2024-09-14T10:48:03.552213+0000","last_active":"2024-09-14T10:48:03.552491+0000","last_peered":"2024-09-14T10:48:03.552491+0000","last_clean":"2024-09-14T10:48:03.552491+0000","last_became_active":"2024-09-14T10:44:05.316350+0000","last_became_peered":"2024-09-14T10:44:05.316350+0000","last_unstale":"2024-09-14T10:48:03.552491+0000","last_undegraded":"2024-09-14T10:48:03.552491+0000","last_fullsized":"2024-09-14T10:48:03.552491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.551983+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.551983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.648129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.489804+0000","last_change":"2024-09-14T10:48:32.489804+0000","last_active":"2024-09-14T10:48:32.489804+0000","last_peered":"2024-09-14T10:48:32.489804+0000","last_clean":"2024-09-14T10:48:32.489804+0000","last_became_active":"2024-09-14T10:44:09.321320+0000","last_became_peered":"2024-09-14T10:44:09.321320+0000","last_unstale":"2024-09-14T10:48:32.489804+0000","last_undegraded":"2024-09-14T10:48:32.489804+0000","last_fullsized":"2024-09-14T10:48:32.489804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:32.489524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:32.489524+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.489524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:13.102091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.485022+0000","last_change":"2024-09-14T10:48:34.485022+0000","last_active":"2024-09-14T10:48:34.485022+0000","last_peered":"2024-09-14T10:48:34.485022+0000","last_clean":"2024-09-14T10:48:34.485022+0000","last_became_active":"2024-09-14T10:44:11.339737+0000","last_became_peered":"2024-09-14T10:44:11.339737+0000","last_unstale":"2024-09-14T10:48:34.485022+0000","last_undegraded":"2024-09-14T10:48:34.485022+0000","last_fullsized":"2024-09-14T10:48:34.485022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-14T10:48:34.484782+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-14T10:48:34.484782+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.484782+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:29.171627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.589885+0000","last_change":"2024-09-14T10:48:45.589885+0000","last_active":"2024-09-14T10:48:45.589885+0000","last_peered":"2024-09-14T10:48:45.589885+0000","last_clean":"2024-09-14T10:48:45.589885+0000","last_became_active":"2024-09-14T10:44:13.358962+0000","last_became_peered":"2024-09-14T10:44:13.358962+0000","last_unstale":"2024-09-14T10:48:45.589885+0000","last_undegraded":"2024-09-14T10:48:45.589885+0000","last_fullsized":"2024-09-14T10:48:45.589885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:45.589679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:45.589679+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.589679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:09.037609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.448179+0000","last_change":"2024-09-14T10:48:49.448179+0000","last_active":"2024-09-14T10:48:49.448179+0000","last_peered":"2024-09-14T10:48:49.448179+0000","last_clean":"2024-09-14T10:48:49.448179+0000","last_became_active":"2024-09-14T10:44:15.384273+0000","last_became_peered":"2024-09-14T10:44:15.384273+0000","last_unstale":"2024-09-14T10:48:49.448179+0000","last_undegraded":"2024-09-14T10:48:49.448179+0000","last_fullsized":"2024-09-14T10:48:49.448179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:49.447960+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:49.447960+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.447960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:59.478591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.497753+0000","last_change":"2024-09-14T10:48:14.497618+0000","last_active":"2024-09-14T10:48:14.497753+0000","last_peered":"2024-09-14T10:48:14.497753+0000","last_clean":"2024-09-14T10:48:14.497753+0000","last_became_active":"2024-09-14T10:44:07.296948+0000","last_became_peered":"2024-09-14T10:44:07.296948+0000","last_unstale":"2024-09-14T10:48:14.497753+0000","last_undegraded":"2024-09-14T10:48:14.497753+0000","last_fullsized":"2024-09-14T10:48:14.497753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:14.497416+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:14.497416+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.497416+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:54.322425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.618993+0000","last_change":"2024-09-14T10:47:59.618709+0000","last_active":"2024-09-14T10:47:59.618993+0000","last_peered":"2024-09-14T10:47:59.618993+0000","last_clean":"2024-09-14T10:47:59.618993+0000","last_became_active":"2024-09-14T10:44:05.320250+0000","last_became_peered":"2024-09-14T10:44:05.320250+0000","last_unstale":"2024-09-14T10:47:59.618993+0000","last_undegraded":"2024-09-14T10:47:59.618993+0000","last_fullsized":"2024-09-14T10:47:59.618993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:59.618492+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.618492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:36.397328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.600141+0000","last_change":"2024-09-14T10:48:26.599902+0000","last_active":"2024-09-14T10:48:26.600141+0000","last_peered":"2024-09-14T10:48:26.600141+0000","last_clean":"2024-09-14T10:48:26.600141+0000","last_became_active":"2024-09-14T10:44:09.315027+0000","last_became_peered":"2024-09-14T10:44:09.315027+0000","last_unstale":"2024-09-14T10:48:26.600141+0000","last_undegraded":"2024-09-14T10:48:26.600141+0000","last_fullsized":"2024-09-14T10:48:26.600141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:26.599635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:26.599635+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.599635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:39.190465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:57.688311+0000","last_change":"2024-09-14T10:48:57.688311+0000","last_active":"2024-09-14T10:48:57.688311+0000","last_peered":"2024-09-14T10:48:57.688311+0000","last_clean":"2024-09-14T10:48:57.688311+0000","last_became_active":"2024-09-14T10:44:11.357217+0000","last_became_peered":"2024-09-14T10:44:11.357217+0000","last_unstale":"2024-09-14T10:48:57.688311+0000","last_undegraded":"2024-09-14T10:48:57.688311+0000","last_fullsized":"2024-09-14T10:48:57.688311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-14T10:48:57.688094+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-14T10:48:57.688094+0000","last_clean_scrub_stamp":"2024-09-14T10:48:57.688094+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:07.231206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.578139+0000","last_change":"2024-09-14T10:48:44.578139+0000","last_active":"2024-09-14T10:48:44.578139+0000","last_peered":"2024-09-14T10:48:44.578139+0000","last_clean":"2024-09-14T10:48:44.578139+0000","last_became_active":"2024-09-14T10:44:13.370822+0000","last_became_peered":"2024-09-14T10:44:13.370822+0000","last_unstale":"2024-09-14T10:48:44.578139+0000","last_undegraded":"2024-09-14T10:48:44.578139+0000","last_fullsized":"2024-09-14T10:48:44.578139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.577958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.577958+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.577958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:50.475596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.746978+0000","last_change":"2024-09-14T10:48:52.746978+0000","last_active":"2024-09-14T10:48:52.746978+0000","last_peered":"2024-09-14T10:48:52.746978+0000","last_clean":"2024-09-14T10:48:52.746978+0000","last_became_active":"2024-09-14T10:44:15.386469+0000","last_became_peered":"2024-09-14T10:44:15.386469+0000","last_unstale":"2024-09-14T10:48:52.746978+0000","last_undegraded":"2024-09-14T10:48:52.746978+0000","last_fullsized":"2024-09-14T10:48:52.746978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:52.746797+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:52.746797+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.746797+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:35.428380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.831292+0000","last_change":"2024-09-14T10:48:12.831150+0000","last_active":"2024-09-14T10:48:12.831292+0000","last_peered":"2024-09-14T10:48:12.831292+0000","last_clean":"2024-09-14T10:48:12.831292+0000","last_became_active":"2024-09-14T10:44:07.313193+0000","last_became_peered":"2024-09-14T10:44:07.313193+0000","last_unstale":"2024-09-14T10:48:12.831292+0000","last_undegraded":"2024-09-14T10:48:12.831292+0000","last_fullsized":"2024-09-14T10:48:12.831292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:12.830946+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.830946+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:42.495812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.990560+0000","last_change":"2024-09-14T10:48:08.990298+0000","last_active":"2024-09-14T10:48:08.990560+0000","last_peered":"2024-09-14T10:48:08.990560+0000","last_clean":"2024-09-14T10:48:08.990560+0000","last_became_active":"2024-09-14T10:44:05.330327+0000","last_became_peered":"2024-09-14T10:44:05.330327+0000","last_unstale":"2024-09-14T10:48:08.990560+0000","last_undegraded":"2024-09-14T10:48:08.990560+0000","last_fullsized":"2024-09-14T10:48:08.990560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:08.990075+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.990075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:54.174799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.571920+0000","last_change":"2024-09-14T10:48:25.571660+0000","last_active":"2024-09-14T10:48:25.571920+0000","last_peered":"2024-09-14T10:48:25.571920+0000","last_clean":"2024-09-14T10:48:25.571920+0000","last_became_active":"2024-09-14T10:44:09.324414+0000","last_became_peered":"2024-09-14T10:44:09.324414+0000","last_unstale":"2024-09-14T10:48:25.571920+0000","last_undegraded":"2024-09-14T10:48:25.571920+0000","last_fullsized":"2024-09-14T10:48:25.571920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:25.571436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:25.571436+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.571436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:36.486026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:55.718348+0000","last_change":"2024-09-14T10:48:55.718348+0000","last_active":"2024-09-14T10:48:55.718348+0000","last_peered":"2024-09-14T10:48:55.718348+0000","last_clean":"2024-09-14T10:48:55.718348+0000","last_became_active":"2024-09-14T10:44:11.353400+0000","last_became_peered":"2024-09-14T10:44:11.353400+0000","last_unstale":"2024-09-14T10:48:55.718348+0000","last_undegraded":"2024-09-14T10:48:55.718348+0000","last_fullsized":"2024-09-14T10:48:55.718348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-14T10:48:55.718125+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-14T10:48:55.718125+0000","last_clean_scrub_stamp":"2024-09-14T10:48:55.718125+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:52.608781+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":390,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.617555+0000","last_change":"2024-09-14T10:48:46.617555+0000","last_active":"2024-09-14T10:48:46.617555+0000","last_peered":"2024-09-14T10:48:46.617555+0000","last_clean":"2024-09-14T10:48:46.617555+0000","last_became_active":"2024-09-14T10:44:13.371713+0000","last_became_peered":"2024-09-14T10:44:13.371713+0000","last_unstale":"2024-09-14T10:48:46.617555+0000","last_undegraded":"2024-09-14T10:48:46.617555+0000","last_fullsized":"2024-09-14T10:48:46.617555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:46.617369+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:46.617369+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.617369+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:31.802093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.688455+0000","last_change":"2024-09-14T10:48:53.688455+0000","last_active":"2024-09-14T10:48:53.688455+0000","last_peered":"2024-09-14T10:48:53.688455+0000","last_clean":"2024-09-14T10:48:53.688455+0000","last_became_active":"2024-09-14T10:44:15.386086+0000","last_became_peered":"2024-09-14T10:44:15.386086+0000","last_unstale":"2024-09-14T10:48:53.688455+0000","last_undegraded":"2024-09-14T10:48:53.688455+0000","last_fullsized":"2024-09-14T10:48:53.688455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:53.688183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:53.688183+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.688183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:29.352610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.781873+0000","last_change":"2024-09-14T10:48:14.781725+0000","last_active":"2024-09-14T10:48:14.781873+0000","last_peered":"2024-09-14T10:48:14.781873+0000","last_clean":"2024-09-14T10:48:14.781873+0000","last_became_active":"2024-09-14T10:44:07.297061+0000","last_became_peered":"2024-09-14T10:44:07.297061+0000","last_unstale":"2024-09-14T10:48:14.781873+0000","last_undegraded":"2024-09-14T10:48:14.781873+0000","last_fullsized":"2024-09-14T10:48:14.781873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.781515+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.781515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:43.801565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.031970+0000","last_change":"2024-09-14T10:48:08.031832+0000","last_active":"2024-09-14T10:48:08.031970+0000","last_peered":"2024-09-14T10:48:08.031970+0000","last_clean":"2024-09-14T10:48:08.031970+0000","last_became_active":"2024-09-14T10:44:05.315151+0000","last_became_peered":"2024-09-14T10:44:05.315151+0000","last_unstale":"2024-09-14T10:48:08.031970+0000","last_undegraded":"2024-09-14T10:48:08.031970+0000","last_fullsized":"2024-09-14T10:48:08.031970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.031656+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.031656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:31.479586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.600776+0000","last_change":"2024-09-14T10:48:24.600606+0000","last_active":"2024-09-14T10:48:24.600776+0000","last_peered":"2024-09-14T10:48:24.600776+0000","last_clean":"2024-09-14T10:48:24.600776+0000","last_became_active":"2024-09-14T10:44:09.324565+0000","last_became_peered":"2024-09-14T10:44:09.324565+0000","last_unstale":"2024-09-14T10:48:24.600776+0000","last_undegraded":"2024-09-14T10:48:24.600776+0000","last_fullsized":"2024-09-14T10:48:24.600776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:24.600403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:24.600403+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.600403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:26.809043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:56.705437+0000","last_change":"2024-09-14T10:48:56.705437+0000","last_active":"2024-09-14T10:48:56.705437+0000","last_peered":"2024-09-14T10:48:56.705437+0000","last_clean":"2024-09-14T10:48:56.705437+0000","last_became_active":"2024-09-14T10:44:11.356115+0000","last_became_peered":"2024-09-14T10:44:11.356115+0000","last_unstale":"2024-09-14T10:48:56.705437+0000","last_undegraded":"2024-09-14T10:48:56.705437+0000","last_fullsized":"2024-09-14T10:48:56.705437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-09-14T10:48:56.705231+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-09-14T10:48:56.705231+0000","last_clean_scrub_stamp":"2024-09-14T10:48:56.705231+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:25.519512+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.539291+0000","last_change":"2024-09-14T10:48:43.539291+0000","last_active":"2024-09-14T10:48:43.539291+0000","last_peered":"2024-09-14T10:48:43.539291+0000","last_clean":"2024-09-14T10:48:43.539291+0000","last_became_active":"2024-09-14T10:44:13.360624+0000","last_became_peered":"2024-09-14T10:44:13.360624+0000","last_unstale":"2024-09-14T10:48:43.539291+0000","last_undegraded":"2024-09-14T10:48:43.539291+0000","last_fullsized":"2024-09-14T10:48:43.539291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.539104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.539104+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.539104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:51.312807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.729545+0000","last_change":"2024-09-14T10:48:52.729545+0000","last_active":"2024-09-14T10:48:52.729545+0000","last_peered":"2024-09-14T10:48:52.729545+0000","last_clean":"2024-09-14T10:48:52.729545+0000","last_became_active":"2024-09-14T10:44:15.361574+0000","last_became_peered":"2024-09-14T10:44:15.361574+0000","last_unstale":"2024-09-14T10:48:52.729545+0000","last_undegraded":"2024-09-14T10:48:52.729545+0000","last_fullsized":"2024-09-14T10:48:52.729545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-14T10:48:52.729295+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-14T10:48:52.729295+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.729295+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:41.771486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.499890+0000","last_change":"2024-09-14T10:48:13.499703+0000","last_active":"2024-09-14T10:48:13.499890+0000","last_peered":"2024-09-14T10:48:13.499890+0000","last_clean":"2024-09-14T10:48:13.499890+0000","last_became_active":"2024-09-14T10:44:44.458744+0000","last_became_peered":"2024-09-14T10:44:44.458744+0000","last_unstale":"2024-09-14T10:48:13.499890+0000","last_undegraded":"2024-09-14T10:48:13.499890+0000","last_fullsized":"2024-09-14T10:48:13.499890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:13.499518+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.499518+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:35.604108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.461131+0000","last_change":"2024-09-14T10:48:02.460875+0000","last_active":"2024-09-14T10:48:02.461131+0000","last_peered":"2024-09-14T10:48:02.461131+0000","last_clean":"2024-09-14T10:48:02.461131+0000","last_became_active":"2024-09-14T10:44:05.314951+0000","last_became_peered":"2024-09-14T10:44:05.314951+0000","last_unstale":"2024-09-14T10:48:02.461131+0000","last_undegraded":"2024-09-14T10:48:02.461131+0000","last_fullsized":"2024-09-14T10:48:02.461131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.460647+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.460647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:07.647413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.607283+0000","last_change":"2024-09-14T10:48:27.607156+0000","last_active":"2024-09-14T10:48:27.607283+0000","last_peered":"2024-09-14T10:48:27.607283+0000","last_clean":"2024-09-14T10:48:27.607283+0000","last_became_active":"2024-09-14T10:44:09.320914+0000","last_became_peered":"2024-09-14T10:44:09.320914+0000","last_unstale":"2024-09-14T10:48:27.607283+0000","last_undegraded":"2024-09-14T10:48:27.607283+0000","last_fullsized":"2024-09-14T10:48:27.607283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:27.606970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:27.606970+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.606970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:41.101194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.599156+0000","last_change":"2024-09-14T10:48:39.599004+0000","last_active":"2024-09-14T10:48:39.599156+0000","last_peered":"2024-09-14T10:48:39.599156+0000","last_clean":"2024-09-14T10:48:39.599156+0000","last_became_active":"2024-09-14T10:44:11.326254+0000","last_became_peered":"2024-09-14T10:44:11.326254+0000","last_unstale":"2024-09-14T10:48:39.599156+0000","last_undegraded":"2024-09-14T10:48:39.599156+0000","last_fullsized":"2024-09-14T10:48:39.599156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-14T10:48:39.598805+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-14T10:48:39.598805+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.598805+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:03.925784+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:10.788050+0000","last_change":"2024-09-14T10:49:10.788050+0000","last_active":"2024-09-14T10:49:10.788050+0000","last_peered":"2024-09-14T10:49:10.788050+0000","last_clean":"2024-09-14T10:49:10.788050+0000","last_became_active":"2024-09-14T10:44:13.368167+0000","last_became_peered":"2024-09-14T10:44:13.368167+0000","last_unstale":"2024-09-14T10:49:10.788050+0000","last_undegraded":"2024-09-14T10:49:10.788050+0000","last_fullsized":"2024-09-14T10:49:10.788050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:10.787867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:10.787867+0000","last_clean_scrub_stamp":"2024-09-14T10:49:10.787867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:22.130716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:11.753211+0000","last_change":"2024-09-14T10:49:11.753211+0000","last_active":"2024-09-14T10:49:11.753211+0000","last_peered":"2024-09-14T10:49:11.753211+0000","last_clean":"2024-09-14T10:49:11.753211+0000","last_became_active":"2024-09-14T10:44:15.387017+0000","last_became_peered":"2024-09-14T10:44:15.387017+0000","last_unstale":"2024-09-14T10:49:11.753211+0000","last_undegraded":"2024-09-14T10:49:11.753211+0000","last_fullsized":"2024-09-14T10:49:11.753211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:49:11.753027+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:49:11.753027+0000","last_clean_scrub_stamp":"2024-09-14T10:49:11.753027+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:02.168286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.862582+0000","last_change":"2024-09-14T10:48:29.862407+0000","last_active":"2024-09-14T10:48:29.862582+0000","last_peered":"2024-09-14T10:48:29.862582+0000","last_clean":"2024-09-14T10:48:29.862582+0000","last_became_active":"2024-09-14T10:44:07.313259+0000","last_became_peered":"2024-09-14T10:44:07.313259+0000","last_unstale":"2024-09-14T10:48:29.862582+0000","last_undegraded":"2024-09-14T10:48:29.862582+0000","last_fullsized":"2024-09-14T10:48:29.862582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:29.862217+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:29.862217+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.862217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:24.391104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.079073+0000","last_change":"2024-09-14T10:48:07.078927+0000","last_active":"2024-09-14T10:48:07.079073+0000","last_peered":"2024-09-14T10:48:07.079073+0000","last_clean":"2024-09-14T10:48:07.079073+0000","last_became_active":"2024-09-14T10:44:05.323871+0000","last_became_peered":"2024-09-14T10:44:05.323871+0000","last_unstale":"2024-09-14T10:48:07.079073+0000","last_undegraded":"2024-09-14T10:48:07.079073+0000","last_fullsized":"2024-09-14T10:48:07.079073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.078726+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.078726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.976365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.657391+0000","last_change":"2024-09-14T10:48:30.657101+0000","last_active":"2024-09-14T10:48:30.657391+0000","last_peered":"2024-09-14T10:48:30.657391+0000","last_clean":"2024-09-14T10:48:30.657391+0000","last_became_active":"2024-09-14T10:44:09.324290+0000","last_became_peered":"2024-09-14T10:44:09.324290+0000","last_unstale":"2024-09-14T10:48:30.657391+0000","last_undegraded":"2024-09-14T10:48:30.657391+0000","last_fullsized":"2024-09-14T10:48:30.657391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:30.656887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:30.656887+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.656887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:28.780823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.472740+0000","last_change":"2024-09-14T10:48:35.472601+0000","last_active":"2024-09-14T10:48:35.472740+0000","last_peered":"2024-09-14T10:48:35.472740+0000","last_clean":"2024-09-14T10:48:35.472740+0000","last_became_active":"2024-09-14T10:44:11.324197+0000","last_became_peered":"2024-09-14T10:44:11.324197+0000","last_unstale":"2024-09-14T10:48:35.472740+0000","last_undegraded":"2024-09-14T10:48:35.472740+0000","last_fullsized":"2024-09-14T10:48:35.472740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:48:35.472394+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:48:35.472394+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.472394+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.251475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.473021+0000","last_change":"2024-09-14T10:48:41.472852+0000","last_active":"2024-09-14T10:48:41.473021+0000","last_peered":"2024-09-14T10:48:41.473021+0000","last_clean":"2024-09-14T10:48:41.473021+0000","last_became_active":"2024-09-14T10:44:13.361930+0000","last_became_peered":"2024-09-14T10:44:13.361930+0000","last_unstale":"2024-09-14T10:48:41.473021+0000","last_undegraded":"2024-09-14T10:48:41.473021+0000","last_fullsized":"2024-09-14T10:48:41.473021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:41.472667+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:41.472667+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.472667+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:45.971791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.674805+0000","last_change":"2024-09-14T10:48:50.674805+0000","last_active":"2024-09-14T10:48:50.674805+0000","last_peered":"2024-09-14T10:48:50.674805+0000","last_clean":"2024-09-14T10:48:50.674805+0000","last_became_active":"2024-09-14T10:44:15.389089+0000","last_became_peered":"2024-09-14T10:44:15.389089+0000","last_unstale":"2024-09-14T10:48:50.674805+0000","last_undegraded":"2024-09-14T10:48:50.674805+0000","last_fullsized":"2024-09-14T10:48:50.674805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:50.674615+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:50.674615+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.674615+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:09.029239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.780035+0000","last_change":"2024-09-14T10:48:15.779894+0000","last_active":"2024-09-14T10:48:15.780035+0000","last_peered":"2024-09-14T10:48:15.780035+0000","last_clean":"2024-09-14T10:48:15.780035+0000","last_became_active":"2024-09-14T10:44:07.314856+0000","last_became_peered":"2024-09-14T10:44:07.314856+0000","last_unstale":"2024-09-14T10:48:15.780035+0000","last_undegraded":"2024-09-14T10:48:15.780035+0000","last_fullsized":"2024-09-14T10:48:15.780035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:15.779722+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:15.779722+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.779722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:54.382214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.033800+0000","last_change":"2024-09-14T10:48:05.033536+0000","last_active":"2024-09-14T10:48:05.033800+0000","last_peered":"2024-09-14T10:48:05.033800+0000","last_clean":"2024-09-14T10:48:05.033800+0000","last_became_active":"2024-09-14T10:44:05.320883+0000","last_became_peered":"2024-09-14T10:44:05.320883+0000","last_unstale":"2024-09-14T10:48:05.033800+0000","last_undegraded":"2024-09-14T10:48:05.033800+0000","last_fullsized":"2024-09-14T10:48:05.033800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.033307+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.033307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:22.683683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.532367+0000","last_change":"2024-09-14T10:48:33.532122+0000","last_active":"2024-09-14T10:48:33.532367+0000","last_peered":"2024-09-14T10:48:33.532367+0000","last_clean":"2024-09-14T10:48:33.532367+0000","last_became_active":"2024-09-14T10:44:09.320931+0000","last_became_peered":"2024-09-14T10:44:09.320931+0000","last_unstale":"2024-09-14T10:48:33.532367+0000","last_undegraded":"2024-09-14T10:48:33.532367+0000","last_fullsized":"2024-09-14T10:48:33.532367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:33.531807+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:33.531807+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.531807+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:30.728116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:58.709247+0000","last_change":"2024-09-14T10:48:58.709247+0000","last_active":"2024-09-14T10:48:58.709247+0000","last_peered":"2024-09-14T10:48:58.709247+0000","last_clean":"2024-09-14T10:48:58.709247+0000","last_became_active":"2024-09-14T10:44:11.364780+0000","last_became_peered":"2024-09-14T10:44:11.364780+0000","last_unstale":"2024-09-14T10:48:58.709247+0000","last_undegraded":"2024-09-14T10:48:58.709247+0000","last_fullsized":"2024-09-14T10:48:58.709247+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:58.709052+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:58.709052+0000","last_clean_scrub_stamp":"2024-09-14T10:48:58.709052+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:20.663397+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":514,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.689447+0000","last_change":"2024-09-14T10:48:46.689447+0000","last_active":"2024-09-14T10:48:46.689447+0000","last_peered":"2024-09-14T10:48:46.689447+0000","last_clean":"2024-09-14T10:48:46.689447+0000","last_became_active":"2024-09-14T10:44:13.361708+0000","last_became_peered":"2024-09-14T10:44:13.361708+0000","last_unstale":"2024-09-14T10:48:46.689447+0000","last_undegraded":"2024-09-14T10:48:46.689447+0000","last_fullsized":"2024-09-14T10:48:46.689447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:46.689269+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:46.689269+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.689269+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:54.147990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.533081+0000","last_change":"2024-09-14T10:48:46.533081+0000","last_active":"2024-09-14T10:48:46.533081+0000","last_peered":"2024-09-14T10:48:46.533081+0000","last_clean":"2024-09-14T10:48:46.533081+0000","last_became_active":"2024-09-14T10:44:15.375398+0000","last_became_peered":"2024-09-14T10:44:15.375398+0000","last_unstale":"2024-09-14T10:48:46.533081+0000","last_undegraded":"2024-09-14T10:48:46.533081+0000","last_fullsized":"2024-09-14T10:48:46.533081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:46.532898+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:46.532898+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.532898+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:04.625405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.480761+0000","last_change":"2024-09-14T10:48:15.480619+0000","last_active":"2024-09-14T10:48:15.480761+0000","last_peered":"2024-09-14T10:48:15.480761+0000","last_clean":"2024-09-14T10:48:15.480761+0000","last_became_active":"2024-09-14T10:44:07.320744+0000","last_became_peered":"2024-09-14T10:44:07.320744+0000","last_unstale":"2024-09-14T10:48:15.480761+0000","last_undegraded":"2024-09-14T10:48:15.480761+0000","last_fullsized":"2024-09-14T10:48:15.480761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:15.480424+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:15.480424+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.480424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:35.371076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.058250+0000","last_change":"2024-09-14T10:48:02.058107+0000","last_active":"2024-09-14T10:48:02.058250+0000","last_peered":"2024-09-14T10:48:02.058250+0000","last_clean":"2024-09-14T10:48:02.058250+0000","last_became_active":"2024-09-14T10:44:05.321488+0000","last_became_peered":"2024-09-14T10:44:05.321488+0000","last_unstale":"2024-09-14T10:48:02.058250+0000","last_undegraded":"2024-09-14T10:48:02.058250+0000","last_fullsized":"2024-09-14T10:48:02.058250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.057931+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.057931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:29.184273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.694350+0000","last_change":"2024-09-14T10:48:47.694350+0000","last_active":"2024-09-14T10:48:47.694350+0000","last_peered":"2024-09-14T10:48:47.694350+0000","last_clean":"2024-09-14T10:48:47.694350+0000","last_became_active":"2024-09-14T10:44:09.341957+0000","last_became_peered":"2024-09-14T10:44:09.341957+0000","last_unstale":"2024-09-14T10:48:47.694350+0000","last_undegraded":"2024-09-14T10:48:47.694350+0000","last_fullsized":"2024-09-14T10:48:47.694350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.694176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.694176+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.694176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:03.255974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.633480+0000","last_change":"2024-09-14T10:48:42.633335+0000","last_active":"2024-09-14T10:48:42.633480+0000","last_peered":"2024-09-14T10:48:42.633480+0000","last_clean":"2024-09-14T10:48:42.633480+0000","last_became_active":"2024-09-14T10:44:11.331820+0000","last_became_peered":"2024-09-14T10:44:11.331820+0000","last_unstale":"2024-09-14T10:48:42.633480+0000","last_undegraded":"2024-09-14T10:48:42.633480+0000","last_fullsized":"2024-09-14T10:48:42.633480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-14T10:48:42.633151+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-14T10:48:42.633151+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.633151+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:24.160724+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.439615+0000","last_change":"2024-09-14T10:48:40.439449+0000","last_active":"2024-09-14T10:48:40.439615+0000","last_peered":"2024-09-14T10:48:40.439615+0000","last_clean":"2024-09-14T10:48:40.439615+0000","last_became_active":"2024-09-14T10:44:13.371175+0000","last_became_peered":"2024-09-14T10:44:13.371175+0000","last_unstale":"2024-09-14T10:48:40.439615+0000","last_undegraded":"2024-09-14T10:48:40.439615+0000","last_fullsized":"2024-09-14T10:48:40.439615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:40.439262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:40.439262+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.439262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:38.874795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.777596+0000","last_change":"2024-09-14T10:48:51.777596+0000","last_active":"2024-09-14T10:48:51.777596+0000","last_peered":"2024-09-14T10:48:51.777596+0000","last_clean":"2024-09-14T10:48:51.777596+0000","last_became_active":"2024-09-14T10:44:15.377388+0000","last_became_peered":"2024-09-14T10:44:15.377388+0000","last_unstale":"2024-09-14T10:48:51.777596+0000","last_undegraded":"2024-09-14T10:48:51.777596+0000","last_fullsized":"2024-09-14T10:48:51.777596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-14T10:48:51.777409+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-14T10:48:51.777409+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.777409+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:10.132034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.904259+0000","last_change":"2024-09-14T10:48:26.904259+0000","last_active":"2024-09-14T10:48:26.904259+0000","last_peered":"2024-09-14T10:48:26.904259+0000","last_clean":"2024-09-14T10:48:26.904259+0000","last_became_active":"2024-09-14T10:44:07.309618+0000","last_became_peered":"2024-09-14T10:44:07.309618+0000","last_unstale":"2024-09-14T10:48:26.904259+0000","last_undegraded":"2024-09-14T10:48:26.904259+0000","last_fullsized":"2024-09-14T10:48:26.904259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:26.904057+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:26.904057+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.904057+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:00.215590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.245843+0000","last_change":"2024-09-14T10:47:57.245843+0000","last_active":"2024-09-14T10:47:57.245843+0000","last_peered":"2024-09-14T10:47:57.245843+0000","last_clean":"2024-09-14T10:47:57.245843+0000","last_became_active":"2024-09-14T10:43:50.582866+0000","last_became_peered":"2024-09-14T10:43:50.582866+0000","last_unstale":"2024-09-14T10:47:57.245843+0000","last_undegraded":"2024-09-14T10:47:57.245843+0000","last_fullsized":"2024-09-14T10:47:57.245843+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-14T10:47:57.245648+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.245648+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:34.787201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.098357+0000","last_change":"2024-09-14T10:48:00.098121+0000","last_active":"2024-09-14T10:48:00.098357+0000","last_peered":"2024-09-14T10:48:00.098357+0000","last_clean":"2024-09-14T10:48:00.098357+0000","last_became_active":"2024-09-14T10:43:55.461008+0000","last_became_peered":"2024-09-14T10:43:55.461008+0000","last_unstale":"2024-09-14T10:48:00.098357+0000","last_undegraded":"2024-09-14T10:48:00.098357+0000","last_fullsized":"2024-09-14T10:48:00.098357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.097899+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.097899+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:08.489566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023871560000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.044417+0000","last_change":"2024-09-14T10:48:03.044221+0000","last_active":"2024-09-14T10:48:03.044417+0000","last_peered":"2024-09-14T10:48:03.044417+0000","last_clean":"2024-09-14T10:48:03.044417+0000","last_became_active":"2024-09-14T10:44:05.335474+0000","last_became_peered":"2024-09-14T10:44:05.335474+0000","last_unstale":"2024-09-14T10:48:03.044417+0000","last_undegraded":"2024-09-14T10:48:03.044417+0000","last_fullsized":"2024-09-14T10:48:03.044417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.044031+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.044031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:27.988834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.446959+0000","last_change":"2024-09-14T10:48:31.446959+0000","last_active":"2024-09-14T10:48:31.446959+0000","last_peered":"2024-09-14T10:48:31.446959+0000","last_clean":"2024-09-14T10:48:31.446959+0000","last_became_active":"2024-09-14T10:44:44.462544+0000","last_became_peered":"2024-09-14T10:44:44.462544+0000","last_unstale":"2024-09-14T10:48:31.446959+0000","last_undegraded":"2024-09-14T10:48:31.446959+0000","last_fullsized":"2024-09-14T10:48:31.446959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:31.446787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:31.446787+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.446787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:40.642565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'91","reported_seq":182,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:54.698326+0000","last_change":"2024-09-14T10:48:54.698326+0000","last_active":"2024-09-14T10:48:54.698326+0000","last_peered":"2024-09-14T10:48:54.698326+0000","last_clean":"2024-09-14T10:48:54.698326+0000","last_became_active":"2024-09-14T10:44:11.356419+0000","last_became_peered":"2024-09-14T10:44:11.356419+0000","last_unstale":"2024-09-14T10:48:54.698326+0000","last_undegraded":"2024-09-14T10:48:54.698326+0000","last_fullsized":"2024-09-14T10:48:54.698326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'91","last_scrub_stamp":"2024-09-14T10:48:54.698150+0000","last_deep_scrub":"34'91","last_deep_scrub_stamp":"2024-09-14T10:48:54.698150+0000","last_clean_scrub_stamp":"2024-09-14T10:48:54.698150+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:28.990213+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.557229+0000","last_change":"2024-09-14T10:48:42.557229+0000","last_active":"2024-09-14T10:48:42.557229+0000","last_peered":"2024-09-14T10:48:42.557229+0000","last_clean":"2024-09-14T10:48:42.557229+0000","last_became_active":"2024-09-14T10:44:13.371931+0000","last_became_peered":"2024-09-14T10:44:13.371931+0000","last_unstale":"2024-09-14T10:48:42.557229+0000","last_undegraded":"2024-09-14T10:48:42.557229+0000","last_fullsized":"2024-09-14T10:48:42.557229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:42.557031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:42.557031+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.557031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:10.725225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.499364+0000","last_change":"2024-09-14T10:48:47.499364+0000","last_active":"2024-09-14T10:48:47.499364+0000","last_peered":"2024-09-14T10:48:47.499364+0000","last_clean":"2024-09-14T10:48:47.499364+0000","last_became_active":"2024-09-14T10:44:15.375654+0000","last_became_peered":"2024-09-14T10:44:15.375654+0000","last_unstale":"2024-09-14T10:48:47.499364+0000","last_undegraded":"2024-09-14T10:48:47.499364+0000","last_fullsized":"2024-09-14T10:48:47.499364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'84","last_scrub_stamp":"2024-09-14T10:48:47.499134+0000","last_deep_scrub":"34'84","last_deep_scrub_stamp":"2024-09-14T10:48:47.499134+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.499134+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:00.278486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.848964+0000","last_change":"2024-09-14T10:48:28.848791+0000","last_active":"2024-09-14T10:48:28.848964+0000","last_peered":"2024-09-14T10:48:28.848964+0000","last_clean":"2024-09-14T10:48:28.848964+0000","last_became_active":"2024-09-14T10:44:07.316357+0000","last_became_peered":"2024-09-14T10:44:07.316357+0000","last_unstale":"2024-09-14T10:48:28.848964+0000","last_undegraded":"2024-09-14T10:48:28.848964+0000","last_fullsized":"2024-09-14T10:48:28.848964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:28.848584+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:28.848584+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.848584+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:33.208461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.110721+0000","last_change":"2024-09-14T10:47:59.110585+0000","last_active":"2024-09-14T10:47:59.110721+0000","last_peered":"2024-09-14T10:47:59.110721+0000","last_clean":"2024-09-14T10:47:59.110721+0000","last_became_active":"2024-09-14T10:43:55.456938+0000","last_became_peered":"2024-09-14T10:43:55.456938+0000","last_unstale":"2024-09-14T10:47:59.110721+0000","last_undegraded":"2024-09-14T10:47:59.110721+0000","last_fullsized":"2024-09-14T10:47:59.110721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:59.110378+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.110378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.838325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001180644,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.456447+0000","last_change":"2024-09-14T10:48:00.456288+0000","last_active":"2024-09-14T10:48:00.456447+0000","last_peered":"2024-09-14T10:48:00.456447+0000","last_clean":"2024-09-14T10:48:00.456447+0000","last_became_active":"2024-09-14T10:44:05.312487+0000","last_became_peered":"2024-09-14T10:44:05.312487+0000","last_unstale":"2024-09-14T10:48:00.456447+0000","last_undegraded":"2024-09-14T10:48:00.456447+0000","last_fullsized":"2024-09-14T10:48:00.456447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:00.456099+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.456099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:16.850631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:46.716345+0000","last_change":"2024-09-14T10:48:46.716345+0000","last_active":"2024-09-14T10:48:46.716345+0000","last_peered":"2024-09-14T10:48:46.716345+0000","last_clean":"2024-09-14T10:48:46.716345+0000","last_became_active":"2024-09-14T10:44:09.340978+0000","last_became_peered":"2024-09-14T10:44:09.340978+0000","last_unstale":"2024-09-14T10:48:46.716345+0000","last_undegraded":"2024-09-14T10:48:46.716345+0000","last_fullsized":"2024-09-14T10:48:46.716345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:46.716165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:46.716165+0000","last_clean_scrub_stamp":"2024-09-14T10:48:46.716165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:46.735357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'294","reported_seq":521,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.638776+0000","last_change":"2024-09-14T10:48:40.638776+0000","last_active":"2024-09-14T10:48:40.638776+0000","last_peered":"2024-09-14T10:48:40.638776+0000","last_clean":"2024-09-14T10:48:40.638776+0000","last_became_active":"2024-09-14T10:44:11.345278+0000","last_became_peered":"2024-09-14T10:44:11.345278+0000","last_unstale":"2024-09-14T10:48:40.638776+0000","last_undegraded":"2024-09-14T10:48:40.638776+0000","last_fullsized":"2024-09-14T10:48:40.638776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'294","last_scrub_stamp":"2024-09-14T10:48:40.638529+0000","last_deep_scrub":"34'294","last_deep_scrub_stamp":"2024-09-14T10:48:40.638529+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.638529+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.944766+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:05.693628+0000","last_change":"2024-09-14T10:49:05.693628+0000","last_active":"2024-09-14T10:49:05.693628+0000","last_peered":"2024-09-14T10:49:05.693628+0000","last_clean":"2024-09-14T10:49:05.693628+0000","last_became_active":"2024-09-14T10:44:13.367960+0000","last_became_peered":"2024-09-14T10:44:13.367960+0000","last_unstale":"2024-09-14T10:49:05.693628+0000","last_undegraded":"2024-09-14T10:49:05.693628+0000","last_fullsized":"2024-09-14T10:49:05.693628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:05.693441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:05.693441+0000","last_clean_scrub_stamp":"2024-09-14T10:49:05.693441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:25.601418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:54.685833+0000","last_change":"2024-09-14T10:48:54.685833+0000","last_active":"2024-09-14T10:48:54.685833+0000","last_peered":"2024-09-14T10:48:54.685833+0000","last_clean":"2024-09-14T10:48:54.685833+0000","last_became_active":"2024-09-14T10:44:15.391529+0000","last_became_peered":"2024-09-14T10:44:15.391529+0000","last_unstale":"2024-09-14T10:48:54.685833+0000","last_undegraded":"2024-09-14T10:48:54.685833+0000","last_fullsized":"2024-09-14T10:48:54.685833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-14T10:48:54.685618+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-14T10:48:54.685618+0000","last_clean_scrub_stamp":"2024-09-14T10:48:54.685618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:30.350045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.567720+0000","last_change":"2024-09-14T10:48:12.567549+0000","last_active":"2024-09-14T10:48:12.567720+0000","last_peered":"2024-09-14T10:48:12.567720+0000","last_clean":"2024-09-14T10:48:12.567720+0000","last_became_active":"2024-09-14T10:44:07.302024+0000","last_became_peered":"2024-09-14T10:44:07.302024+0000","last_unstale":"2024-09-14T10:48:12.567720+0000","last_undegraded":"2024-09-14T10:48:12.567720+0000","last_fullsized":"2024-09-14T10:48:12.567720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:12.567361+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.567361+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:57.983269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.581742+0000","last_change":"2024-09-14T10:47:58.581615+0000","last_active":"2024-09-14T10:47:58.581742+0000","last_peered":"2024-09-14T10:47:58.581742+0000","last_clean":"2024-09-14T10:47:58.581742+0000","last_became_active":"2024-09-14T10:43:55.456232+0000","last_became_peered":"2024-09-14T10:43:55.456232+0000","last_unstale":"2024-09-14T10:47:58.581742+0000","last_undegraded":"2024-09-14T10:47:58.581742+0000","last_fullsized":"2024-09-14T10:47:58.581742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:58.581432+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.581432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:45.392307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013151860000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.414030+0000","last_change":"2024-09-14T10:48:01.413761+0000","last_active":"2024-09-14T10:48:01.414030+0000","last_peered":"2024-09-14T10:48:01.414030+0000","last_clean":"2024-09-14T10:48:01.414030+0000","last_became_active":"2024-09-14T10:44:05.312992+0000","last_became_peered":"2024-09-14T10:44:05.312992+0000","last_unstale":"2024-09-14T10:48:01.414030+0000","last_undegraded":"2024-09-14T10:48:01.414030+0000","last_fullsized":"2024-09-14T10:48:01.414030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.413492+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.413492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.502183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:26.642698+0000","last_change":"2024-09-14T10:48:26.642521+0000","last_active":"2024-09-14T10:48:26.642698+0000","last_peered":"2024-09-14T10:48:26.642698+0000","last_clean":"2024-09-14T10:48:26.642698+0000","last_became_active":"2024-09-14T10:44:09.314261+0000","last_became_peered":"2024-09-14T10:44:09.314261+0000","last_unstale":"2024-09-14T10:48:26.642698+0000","last_undegraded":"2024-09-14T10:48:26.642698+0000","last_fullsized":"2024-09-14T10:48:26.642698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:26.642330+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:26.642330+0000","last_clean_scrub_stamp":"2024-09-14T10:48:26.642330+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:19.213154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'25","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.571067+0000","last_change":"2024-09-14T10:48:32.571067+0000","last_active":"2024-09-14T10:48:32.571067+0000","last_peered":"2024-09-14T10:48:32.571067+0000","last_clean":"2024-09-14T10:48:32.571067+0000","last_became_active":"2024-09-14T10:44:11.339122+0000","last_became_peered":"2024-09-14T10:44:11.339122+0000","last_unstale":"2024-09-14T10:48:32.571067+0000","last_undegraded":"2024-09-14T10:48:32.571067+0000","last_fullsized":"2024-09-14T10:48:32.571067+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'25","last_scrub_stamp":"2024-09-14T10:48:32.570846+0000","last_deep_scrub":"34'25","last_deep_scrub_stamp":"2024-09-14T10:48:32.570846+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.570846+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:53:30.502745+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.520232+0000","last_change":"2024-09-14T10:48:41.520232+0000","last_active":"2024-09-14T10:48:41.520232+0000","last_peered":"2024-09-14T10:48:41.520232+0000","last_clean":"2024-09-14T10:48:41.520232+0000","last_became_active":"2024-09-14T10:44:13.370577+0000","last_became_peered":"2024-09-14T10:44:13.370577+0000","last_unstale":"2024-09-14T10:48:41.520232+0000","last_undegraded":"2024-09-14T10:48:41.520232+0000","last_fullsized":"2024-09-14T10:48:41.520232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:41.520044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:41.520044+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.520044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:23.047617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:15.783267+0000","last_change":"2024-09-14T10:49:15.783267+0000","last_active":"2024-09-14T10:49:15.783267+0000","last_peered":"2024-09-14T10:49:15.783267+0000","last_clean":"2024-09-14T10:49:15.783267+0000","last_became_active":"2024-09-14T10:44:15.378616+0000","last_became_peered":"2024-09-14T10:44:15.378616+0000","last_unstale":"2024-09-14T10:49:15.783267+0000","last_undegraded":"2024-09-14T10:49:15.783267+0000","last_fullsized":"2024-09-14T10:49:15.783267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:15.783085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:15.783085+0000","last_clean_scrub_stamp":"2024-09-14T10:49:15.783085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:39.100338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.613733+0000","last_change":"2024-09-14T10:48:13.613570+0000","last_active":"2024-09-14T10:48:13.613733+0000","last_peered":"2024-09-14T10:48:13.613733+0000","last_clean":"2024-09-14T10:48:13.613733+0000","last_became_active":"2024-09-14T10:44:07.305707+0000","last_became_peered":"2024-09-14T10:44:07.305707+0000","last_unstale":"2024-09-14T10:48:13.613733+0000","last_undegraded":"2024-09-14T10:48:13.613733+0000","last_fullsized":"2024-09-14T10:48:13.613733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:13.613391+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.613391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:50.163937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.149492+0000","last_change":"2024-09-14T10:47:58.149312+0000","last_active":"2024-09-14T10:47:58.149492+0000","last_peered":"2024-09-14T10:47:58.149492+0000","last_clean":"2024-09-14T10:47:58.149492+0000","last_became_active":"2024-09-14T10:43:55.457843+0000","last_became_peered":"2024-09-14T10:43:55.457843+0000","last_unstale":"2024-09-14T10:47:58.149492+0000","last_undegraded":"2024-09-14T10:47:58.149492+0000","last_fullsized":"2024-09-14T10:47:58.149492+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:47:58.149127+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.149127+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:37.977768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002249493,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.572653+0000","last_change":"2024-09-14T10:48:00.572497+0000","last_active":"2024-09-14T10:48:00.572653+0000","last_peered":"2024-09-14T10:48:00.572653+0000","last_clean":"2024-09-14T10:48:00.572653+0000","last_became_active":"2024-09-14T10:44:05.314326+0000","last_became_peered":"2024-09-14T10:44:05.314326+0000","last_unstale":"2024-09-14T10:48:00.572653+0000","last_undegraded":"2024-09-14T10:48:00.572653+0000","last_fullsized":"2024-09-14T10:48:00.572653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:00.572309+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.572309+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:24.566081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.559461+0000","last_change":"2024-09-14T10:48:23.559461+0000","last_active":"2024-09-14T10:48:23.559461+0000","last_peered":"2024-09-14T10:48:23.559461+0000","last_clean":"2024-09-14T10:48:23.559461+0000","last_became_active":"2024-09-14T10:44:09.321524+0000","last_became_peered":"2024-09-14T10:44:09.321524+0000","last_unstale":"2024-09-14T10:48:23.559461+0000","last_undegraded":"2024-09-14T10:48:23.559461+0000","last_fullsized":"2024-09-14T10:48:23.559461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:23.559204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:23.559204+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.559204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:28.629556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.694473+0000","last_change":"2024-09-14T10:48:53.694473+0000","last_active":"2024-09-14T10:48:53.694473+0000","last_peered":"2024-09-14T10:48:53.694473+0000","last_clean":"2024-09-14T10:48:53.694473+0000","last_became_active":"2024-09-14T10:44:11.361761+0000","last_became_peered":"2024-09-14T10:44:11.361761+0000","last_unstale":"2024-09-14T10:48:53.694473+0000","last_undegraded":"2024-09-14T10:48:53.694473+0000","last_fullsized":"2024-09-14T10:48:53.694473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-14T10:48:53.694274+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-14T10:48:53.694274+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.694274+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:45.043117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:06.649907+0000","last_change":"2024-09-14T10:49:06.649907+0000","last_active":"2024-09-14T10:49:06.649907+0000","last_peered":"2024-09-14T10:49:06.649907+0000","last_clean":"2024-09-14T10:49:06.649907+0000","last_became_active":"2024-09-14T10:44:13.368358+0000","last_became_peered":"2024-09-14T10:44:13.368358+0000","last_unstale":"2024-09-14T10:49:06.649907+0000","last_undegraded":"2024-09-14T10:49:06.649907+0000","last_fullsized":"2024-09-14T10:49:06.649907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.649694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.649694+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.649694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:08.973745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:53.717566+0000","last_change":"2024-09-14T10:48:53.717566+0000","last_active":"2024-09-14T10:48:53.717566+0000","last_peered":"2024-09-14T10:48:53.717566+0000","last_clean":"2024-09-14T10:48:53.717566+0000","last_became_active":"2024-09-14T10:44:15.381378+0000","last_became_peered":"2024-09-14T10:44:15.381378+0000","last_unstale":"2024-09-14T10:48:53.717566+0000","last_undegraded":"2024-09-14T10:48:53.717566+0000","last_fullsized":"2024-09-14T10:48:53.717566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:53.717357+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:53.717357+0000","last_clean_scrub_stamp":"2024-09-14T10:48:53.717357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:42.759549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.468843+0000","last_change":"2024-09-14T10:48:11.468705+0000","last_active":"2024-09-14T10:48:11.468843+0000","last_peered":"2024-09-14T10:48:11.468843+0000","last_clean":"2024-09-14T10:48:11.468843+0000","last_became_active":"2024-09-14T10:44:07.314238+0000","last_became_peered":"2024-09-14T10:44:07.314238+0000","last_unstale":"2024-09-14T10:48:11.468843+0000","last_undegraded":"2024-09-14T10:48:11.468843+0000","last_fullsized":"2024-09-14T10:48:11.468843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:11.468533+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.468533+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:45.152569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.623568+0000","last_change":"2024-09-14T10:47:57.623416+0000","last_active":"2024-09-14T10:47:57.623568+0000","last_peered":"2024-09-14T10:47:57.623568+0000","last_clean":"2024-09-14T10:47:57.623568+0000","last_became_active":"2024-09-14T10:44:05.317067+0000","last_became_peered":"2024-09-14T10:44:05.317067+0000","last_unstale":"2024-09-14T10:47:57.623568+0000","last_undegraded":"2024-09-14T10:47:57.623568+0000","last_fullsized":"2024-09-14T10:47:57.623568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:57.623229+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.623229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:32.565978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:57.487932+0000","last_change":"2024-09-14T10:47:57.487828+0000","last_active":"2024-09-14T10:47:57.487932+0000","last_peered":"2024-09-14T10:47:57.487932+0000","last_clean":"2024-09-14T10:47:57.487932+0000","last_became_active":"2024-09-14T10:43:55.460624+0000","last_became_peered":"2024-09-14T10:43:55.460624+0000","last_unstale":"2024-09-14T10:47:57.487932+0000","last_undegraded":"2024-09-14T10:47:57.487932+0000","last_fullsized":"2024-09-14T10:47:57.487932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:57.487712+0000","last_clean_scrub_stamp":"2024-09-14T10:47:57.487712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:43.722639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001002731,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:25.624258+0000","last_change":"2024-09-14T10:48:25.624110+0000","last_active":"2024-09-14T10:48:25.624258+0000","last_peered":"2024-09-14T10:48:25.624258+0000","last_clean":"2024-09-14T10:48:25.624258+0000","last_became_active":"2024-09-14T10:44:44.454694+0000","last_became_peered":"2024-09-14T10:44:44.454694+0000","last_unstale":"2024-09-14T10:48:25.624258+0000","last_undegraded":"2024-09-14T10:48:25.624258+0000","last_fullsized":"2024-09-14T10:48:25.624258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:25.623922+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:25.623922+0000","last_clean_scrub_stamp":"2024-09-14T10:48:25.623922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:39.508678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'77","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:32.611378+0000","last_change":"2024-09-14T10:48:32.611378+0000","last_active":"2024-09-14T10:48:32.611378+0000","last_peered":"2024-09-14T10:48:32.611378+0000","last_clean":"2024-09-14T10:48:32.611378+0000","last_became_active":"2024-09-14T10:44:11.325437+0000","last_became_peered":"2024-09-14T10:44:11.325437+0000","last_unstale":"2024-09-14T10:48:32.611378+0000","last_undegraded":"2024-09-14T10:48:32.611378+0000","last_fullsized":"2024-09-14T10:48:32.611378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'77","last_scrub_stamp":"2024-09-14T10:48:32.611179+0000","last_deep_scrub":"34'77","last_deep_scrub_stamp":"2024-09-14T10:48:32.611179+0000","last_clean_scrub_stamp":"2024-09-14T10:48:32.611179+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.807488+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.425772+0000","last_change":"2024-09-14T10:48:38.425772+0000","last_active":"2024-09-14T10:48:38.425772+0000","last_peered":"2024-09-14T10:48:38.425772+0000","last_clean":"2024-09-14T10:48:38.425772+0000","last_became_active":"2024-09-14T10:44:13.362371+0000","last_became_peered":"2024-09-14T10:44:13.362371+0000","last_unstale":"2024-09-14T10:48:38.425772+0000","last_undegraded":"2024-09-14T10:48:38.425772+0000","last_fullsized":"2024-09-14T10:48:38.425772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:38.425580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:38.425580+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.425580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:05.797956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'9","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:55.716129+0000","last_change":"2024-09-14T10:48:55.716129+0000","last_active":"2024-09-14T10:48:55.716129+0000","last_peered":"2024-09-14T10:48:55.716129+0000","last_clean":"2024-09-14T10:48:55.716129+0000","last_became_active":"2024-09-14T10:44:15.379193+0000","last_became_peered":"2024-09-14T10:44:15.379193+0000","last_unstale":"2024-09-14T10:48:55.716129+0000","last_undegraded":"2024-09-14T10:48:55.716129+0000","last_fullsized":"2024-09-14T10:48:55.716129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:55.715943+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:55.715943+0000","last_clean_scrub_stamp":"2024-09-14T10:48:55.715943+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:37.863971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:12.481717+0000","last_change":"2024-09-14T10:48:12.481545+0000","last_active":"2024-09-14T10:48:12.481717+0000","last_peered":"2024-09-14T10:48:12.481717+0000","last_clean":"2024-09-14T10:48:12.481717+0000","last_became_active":"2024-09-14T10:44:07.318281+0000","last_became_peered":"2024-09-14T10:44:07.318281+0000","last_unstale":"2024-09-14T10:48:12.481717+0000","last_undegraded":"2024-09-14T10:48:12.481717+0000","last_fullsized":"2024-09-14T10:48:12.481717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:12.481368+0000","last_clean_scrub_stamp":"2024-09-14T10:48:12.481368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.388398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.477560+0000","last_change":"2024-09-14T10:47:58.477358+0000","last_active":"2024-09-14T10:47:58.477560+0000","last_peered":"2024-09-14T10:47:58.477560+0000","last_clean":"2024-09-14T10:47:58.477560+0000","last_became_active":"2024-09-14T10:44:05.321701+0000","last_became_peered":"2024-09-14T10:44:05.321701+0000","last_unstale":"2024-09-14T10:47:58.477560+0000","last_undegraded":"2024-09-14T10:47:58.477560+0000","last_fullsized":"2024-09-14T10:47:58.477560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:47:58.477145+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.477145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.383210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.998360+0000","last_change":"2024-09-14T10:48:03.998223+0000","last_active":"2024-09-14T10:48:03.998360+0000","last_peered":"2024-09-14T10:48:03.998360+0000","last_clean":"2024-09-14T10:48:03.998360+0000","last_became_active":"2024-09-14T10:43:55.459178+0000","last_became_peered":"2024-09-14T10:43:55.459178+0000","last_unstale":"2024-09-14T10:48:03.998360+0000","last_undegraded":"2024-09-14T10:48:03.998360+0000","last_fullsized":"2024-09-14T10:48:03.998360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:03.998046+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.998046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:28.536432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00096142999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.728758+0000","last_change":"2024-09-14T10:48:45.728758+0000","last_active":"2024-09-14T10:48:45.728758+0000","last_peered":"2024-09-14T10:48:45.728758+0000","last_clean":"2024-09-14T10:48:45.728758+0000","last_became_active":"2024-09-14T10:44:09.331894+0000","last_became_peered":"2024-09-14T10:44:09.331894+0000","last_unstale":"2024-09-14T10:48:45.728758+0000","last_undegraded":"2024-09-14T10:48:45.728758+0000","last_fullsized":"2024-09-14T10:48:45.728758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:45.728586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:45.728586+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.728586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:21.992740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.550457+0000","last_change":"2024-09-14T10:48:38.550457+0000","last_active":"2024-09-14T10:48:38.550457+0000","last_peered":"2024-09-14T10:48:38.550457+0000","last_clean":"2024-09-14T10:48:38.550457+0000","last_became_active":"2024-09-14T10:44:11.333751+0000","last_became_peered":"2024-09-14T10:44:11.333751+0000","last_unstale":"2024-09-14T10:48:38.550457+0000","last_undegraded":"2024-09-14T10:48:38.550457+0000","last_fullsized":"2024-09-14T10:48:38.550457+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-14T10:48:38.550231+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-14T10:48:38.550231+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.550231+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:25.910802+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.677575+0000","last_change":"2024-09-14T10:48:45.677575+0000","last_active":"2024-09-14T10:48:45.677575+0000","last_peered":"2024-09-14T10:48:45.677575+0000","last_clean":"2024-09-14T10:48:45.677575+0000","last_became_active":"2024-09-14T10:44:13.352827+0000","last_became_peered":"2024-09-14T10:44:13.352827+0000","last_unstale":"2024-09-14T10:48:45.677575+0000","last_undegraded":"2024-09-14T10:48:45.677575+0000","last_fullsized":"2024-09-14T10:48:45.677575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:45.677384+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:45.677384+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.677384+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:51.575023+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:12.716190+0000","last_change":"2024-09-14T10:49:12.716190+0000","last_active":"2024-09-14T10:49:12.716190+0000","last_peered":"2024-09-14T10:49:12.716190+0000","last_clean":"2024-09-14T10:49:12.716190+0000","last_became_active":"2024-09-14T10:44:15.370787+0000","last_became_peered":"2024-09-14T10:44:15.370787+0000","last_unstale":"2024-09-14T10:49:12.716190+0000","last_undegraded":"2024-09-14T10:49:12.716190+0000","last_fullsized":"2024-09-14T10:49:12.716190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:12.716008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:12.716008+0000","last_clean_scrub_stamp":"2024-09-14T10:49:12.716008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:50.925067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.929810+0000","last_change":"2024-09-14T10:48:24.929810+0000","last_active":"2024-09-14T10:48:24.929810+0000","last_peered":"2024-09-14T10:48:24.929810+0000","last_clean":"2024-09-14T10:48:24.929810+0000","last_became_active":"2024-09-14T10:44:07.308952+0000","last_became_peered":"2024-09-14T10:44:07.308952+0000","last_unstale":"2024-09-14T10:48:24.929810+0000","last_undegraded":"2024-09-14T10:48:24.929810+0000","last_fullsized":"2024-09-14T10:48:24.929810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:24.929616+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:24.929616+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.929616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:39.211133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.041432+0000","last_change":"2024-09-14T10:48:06.041282+0000","last_active":"2024-09-14T10:48:06.041432+0000","last_peered":"2024-09-14T10:48:06.041432+0000","last_clean":"2024-09-14T10:48:06.041432+0000","last_became_active":"2024-09-14T10:44:05.312536+0000","last_became_peered":"2024-09-14T10:44:05.312536+0000","last_unstale":"2024-09-14T10:48:06.041432+0000","last_undegraded":"2024-09-14T10:48:06.041432+0000","last_fullsized":"2024-09-14T10:48:06.041432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.041120+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.041120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:55.979958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:56.524180+0000","last_change":"2024-09-14T10:47:56.524057+0000","last_active":"2024-09-14T10:47:56.524180+0000","last_peered":"2024-09-14T10:47:56.524180+0000","last_clean":"2024-09-14T10:47:56.524180+0000","last_became_active":"2024-09-14T10:43:55.458154+0000","last_became_peered":"2024-09-14T10:43:55.458154+0000","last_unstale":"2024-09-14T10:47:56.524180+0000","last_undegraded":"2024-09-14T10:47:56.524180+0000","last_fullsized":"2024-09-14T10:47:56.524180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:47:56.523860+0000","last_clean_scrub_stamp":"2024-09-14T10:47:56.523860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:01.837471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001029145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.694914+0000","last_change":"2024-09-14T10:48:44.694914+0000","last_active":"2024-09-14T10:48:44.694914+0000","last_peered":"2024-09-14T10:48:44.694914+0000","last_clean":"2024-09-14T10:48:44.694914+0000","last_became_active":"2024-09-14T10:44:09.331851+0000","last_became_peered":"2024-09-14T10:44:09.331851+0000","last_unstale":"2024-09-14T10:48:44.694914+0000","last_undegraded":"2024-09-14T10:48:44.694914+0000","last_fullsized":"2024-09-14T10:48:44.694914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.694737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.694737+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.694737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:48.362904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:52.717581+0000","last_change":"2024-09-14T10:48:52.717581+0000","last_active":"2024-09-14T10:48:52.717581+0000","last_peered":"2024-09-14T10:48:52.717581+0000","last_clean":"2024-09-14T10:48:52.717581+0000","last_became_active":"2024-09-14T10:44:11.359631+0000","last_became_peered":"2024-09-14T10:44:11.359631+0000","last_unstale":"2024-09-14T10:48:52.717581+0000","last_undegraded":"2024-09-14T10:48:52.717581+0000","last_fullsized":"2024-09-14T10:48:52.717581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-14T10:48:52.717383+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-14T10:48:52.717383+0000","last_clean_scrub_stamp":"2024-09-14T10:48:52.717383+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:24.329304+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":432,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:40.565178+0000","last_change":"2024-09-14T10:48:40.565178+0000","last_active":"2024-09-14T10:48:40.565178+0000","last_peered":"2024-09-14T10:48:40.565178+0000","last_clean":"2024-09-14T10:48:40.565178+0000","last_became_active":"2024-09-14T10:44:13.348863+0000","last_became_peered":"2024-09-14T10:44:13.348863+0000","last_unstale":"2024-09-14T10:48:40.565178+0000","last_undegraded":"2024-09-14T10:48:40.565178+0000","last_fullsized":"2024-09-14T10:48:40.565178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:40.564999+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:40.564999+0000","last_clean_scrub_stamp":"2024-09-14T10:48:40.564999+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:30.676479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'7","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:55.711758+0000","last_change":"2024-09-14T10:48:55.711758+0000","last_active":"2024-09-14T10:48:55.711758+0000","last_peered":"2024-09-14T10:48:55.711758+0000","last_clean":"2024-09-14T10:48:55.711758+0000","last_became_active":"2024-09-14T10:44:15.379452+0000","last_became_peered":"2024-09-14T10:44:15.379452+0000","last_unstale":"2024-09-14T10:48:55.711758+0000","last_undegraded":"2024-09-14T10:48:55.711758+0000","last_fullsized":"2024-09-14T10:48:55.711758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-14T10:48:55.711503+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-14T10:48:55.711503+0000","last_clean_scrub_stamp":"2024-09-14T10:48:55.711503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:20.209155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.839501+0000","last_change":"2024-09-14T10:48:11.839361+0000","last_active":"2024-09-14T10:48:11.839501+0000","last_peered":"2024-09-14T10:48:11.839501+0000","last_clean":"2024-09-14T10:48:11.839501+0000","last_became_active":"2024-09-14T10:44:07.314596+0000","last_became_peered":"2024-09-14T10:44:07.314596+0000","last_unstale":"2024-09-14T10:48:11.839501+0000","last_undegraded":"2024-09-14T10:48:11.839501+0000","last_fullsized":"2024-09-14T10:48:11.839501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:11.839181+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.839181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:55.359032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:58.217592+0000","last_change":"2024-09-14T10:47:58.217454+0000","last_active":"2024-09-14T10:47:58.217592+0000","last_peered":"2024-09-14T10:47:58.217592+0000","last_clean":"2024-09-14T10:47:58.217592+0000","last_became_active":"2024-09-14T10:44:05.319974+0000","last_became_peered":"2024-09-14T10:44:05.319974+0000","last_unstale":"2024-09-14T10:47:58.217592+0000","last_undegraded":"2024-09-14T10:47:58.217592+0000","last_fullsized":"2024-09-14T10:47:58.217592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:47:58.217266+0000","last_clean_scrub_stamp":"2024-09-14T10:47:58.217266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:03.530877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.067246+0000","last_change":"2024-09-14T10:48:01.067081+0000","last_active":"2024-09-14T10:48:01.067246+0000","last_peered":"2024-09-14T10:48:01.067246+0000","last_clean":"2024-09-14T10:48:01.067246+0000","last_became_active":"2024-09-14T10:43:56.092901+0000","last_became_peered":"2024-09-14T10:43:56.092901+0000","last_unstale":"2024-09-14T10:48:01.067246+0000","last_undegraded":"2024-09-14T10:48:01.067246+0000","last_fullsized":"2024-09-14T10:48:01.067246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:01.066905+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.066905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:15.602397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028626480000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.692185+0000","last_change":"2024-09-14T10:48:43.692185+0000","last_active":"2024-09-14T10:48:43.692185+0000","last_peered":"2024-09-14T10:48:43.692185+0000","last_clean":"2024-09-14T10:48:43.692185+0000","last_became_active":"2024-09-14T10:44:09.333054+0000","last_became_peered":"2024-09-14T10:44:09.333054+0000","last_unstale":"2024-09-14T10:48:43.692185+0000","last_undegraded":"2024-09-14T10:48:43.692185+0000","last_fullsized":"2024-09-14T10:48:43.692185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.692008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.692008+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.692008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:45.530106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'100","reported_seq":194,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:33.534479+0000","last_change":"2024-09-14T10:48:33.534479+0000","last_active":"2024-09-14T10:48:33.534479+0000","last_peered":"2024-09-14T10:48:33.534479+0000","last_clean":"2024-09-14T10:48:33.534479+0000","last_became_active":"2024-09-14T10:44:11.358229+0000","last_became_peered":"2024-09-14T10:44:11.358229+0000","last_unstale":"2024-09-14T10:48:33.534479+0000","last_undegraded":"2024-09-14T10:48:33.534479+0000","last_fullsized":"2024-09-14T10:48:33.534479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'100","last_scrub_stamp":"2024-09-14T10:48:33.534256+0000","last_deep_scrub":"34'100","last_deep_scrub_stamp":"2024-09-14T10:48:33.534256+0000","last_clean_scrub_stamp":"2024-09-14T10:48:33.534256+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:30.978930+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.621964+0000","last_change":"2024-09-14T10:48:38.621964+0000","last_active":"2024-09-14T10:48:38.621964+0000","last_peered":"2024-09-14T10:48:38.621964+0000","last_clean":"2024-09-14T10:48:38.621964+0000","last_became_active":"2024-09-14T10:44:13.360539+0000","last_became_peered":"2024-09-14T10:44:13.360539+0000","last_unstale":"2024-09-14T10:48:38.621964+0000","last_undegraded":"2024-09-14T10:48:38.621964+0000","last_fullsized":"2024-09-14T10:48:38.621964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:38.621875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:38.621875+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.621875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:02.948854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.481579+0000","last_change":"2024-09-14T10:48:48.481579+0000","last_active":"2024-09-14T10:48:48.481579+0000","last_peered":"2024-09-14T10:48:48.481579+0000","last_clean":"2024-09-14T10:48:48.481579+0000","last_became_active":"2024-09-14T10:44:15.375430+0000","last_became_peered":"2024-09-14T10:44:15.375430+0000","last_unstale":"2024-09-14T10:48:48.481579+0000","last_undegraded":"2024-09-14T10:48:48.481579+0000","last_fullsized":"2024-09-14T10:48:48.481579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:48.481360+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:48.481360+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.481360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:00.754346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.465376+0000","last_change":"2024-09-14T10:48:50.465376+0000","last_active":"2024-09-14T10:48:50.465376+0000","last_peered":"2024-09-14T10:48:50.465376+0000","last_clean":"2024-09-14T10:48:50.465376+0000","last_became_active":"2024-09-14T10:44:15.381153+0000","last_became_peered":"2024-09-14T10:44:15.381153+0000","last_unstale":"2024-09-14T10:48:50.465376+0000","last_undegraded":"2024-09-14T10:48:50.465376+0000","last_fullsized":"2024-09-14T10:48:50.465376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:50.465198+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:50.465198+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.465198+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:19.453603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.749236+0000","last_change":"2024-09-14T10:48:16.748979+0000","last_active":"2024-09-14T10:48:16.749236+0000","last_peered":"2024-09-14T10:48:16.749236+0000","last_clean":"2024-09-14T10:48:16.749236+0000","last_became_active":"2024-09-14T10:44:07.314321+0000","last_became_peered":"2024-09-14T10:44:07.314321+0000","last_unstale":"2024-09-14T10:48:16.749236+0000","last_undegraded":"2024-09-14T10:48:16.749236+0000","last_fullsized":"2024-09-14T10:48:16.749236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:16.748707+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:16.748707+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.748707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:29.127800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:11.979894+0000","last_change":"2024-09-14T10:48:11.979725+0000","last_active":"2024-09-14T10:48:11.979894+0000","last_peered":"2024-09-14T10:48:11.979894+0000","last_clean":"2024-09-14T10:48:11.979894+0000","last_became_active":"2024-09-14T10:44:05.312599+0000","last_became_peered":"2024-09-14T10:44:05.312599+0000","last_unstale":"2024-09-14T10:48:11.979894+0000","last_undegraded":"2024-09-14T10:48:11.979894+0000","last_fullsized":"2024-09-14T10:48:11.979894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:11.979551+0000","last_clean_scrub_stamp":"2024-09-14T10:48:11.979551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:25.927244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.549319+0000","last_change":"2024-09-14T10:48:34.549173+0000","last_active":"2024-09-14T10:48:34.549319+0000","last_peered":"2024-09-14T10:48:34.549319+0000","last_clean":"2024-09-14T10:48:34.549319+0000","last_became_active":"2024-09-14T10:44:09.319348+0000","last_became_peered":"2024-09-14T10:44:09.319348+0000","last_unstale":"2024-09-14T10:48:34.549319+0000","last_undegraded":"2024-09-14T10:48:34.549319+0000","last_fullsized":"2024-09-14T10:48:34.549319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:34.548997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:34.548997+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.548997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:34.500266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:59.752796+0000","last_change":"2024-09-14T10:48:59.752796+0000","last_active":"2024-09-14T10:48:59.752796+0000","last_peered":"2024-09-14T10:48:59.752796+0000","last_clean":"2024-09-14T10:48:59.752796+0000","last_became_active":"2024-09-14T10:44:11.352989+0000","last_became_peered":"2024-09-14T10:44:11.352989+0000","last_unstale":"2024-09-14T10:48:59.752796+0000","last_undegraded":"2024-09-14T10:48:59.752796+0000","last_fullsized":"2024-09-14T10:48:59.752796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-14T10:48:59.752606+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-14T10:48:59.752606+0000","last_clean_scrub_stamp":"2024-09-14T10:48:59.752606+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:39.741730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:07.680821+0000","last_change":"2024-09-14T10:49:07.680821+0000","last_active":"2024-09-14T10:49:07.680821+0000","last_peered":"2024-09-14T10:49:07.680821+0000","last_clean":"2024-09-14T10:49:07.680821+0000","last_became_active":"2024-09-14T10:44:13.369607+0000","last_became_peered":"2024-09-14T10:44:13.369607+0000","last_unstale":"2024-09-14T10:49:07.680821+0000","last_undegraded":"2024-09-14T10:49:07.680821+0000","last_fullsized":"2024-09-14T10:49:07.680821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:07.680615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:07.680615+0000","last_clean_scrub_stamp":"2024-09-14T10:49:07.680615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:36.921373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:58.648532+0000","last_change":"2024-09-14T10:48:58.648532+0000","last_active":"2024-09-14T10:48:58.648532+0000","last_peered":"2024-09-14T10:48:58.648532+0000","last_clean":"2024-09-14T10:48:58.648532+0000","last_became_active":"2024-09-14T10:44:15.361287+0000","last_became_peered":"2024-09-14T10:44:15.361287+0000","last_unstale":"2024-09-14T10:48:58.648532+0000","last_undegraded":"2024-09-14T10:48:58.648532+0000","last_fullsized":"2024-09-14T10:48:58.648532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:58.648352+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:58.648352+0000","last_clean_scrub_stamp":"2024-09-14T10:48:58.648352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:15.101235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.470865+0000","last_change":"2024-09-14T10:48:16.470720+0000","last_active":"2024-09-14T10:48:16.470865+0000","last_peered":"2024-09-14T10:48:16.470865+0000","last_clean":"2024-09-14T10:48:16.470865+0000","last_became_active":"2024-09-14T10:44:44.459047+0000","last_became_peered":"2024-09-14T10:44:44.459047+0000","last_unstale":"2024-09-14T10:48:16.470865+0000","last_undegraded":"2024-09-14T10:48:16.470865+0000","last_fullsized":"2024-09-14T10:48:16.470865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:16.470534+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:16.470534+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.470534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:20.092198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.594514+0000","last_change":"2024-09-14T10:48:02.594367+0000","last_active":"2024-09-14T10:48:02.594514+0000","last_peered":"2024-09-14T10:48:02.594514+0000","last_clean":"2024-09-14T10:48:02.594514+0000","last_became_active":"2024-09-14T10:44:05.319747+0000","last_became_peered":"2024-09-14T10:44:05.319747+0000","last_unstale":"2024-09-14T10:48:02.594514+0000","last_undegraded":"2024-09-14T10:48:02.594514+0000","last_fullsized":"2024-09-14T10:48:02.594514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:02.594183+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.594183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.132926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.676176+0000","last_change":"2024-09-14T10:48:49.676176+0000","last_active":"2024-09-14T10:48:49.676176+0000","last_peered":"2024-09-14T10:48:49.676176+0000","last_clean":"2024-09-14T10:48:49.676176+0000","last_became_active":"2024-09-14T10:44:44.462292+0000","last_became_peered":"2024-09-14T10:44:44.462292+0000","last_unstale":"2024-09-14T10:48:49.676176+0000","last_undegraded":"2024-09-14T10:48:49.676176+0000","last_fullsized":"2024-09-14T10:48:49.676176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.675950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.675950+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.675950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:38.224806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.610556+0000","last_change":"2024-09-14T10:48:34.610413+0000","last_active":"2024-09-14T10:48:34.610556+0000","last_peered":"2024-09-14T10:48:34.610556+0000","last_clean":"2024-09-14T10:48:34.610556+0000","last_became_active":"2024-09-14T10:44:11.322797+0000","last_became_peered":"2024-09-14T10:44:11.322797+0000","last_unstale":"2024-09-14T10:48:34.610556+0000","last_undegraded":"2024-09-14T10:48:34.610556+0000","last_fullsized":"2024-09-14T10:48:34.610556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-14T10:48:34.610221+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-14T10:48:34.610221+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.610221+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:42.868537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:42.492445+0000","last_change":"2024-09-14T10:48:42.492309+0000","last_active":"2024-09-14T10:48:42.492445+0000","last_peered":"2024-09-14T10:48:42.492445+0000","last_clean":"2024-09-14T10:48:42.492445+0000","last_became_active":"2024-09-14T10:44:13.371279+0000","last_became_peered":"2024-09-14T10:44:13.371279+0000","last_unstale":"2024-09-14T10:48:42.492445+0000","last_undegraded":"2024-09-14T10:48:42.492445+0000","last_fullsized":"2024-09-14T10:48:42.492445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:42.492140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:42.492140+0000","last_clean_scrub_stamp":"2024-09-14T10:48:42.492140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:51:31.192955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:57.696454+0000","last_change":"2024-09-14T10:48:57.696288+0000","last_active":"2024-09-14T10:48:57.696454+0000","last_peered":"2024-09-14T10:48:57.696454+0000","last_clean":"2024-09-14T10:48:57.696454+0000","last_became_active":"2024-09-14T10:44:15.385858+0000","last_became_peered":"2024-09-14T10:44:15.385858+0000","last_unstale":"2024-09-14T10:48:57.696454+0000","last_undegraded":"2024-09-14T10:48:57.696454+0000","last_fullsized":"2024-09-14T10:48:57.696454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:57.696109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:57.696109+0000","last_clean_scrub_stamp":"2024-09-14T10:48:57.696109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:11.570223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.626201+0000","last_change":"2024-09-14T10:48:14.626010+0000","last_active":"2024-09-14T10:48:14.626201+0000","last_peered":"2024-09-14T10:48:14.626201+0000","last_clean":"2024-09-14T10:48:14.626201+0000","last_became_active":"2024-09-14T10:44:07.316131+0000","last_became_peered":"2024-09-14T10:44:07.316131+0000","last_unstale":"2024-09-14T10:48:14.626201+0000","last_undegraded":"2024-09-14T10:48:14.626201+0000","last_fullsized":"2024-09-14T10:48:14.626201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:14.625832+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.625832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:18.247497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.596198+0000","last_change":"2024-09-14T10:48:04.596063+0000","last_active":"2024-09-14T10:48:04.596198+0000","last_peered":"2024-09-14T10:48:04.596198+0000","last_clean":"2024-09-14T10:48:04.596198+0000","last_became_active":"2024-09-14T10:44:05.321568+0000","last_became_peered":"2024-09-14T10:44:05.321568+0000","last_unstale":"2024-09-14T10:48:04.596198+0000","last_undegraded":"2024-09-14T10:48:04.596198+0000","last_fullsized":"2024-09-14T10:48:04.596198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.595874+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.595874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:58.777417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:28.558337+0000","last_change":"2024-09-14T10:48:28.558189+0000","last_active":"2024-09-14T10:48:28.558337+0000","last_peered":"2024-09-14T10:48:28.558337+0000","last_clean":"2024-09-14T10:48:28.558337+0000","last_became_active":"2024-09-14T10:44:09.317673+0000","last_became_peered":"2024-09-14T10:44:09.317673+0000","last_unstale":"2024-09-14T10:48:28.558337+0000","last_undegraded":"2024-09-14T10:48:28.558337+0000","last_fullsized":"2024-09-14T10:48:28.558337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:28.558009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:28.558009+0000","last_clean_scrub_stamp":"2024-09-14T10:48:28.558009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:34.621600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.612052+0000","last_change":"2024-09-14T10:48:36.611887+0000","last_active":"2024-09-14T10:48:36.612052+0000","last_peered":"2024-09-14T10:48:36.612052+0000","last_clean":"2024-09-14T10:48:36.612052+0000","last_became_active":"2024-09-14T10:44:11.335377+0000","last_became_peered":"2024-09-14T10:44:11.335377+0000","last_unstale":"2024-09-14T10:48:36.612052+0000","last_undegraded":"2024-09-14T10:48:36.612052+0000","last_fullsized":"2024-09-14T10:48:36.612052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-14T10:48:36.611684+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-14T10:48:36.611684+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.611684+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:12.339630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.723368+0000","last_change":"2024-09-14T10:48:47.723250+0000","last_active":"2024-09-14T10:48:47.723368+0000","last_peered":"2024-09-14T10:48:47.723368+0000","last_clean":"2024-09-14T10:48:47.723368+0000","last_became_active":"2024-09-14T10:44:13.353569+0000","last_became_peered":"2024-09-14T10:44:13.353569+0000","last_unstale":"2024-09-14T10:48:47.723368+0000","last_undegraded":"2024-09-14T10:48:47.723368+0000","last_fullsized":"2024-09-14T10:48:47.723368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.723075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.723075+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.723075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:32.907799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:21.771091+0000","last_change":"2024-09-14T10:49:21.771091+0000","last_active":"2024-09-14T10:49:21.771091+0000","last_peered":"2024-09-14T10:49:21.771091+0000","last_clean":"2024-09-14T10:49:21.771091+0000","last_became_active":"2024-09-14T10:44:15.377806+0000","last_became_peered":"2024-09-14T10:44:15.377806+0000","last_unstale":"2024-09-14T10:49:21.771091+0000","last_undegraded":"2024-09-14T10:49:21.771091+0000","last_fullsized":"2024-09-14T10:49:21.771091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:21.770911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:21.770911+0000","last_clean_scrub_stamp":"2024-09-14T10:49:21.770911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:23.532149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.902526+0000","last_change":"2024-09-14T10:48:30.902377+0000","last_active":"2024-09-14T10:48:30.902526+0000","last_peered":"2024-09-14T10:48:30.902526+0000","last_clean":"2024-09-14T10:48:30.902526+0000","last_became_active":"2024-09-14T10:44:07.312525+0000","last_became_peered":"2024-09-14T10:44:07.312525+0000","last_unstale":"2024-09-14T10:48:30.902526+0000","last_undegraded":"2024-09-14T10:48:30.902526+0000","last_fullsized":"2024-09-14T10:48:30.902526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:30.902193+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:30.902193+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.902193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:41.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:00.280343+0000","last_change":"2024-09-14T10:48:00.280211+0000","last_active":"2024-09-14T10:48:00.280343+0000","last_peered":"2024-09-14T10:48:00.280343+0000","last_clean":"2024-09-14T10:48:00.280343+0000","last_became_active":"2024-09-14T10:44:05.315697+0000","last_became_peered":"2024-09-14T10:44:05.315697+0000","last_unstale":"2024-09-14T10:48:00.280343+0000","last_undegraded":"2024-09-14T10:48:00.280343+0000","last_fullsized":"2024-09-14T10:48:00.280343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:00.280016+0000","last_clean_scrub_stamp":"2024-09-14T10:48:00.280016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:02.623876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:48.673942+0000","last_change":"2024-09-14T10:48:48.673806+0000","last_active":"2024-09-14T10:48:48.673942+0000","last_peered":"2024-09-14T10:48:48.673942+0000","last_clean":"2024-09-14T10:48:48.673942+0000","last_became_active":"2024-09-14T10:44:09.334565+0000","last_became_peered":"2024-09-14T10:44:09.334565+0000","last_unstale":"2024-09-14T10:48:48.673942+0000","last_undegraded":"2024-09-14T10:48:48.673942+0000","last_fullsized":"2024-09-14T10:48:48.673942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:48.673623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:48.673623+0000","last_clean_scrub_stamp":"2024-09-14T10:48:48.673623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:12.881111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.430971+0000","last_change":"2024-09-14T10:48:36.430697+0000","last_active":"2024-09-14T10:48:36.430971+0000","last_peered":"2024-09-14T10:48:36.430971+0000","last_clean":"2024-09-14T10:48:36.430971+0000","last_became_active":"2024-09-14T10:44:11.320963+0000","last_became_peered":"2024-09-14T10:44:11.320963+0000","last_unstale":"2024-09-14T10:48:36.430971+0000","last_undegraded":"2024-09-14T10:48:36.430971+0000","last_fullsized":"2024-09-14T10:48:36.430971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-14T10:48:36.430445+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-14T10:48:36.430445+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.430445+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:46.137903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:43.466977+0000","last_change":"2024-09-14T10:48:43.466834+0000","last_active":"2024-09-14T10:48:43.466977+0000","last_peered":"2024-09-14T10:48:43.466977+0000","last_clean":"2024-09-14T10:48:43.466977+0000","last_became_active":"2024-09-14T10:44:13.355592+0000","last_became_peered":"2024-09-14T10:44:13.355592+0000","last_unstale":"2024-09-14T10:48:43.466977+0000","last_undegraded":"2024-09-14T10:48:43.466977+0000","last_fullsized":"2024-09-14T10:48:43.466977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:43.466665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:43.466665+0000","last_clean_scrub_stamp":"2024-09-14T10:48:43.466665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:38.006360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:34.760508+0000","last_change":"2024-09-14T10:48:34.760508+0000","last_active":"2024-09-14T10:48:34.760508+0000","last_peered":"2024-09-14T10:48:34.760508+0000","last_clean":"2024-09-14T10:48:34.760508+0000","last_became_active":"2024-09-14T10:44:07.312403+0000","last_became_peered":"2024-09-14T10:44:07.312403+0000","last_unstale":"2024-09-14T10:48:34.760508+0000","last_undegraded":"2024-09-14T10:48:34.760508+0000","last_fullsized":"2024-09-14T10:48:34.760508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:34.760328+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:34.760328+0000","last_clean_scrub_stamp":"2024-09-14T10:48:34.760328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:30.695415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.008939+0000","last_change":"2024-09-14T10:48:13.008639+0000","last_active":"2024-09-14T10:48:13.008939+0000","last_peered":"2024-09-14T10:48:13.008939+0000","last_clean":"2024-09-14T10:48:13.008939+0000","last_became_active":"2024-09-14T10:44:05.314575+0000","last_became_peered":"2024-09-14T10:44:05.314575+0000","last_unstale":"2024-09-14T10:48:13.008939+0000","last_undegraded":"2024-09-14T10:48:13.008939+0000","last_fullsized":"2024-09-14T10:48:13.008939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.008350+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.008350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:31.362974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.630021+0000","last_change":"2024-09-14T10:48:29.630021+0000","last_active":"2024-09-14T10:48:29.630021+0000","last_peered":"2024-09-14T10:48:29.630021+0000","last_clean":"2024-09-14T10:48:29.630021+0000","last_became_active":"2024-09-14T10:44:09.332339+0000","last_became_peered":"2024-09-14T10:44:09.332339+0000","last_unstale":"2024-09-14T10:48:29.630021+0000","last_undegraded":"2024-09-14T10:48:29.630021+0000","last_fullsized":"2024-09-14T10:48:29.630021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:29.629844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:29.629844+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.629844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:51.400468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'67","reported_seq":141,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:39.587905+0000","last_change":"2024-09-14T10:48:39.587768+0000","last_active":"2024-09-14T10:48:39.587905+0000","last_peered":"2024-09-14T10:48:39.587905+0000","last_clean":"2024-09-14T10:48:39.587905+0000","last_became_active":"2024-09-14T10:44:11.340267+0000","last_became_peered":"2024-09-14T10:44:11.340267+0000","last_unstale":"2024-09-14T10:48:39.587905+0000","last_undegraded":"2024-09-14T10:48:39.587905+0000","last_fullsized":"2024-09-14T10:48:39.587905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'67","last_scrub_stamp":"2024-09-14T10:48:39.587554+0000","last_deep_scrub":"34'67","last_deep_scrub_stamp":"2024-09-14T10:48:39.587554+0000","last_clean_scrub_stamp":"2024-09-14T10:48:39.587554+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:58.893791+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.511570+0000","last_change":"2024-09-14T10:48:44.511426+0000","last_active":"2024-09-14T10:48:44.511570+0000","last_peered":"2024-09-14T10:48:44.511570+0000","last_clean":"2024-09-14T10:48:44.511570+0000","last_became_active":"2024-09-14T10:44:13.356053+0000","last_became_peered":"2024-09-14T10:44:13.356053+0000","last_unstale":"2024-09-14T10:48:44.511570+0000","last_undegraded":"2024-09-14T10:48:44.511570+0000","last_fullsized":"2024-09-14T10:48:44.511570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:44.511202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:44.511202+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.511202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:16.374234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:54.713184+0000","last_change":"2024-09-14T10:48:54.712895+0000","last_active":"2024-09-14T10:48:54.713184+0000","last_peered":"2024-09-14T10:48:54.713184+0000","last_clean":"2024-09-14T10:48:54.713184+0000","last_became_active":"2024-09-14T10:44:15.389312+0000","last_became_peered":"2024-09-14T10:44:15.389312+0000","last_unstale":"2024-09-14T10:48:54.713184+0000","last_undegraded":"2024-09-14T10:48:54.713184+0000","last_fullsized":"2024-09-14T10:48:54.713184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-14T10:48:54.712628+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-14T10:48:54.712628+0000","last_clean_scrub_stamp":"2024-09-14T10:48:54.712628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:19.210280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.496839+0000","last_change":"2024-09-14T10:48:19.496839+0000","last_active":"2024-09-14T10:48:19.496839+0000","last_peered":"2024-09-14T10:48:19.496839+0000","last_clean":"2024-09-14T10:48:19.496839+0000","last_became_active":"2024-09-14T10:44:07.304354+0000","last_became_peered":"2024-09-14T10:44:07.304354+0000","last_unstale":"2024-09-14T10:48:19.496839+0000","last_undegraded":"2024-09-14T10:48:19.496839+0000","last_fullsized":"2024-09-14T10:48:19.496839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:19.496651+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:19.496651+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.496651+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:16.610106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:01.271212+0000","last_change":"2024-09-14T10:48:01.271045+0000","last_active":"2024-09-14T10:48:01.271212+0000","last_peered":"2024-09-14T10:48:01.271212+0000","last_clean":"2024-09-14T10:48:01.271212+0000","last_became_active":"2024-09-14T10:44:05.315916+0000","last_became_peered":"2024-09-14T10:44:05.315916+0000","last_unstale":"2024-09-14T10:48:01.271212+0000","last_undegraded":"2024-09-14T10:48:01.271212+0000","last_fullsized":"2024-09-14T10:48:01.271212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:01.270861+0000","last_clean_scrub_stamp":"2024-09-14T10:48:01.270861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:42.910644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:30.522928+0000","last_change":"2024-09-14T10:48:30.522928+0000","last_active":"2024-09-14T10:48:30.522928+0000","last_peered":"2024-09-14T10:48:30.522928+0000","last_clean":"2024-09-14T10:48:30.522928+0000","last_became_active":"2024-09-14T10:44:09.312125+0000","last_became_peered":"2024-09-14T10:44:09.312125+0000","last_unstale":"2024-09-14T10:48:30.522928+0000","last_undegraded":"2024-09-14T10:48:30.522928+0000","last_fullsized":"2024-09-14T10:48:30.522928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:30.522747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:30.522747+0000","last_clean_scrub_stamp":"2024-09-14T10:48:30.522747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.439750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:03.734741+0000","last_change":"2024-09-14T10:49:03.734604+0000","last_active":"2024-09-14T10:49:03.734741+0000","last_peered":"2024-09-14T10:49:03.734741+0000","last_clean":"2024-09-14T10:49:03.734741+0000","last_became_active":"2024-09-14T10:44:11.356198+0000","last_became_peered":"2024-09-14T10:44:11.356198+0000","last_unstale":"2024-09-14T10:49:03.734741+0000","last_undegraded":"2024-09-14T10:49:03.734741+0000","last_fullsized":"2024-09-14T10:49:03.734741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:49:03.734408+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:49:03.734408+0000","last_clean_scrub_stamp":"2024-09-14T10:49:03.734408+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:03.428618+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:50.741289+0000","last_change":"2024-09-14T10:48:50.741123+0000","last_active":"2024-09-14T10:48:50.741289+0000","last_peered":"2024-09-14T10:48:50.741289+0000","last_clean":"2024-09-14T10:48:50.741289+0000","last_became_active":"2024-09-14T10:44:13.371169+0000","last_became_peered":"2024-09-14T10:44:13.371169+0000","last_unstale":"2024-09-14T10:48:50.741289+0000","last_undegraded":"2024-09-14T10:48:50.741289+0000","last_fullsized":"2024-09-14T10:48:50.741289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:50.740934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:50.740934+0000","last_clean_scrub_stamp":"2024-09-14T10:48:50.740934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:04.688628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:17.777948+0000","last_change":"2024-09-14T10:49:17.777948+0000","last_active":"2024-09-14T10:49:17.777948+0000","last_peered":"2024-09-14T10:49:17.777948+0000","last_clean":"2024-09-14T10:49:17.777948+0000","last_became_active":"2024-09-14T10:44:15.378729+0000","last_became_peered":"2024-09-14T10:44:15.378729+0000","last_unstale":"2024-09-14T10:49:17.777948+0000","last_undegraded":"2024-09-14T10:49:17.777948+0000","last_fullsized":"2024-09-14T10:49:17.777948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:17.777775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:17.777775+0000","last_clean_scrub_stamp":"2024-09-14T10:49:17.777775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:53.259424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.738250+0000","last_change":"2024-09-14T10:48:35.738014+0000","last_active":"2024-09-14T10:48:35.738250+0000","last_peered":"2024-09-14T10:48:35.738250+0000","last_clean":"2024-09-14T10:48:35.738250+0000","last_became_active":"2024-09-14T10:44:07.316896+0000","last_became_peered":"2024-09-14T10:44:07.316896+0000","last_unstale":"2024-09-14T10:48:35.738250+0000","last_undegraded":"2024-09-14T10:48:35.738250+0000","last_fullsized":"2024-09-14T10:48:35.738250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:35.737790+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:35.737790+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.737790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:30.363223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:02.293031+0000","last_change":"2024-09-14T10:48:02.292893+0000","last_active":"2024-09-14T10:48:02.293031+0000","last_peered":"2024-09-14T10:48:02.293031+0000","last_clean":"2024-09-14T10:48:02.293031+0000","last_became_active":"2024-09-14T10:44:05.313765+0000","last_became_peered":"2024-09-14T10:44:05.313765+0000","last_unstale":"2024-09-14T10:48:02.293031+0000","last_undegraded":"2024-09-14T10:48:02.293031+0000","last_fullsized":"2024-09-14T10:48:02.293031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:02.292668+0000","last_clean_scrub_stamp":"2024-09-14T10:48:02.292668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:18.687200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.549567+0000","last_change":"2024-09-14T10:48:31.549300+0000","last_active":"2024-09-14T10:48:31.549567+0000","last_peered":"2024-09-14T10:48:31.549567+0000","last_clean":"2024-09-14T10:48:31.549567+0000","last_became_active":"2024-09-14T10:44:09.315758+0000","last_became_peered":"2024-09-14T10:44:09.315758+0000","last_unstale":"2024-09-14T10:48:31.549567+0000","last_undegraded":"2024-09-14T10:48:31.549567+0000","last_fullsized":"2024-09-14T10:48:31.549567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:31.549097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:31.549097+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.549097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:35.467929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.650518+0000","last_change":"2024-09-14T10:48:37.650518+0000","last_active":"2024-09-14T10:48:37.650518+0000","last_peered":"2024-09-14T10:48:37.650518+0000","last_clean":"2024-09-14T10:48:37.650518+0000","last_became_active":"2024-09-14T10:44:11.329853+0000","last_became_peered":"2024-09-14T10:44:11.329853+0000","last_unstale":"2024-09-14T10:48:37.650518+0000","last_undegraded":"2024-09-14T10:48:37.650518+0000","last_fullsized":"2024-09-14T10:48:37.650518+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-14T10:48:37.650331+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-14T10:48:37.650331+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.650331+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:25.010902+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:51.703578+0000","last_change":"2024-09-14T10:48:51.703578+0000","last_active":"2024-09-14T10:48:51.703578+0000","last_peered":"2024-09-14T10:48:51.703578+0000","last_clean":"2024-09-14T10:48:51.703578+0000","last_became_active":"2024-09-14T10:44:13.363588+0000","last_became_peered":"2024-09-14T10:44:13.363588+0000","last_unstale":"2024-09-14T10:48:51.703578+0000","last_undegraded":"2024-09-14T10:48:51.703578+0000","last_fullsized":"2024-09-14T10:48:51.703578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:51.703396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:51.703396+0000","last_clean_scrub_stamp":"2024-09-14T10:48:51.703396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:34.384980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:13.749944+0000","last_change":"2024-09-14T10:49:13.749944+0000","last_active":"2024-09-14T10:49:13.749944+0000","last_peered":"2024-09-14T10:49:13.749944+0000","last_clean":"2024-09-14T10:49:13.749944+0000","last_became_active":"2024-09-14T10:44:15.378657+0000","last_became_peered":"2024-09-14T10:44:15.378657+0000","last_unstale":"2024-09-14T10:49:13.749944+0000","last_undegraded":"2024-09-14T10:49:13.749944+0000","last_fullsized":"2024-09-14T10:49:13.749944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:49:13.749758+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:49:13.749758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:13.749758+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:08.806701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'10","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.588638+0000","last_change":"2024-09-14T10:48:16.588402+0000","last_active":"2024-09-14T10:48:16.588638+0000","last_peered":"2024-09-14T10:48:16.588638+0000","last_clean":"2024-09-14T10:48:16.588638+0000","last_became_active":"2024-09-14T10:44:07.304598+0000","last_became_peered":"2024-09-14T10:44:07.304598+0000","last_unstale":"2024-09-14T10:48:16.588638+0000","last_undegraded":"2024-09-14T10:48:16.588638+0000","last_fullsized":"2024-09-14T10:48:16.588638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:16.588185+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.588185+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:49.661160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:13.969249+0000","last_change":"2024-09-14T10:48:13.969100+0000","last_active":"2024-09-14T10:48:13.969249+0000","last_peered":"2024-09-14T10:48:13.969249+0000","last_clean":"2024-09-14T10:48:13.969249+0000","last_became_active":"2024-09-14T10:44:05.319083+0000","last_became_peered":"2024-09-14T10:44:05.319083+0000","last_unstale":"2024-09-14T10:48:13.969249+0000","last_undegraded":"2024-09-14T10:48:13.969249+0000","last_fullsized":"2024-09-14T10:48:13.969249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:13.968917+0000","last_clean_scrub_stamp":"2024-09-14T10:48:13.968917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:56.650501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:41.603967+0000","last_change":"2024-09-14T10:48:41.603809+0000","last_active":"2024-09-14T10:48:41.603967+0000","last_peered":"2024-09-14T10:48:41.603967+0000","last_clean":"2024-09-14T10:48:41.603967+0000","last_became_active":"2024-09-14T10:44:09.313045+0000","last_became_peered":"2024-09-14T10:44:09.313045+0000","last_unstale":"2024-09-14T10:48:41.603967+0000","last_undegraded":"2024-09-14T10:48:41.603967+0000","last_fullsized":"2024-09-14T10:48:41.603967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:41.603602+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:41.603602+0000","last_clean_scrub_stamp":"2024-09-14T10:48:41.603602+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:31.715081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'17","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:04.707084+0000","last_change":"2024-09-14T10:49:04.707084+0000","last_active":"2024-09-14T10:49:04.707084+0000","last_peered":"2024-09-14T10:49:04.707084+0000","last_clean":"2024-09-14T10:49:04.707084+0000","last_became_active":"2024-09-14T10:44:11.364525+0000","last_became_peered":"2024-09-14T10:44:11.364525+0000","last_unstale":"2024-09-14T10:49:04.707084+0000","last_undegraded":"2024-09-14T10:49:04.707084+0000","last_fullsized":"2024-09-14T10:49:04.707084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-14T10:49:04.706879+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-14T10:49:04.706879+0000","last_clean_scrub_stamp":"2024-09-14T10:49:04.706879+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:23.853796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:45.527739+0000","last_change":"2024-09-14T10:48:45.527739+0000","last_active":"2024-09-14T10:48:45.527739+0000","last_peered":"2024-09-14T10:48:45.527739+0000","last_clean":"2024-09-14T10:48:45.527739+0000","last_became_active":"2024-09-14T10:44:13.372206+0000","last_became_peered":"2024-09-14T10:44:13.372206+0000","last_unstale":"2024-09-14T10:48:45.527739+0000","last_undegraded":"2024-09-14T10:48:45.527739+0000","last_fullsized":"2024-09-14T10:48:45.527739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-14T10:48:45.527537+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-14T10:48:45.527537+0000","last_clean_scrub_stamp":"2024-09-14T10:48:45.527537+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:57.709365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:14.770511+0000","last_change":"2024-09-14T10:49:14.770511+0000","last_active":"2024-09-14T10:49:14.770511+0000","last_peered":"2024-09-14T10:49:14.770511+0000","last_clean":"2024-09-14T10:49:14.770511+0000","last_became_active":"2024-09-14T10:44:15.387814+0000","last_became_peered":"2024-09-14T10:44:15.387814+0000","last_unstale":"2024-09-14T10:49:14.770511+0000","last_undegraded":"2024-09-14T10:49:14.770511+0000","last_fullsized":"2024-09-14T10:49:14.770511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:49:14.770331+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:49:14.770331+0000","last_clean_scrub_stamp":"2024-09-14T10:49:14.770331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:51.164913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.761003+0000","last_change":"2024-09-14T10:48:20.760834+0000","last_active":"2024-09-14T10:48:20.761003+0000","last_peered":"2024-09-14T10:48:20.761003+0000","last_clean":"2024-09-14T10:48:20.761003+0000","last_became_active":"2024-09-14T10:44:07.297436+0000","last_became_peered":"2024-09-14T10:44:07.297436+0000","last_unstale":"2024-09-14T10:48:20.761003+0000","last_undegraded":"2024-09-14T10:48:20.761003+0000","last_fullsized":"2024-09-14T10:48:20.761003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:20.760654+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:20.760654+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.760654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:00.206789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.280007+0000","last_change":"2024-09-14T10:48:03.279857+0000","last_active":"2024-09-14T10:48:03.280007+0000","last_peered":"2024-09-14T10:48:03.280007+0000","last_clean":"2024-09-14T10:48:03.280007+0000","last_became_active":"2024-09-14T10:44:05.313242+0000","last_became_peered":"2024-09-14T10:44:05.313242+0000","last_unstale":"2024-09-14T10:48:03.280007+0000","last_undegraded":"2024-09-14T10:48:03.280007+0000","last_fullsized":"2024-09-14T10:48:03.280007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.279672+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.279672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:11.368363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.564803+0000","last_change":"2024-09-14T10:48:37.564658+0000","last_active":"2024-09-14T10:48:37.564803+0000","last_peered":"2024-09-14T10:48:37.564803+0000","last_clean":"2024-09-14T10:48:37.564803+0000","last_became_active":"2024-09-14T10:44:09.322765+0000","last_became_peered":"2024-09-14T10:44:09.322765+0000","last_unstale":"2024-09-14T10:48:37.564803+0000","last_undegraded":"2024-09-14T10:48:37.564803+0000","last_fullsized":"2024-09-14T10:48:37.564803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:37.564481+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:37.564481+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.564481+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:19.854700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:44.640456+0000","last_change":"2024-09-14T10:48:44.640308+0000","last_active":"2024-09-14T10:48:44.640456+0000","last_peered":"2024-09-14T10:48:44.640456+0000","last_clean":"2024-09-14T10:48:44.640456+0000","last_became_active":"2024-09-14T10:44:11.326566+0000","last_became_peered":"2024-09-14T10:44:11.326566+0000","last_unstale":"2024-09-14T10:48:44.640456+0000","last_undegraded":"2024-09-14T10:48:44.640456+0000","last_fullsized":"2024-09-14T10:48:44.640456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-14T10:48:44.640106+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-14T10:48:44.640106+0000","last_clean_scrub_stamp":"2024-09-14T10:48:44.640106+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.413809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:47.614300+0000","last_change":"2024-09-14T10:48:47.614160+0000","last_active":"2024-09-14T10:48:47.614300+0000","last_peered":"2024-09-14T10:48:47.614300+0000","last_clean":"2024-09-14T10:48:47.614300+0000","last_became_active":"2024-09-14T10:44:13.375533+0000","last_became_peered":"2024-09-14T10:44:13.375533+0000","last_unstale":"2024-09-14T10:48:47.614300+0000","last_undegraded":"2024-09-14T10:48:47.614300+0000","last_fullsized":"2024-09-14T10:48:47.614300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:47.614005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:47.614005+0000","last_clean_scrub_stamp":"2024-09-14T10:48:47.614005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:50.769847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:56.701821+0000","last_change":"2024-09-14T10:48:56.701584+0000","last_active":"2024-09-14T10:48:56.701821+0000","last_peered":"2024-09-14T10:48:56.701821+0000","last_clean":"2024-09-14T10:48:56.701821+0000","last_became_active":"2024-09-14T10:44:15.387851+0000","last_became_peered":"2024-09-14T10:44:15.387851+0000","last_unstale":"2024-09-14T10:48:56.701821+0000","last_undegraded":"2024-09-14T10:48:56.701821+0000","last_fullsized":"2024-09-14T10:48:56.701821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:56.701311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:56.701311+0000","last_clean_scrub_stamp":"2024-09-14T10:48:56.701311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:38.849339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.765411+0000","last_change":"2024-09-14T10:48:19.765236+0000","last_active":"2024-09-14T10:48:19.765411+0000","last_peered":"2024-09-14T10:48:19.765411+0000","last_clean":"2024-09-14T10:48:19.765411+0000","last_became_active":"2024-09-14T10:44:07.301361+0000","last_became_peered":"2024-09-14T10:44:07.301361+0000","last_unstale":"2024-09-14T10:48:19.765411+0000","last_undegraded":"2024-09-14T10:48:19.765411+0000","last_fullsized":"2024-09-14T10:48:19.765411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:19.765058+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:19.765058+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.765058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.778145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:14.957419+0000","last_change":"2024-09-14T10:48:14.957292+0000","last_active":"2024-09-14T10:48:14.957419+0000","last_peered":"2024-09-14T10:48:14.957419+0000","last_clean":"2024-09-14T10:48:14.957419+0000","last_became_active":"2024-09-14T10:44:05.312442+0000","last_became_peered":"2024-09-14T10:44:05.312442+0000","last_unstale":"2024-09-14T10:48:14.957419+0000","last_undegraded":"2024-09-14T10:48:14.957419+0000","last_fullsized":"2024-09-14T10:48:14.957419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:14.957115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:14.957115+0000","last_clean_scrub_stamp":"2024-09-14T10:48:14.957115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.999307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:29.533325+0000","last_change":"2024-09-14T10:48:29.533192+0000","last_active":"2024-09-14T10:48:29.533325+0000","last_peered":"2024-09-14T10:48:29.533325+0000","last_clean":"2024-09-14T10:48:29.533325+0000","last_became_active":"2024-09-14T10:44:09.320332+0000","last_became_peered":"2024-09-14T10:44:09.320332+0000","last_unstale":"2024-09-14T10:48:29.533325+0000","last_undegraded":"2024-09-14T10:48:29.533325+0000","last_fullsized":"2024-09-14T10:48:29.533325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:29.532987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:29.532987+0000","last_clean_scrub_stamp":"2024-09-14T10:48:29.532987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:36.699790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'38","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.584971+0000","last_change":"2024-09-14T10:48:35.584703+0000","last_active":"2024-09-14T10:48:35.584971+0000","last_peered":"2024-09-14T10:48:35.584971+0000","last_clean":"2024-09-14T10:48:35.584971+0000","last_became_active":"2024-09-14T10:44:11.325394+0000","last_became_peered":"2024-09-14T10:44:11.325394+0000","last_unstale":"2024-09-14T10:48:35.584971+0000","last_undegraded":"2024-09-14T10:48:35.584971+0000","last_fullsized":"2024-09-14T10:48:35.584971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-14T10:48:35.584572+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-14T10:48:35.584572+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.584572+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:15.413214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.762527+0000","last_change":"2024-09-14T10:49:09.762527+0000","last_active":"2024-09-14T10:49:09.762527+0000","last_peered":"2024-09-14T10:49:09.762527+0000","last_clean":"2024-09-14T10:49:09.762527+0000","last_became_active":"2024-09-14T10:44:13.368029+0000","last_became_peered":"2024-09-14T10:44:13.368029+0000","last_unstale":"2024-09-14T10:49:09.762527+0000","last_undegraded":"2024-09-14T10:49:09.762527+0000","last_fullsized":"2024-09-14T10:49:09.762527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:09.762349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:09.762349+0000","last_clean_scrub_stamp":"2024-09-14T10:49:09.762349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:21.048395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:20.731373+0000","last_change":"2024-09-14T10:49:20.731373+0000","last_active":"2024-09-14T10:49:20.731373+0000","last_peered":"2024-09-14T10:49:20.731373+0000","last_clean":"2024-09-14T10:49:20.731373+0000","last_became_active":"2024-09-14T10:44:15.385142+0000","last_became_peered":"2024-09-14T10:44:15.385142+0000","last_unstale":"2024-09-14T10:49:20.731373+0000","last_undegraded":"2024-09-14T10:49:20.731373+0000","last_fullsized":"2024-09-14T10:49:20.731373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:20.731166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:20.731166+0000","last_clean_scrub_stamp":"2024-09-14T10:49:20.731166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:00.007143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.730058+0000","last_change":"2024-09-14T10:48:18.729791+0000","last_active":"2024-09-14T10:48:18.730058+0000","last_peered":"2024-09-14T10:48:18.730058+0000","last_clean":"2024-09-14T10:48:18.730058+0000","last_became_active":"2024-09-14T10:44:44.443266+0000","last_became_peered":"2024-09-14T10:44:44.443266+0000","last_unstale":"2024-09-14T10:48:18.730058+0000","last_undegraded":"2024-09-14T10:48:18.730058+0000","last_fullsized":"2024-09-14T10:48:18.730058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:18.729528+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:18.729528+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.729528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.709783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:47:59.470373+0000","last_change":"2024-09-14T10:47:59.470192+0000","last_active":"2024-09-14T10:47:59.470373+0000","last_peered":"2024-09-14T10:47:59.470373+0000","last_clean":"2024-09-14T10:47:59.470373+0000","last_became_active":"2024-09-14T10:44:05.312718+0000","last_became_peered":"2024-09-14T10:44:05.312718+0000","last_unstale":"2024-09-14T10:47:59.470373+0000","last_undegraded":"2024-09-14T10:47:59.470373+0000","last_fullsized":"2024-09-14T10:47:59.470373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:47:59.470009+0000","last_clean_scrub_stamp":"2024-09-14T10:47:59.470009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:41.109792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.601670+0000","last_change":"2024-09-14T10:48:36.601461+0000","last_active":"2024-09-14T10:48:36.601670+0000","last_peered":"2024-09-14T10:48:36.601670+0000","last_clean":"2024-09-14T10:48:36.601670+0000","last_became_active":"2024-09-14T10:44:09.317780+0000","last_became_peered":"2024-09-14T10:44:09.317780+0000","last_unstale":"2024-09-14T10:48:36.601670+0000","last_undegraded":"2024-09-14T10:48:36.601670+0000","last_fullsized":"2024-09-14T10:48:36.601670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:36.601284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:36.601284+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.601284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:15.572560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:02.736436+0000","last_change":"2024-09-14T10:49:02.736171+0000","last_active":"2024-09-14T10:49:02.736436+0000","last_peered":"2024-09-14T10:49:02.736436+0000","last_clean":"2024-09-14T10:49:02.736436+0000","last_became_active":"2024-09-14T10:44:11.355643+0000","last_became_peered":"2024-09-14T10:44:11.355643+0000","last_unstale":"2024-09-14T10:49:02.736436+0000","last_undegraded":"2024-09-14T10:49:02.736436+0000","last_fullsized":"2024-09-14T10:49:02.736436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-14T10:49:02.735925+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-14T10:49:02.735925+0000","last_clean_scrub_stamp":"2024-09-14T10:49:02.735925+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:35.204917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:16.772018+0000","last_change":"2024-09-14T10:49:16.772018+0000","last_active":"2024-09-14T10:49:16.772018+0000","last_peered":"2024-09-14T10:49:16.772018+0000","last_clean":"2024-09-14T10:49:16.772018+0000","last_became_active":"2024-09-14T10:44:13.366549+0000","last_became_peered":"2024-09-14T10:44:13.366549+0000","last_unstale":"2024-09-14T10:49:16.772018+0000","last_undegraded":"2024-09-14T10:49:16.772018+0000","last_fullsized":"2024-09-14T10:49:16.772018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:16.771747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:16.771747+0000","last_clean_scrub_stamp":"2024-09-14T10:49:16.771747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:58.769662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:19.781250+0000","last_change":"2024-09-14T10:49:19.781250+0000","last_active":"2024-09-14T10:49:19.781250+0000","last_peered":"2024-09-14T10:49:19.781250+0000","last_clean":"2024-09-14T10:49:19.781250+0000","last_became_active":"2024-09-14T10:44:15.385123+0000","last_became_peered":"2024-09-14T10:44:15.385123+0000","last_unstale":"2024-09-14T10:49:19.781250+0000","last_undegraded":"2024-09-14T10:49:19.781250+0000","last_fullsized":"2024-09-14T10:49:19.781250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:49:19.781060+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:49:19.781060+0000","last_clean_scrub_stamp":"2024-09-14T10:49:19.781060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:29.502369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.723724+0000","last_change":"2024-09-14T10:48:17.723592+0000","last_active":"2024-09-14T10:48:17.723724+0000","last_peered":"2024-09-14T10:48:17.723724+0000","last_clean":"2024-09-14T10:48:17.723724+0000","last_became_active":"2024-09-14T10:44:07.294806+0000","last_became_peered":"2024-09-14T10:44:07.294806+0000","last_unstale":"2024-09-14T10:48:17.723724+0000","last_undegraded":"2024-09-14T10:48:17.723724+0000","last_fullsized":"2024-09-14T10:48:17.723724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:17.723405+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:17.723405+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.723405+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:16.395502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.315403+0000","last_change":"2024-09-14T10:48:04.315262+0000","last_active":"2024-09-14T10:48:04.315403+0000","last_peered":"2024-09-14T10:48:04.315403+0000","last_clean":"2024-09-14T10:48:04.315403+0000","last_became_active":"2024-09-14T10:44:05.316405+0000","last_became_peered":"2024-09-14T10:44:05.316405+0000","last_unstale":"2024-09-14T10:48:04.315403+0000","last_undegraded":"2024-09-14T10:48:04.315403+0000","last_fullsized":"2024-09-14T10:48:04.315403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.315084+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.315084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:09.501850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:35.598879+0000","last_change":"2024-09-14T10:48:35.598708+0000","last_active":"2024-09-14T10:48:35.598879+0000","last_peered":"2024-09-14T10:48:35.598879+0000","last_clean":"2024-09-14T10:48:35.598879+0000","last_became_active":"2024-09-14T10:44:09.327608+0000","last_became_peered":"2024-09-14T10:44:09.327608+0000","last_unstale":"2024-09-14T10:48:35.598879+0000","last_undegraded":"2024-09-14T10:48:35.598879+0000","last_fullsized":"2024-09-14T10:48:35.598879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-14T10:48:35.598542+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-14T10:48:35.598542+0000","last_clean_scrub_stamp":"2024-09-14T10:48:35.598542+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:06.821482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'40","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:01.725303+0000","last_change":"2024-09-14T10:49:01.725155+0000","last_active":"2024-09-14T10:49:01.725303+0000","last_peered":"2024-09-14T10:49:01.725303+0000","last_clean":"2024-09-14T10:49:01.725303+0000","last_became_active":"2024-09-14T10:44:11.356349+0000","last_became_peered":"2024-09-14T10:44:11.356349+0000","last_unstale":"2024-09-14T10:49:01.725303+0000","last_undegraded":"2024-09-14T10:49:01.725303+0000","last_fullsized":"2024-09-14T10:49:01.725303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-14T10:49:01.724951+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-14T10:49:01.724951+0000","last_clean_scrub_stamp":"2024-09-14T10:49:01.724951+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:36.261655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:49.681766+0000","last_change":"2024-09-14T10:48:49.681527+0000","last_active":"2024-09-14T10:48:49.681766+0000","last_peered":"2024-09-14T10:48:49.681766+0000","last_clean":"2024-09-14T10:48:49.681766+0000","last_became_active":"2024-09-14T10:44:13.372593+0000","last_became_peered":"2024-09-14T10:44:13.372593+0000","last_unstale":"2024-09-14T10:48:49.681766+0000","last_undegraded":"2024-09-14T10:48:49.681766+0000","last_fullsized":"2024-09-14T10:48:49.681766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:49.681287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:49.681287+0000","last_clean_scrub_stamp":"2024-09-14T10:48:49.681287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:03.628980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'18","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:49:18.732254+0000","last_change":"2024-09-14T10:49:18.732254+0000","last_active":"2024-09-14T10:49:18.732254+0000","last_peered":"2024-09-14T10:49:18.732254+0000","last_clean":"2024-09-14T10:49:18.732254+0000","last_became_active":"2024-09-14T10:44:15.385838+0000","last_became_peered":"2024-09-14T10:44:15.385838+0000","last_unstale":"2024-09-14T10:49:18.732254+0000","last_undegraded":"2024-09-14T10:49:18.732254+0000","last_fullsized":"2024-09-14T10:49:18.732254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-14T10:49:18.732031+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-14T10:49:18.732031+0000","last_clean_scrub_stamp":"2024-09-14T10:49:18.732031+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:08.545363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":70,"num_write":57,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.468297+0000","last_change":"2024-09-14T10:48:19.468123+0000","last_active":"2024-09-14T10:48:19.468297+0000","last_peered":"2024-09-14T10:48:19.468297+0000","last_clean":"2024-09-14T10:48:19.468297+0000","last_became_active":"2024-09-14T10:44:07.318968+0000","last_became_peered":"2024-09-14T10:44:07.318968+0000","last_unstale":"2024-09-14T10:48:19.468297+0000","last_undegraded":"2024-09-14T10:48:19.468297+0000","last_fullsized":"2024-09-14T10:48:19.468297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:19.467939+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:19.467939+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.467939+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:55.076769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.685193+0000","last_change":"2024-09-14T10:48:06.684936+0000","last_active":"2024-09-14T10:48:06.685193+0000","last_peered":"2024-09-14T10:48:06.685193+0000","last_clean":"2024-09-14T10:48:06.685193+0000","last_became_active":"2024-09-14T10:44:05.318934+0000","last_became_peered":"2024-09-14T10:44:05.318934+0000","last_unstale":"2024-09-14T10:48:06.685193+0000","last_undegraded":"2024-09-14T10:48:06.685193+0000","last_fullsized":"2024-09-14T10:48:06.685193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:06.684579+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.684579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:30.618905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.540206+0000","last_change":"2024-09-14T10:48:22.539962+0000","last_active":"2024-09-14T10:48:22.540206+0000","last_peered":"2024-09-14T10:48:22.540206+0000","last_clean":"2024-09-14T10:48:22.540206+0000","last_became_active":"2024-09-14T10:44:07.304441+0000","last_became_peered":"2024-09-14T10:44:07.304441+0000","last_unstale":"2024-09-14T10:48:22.540206+0000","last_undegraded":"2024-09-14T10:48:22.540206+0000","last_fullsized":"2024-09-14T10:48:22.540206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:22.539696+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:22.539696+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.539696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:19.296367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:03.500388+0000","last_change":"2024-09-14T10:48:03.500209+0000","last_active":"2024-09-14T10:48:03.500388+0000","last_peered":"2024-09-14T10:48:03.500388+0000","last_clean":"2024-09-14T10:48:03.500388+0000","last_became_active":"2024-09-14T10:44:05.318123+0000","last_became_peered":"2024-09-14T10:44:05.318123+0000","last_unstale":"2024-09-14T10:48:03.500388+0000","last_undegraded":"2024-09-14T10:48:03.500388+0000","last_fullsized":"2024-09-14T10:48:03.500388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:03.500037+0000","last_clean_scrub_stamp":"2024-09-14T10:48:03.500037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:09.580224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:36.713248+0000","last_change":"2024-09-14T10:48:36.713248+0000","last_active":"2024-09-14T10:48:36.713248+0000","last_peered":"2024-09-14T10:48:36.713248+0000","last_clean":"2024-09-14T10:48:36.713248+0000","last_became_active":"2024-09-14T10:44:07.299697+0000","last_became_peered":"2024-09-14T10:44:07.299697+0000","last_unstale":"2024-09-14T10:48:36.713248+0000","last_undegraded":"2024-09-14T10:48:36.713248+0000","last_fullsized":"2024-09-14T10:48:36.713248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:36.713060+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:36.713060+0000","last_clean_scrub_stamp":"2024-09-14T10:48:36.713060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:14.937115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:15.948514+0000","last_change":"2024-09-14T10:48:15.948514+0000","last_active":"2024-09-14T10:48:15.948514+0000","last_peered":"2024-09-14T10:48:15.948514+0000","last_clean":"2024-09-14T10:48:15.948514+0000","last_became_active":"2024-09-14T10:44:05.324337+0000","last_became_peered":"2024-09-14T10:44:05.324337+0000","last_unstale":"2024-09-14T10:48:15.948514+0000","last_undegraded":"2024-09-14T10:48:15.948514+0000","last_fullsized":"2024-09-14T10:48:15.948514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:15.948330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:15.948330+0000","last_clean_scrub_stamp":"2024-09-14T10:48:15.948330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:51.612757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:31.620971+0000","last_change":"2024-09-14T10:48:31.620971+0000","last_active":"2024-09-14T10:48:31.620971+0000","last_peered":"2024-09-14T10:48:31.620971+0000","last_clean":"2024-09-14T10:48:31.620971+0000","last_became_active":"2024-09-14T10:44:07.305539+0000","last_became_peered":"2024-09-14T10:44:07.305539+0000","last_unstale":"2024-09-14T10:48:31.620971+0000","last_undegraded":"2024-09-14T10:48:31.620971+0000","last_fullsized":"2024-09-14T10:48:31.620971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-14T10:48:31.620785+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-14T10:48:31.620785+0000","last_clean_scrub_stamp":"2024-09-14T10:48:31.620785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:12.233352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.437129+0000","last_change":"2024-09-14T10:48:06.436938+0000","last_active":"2024-09-14T10:48:06.437129+0000","last_peered":"2024-09-14T10:48:06.437129+0000","last_clean":"2024-09-14T10:48:06.437129+0000","last_became_active":"2024-09-14T10:44:05.318968+0000","last_became_peered":"2024-09-14T10:44:05.318968+0000","last_unstale":"2024-09-14T10:48:06.437129+0000","last_undegraded":"2024-09-14T10:48:06.437129+0000","last_fullsized":"2024-09-14T10:48:06.437129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:06.436743+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.436743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:28.064799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.535992+0000","last_change":"2024-09-14T10:48:18.535992+0000","last_active":"2024-09-14T10:48:18.535992+0000","last_peered":"2024-09-14T10:48:18.535992+0000","last_clean":"2024-09-14T10:48:18.535992+0000","last_became_active":"2024-09-14T10:44:07.315996+0000","last_became_peered":"2024-09-14T10:44:07.315996+0000","last_unstale":"2024-09-14T10:48:18.535992+0000","last_undegraded":"2024-09-14T10:48:18.535992+0000","last_fullsized":"2024-09-14T10:48:18.535992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:18.535801+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:18.535801+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.535801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:37.962177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.477417+0000","last_change":"2024-09-14T10:48:07.477245+0000","last_active":"2024-09-14T10:48:07.477417+0000","last_peered":"2024-09-14T10:48:07.477417+0000","last_clean":"2024-09-14T10:48:07.477417+0000","last_became_active":"2024-09-14T10:44:05.318791+0000","last_became_peered":"2024-09-14T10:44:05.318791+0000","last_unstale":"2024-09-14T10:48:07.477417+0000","last_undegraded":"2024-09-14T10:48:07.477417+0000","last_fullsized":"2024-09-14T10:48:07.477417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:07.477054+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.477054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.383162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.420346+0000","last_change":"2024-09-14T10:48:18.420100+0000","last_active":"2024-09-14T10:48:18.420346+0000","last_peered":"2024-09-14T10:48:18.420346+0000","last_clean":"2024-09-14T10:48:18.420346+0000","last_became_active":"2024-09-14T10:44:07.314589+0000","last_became_peered":"2024-09-14T10:44:07.314589+0000","last_unstale":"2024-09-14T10:48:18.420346+0000","last_undegraded":"2024-09-14T10:48:18.420346+0000","last_fullsized":"2024-09-14T10:48:18.420346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:18.419824+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:18.419824+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.419824+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:51.492799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.344100+0000","last_change":"2024-09-14T10:48:05.343952+0000","last_active":"2024-09-14T10:48:05.344100+0000","last_peered":"2024-09-14T10:48:05.344100+0000","last_clean":"2024-09-14T10:48:05.344100+0000","last_became_active":"2024-09-14T10:44:05.311652+0000","last_became_peered":"2024-09-14T10:44:05.311652+0000","last_unstale":"2024-09-14T10:48:05.344100+0000","last_undegraded":"2024-09-14T10:48:05.344100+0000","last_fullsized":"2024-09-14T10:48:05.344100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.343728+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.343728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:11.423916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.572507+0000","last_change":"2024-09-14T10:48:17.572507+0000","last_active":"2024-09-14T10:48:17.572507+0000","last_peered":"2024-09-14T10:48:17.572507+0000","last_clean":"2024-09-14T10:48:17.572507+0000","last_became_active":"2024-09-14T10:44:07.301628+0000","last_became_peered":"2024-09-14T10:44:07.301628+0000","last_unstale":"2024-09-14T10:48:17.572507+0000","last_undegraded":"2024-09-14T10:48:17.572507+0000","last_fullsized":"2024-09-14T10:48:17.572507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:17.572324+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:17.572324+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.572324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:53.181155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.636701+0000","last_change":"2024-09-14T10:48:05.636531+0000","last_active":"2024-09-14T10:48:05.636701+0000","last_peered":"2024-09-14T10:48:05.636701+0000","last_clean":"2024-09-14T10:48:05.636701+0000","last_became_active":"2024-09-14T10:44:05.319648+0000","last_became_peered":"2024-09-14T10:44:05.319648+0000","last_unstale":"2024-09-14T10:48:05.636701+0000","last_undegraded":"2024-09-14T10:48:05.636701+0000","last_fullsized":"2024-09-14T10:48:05.636701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.636345+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.636345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:39.594590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.445845+0000","last_change":"2024-09-14T10:48:17.445719+0000","last_active":"2024-09-14T10:48:17.445845+0000","last_peered":"2024-09-14T10:48:17.445845+0000","last_clean":"2024-09-14T10:48:17.445845+0000","last_became_active":"2024-09-14T10:44:07.303118+0000","last_became_peered":"2024-09-14T10:44:07.303118+0000","last_unstale":"2024-09-14T10:48:17.445845+0000","last_undegraded":"2024-09-14T10:48:17.445845+0000","last_fullsized":"2024-09-14T10:48:17.445845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:17.445534+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:17.445534+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.445534+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.253965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:04.493171+0000","last_change":"2024-09-14T10:48:04.492991+0000","last_active":"2024-09-14T10:48:04.493171+0000","last_peered":"2024-09-14T10:48:04.493171+0000","last_clean":"2024-09-14T10:48:04.493171+0000","last_became_active":"2024-09-14T10:44:05.312726+0000","last_became_peered":"2024-09-14T10:44:05.312726+0000","last_unstale":"2024-09-14T10:48:04.493171+0000","last_undegraded":"2024-09-14T10:48:04.493171+0000","last_fullsized":"2024-09-14T10:48:04.493171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:04.492802+0000","last_clean_scrub_stamp":"2024-09-14T10:48:04.492802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:02.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.424125+0000","last_change":"2024-09-14T10:48:23.423969+0000","last_active":"2024-09-14T10:48:23.424125+0000","last_peered":"2024-09-14T10:48:23.424125+0000","last_clean":"2024-09-14T10:48:23.424125+0000","last_became_active":"2024-09-14T10:44:07.302523+0000","last_became_peered":"2024-09-14T10:44:07.302523+0000","last_unstale":"2024-09-14T10:48:23.424125+0000","last_undegraded":"2024-09-14T10:48:23.424125+0000","last_fullsized":"2024-09-14T10:48:23.424125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:23.423787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:23.423787+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.423787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:32.029468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:16.905728+0000","last_change":"2024-09-14T10:48:16.905587+0000","last_active":"2024-09-14T10:48:16.905728+0000","last_peered":"2024-09-14T10:48:16.905728+0000","last_clean":"2024-09-14T10:48:16.905728+0000","last_became_active":"2024-09-14T10:44:05.321199+0000","last_became_peered":"2024-09-14T10:44:05.321199+0000","last_unstale":"2024-09-14T10:48:16.905728+0000","last_undegraded":"2024-09-14T10:48:16.905728+0000","last_fullsized":"2024-09-14T10:48:16.905728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:16.905404+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:16.905404+0000","last_clean_scrub_stamp":"2024-09-14T10:48:16.905404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:41.403056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:38.683826+0000","last_change":"2024-09-14T10:48:38.683583+0000","last_active":"2024-09-14T10:48:38.683826+0000","last_peered":"2024-09-14T10:48:38.683826+0000","last_clean":"2024-09-14T10:48:38.683826+0000","last_became_active":"2024-09-14T10:44:07.309084+0000","last_became_peered":"2024-09-14T10:44:07.309084+0000","last_unstale":"2024-09-14T10:48:38.683826+0000","last_undegraded":"2024-09-14T10:48:38.683826+0000","last_fullsized":"2024-09-14T10:48:38.683826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:38.683371+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:38.683371+0000","last_clean_scrub_stamp":"2024-09-14T10:48:38.683371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:37.975683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:05.451669+0000","last_change":"2024-09-14T10:48:05.451486+0000","last_active":"2024-09-14T10:48:05.451669+0000","last_peered":"2024-09-14T10:48:05.451669+0000","last_clean":"2024-09-14T10:48:05.451669+0000","last_became_active":"2024-09-14T10:44:05.321523+0000","last_became_peered":"2024-09-14T10:44:05.321523+0000","last_unstale":"2024-09-14T10:48:05.451669+0000","last_undegraded":"2024-09-14T10:48:05.451669+0000","last_fullsized":"2024-09-14T10:48:05.451669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:05.451302+0000","last_clean_scrub_stamp":"2024-09-14T10:48:05.451302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:31.147968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.489122+0000","last_change":"2024-09-14T10:48:20.488933+0000","last_active":"2024-09-14T10:48:20.489122+0000","last_peered":"2024-09-14T10:48:20.489122+0000","last_clean":"2024-09-14T10:48:20.489122+0000","last_became_active":"2024-09-14T10:44:07.313487+0000","last_became_peered":"2024-09-14T10:44:07.313487+0000","last_unstale":"2024-09-14T10:48:20.489122+0000","last_undegraded":"2024-09-14T10:48:20.489122+0000","last_fullsized":"2024-09-14T10:48:20.489122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:20.488751+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:20.488751+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.488751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:13.985690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.364360+0000","last_change":"2024-09-14T10:48:08.364214+0000","last_active":"2024-09-14T10:48:08.364360+0000","last_peered":"2024-09-14T10:48:08.364360+0000","last_clean":"2024-09-14T10:48:08.364360+0000","last_became_active":"2024-09-14T10:44:05.315415+0000","last_became_peered":"2024-09-14T10:44:05.315415+0000","last_unstale":"2024-09-14T10:48:08.364360+0000","last_undegraded":"2024-09-14T10:48:08.364360+0000","last_fullsized":"2024-09-14T10:48:08.364360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.364025+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.364025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:29.992081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:22.418619+0000","last_change":"2024-09-14T10:48:22.418342+0000","last_active":"2024-09-14T10:48:22.418619+0000","last_peered":"2024-09-14T10:48:22.418619+0000","last_clean":"2024-09-14T10:48:22.418619+0000","last_became_active":"2024-09-14T10:44:07.302933+0000","last_became_peered":"2024-09-14T10:44:07.302933+0000","last_unstale":"2024-09-14T10:48:22.418619+0000","last_undegraded":"2024-09-14T10:48:22.418619+0000","last_fullsized":"2024-09-14T10:48:22.418619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-14T10:48:22.418134+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-14T10:48:22.418134+0000","last_clean_scrub_stamp":"2024-09-14T10:48:22.418134+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:30.725200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:06.363509+0000","last_change":"2024-09-14T10:48:06.363263+0000","last_active":"2024-09-14T10:48:06.363509+0000","last_peered":"2024-09-14T10:48:06.363509+0000","last_clean":"2024-09-14T10:48:06.363509+0000","last_became_active":"2024-09-14T10:44:05.313351+0000","last_became_peered":"2024-09-14T10:44:05.313351+0000","last_unstale":"2024-09-14T10:48:06.363509+0000","last_undegraded":"2024-09-14T10:48:06.363509+0000","last_fullsized":"2024-09-14T10:48:06.363509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:06.363044+0000","last_clean_scrub_stamp":"2024-09-14T10:48:06.363044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:10.900801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.466094+0000","last_change":"2024-09-14T10:48:21.465950+0000","last_active":"2024-09-14T10:48:21.466094+0000","last_peered":"2024-09-14T10:48:21.466094+0000","last_clean":"2024-09-14T10:48:21.466094+0000","last_became_active":"2024-09-14T10:44:07.318797+0000","last_became_peered":"2024-09-14T10:44:07.318797+0000","last_unstale":"2024-09-14T10:48:21.466094+0000","last_undegraded":"2024-09-14T10:48:21.466094+0000","last_fullsized":"2024-09-14T10:48:21.466094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-14T10:48:21.465744+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-14T10:48:21.465744+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.465744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:03.866722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:17.869049+0000","last_change":"2024-09-14T10:48:17.868897+0000","last_active":"2024-09-14T10:48:17.869049+0000","last_peered":"2024-09-14T10:48:17.869049+0000","last_clean":"2024-09-14T10:48:17.869049+0000","last_became_active":"2024-09-14T10:44:05.314638+0000","last_became_peered":"2024-09-14T10:44:05.314638+0000","last_unstale":"2024-09-14T10:48:17.869049+0000","last_undegraded":"2024-09-14T10:48:17.869049+0000","last_fullsized":"2024-09-14T10:48:17.869049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:17.868688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:17.868688+0000","last_clean_scrub_stamp":"2024-09-14T10:48:17.868688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:00.016716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:24.426613+0000","last_change":"2024-09-14T10:48:24.426484+0000","last_active":"2024-09-14T10:48:24.426613+0000","last_peered":"2024-09-14T10:48:24.426613+0000","last_clean":"2024-09-14T10:48:24.426613+0000","last_became_active":"2024-09-14T10:44:07.304623+0000","last_became_peered":"2024-09-14T10:44:07.304623+0000","last_unstale":"2024-09-14T10:48:24.426613+0000","last_undegraded":"2024-09-14T10:48:24.426613+0000","last_fullsized":"2024-09-14T10:48:24.426613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-14T10:48:24.426271+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-14T10:48:24.426271+0000","last_clean_scrub_stamp":"2024-09-14T10:48:24.426271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:29.496623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:18.841640+0000","last_change":"2024-09-14T10:48:18.841503+0000","last_active":"2024-09-14T10:48:18.841640+0000","last_peered":"2024-09-14T10:48:18.841640+0000","last_clean":"2024-09-14T10:48:18.841640+0000","last_became_active":"2024-09-14T10:44:05.314449+0000","last_became_peered":"2024-09-14T10:44:05.314449+0000","last_unstale":"2024-09-14T10:48:18.841640+0000","last_undegraded":"2024-09-14T10:48:18.841640+0000","last_fullsized":"2024-09-14T10:48:18.841640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:18.841299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:18.841299+0000","last_clean_scrub_stamp":"2024-09-14T10:48:18.841299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:50.935286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:37.677116+0000","last_change":"2024-09-14T10:48:37.676947+0000","last_active":"2024-09-14T10:48:37.677116+0000","last_peered":"2024-09-14T10:48:37.677116+0000","last_clean":"2024-09-14T10:48:37.677116+0000","last_became_active":"2024-09-14T10:44:07.306757+0000","last_became_peered":"2024-09-14T10:44:07.306757+0000","last_unstale":"2024-09-14T10:48:37.677116+0000","last_undegraded":"2024-09-14T10:48:37.677116+0000","last_fullsized":"2024-09-14T10:48:37.677116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:37.676736+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:37.676736+0000","last_clean_scrub_stamp":"2024-09-14T10:48:37.676736+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:29.904245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'5","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:07.692298+0000","last_change":"2024-09-14T10:48:07.692142+0000","last_active":"2024-09-14T10:48:07.692298+0000","last_peered":"2024-09-14T10:48:07.692298+0000","last_clean":"2024-09-14T10:48:07.692298+0000","last_became_active":"2024-09-14T10:44:05.316270+0000","last_became_peered":"2024-09-14T10:44:05.316270+0000","last_unstale":"2024-09-14T10:48:07.692298+0000","last_undegraded":"2024-09-14T10:48:07.692298+0000","last_fullsized":"2024-09-14T10:48:07.692298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-14T10:48:07.691953+0000","last_clean_scrub_stamp":"2024-09-14T10:48:07.691953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:20.730540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:20.428035+0000","last_change":"2024-09-14T10:48:20.427795+0000","last_active":"2024-09-14T10:48:20.428035+0000","last_peered":"2024-09-14T10:48:20.428035+0000","last_clean":"2024-09-14T10:48:20.428035+0000","last_became_active":"2024-09-14T10:44:07.302751+0000","last_became_peered":"2024-09-14T10:44:07.302751+0000","last_unstale":"2024-09-14T10:48:20.428035+0000","last_undegraded":"2024-09-14T10:48:20.428035+0000","last_fullsized":"2024-09-14T10:48:20.428035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-14T10:48:20.427585+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-14T10:48:20.427585+0000","last_clean_scrub_stamp":"2024-09-14T10:48:20.427585+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:39.853960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:19.871416+0000","last_change":"2024-09-14T10:48:19.871271+0000","last_active":"2024-09-14T10:48:19.871416+0000","last_peered":"2024-09-14T10:48:19.871416+0000","last_clean":"2024-09-14T10:48:19.871416+0000","last_became_active":"2024-09-14T10:44:05.311985+0000","last_became_peered":"2024-09-14T10:44:05.311985+0000","last_unstale":"2024-09-14T10:48:19.871416+0000","last_undegraded":"2024-09-14T10:48:19.871416+0000","last_fullsized":"2024-09-14T10:48:19.871416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:48:19.871088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:48:19.871088+0000","last_clean_scrub_stamp":"2024-09-14T10:48:19.871088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:33.745202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:23.904530+0000","last_change":"2024-09-14T10:48:23.904343+0000","last_active":"2024-09-14T10:48:23.904530+0000","last_peered":"2024-09-14T10:48:23.904530+0000","last_clean":"2024-09-14T10:48:23.904530+0000","last_became_active":"2024-09-14T10:44:05.312584+0000","last_became_peered":"2024-09-14T10:44:05.312584+0000","last_unstale":"2024-09-14T10:48:23.904530+0000","last_undegraded":"2024-09-14T10:48:23.904530+0000","last_fullsized":"2024-09-14T10:48:23.904530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-14T10:48:23.904146+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-14T10:48:23.904146+0000","last_clean_scrub_stamp":"2024-09-14T10:48:23.904146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:56.282823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8,"num_write":30,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:21.506497+0000","last_change":"2024-09-14T10:48:21.506316+0000","last_active":"2024-09-14T10:48:21.506497+0000","last_peered":"2024-09-14T10:48:21.506497+0000","last_clean":"2024-09-14T10:48:21.506497+0000","last_became_active":"2024-09-14T10:44:07.308496+0000","last_became_peered":"2024-09-14T10:44:07.308496+0000","last_unstale":"2024-09-14T10:48:21.506497+0000","last_undegraded":"2024-09-14T10:48:21.506497+0000","last_fullsized":"2024-09-14T10:48:21.506497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:21.506141+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:21.506141+0000","last_clean_scrub_stamp":"2024-09-14T10:48:21.506141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:41.836176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:08.454991+0000","last_change":"2024-09-14T10:48:08.454843+0000","last_active":"2024-09-14T10:48:08.454991+0000","last_peered":"2024-09-14T10:48:08.454991+0000","last_clean":"2024-09-14T10:48:08.454991+0000","last_became_active":"2024-09-14T10:44:05.321583+0000","last_became_peered":"2024-09-14T10:44:05.321583+0000","last_unstale":"2024-09-14T10:48:08.454991+0000","last_undegraded":"2024-09-14T10:48:08.454991+0000","last_fullsized":"2024-09-14T10:48:08.454991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-14T10:48:08.454661+0000","last_clean_scrub_stamp":"2024-09-14T10:48:08.454661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:34.179499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-14T10:48:27.473712+0000","last_change":"2024-09-14T10:48:27.473573+0000","last_active":"2024-09-14T10:48:27.473712+0000","last_peered":"2024-09-14T10:48:27.473712+0000","last_clean":"2024-09-14T10:48:27.473712+0000","last_became_active":"2024-09-14T10:44:07.318573+0000","last_became_peered":"2024-09-14T10:44:07.318573+0000","last_unstale":"2024-09-14T10:48:27.473712+0000","last_undegraded":"2024-09-14T10:48:27.473712+0000","last_fullsized":"2024-09-14T10:48:27.473712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-14T10:48:27.473358+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-14T10:48:27.473358+0000","last_clean_scrub_stamp":"2024-09-14T10:48:27.473358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:40.064188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640330,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":740626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673033,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":151940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673033,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1040384,"data_stored":742212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":450560,"data_stored":152178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:49:40.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T10:49:40.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.187+0000 7fd849bea640 1 Processor -- start 2024-09-14T10:49:40.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.187+0000 7fd849bea640 1 -- start start 2024-09-14T10:49:40.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd849bea640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd84406fc60 0x7fd844131590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:40.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd849bea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8440704a0 con 0x7fd84406f170 2024-09-14T10:49:40.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd849bea640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd84409a330 con 0x7fd84406fc60 2024-09-14T10:49:40.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd842ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd84406fc60 0x7fd844131590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:40.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd8437fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd84406f170 0x7fd84406f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:52050/0 (socket says 172.21.15.70:52050) 2024-09-14T10:49:40.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd8437fe640 1 -- 172.21.15.70:0/571127977 learned_addr learned my addr 172.21.15.70:0/571127977 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-14T10:49:40.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd842ffd640 1 -- 172.21.15.70:0/571127977 >> v1:172.21.15.70:6789/0 conn(0x7fd84406f170 legacy=0x7fd84406f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:40.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd8427fc640 1 -- 172.21.15.70:0/571127977 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753137408 0 0) 0x7fd8440704a0 con 0x7fd84406f170 2024-09-14T10:49:40.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd842ffd640 1 -- 172.21.15.70:0/571127977 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd844099b10 con 0x7fd84406fc60 2024-09-14T10:49:40.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd842ffd640 1 --2- 172.21.15.70:0/571127977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406fc60 0x7fd844131590 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009740 tx=0x7fd82c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ef6785652eaa32 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:40.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd8427fc640 1 -- 172.21.15.70:0/571127977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd82c0b0070 con 0x7fd84406fc60 2024-09-14T10:49:40.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd8427fc640 1 -- 172.21.15.70:0/571127977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82c0ab530 con 0x7fd84406fc60 2024-09-14T10:49:40.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.191+0000 7fd8427fc640 1 -- 172.21.15.70:0/571127977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd82c0ab830 con 0x7fd84406fc60 2024-09-14T10:49:40.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- 172.21.15.70:0/571127977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406fc60 msgr2=0x7fd844131590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:40.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 --2- 172.21.15.70:0/571127977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406fc60 0x7fd844131590 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009740 tx=0x7fd82c01c370 comp rx=0 tx=0).stop 2024-09-14T10:49:40.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- 172.21.15.70:0/571127977 shutdown_connections 2024-09-14T10:49:40.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 --2- 172.21.15.70:0/571127977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406fc60 0x7fd844131590 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:40.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- 172.21.15.70:0/571127977 >> 172.21.15.70:0/571127977 conn(0x7fd84409a970 msgr2=0x7fd84409ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:49:40.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- 172.21.15.70:0/571127977 shutdown_connections 2024-09-14T10:49:40.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- 172.21.15.70:0/571127977 wait complete. 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 Processor -- start 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- start start 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406f170 0x7fd844129e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd844134680 con 0x7fd84406f170 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406f170 0x7fd844129e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd8437fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406f170 0x7fd844129e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58202/0 (socket says 172.21.15.70:58202) 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd8437fe640 1 -- 172.21.15.70:0/639211220 learned_addr learned my addr 172.21.15.70:0/639211220 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd8437fe640 1 -- 172.21.15.70:0/639211220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd844097b20 con 0x7fd84406f170 2024-09-14T10:49:40.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd8437fe640 1 --2- 172.21.15.70:0/639211220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406f170 0x7fd844129e10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c7f0 tx=0x7fd83c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:40.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd83bfff640 1 -- 172.21.15.70:0/639211220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c018070 con 0x7fd84406f170 2024-09-14T10:49:40.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd83bfff640 1 -- 172.21.15.70:0/639211220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd83c004d80 con 0x7fd84406f170 2024-09-14T10:49:40.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84412b760 con 0x7fd84406f170 2024-09-14T10:49:40.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd83bfff640 1 -- 172.21.15.70:0/639211220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c00a7b0 con 0x7fd84406f170 2024-09-14T10:49:40.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd844127110 con 0x7fd84406f170 2024-09-14T10:49:40.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd84412cd30 con 0x7fd84406f170 2024-09-14T10:49:40.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.195+0000 7fd83bfff640 1 -- 172.21.15.70:0/639211220 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 48867+0+0 (secure 0 0 0) 0x7fd83c01b070 con 0x7fd84406f170 2024-09-14T10:49:40.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.199+0000 7fd83bfff640 1 --2- 172.21.15.70:0/639211220 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd82403b8e0 0x7fd82403dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:49:40.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.199+0000 7fd83bfff640 1 -- 172.21.15.70:0/639211220 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd83c04f710 con 0x7fd84406f170 2024-09-14T10:49:40.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.199+0000 7fd842ffd640 1 --2- 172.21.15.70:0/639211220 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd82403b8e0 0x7fd82403dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:49:40.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.199+0000 7fd842ffd640 1 --2- 172.21.15.70:0/639211220 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd82403b8e0 0x7fd82403dda0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0ad000 tx=0x7fd82c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:49:40.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.203+0000 7fd83bfff640 1 -- 172.21.15.70:0/639211220 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fd84412cd30 con 0x7fd84406f170 2024-09-14T10:49:40.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.363+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd84406f550 con 0x7fd84406f170 2024-09-14T10:49:40.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.367+0000 7fd83bfff640 1 -- 172.21.15.70:0/639211220 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fd83c0075f0 con 0x7fd84406f170 2024-09-14T10:49:40.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd83bfff640 1 -- 172.21.15.70:0/639211220 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd83c010300 con 0x7fd84406f170 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd82403b8e0 msgr2=0x7fd82403dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 --2- 172.21.15.70:0/639211220 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd82403b8e0 0x7fd82403dda0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0ad000 tx=0x7fd82c008040 comp rx=0 tx=0).stop 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406f170 msgr2=0x7fd844129e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 --2- 172.21.15.70:0/639211220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406f170 0x7fd844129e10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c7f0 tx=0x7fd83c00ccb0 comp rx=0 tx=0).stop 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 shutdown_connections 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 --2- 172.21.15.70:0/639211220 >> [v2:172.21.15.96:6824/992869166,v1:172.21.15.96:6825/992869166] conn(0x7fd82403b8e0 0x7fd82403dda0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 --2- 172.21.15.70:0/639211220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd84406f170 0x7fd844129e10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 >> 172.21.15.70:0/639211220 conn(0x7fd84409a970 msgr2=0x7fd84412d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 shutdown_connections 2024-09-14T10:49:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-14T10:49:40.371+0000 7fd849bea640 1 -- 172.21.15.70:0/639211220 wait complete. 2024-09-14T10:49:40.379 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T10:49:40.379 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T10:49:40.380 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T10:49:40.380 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T10:49:40.476 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T10:49:40.476 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T10:49:40.477 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T10:49:40.570 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T10:49:40.570 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T10:49:40.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T10:49:40.669 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T10:49:40.669 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T10:49:40.669 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T10:49:40.761 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T10:49:40.761 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T10:49:40.761 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T10:49:40.761 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T10:49:40.803 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T10:49:40.803 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T10:49:40.804 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T10:49:40.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T10:49:40.828 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T10:49:40.828 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T10:49:40.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-14T10:49:40.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-14T10:49:40.888 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T10:49:41.153 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:49:41.153 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T10:49:41.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:49:41.343 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T10:49:41.524 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:49:41.524 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T10:49:41.675 INFO:tasks.ceph:Archiving mon data... 2024-09-14T10:49:41.677 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116/data/mon.a.tgz 2024-09-14T10:49:41.677 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-14T10:49:41.683 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.hi81jeFF34 2024-09-14T10:49:41.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hi81jeFF34 2024-09-14T10:49:41.803 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.hi81jeFF34 2024-09-14T10:49:41.868 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.hi81jeFF34 is 287KB 2024-09-14T10:49:41.930 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.hi81jeFF34 2024-09-14T10:49:41.935 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T10:49:41.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T10:49:41.981 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T10:49:42.040 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T10:49:42.046 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T10:49:42.046 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T10:49:42.048 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116/remote/smithi070/crash 2024-09-14T10:49:42.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T10:49:42.096 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116/remote/smithi096/crash 2024-09-14T10:49:42.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T10:49:42.110 INFO:tasks.ceph:Compressing logs... 2024-09-14T10:49:42.111 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T10:49:42.141 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T10:49:42.169 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62094.log 2024-09-14T10:49:42.170 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T10:49:42.170 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.62094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60914.log 2024-09-14T10:49:42.205 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24708.log 2024-09-14T10:49:42.205 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24788.log 2024-09-14T10:49:42.205 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24708.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T10:49:42.205 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24788.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24708.log.gz 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:gzip 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24788.log.gz -5 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23885.log 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24105.log 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24656.log 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24105.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23885.log.gz 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23911.log 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24105.log.gz 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22869.log 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23911.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.24656.log.gz 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24229.log 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23911.log.gz 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24104.log 2024-09-14T10:49:42.206 INFO:teuthology.orchestra.run.smithi070.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.22869.log.gz 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24682.log 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24104.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24229.log.gz 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23998.log 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24104.log.gz 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24448.log 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24682.log.gz 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24327.log 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24448.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23998.log.gz 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24841.log 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24448.log.gz 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24327.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T10:49:42.207 INFO:teuthology.orchestra.run.smithi070.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24327.log.gz 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24353.log 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.a.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24841.log.gz 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23995.log 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24000.log 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23995.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24353.log.gz 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21511.log 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23995.log.gz 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24301.log 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24000.log.gz 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23963.log 2024-09-14T10:49:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.tmp-client.admin.21511.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21511.log.gz 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24578.log 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24301.log.gz 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24422.log 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23963.log.gz 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23840.log 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24578.log: /var/log/ceph/ceph-client.admin.24422.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24578.log.gz 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23777.log 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24422.log.gz 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24604.log 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23777.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23840.log.gz 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22758.log 2024-09-14T10:49:42.209 INFO:teuthology.orchestra.run.smithi070.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23777.log.gz 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24001.log 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24604.log.gz 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23815.log 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24001.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.22758.log.gz 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23815.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.24001.log.gz 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24197.log 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23815.log.gz 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24097.log 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23865.log 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24197.log.gz 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24201.log 2024-09-14T10:49:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24097.log: /var/log/ceph/ceph-client.admin.23865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24761.log 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24097.log.gz 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24201.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.23865.log.gz 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24201.log.gz 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24761.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24815.log 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24761.log.gz 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24500.log 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24552.log 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24815.log.gz 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T10:49:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24526.log 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24500.log.gz 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24396.log 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24552.log.gz 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23937.log 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24396.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24526.log.gz 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22828.log 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24396.log.gz 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.23937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24630.log 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23937.log.gz 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.22828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24093.log 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.22828.log.gz 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24474.log 2024-09-14T10:49:42.212 INFO:teuthology.orchestra.run.smithi070.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24630.log.gz 2024-09-14T10:49:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24734.log 2024-09-14T10:49:42.213 INFO:teuthology.orchestra.run.smithi070.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24093.log.gz 2024-09-14T10:49:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24205.log 2024-09-14T10:49:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24474.log: /var/log/ceph/ceph-client.admin.24734.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24474.log.gz 2024-09-14T10:49:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24865.log 2024-09-14T10:49:42.213 INFO:teuthology.orchestra.run.smithi070.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.24734.log.gz 2024-09-14T10:49:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24205.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24205.log.gz 2024-09-14T10:49:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.24865.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24865.log.gz 2024-09-14T10:49:42.231 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67997.log 2024-09-14T10:49:42.231 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80357.log 2024-09-14T10:49:42.231 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.60914.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.62094.log.gz 2024-09-14T10:49:42.231 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.67997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58554.log 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.80357.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.67997.log.gz 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63864.log 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31420.log 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80357.log.gz 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.58554.log: /var/log/ceph/ceph-client.0.63864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72717.log 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.31420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81537.log 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47344.log 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.72717.log: /var/log/ceph/ceph-client.0.81537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83307.log 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63864.log.gz 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% 91.7% -- replaced with /var/log/ceph/ceph-client.0.31420.log.gz 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46164.log 2024-09-14T10:49:42.232 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.0.58554.log.gz 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.47344.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.60914.log.gz/var/log/ceph/ceph-client.0.83307.log: 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36724.log 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.72717.log.gz 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60324.log 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.46164.log: /var/log/ceph/ceph-client.0.36724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42034.log 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81537.log.gz 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.83307.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.39674.log 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.47344.log.gz 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.60324.log: /var/log/ceph/ceph-client.0.42034.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46164.log.gz 2024-09-14T10:49:42.233 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38494.log 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36724.log.gz/var/log/ceph/ceph-client.0.39674.log: 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33774.log 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.38494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35544.log 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60324.log.gz 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.42034.log.gz 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56194.log 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.35544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37904.log 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39674.log.gz 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.38494.log.gz 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.56194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24988.log 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.37904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84487.log 2024-09-14T10:49:42.234 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.33774.log.gz 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35544.log.gz 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.24988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29650.log 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.24988.log.gz 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.84487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55014.log 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.56194.log.gz 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.29650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69767.log 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37904.log.gz 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.55014.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.69767.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84487.log.gz 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75667.log 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82717.log 2024-09-14T10:49:42.235 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.0.75667.log: 92.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87437.log 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.0.29650.log.gz 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55014.log.gz 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.82717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51474.log 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69767.log.gz 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73897.log 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.87437.log: /var/log/ceph/ceph-client.0.51474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68587.log 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.73897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79767.log 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.68587.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82717.log.gz 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.87437.log.gz 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75667.log.gz 2024-09-14T10:49:42.236 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51474.log.gz 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68587.log.gz 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47934.log 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.79767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63274.log 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.47934.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.73897.log.gz 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70947.log 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.63274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83897.log 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.70947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52064.log 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.79767.log.gz 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.47934.log.gz 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.83897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40264.log 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.52064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53244.log 2024-09-14T10:49:42.237 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63274.log.gz 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.40264.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66224.log 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.0.70947.log.gz 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.53244.log: gzip -5 --verbose 91.2% -- /var/log/ceph/ceph-client.0.76847.log -- replaced with /var/log/ceph/ceph-client.0.83897.log.gz 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.66224.log: 91.2%/var/log/ceph/ceph-client.0.76847.log: -- replaced with /var/log/ceph/ceph-client.0.52064.log.gz 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:gzip 91.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.40264.log.gz -- 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr: /var/log/ceph/ceph-client.0.55604.log 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.76847.log.gz 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.53244.log.gz 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25012.log 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.55604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32600.log 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25012.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66224.log.gz 2024-09-14T10:49:42.238 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50294.log 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25012.log.gz 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.32600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77431.log 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65044.log 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.50294.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.32600.log.gz/var/log/ceph/ceph-client.0.77431.log: 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:gzip 91.3% -5 -- replaced with /var/log/ceph/ceph-client.0.55604.log.gz 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.0.73307.log 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86257.log 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.65044.log: /var/log/ceph/ceph-client.0.73307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56784.log 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.77431.log.gz 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50294.log.gz 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.86257.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65044.log.gz 2024-09-14T10:49:42.239 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40854.log 2024-09-14T10:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2%/var/log/ceph/ceph-client.0.56784.log: -- replaced with /var/log/ceph/ceph-client.0.86257.log.gz 2024-09-14T10:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T10:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.40854.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37314.log 2024-09-14T10:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.0.73307.log.gz 2024-09-14T10:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59144.log 2024-09-14T10:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43214.log 2024-09-14T10:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.37314.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.56784.log.gz 2024-09-14T10:49:42.240 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.59144.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40854.log.gz 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.37314.log.gz 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36134.log 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.43214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28883.log 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.59144.log.gz 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.36134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45574.log 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32010.log 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28883.log: /var/log/ceph/ceph-client.0.45574.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.43214.log.gz 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28883.log.gz 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.0.36134.log.gz 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.32010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43804.log 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mgr.x.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45574.log.gz 2024-09-14T10:49:42.241 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46754.log 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79183.log 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.43804.log: /var/log/ceph/ceph-client.0.46754.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.32010.log.gz 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46754.log.gz 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43804.log.gz 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78599.log 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.79183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59734.log 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.78599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39084.log 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.79183.log.gz 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.59734.log: 90.2% -- replaced with /var/log/ceph/ceph-client.0.78599.log.gz 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.59734.log.gz 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88032.log 2024-09-14T10:49:42.242 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.39084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42624.log 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.88032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53834.log 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.42624.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39084.log.gz 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42624.log.gz 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69177.log 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78015.log 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.53834.log: /var/log/ceph/ceph-client.0.69177.log: 93.4% -- replaced with /var/log/ceph/ceph-client.0.88032.log.gz 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.53834.log.gz 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69177.log.gz 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41444.log 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.78015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67407.log 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.41444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74487.log 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78015.log.gz 2024-09-14T10:49:42.243 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.67407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48524.log 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.74487.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.41444.log.gz 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62684.log 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.48524.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74487.log.gz 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67407.log.gz 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25060.log 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.62684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66817.log 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.25060.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48524.log.gz 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.25060.log.gz 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44394.log 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.62684.log.gz 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.66817.log: /var/log/ceph/ceph-client.0.44394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71537.log 2024-09-14T10:49:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44394.log.gz 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr: 91.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76257.log 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.0.66817.log.gz 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.71537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72127.log 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.76257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82127.log 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.72127.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.76257.log.gz 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71537.log.gz 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.72127.log.gz 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75077.log 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28981.log 2024-09-14T10:49:42.245 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.82127.log: /var/log/ceph/ceph-client.0.75077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28909.log 2024-09-14T10:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44984.log 2024-09-14T10:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28981.log.gz/var/log/ceph/ceph-client.admin.28909.log: 2024-09-14T10:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82127.log.gz 2024-09-14T10:49:42.246 INFO:teuthology.orchestra.run.smithi096.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28909.log.gz 2024-09-14T10:49:42.247 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75077.log.gz 2024-09-14T10:49:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65634.log 2024-09-14T10:49:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.44984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57374.log 2024-09-14T10:49:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.65634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85667.log 2024-09-14T10:49:42.247 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.57374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28933.log 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44984.log.gz/var/log/ceph/ceph-client.0.85667.log: 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65634.log.gz 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85667.log.gz 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61504.log 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57374.log.gz 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.28933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50884.log 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28933.log.gz 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.61504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64454.log 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34954.log 2024-09-14T10:49:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.50884.log: /var/log/ceph/ceph-client.0.64454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28957.log 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.34954.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50884.log.gz 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.34954.log.gz 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70357.log 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr: 93.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54424.log 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.0.61504.log.gz 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6%/var/log/ceph/ceph-client.admin.28957.log: -- replaced with /var/log/ceph/ceph-client.0.64454.log.gz 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.70357.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28957.log.gz 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49114.log 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25036.log 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.54424.log: /var/log/ceph/ceph-client.0.49114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34364.log 2024-09-14T10:49:42.254 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5%/var/log/ceph/ceph-client.admin.25036.log: -- replaced with /var/log/ceph/ceph-client.0.70357.log.gz 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.25036.log.gz 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80947.log 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54424.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.49704.log 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49114.log.gz 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.34364.log: /var/log/ceph/ceph-client.0.80947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30830.log 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.49704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86847.log 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.30830.log: 91.4% 91.5% -- replaced with /var/log/ceph/ceph-client.0.80947.log.gz 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.0.34364.log.gz 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.49704.log.gz 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30830.log.gz 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57964.log 2024-09-14T10:49:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.86847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33184.log 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.57964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30240.log 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.33184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52654.log 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2%/var/log/ceph/ceph-client.0.30240.log: -- replaced with /var/log/ceph/ceph-client.0.86847.log.gz 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57964.log.gz 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30240.log.gz 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.33184.log.gz 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85077.log 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.52654.log: /var/log/ceph/ceph-client.0.85077.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.52654.log.gz 2024-09-14T10:49:42.256 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85077.log.gz 2024-09-14T10:49:42.259 INFO:teuthology.orchestra.run.smithi096.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T10:49:42.361 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T10:49:43.099 INFO:teuthology.orchestra.run.smithi096.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T10:49:43.161 INFO:teuthology.orchestra.run.smithi070.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T10:49:43.163 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-14T10:49:43.163 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m1.020s 2024-09-14T10:49:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m1.187s 2024-09-14T10:49:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.072s 2024-09-14T10:49:43.242 INFO:teuthology.orchestra.run.smithi096.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T10:49:43.252 INFO:teuthology.orchestra.run.smithi096.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T10:49:43.253 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-09-14T10:49:43.253 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m1.098s 2024-09-14T10:49:43.253 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m3.227s 2024-09-14T10:49:43.253 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m0.184s 2024-09-14T10:49:43.254 INFO:tasks.ceph:Archiving logs... 2024-09-14T10:49:43.254 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116/remote/smithi070/log 2024-09-14T10:49:43.256 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T10:49:43.489 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116/remote/smithi096/log 2024-09-14T10:49:43.490 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T10:49:43.981 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T10:49:43.994 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T10:49:43.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T10:49:43.997 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T10:49:44.062 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T10:49:44.071 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T10:49:44.071 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:49:44.074 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:49:44.085 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T10:49:44.085 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-14T10:49:44.085 INFO:teuthology.orchestra.run.smithi070.stdout:*hv01.front.sepi 67.205.162.81 3 u 35 64 377 0.077 -7.958 1.921 2024-09-14T10:49:44.085 INFO:teuthology.orchestra.run.smithi070.stdout:+hv02.front.sepi 96.245.170.99 3 u 33 64 377 0.108 -5.212 1.947 2024-09-14T10:49:44.086 INFO:teuthology.orchestra.run.smithi070.stdout:+hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.061 +6.711 2.632 2024-09-14T10:49:44.086 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:49:44.087 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T10:49:44.087 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-09-14T10:49:44.087 INFO:teuthology.orchestra.run.smithi096.stdout:*hv01.front.sepi 67.205.162.81 3 u 31 64 377 0.085 -4.969 0.952 2024-09-14T10:49:44.087 INFO:teuthology.orchestra.run.smithi096.stdout:+hv02.front.sepi 96.245.170.99 3 u 39 64 377 0.121 -2.677 1.046 2024-09-14T10:49:44.087 INFO:teuthology.orchestra.run.smithi096.stdout:+hv03.front.sepi 74.6.168.72 3 u 35 64 377 0.131 +7.341 0.759 2024-09-14T10:49:44.088 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:49:44.088 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T10:49:44.097 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T10:49:44.097 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T10:49:44.106 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T10:49:44.114 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T10:49:44.122 INFO:teuthology.task.internal:Duration was 950.440753 seconds 2024-09-14T10:49:44.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T10:49:44.131 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T10:49:44.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T10:49:44.134 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T10:49:44.170 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T10:49:44.170 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-14T10:49:44.171 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T10:49:44.221 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-09-14T10:49:44.221 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T10:49:44.231 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T10:49:44.231 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T10:49:44.264 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T10:49:44.297 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T10:49:44.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T10:49:44.332 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T10:49:44.401 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T10:49:44.411 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T10:49:44.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T10:49:44.425 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T10:49:44.437 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T10:49:44.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T10:49:44.472 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T10:49:44.481 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-14T10:49:44.490 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-09-14T10:49:44.578 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T10:49:44.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:49:44.624 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T10:49:44.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:49:44.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T10:49:44.639 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T10:49:44.640 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116/remote/smithi070 2024-09-14T10:49:44.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T10:49:44.688 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904116/remote/smithi096 2024-09-14T10:49:44.689 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T10:49:44.710 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T10:49:44.711 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T10:49:44.729 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T10:49:44.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T10:49:44.765 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T10:49:44.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T10:49:44.775 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T10:49:44.776 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T10:49:44.778 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T10:49:44.782 INFO:teuthology.orchestra.run.smithi070.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 10:49 /home/ubuntu/cephtest 2024-09-14T10:49:44.801 INFO:teuthology.orchestra.run.smithi096.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 10:49 /home/ubuntu/cephtest 2024-09-14T10:49:44.803 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T10:49:44.813 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T10:49:44.836 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 950.4407527446747 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T10:49:44.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:49:44.923 INFO:teuthology.run:pass